-- Logs begin at Sun 2022-09-25 00:10:39 UTC, end at Sun 2022-09-25 02:49:52 UTC. -- Sep 25 00:49:54.333692 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 25 00:49:54.342383 n-d-master-1 devstack@n-api.service[106312]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 00:49:54 2022] *** Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: nodename: n-d-master-1 Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: machine: x86_64 Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: clock source: unix Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: pcre jit disabled Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: detected number of CPU cores: 4 Sep 25 00:49:54.345087 n-d-master-1 devstack@n-api.service[106312]: current working directory: / Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: detected binary path: /usr/bin/uwsgi-core Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: your processes number limit is 47680 Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: your memory page size is 4096 bytes Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: detected max file descriptor number: 2048 Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: lock engine: pthread robust mutexes Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: thunder lock: enabled Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 25 00:49:54.345819 n-d-master-1 devstack@n-api.service[106312]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 00:49:54.384912 n-d-master-1 devstack@n-api.service[106312]: Python main interpreter initialized at 0x55f114f8e9c0 Sep 25 00:49:54.384912 n-d-master-1 devstack@n-api.service[106312]: python threads support enabled Sep 25 00:49:54.384912 n-d-master-1 devstack@n-api.service[106312]: your server socket listen backlog is limited to 100 connections Sep 25 00:49:54.384912 n-d-master-1 devstack@n-api.service[106312]: your mercy for graceful operations on workers is 90 seconds Sep 25 00:49:54.385336 n-d-master-1 devstack@n-api.service[106312]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 00:49:54.385336 n-d-master-1 devstack@n-api.service[106312]: *** Operational MODE: preforking *** Sep 25 00:49:54.385645 n-d-master-1 devstack@n-api.service[106312]: *** uWSGI is running in multiple interpreter mode *** Sep 25 00:49:54.385645 n-d-master-1 devstack@n-api.service[106312]: spawned uWSGI master process (pid: 106312) Sep 25 00:49:54.385852 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 25 00:49:54.389220 n-d-master-1 devstack@n-api.service[106312]: spawned uWSGI worker 1 (pid: 106313, cores: 1) Sep 25 00:49:54.389220 n-d-master-1 devstack@n-api.service[106312]: spawned uWSGI worker 2 (pid: 106314, cores: 1) Sep 25 00:49:54.389220 n-d-master-1 devstack@n-api.service[106312]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 00:49:55.057104 n-d-master-1 devstack@n-api.service[106314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:49:55.067601 n-d-master-1 devstack@n-api.service[106313]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:49:56.172669 n-d-master-1 devstack@n-api.service[106313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:49:56.172669 n-d-master-1 devstack@n-api.service[106313]: from cryptography.utils import int_from_bytes Sep 25 00:49:56.173444 n-d-master-1 devstack@n-api.service[106313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:49:56.173444 n-d-master-1 devstack@n-api.service[106313]: from cryptography.utils import int_from_bytes Sep 25 00:49:56.174098 n-d-master-1 devstack@n-api.service[106314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:49:56.174098 n-d-master-1 devstack@n-api.service[106314]: from cryptography.utils import int_from_bytes Sep 25 00:49:56.174531 n-d-master-1 devstack@n-api.service[106314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:49:56.174531 n-d-master-1 devstack@n-api.service[106314]: from cryptography.utils import int_from_bytes Sep 25 00:49:58.710967 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:49:58.711598 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:49:58.711956 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:49:58.712056 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:49:58.712149 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:49:58.712257 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:49:58.712344 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:49:58.712440 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:49:58.712529 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:49:58.712621 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:49:58.712712 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.712797 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.712965 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.713105 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.713287 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.713464 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.713658 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.713797 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.713996 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.714134 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.714309 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.714450 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.714634 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.714775 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.714957 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.715098 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.715289 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.715427 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.715554 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.715692 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.715874 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716013 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716204 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716342 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716561 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716669 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716872 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.716967 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.717185 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.717318 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.718074 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.718173 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.718420 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.718523 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.718757 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.718858 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.719067 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.719157 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.719596 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.719768 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.720026 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.720334 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.720441 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.720645 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.720745 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.720962 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.721072 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.721292 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.721395 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.721633 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.721736 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.721950 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.722044 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.722259 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.722351 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.722578 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.722662 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.722900 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.723011 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.723212 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.723313 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.723600 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.723686 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.723918 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.724010 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.724232 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.724329 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.724550 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.724661 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.724952 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.725045 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.725265 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.725363 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.725606 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.725701 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.725930 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726016 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726240 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726343 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726570 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726657 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726893 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.726980 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.727213 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.727309 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.727537 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.727624 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.727843 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.727931 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.728156 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.728251 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.728466 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.728559 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.728788 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.728885 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.729095 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.729189 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.729430 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.729547 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.729686 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.729856 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730005 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730138 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730285 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730426 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730568 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730706 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.730895 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731040 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731177 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731309 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731450 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731609 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731747 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.731882 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.732026 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.732166 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.732309 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.732443 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.732627 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.732765 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.733510 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.733668 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.733855 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.733939 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.734152 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.734249 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.734517 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.734679 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.734833 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.734927 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.735148 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.735240 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.735460 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.735554 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.735781 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.735866 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.736100 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.736191 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.736415 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.736508 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.736727 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.736812 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.737055 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.737143 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.737377 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.737526 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.737717 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.737805 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.738062 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.738155 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.738384 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.738481 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.738701 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.738794 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739026 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739120 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739347 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739441 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739660 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739754 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.739972 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.740060 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.740283 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.740377 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.740594 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.740680 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.740919 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741007 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741227 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741320 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741507 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741597 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741813 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.741898 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.742116 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.742210 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.742426 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.742519 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.742736 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.742829 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743049 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743143 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743359 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743452 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743663 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743757 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.743966 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744058 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744278 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744369 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744589 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744686 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744899 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.744987 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.745210 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.745302 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.745545 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.745653 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.745856 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.745941 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.746162 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.746255 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.746471 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.746565 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.746778 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.746870 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.747088 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.747182 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.747412 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.747499 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.747723 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.747815 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.748034 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.748125 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.748344 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.748567 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.748721 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.748888 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.749051 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.749920 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750021 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750210 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750307 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750540 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750630 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750853 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.750938 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.751163 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.751251 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.751479 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.751565 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.751789 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.751887 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.752101 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.752195 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.752413 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.752504 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.752719 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.752818 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753031 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753132 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753334 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753506 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753675 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753834 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.753982 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754069 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754289 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754376 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754596 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754689 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754900 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.754984 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.755207 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.755291 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.755526 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.755657 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.755811 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756007 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756097 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756175 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756412 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756499 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756716 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.756808 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757035 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757120 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757348 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757455 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757683 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757772 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.757994 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.758087 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.758308 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.758490 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.758638 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:49:58.758741 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.758978 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.759078 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.759295 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.759379 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.759633 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.759721 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.759966 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.760105 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.760286 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.760386 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.760603 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.760702 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.760925 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761026 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761239 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761325 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761582 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761727 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761900 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.761995 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.762468 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.762562 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.762783 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.762869 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.763099 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.763206 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.763421 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.763517 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.763739 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.763830 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.764059 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.764175 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.764476 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.764575 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.764794 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765080 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765183 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765265 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765459 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765551 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765788 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.765878 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.766106 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.766196 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.766453 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.766547 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.766794 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.766881 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.767109 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.767196 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.767439 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.767532 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.767768 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.767863 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.768083 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.768178 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.768399 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.768485 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.768711 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.768811 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.769026 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.769112 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.769339 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.769450 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.769698 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.769799 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770015 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770108 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770334 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770420 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770657 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770753 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.770974 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.771073 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.771290 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.771377 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.771604 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.771768 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.771919 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772011 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772233 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772320 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772549 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772655 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772863 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.772950 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.773189 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.773281 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.773533 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.773637 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.773850 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.773935 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.774172 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.774257 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.774486 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.774573 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.774801 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.774895 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.775114 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.775199 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.775420 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.775506 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.775727 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.775813 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776034 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776185 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776346 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776478 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776654 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776799 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.776977 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.777122 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.777291 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.777460 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.777622 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.777707 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.777954 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778049 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778260 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778358 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778574 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778663 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778888 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.778991 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.779198 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.779290 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.779503 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.779596 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.779940 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780206 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780296 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780433 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780521 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780600 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780882 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.780984 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.781194 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.781279 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.781531 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.781634 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.781856 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.781944 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.782164 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.782259 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.782474 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.782561 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.782784 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.782871 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.783095 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.783191 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.783410 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.783507 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.783722 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.783809 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784035 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784120 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784349 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784444 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784662 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784749 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.784974 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.785069 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.785289 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.785397 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.785630 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.785717 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.785966 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.786087 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.786297 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.786414 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.786601 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.786699 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.786928 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787034 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787233 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787330 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787546 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787644 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787852 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.787957 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.788160 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.788256 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.788462 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.788591 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.788767 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.788856 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.789073 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.789195 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.789378 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.789510 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.789706 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.789794 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790015 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790103 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790320 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790433 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790625 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790734 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.790929 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791017 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791236 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791335 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791540 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791638 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791843 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.791931 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.792148 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.792243 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.792454 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.792560 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.792799 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.792887 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.793106 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.793192 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.793457 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.793561 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.793784 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.793879 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.794103 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.794189 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.794424 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.794554 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.794732 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.794828 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.795046 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.795142 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.795874 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.795972 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.796189 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.796329 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.796524 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.796658 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.796906 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.797044 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.797233 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.797369 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.797573 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.797703 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.797898 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798036 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798209 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798346 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798532 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798666 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798845 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.798998 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.799142 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.799292 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.799465 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.799566 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.799783 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.799870 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.800109 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.800214 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.800440 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.800576 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.800754 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.800881 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.801071 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.801164 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.801381 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.801654 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.801749 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.801830 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802018 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802115 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802328 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802425 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802643 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802732 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.802955 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803043 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803301 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803418 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803585 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803678 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803904 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.803989 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.804213 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.804307 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.804536 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.804623 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.804842 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.804929 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.805161 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.805249 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.805484 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.805588 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.805803 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.805898 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.806149 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.806236 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.806450 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.806550 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.806769 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.806855 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.807080 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.807167 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.807394 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.807481 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.807704 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.807799 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808011 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808096 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808320 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808415 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808630 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808795 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.808931 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809016 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809234 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809321 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809576 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809686 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809884 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.809972 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.810192 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.810286 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.810500 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.810648 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.810804 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.810936 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.811186 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.811275 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.811503 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.811600 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.811813 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.811935 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.812131 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.812272 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.812457 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.812597 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.812771 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.812909 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.813097 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.813232 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.813447 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.813607 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.813754 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.813892 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814048 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814186 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814375 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814525 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814665 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814801 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.814970 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.815118 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.815307 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.815450 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.815587 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.815724 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.815904 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816048 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816219 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816407 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816528 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816616 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816836 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.816929 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.817152 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.817239 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.817482 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.817570 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.817796 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.817893 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.818107 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.818202 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.818420 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.818508 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.818730 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.818818 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819045 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819131 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819354 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819439 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819667 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819753 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.819978 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.820071 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.820292 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.820379 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.820607 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.820738 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.820922 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.821018 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.821231 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.821318 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.821558 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.821646 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.821872 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.822004 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.822578 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.822727 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.822826 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.822914 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.822994 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.823072 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.823364 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.823462 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.823700 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.823787 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.824027 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.824113 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.824348 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.824445 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.824680 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.824767 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825005 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825103 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825322 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825429 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825659 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825831 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.825978 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.826066 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.826285 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.826372 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.827103 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.827221 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.827455 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.827579 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.827769 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.827898 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.828082 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.828218 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.828393 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.828530 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.828707 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.828847 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829025 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829136 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829325 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829477 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829671 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829788 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.829981 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.830097 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.830300 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.830409 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.830614 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.830717 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.830932 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831037 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831237 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831324 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831561 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831648 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831875 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.831963 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.832183 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.832270 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.832492 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.832581 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.832799 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.832888 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.833112 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.833199 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.833444 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.833550 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.833797 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.833958 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.834098 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.834240 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.834441 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.834590 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.834758 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.834902 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835066 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835203 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835392 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835546 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835683 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835816 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.835992 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836128 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836297 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836443 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836607 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836710 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836909 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.836997 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.837214 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.837302 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.837545 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.837634 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.837854 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.837951 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.838161 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.838248 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.838472 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.838559 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.838777 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.838908 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.839087 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.839175 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.839386 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.839473 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.839695 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.839781 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840002 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840091 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840303 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840390 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840613 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840714 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.840932 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841017 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841223 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841318 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841545 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841649 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841861 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.841976 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.842161 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.842341 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.842528 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.842673 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.842838 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.842928 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.843157 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.843331 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.843464 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.843645 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.843771 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.843961 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.844082 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.844274 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.844395 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.844580 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.844707 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.844983 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845080 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845227 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845323 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845570 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845671 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845878 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.845965 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.846191 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.846285 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.846497 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.846583 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.846804 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.846893 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.847115 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.847210 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.847427 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.847515 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.847744 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.847830 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848051 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848140 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848353 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848439 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848657 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848742 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.848962 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849048 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849270 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849372 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849599 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849696 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849899 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.849989 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.850202 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.850291 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.850509 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.850595 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.850814 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.850901 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.851115 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.851208 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.851417 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.851513 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.851738 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.851828 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852045 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852133 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852350 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852445 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852654 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852747 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.852959 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.853047 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.853289 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.853385 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.853625 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.853722 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854034 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854141 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854288 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854390 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854604 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854699 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.854920 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855017 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855234 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855337 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855548 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855633 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855854 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.855951 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.856166 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.856275 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.856474 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.856561 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.856788 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.856895 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.857129 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.857231 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.857378 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.857563 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.857747 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.857826 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.858562 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.858661 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.858974 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.859078 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.859338 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.859498 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.859687 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.859833 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.859993 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.860139 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.860276 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.860419 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.860555 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.860719 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.860859 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861035 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861206 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861346 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861560 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861708 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861876 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.861966 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.862198 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.862317 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.862515 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.862616 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.862833 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.862922 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.863150 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.863253 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.863465 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.863568 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.863777 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.863876 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.864166 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.864274 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.864400 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.864490 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.864705 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.864793 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865011 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865099 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865329 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865470 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865662 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865763 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.865976 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866066 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866284 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866379 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866598 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866697 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866905 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.866993 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.867210 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.867351 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.867648 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.867744 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.867966 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868054 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868274 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868359 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868580 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868674 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868894 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.868980 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.869215 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.869310 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.869574 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.869755 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.869859 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.869943 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.870220 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.870328 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.870590 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.870700 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.870909 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.871015 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.871227 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.871396 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.871530 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.871658 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.871880 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872030 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872167 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872324 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872472 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872614 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872755 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.872890 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.873022 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.873168 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.873317 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.873492 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.873704 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.873802 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.874030 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.874156 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.874474 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.874576 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.874798 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.874956 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.875221 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.875325 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.875536 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.875632 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.875846 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.875973 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.876269 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.876365 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.876586 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.876676 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.876900 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.876996 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.877222 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.877326 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.877570 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.877718 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.877879 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.877981 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.878197 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.878285 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.878509 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.878609 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.878820 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.878950 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.879148 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.879299 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.879462 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.879563 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.879773 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.879877 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.880075 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.880186 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.880383 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.880474 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.880708 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.880799 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.881027 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.881115 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.881342 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.881451 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.881694 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.881787 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.882104 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.882193 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.882418 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.882508 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.882730 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.882820 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883057 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883158 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883363 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883462 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883671 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883767 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.883983 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884078 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884289 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884427 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884635 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884725 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884887 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.884988 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.885204 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.885290 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.885531 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.885622 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.885848 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.885948 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.886159 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.886245 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.886465 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.886552 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.886769 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.886868 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.887328 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.887453 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.887642 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.887728 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.887948 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888039 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888271 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888359 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888586 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888674 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888906 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.888997 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.889776 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.889901 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.890199 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.890366 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.890533 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.890685 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.890850 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.890995 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.891160 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.891304 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.891470 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.891620 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.891779 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.891969 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.892129 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.892280 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.892441 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.892606 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.892767 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.892942 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.893102 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.893274 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.893456 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.893619 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.893772 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.893958 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.894113 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.894290 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.894452 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.894678 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.894780 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.894916 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.895077 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.895234 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.895400 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.895562 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.895726 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.895870 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896034 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896176 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896341 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896486 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896654 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896794 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.896963 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.897101 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.897271 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.897420 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.897607 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.897739 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.897918 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898047 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898223 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898354 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898530 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898661 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898838 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.898990 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.899163 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.899298 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.899471 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.899622 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.899795 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.899934 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.900106 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.900241 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.900412 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.900549 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.900722 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.900854 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.901029 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.901201 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.901376 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.901543 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.901706 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.901870 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.902041 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.902185 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.902356 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.902541 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.902683 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.902829 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903005 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903149 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903328 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903471 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903650 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903795 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.903973 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.904116 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.904283 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.904437 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.904605 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.904827 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.905514 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.905651 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.905812 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.905976 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.906136 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.906299 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.906457 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.906623 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.906780 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.907198 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.907346 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.907532 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.907684 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.907851 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908003 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908170 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908325 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908487 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908715 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908809 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.908944 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.909112 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.909253 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.909446 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.909600 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.909767 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.909917 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.910069 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.910220 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.910371 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.910533 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.910683 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.910832 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.911021 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.911236 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.911388 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.911549 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.911704 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.911851 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.912082 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.912236 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.912497 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.912649 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.912806 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.912966 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.913116 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.913266 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.913450 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.913604 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.913753 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.913896 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914041 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914203 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914349 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914496 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914654 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914799 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.914948 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915076 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915162 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915287 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915431 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915573 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915716 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.915876 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916022 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916181 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916330 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916464 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916633 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916782 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.916932 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.917080 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.917227 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.917391 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.917656 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.917804 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.917951 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918098 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918248 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918396 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918555 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918716 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918864 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.918998 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.919156 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.919319 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.919582 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.919741 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.919891 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.920038 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.920219 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.920383 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.920599 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.920761 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.920946 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.921146 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.921354 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.921673 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.921836 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922027 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922179 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922326 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922486 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922649 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922795 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.922952 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923097 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923242 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923398 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923545 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923692 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923851 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.923998 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.924145 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.924321 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.924471 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.924620 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.924769 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.924916 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.925074 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.925236 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.925383 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.925621 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.925906 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.926063 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.926235 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.926389 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.926538 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.926684 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.926871 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927032 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927191 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927332 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927477 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927624 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927797 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.927898 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.928111 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.928264 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.928409 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.928555 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.928702 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.928850 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929018 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929166 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929310 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929484 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929631 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929774 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.929941 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930087 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930247 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930437 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930535 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930626 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930809 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.930963 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.931108 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.931257 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.931403 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.931564 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.931724 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.931881 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932028 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932181 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932338 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932498 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932647 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932795 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.932942 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.933027 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.933252 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.933504 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.933651 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.933794 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.933794 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934059 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934227 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934376 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934523 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934671 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934819 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.934978 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.935139 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.935348 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.935348 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.935636 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.935793 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.936078 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.936242 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.936397 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.936561 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.936712 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.936871 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937020 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937183 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937334 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937504 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937651 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937819 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.937988 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.938136 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.938286 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.938436 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.938584 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.938730 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.938896 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939040 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939185 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939340 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939481 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939621 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939788 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.939931 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940076 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940233 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940377 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940588 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940731 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940816 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.940886 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.941128 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.941312 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.941629 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.941794 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.941954 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942119 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942119 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942387 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942387 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942688 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942834 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942990 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.942990 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.943271 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.943448 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.943546 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.943627 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.943714 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.943880 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944037 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944196 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944354 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944502 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944674 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944838 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.944995 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.945133 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.945276 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.945461 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.945611 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.945760 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.945932 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946080 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946225 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946374 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946521 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946681 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946843 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.946991 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.947138 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.947298 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.947452 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.947612 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.947755 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.947905 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.948054 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.948268 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.948420 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.948581 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.948728 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.948877 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949022 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949166 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949334 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949564 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949728 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949836 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949906 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.949981 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.950058 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.950339 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.950495 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.950643 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.950785 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.950933 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.951100 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.951271 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.951584 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.952395 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.952571 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.952723 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.952886 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.953032 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.953189 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.953335 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.953541 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.953764 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.953920 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954065 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954181 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954310 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954460 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954621 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954768 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.954927 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.955085 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.955233 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.955393 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.955541 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.955740 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.955881 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.956082 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.956233 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.956398 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.956542 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.956715 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.956875 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.957019 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.957162 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.957319 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.957546 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.957712 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.957963 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.958118 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.958262 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.958420 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.958569 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.958713 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.958866 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959021 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959168 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959325 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959481 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959627 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959775 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.959922 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.960086 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.960235 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.960382 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.960528 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.960672 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.960819 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961042 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961201 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961345 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961511 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961658 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961824 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.961991 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.962136 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.962285 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.962430 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.962586 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.962747 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.962903 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963076 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963222 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963374 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963524 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963684 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963783 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963865 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.963954 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.964099 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.964229 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.964395 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.964551 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.964706 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.964865 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965077 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965239 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965397 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965582 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965724 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965856 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.965985 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966134 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966266 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966397 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966534 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966662 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966789 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.966941 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.967069 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.967147 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.967255 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.967431 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.968088 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.968250 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.968426 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.968564 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.968743 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.968880 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.969062 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.969214 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.969381 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.969567 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.969700 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.969830 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.970024 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.970161 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.970338 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.970447 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.971059 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.971280 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.971280 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.971677 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.971806 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.971951 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.972094 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.972237 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.972396 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.972551 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.972698 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.972852 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973000 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973170 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973316 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973523 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973671 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973818 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.973977 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.974130 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.974276 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.974420 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.974586 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.974732 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.974877 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975038 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975201 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975314 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975397 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975510 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975727 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.975883 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976042 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976195 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976353 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976499 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976662 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976810 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.976959 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.977113 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.977253 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.977396 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.977590 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.977739 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.977885 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978032 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978191 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978345 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978503 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978651 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978798 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.978945 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.979120 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.979282 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.979431 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.979580 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.979728 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.979996 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.980131 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.980284 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.980443 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.980593 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:49:58.980780 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:49:58.980875 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:49:59.135124 n-d-master-1 devstack@n-api.service[106313]: INFO dbcounter [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Registered counter for database nova_api Sep 25 00:49:59.135912 n-d-master-1 devstack@n-api.service[106314]: INFO dbcounter [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Registered counter for database nova_api Sep 25 00:49:59.157172 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.160022 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_db.sqlalchemy.engines [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.164436 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.167127 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writer thread running {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.223118 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.context [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=106314) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:49:59.225640 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.context [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=106313) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:49:59.227021 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:49:59.227502 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:49:59.229080 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:49:59.229580 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_concurrency.lockutils [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:49:59.229855 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:49:59.230063 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_concurrency.lockutils [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:49:59.230298 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:49:59.231619 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_concurrency.lockutils [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:49:59.232294 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:49:59.232388 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_concurrency.lockutils [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:49:59.232795 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_concurrency.lockutils [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:49:59.234400 n-d-master-1 devstack@n-api.service[106314]: INFO dbcounter [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Registered counter for database nova_cell0 Sep 25 00:49:59.234818 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_concurrency.lockutils [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:49:59.237110 n-d-master-1 devstack@n-api.service[106313]: INFO dbcounter [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Registered counter for database nova_cell0 Sep 25 00:49:59.238621 n-d-master-1 devstack@n-api.service[106314]: INFO dbcounter [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Registered counter for database nova_cell1 Sep 25 00:49:59.241177 n-d-master-1 devstack@n-api.service[106313]: INFO dbcounter [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Registered counter for database nova_cell1 Sep 25 00:49:59.246777 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.251519 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_db.sqlalchemy.engines [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.252164 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.252825 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.254545 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_db.sqlalchemy.engines [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.257462 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writer thread running {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.400748 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.403794 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writer thread running {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.412147 n-d-master-1 devstack@n-api.service[106314]: INFO dbcounter [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Registered counter for database nova_cell0 Sep 25 00:49:59.413845 n-d-master-1 devstack@n-api.service[106313]: INFO dbcounter [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Registered counter for database nova_cell0 Sep 25 00:49:59.422496 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.424116 n-d-master-1 devstack@n-api.service[106313]: DEBUG oslo_db.sqlalchemy.engines [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:49:59.427858 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.429183 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writer thread running {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:49:59.777492 n-d-master-1 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:49:59.778610 n-d-master-1 devstack@n-api.service[106313]: WARNING keystonemiddleware.auth_token [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:49:59.785052 n-d-master-1 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:49:59.786461 n-d-master-1 devstack@n-api.service[106313]: WARNING keystonemiddleware.auth_token [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:00.132065 n-d-master-1 devstack@n-api.service[106313]: WARNING keystonemiddleware.auth_token [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:50:00.133742 n-d-master-1 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:50:00.138251 n-d-master-1 devstack@n-api.service[106313]: WARNING keystonemiddleware.auth_token [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:00.140304 n-d-master-1 devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:00.143886 n-d-master-1 devstack@n-api.service[106313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f114f8e9c0 pid: 106313 (default app) Sep 25 00:50:00.146040 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:50:00.146600 n-d-master-1 devstack@n-api.service[106314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f114f8e9c0 pid: 106314 (default app) Sep 25 00:50:00.147283 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-8041e083-7fb8-48cc-bbb1-7b428fb460a1 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001872 Sep 25 00:50:00.147692 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Sun Sep 25 00:50:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:24.811133 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:24.812683 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003854 Sep 25 00:51:24.813583 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:24.828957 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_api:SELECT=3 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:24.829793 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_cell0:SELECT=3 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:24.831362 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_cell1:SELECT=3 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:24.832106 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:25.859931 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-3c4448ba-2789-4c08-8722-56d0a58514d2 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:25.893837 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-3c4448ba-2789-4c08-8722-56d0a58514d2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.071429 Sep 25 00:51:25.894569 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 00:51:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:51:28.576358 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:28.577352 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-d3357b75-9723-413e-80ce-137f1b26d90c None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Sep 25 00:51:28.577972 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:29.067985 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-e5990d47-37e0-427d-b5c9-d734e0e080ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "disk": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:29.117442 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-e5990d47-37e0-427d-b5c9-d734e0e080ee admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533018 Sep 25 00:51:29.118007 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:51:29.132666 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:29.134703 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell0:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:29.137249 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell1:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:29.138455 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:29.348944 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b1ca8825-01d2-496c-8834-481f0dfefaf6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:29.423035 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-b1ca8825-01d2-496c-8834-481f0dfefaf6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295616 Sep 25 00:51:29.423632 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Sun Sep 25 00:51:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:51:32.175125 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-e5990d47-37e0-427d-b5c9-d734e0e080ee admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:32.176133 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-e5990d47-37e0-427d-b5c9-d734e0e080ee admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 25 00:51:32.176524 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:33.071757 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fc1b8fd0-5b1f-40c8-bc48-68eaf5b2efbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:33.117745 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fc1b8fd0-5b1f-40c8-bc48-68eaf5b2efbe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.934802 Sep 25 00:51:33.118759 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:51:33.133150 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5b2a6b3-34ee-451b-948a-18231b46c9e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:33.198758 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5b2a6b3-34ee-451b-948a-18231b46c9e7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070034 Sep 25 00:51:33.200059 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Sun Sep 25 00:51:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:51:36.195453 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fc1b8fd0-5b1f-40c8-bc48-68eaf5b2efbe admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:36.196599 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fc1b8fd0-5b1f-40c8-bc48-68eaf5b2efbe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 25 00:51:36.197208 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:36.793942 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-3b58825c-51e2-4dc2-91cc-82b2d0a122e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "name": "ds1G"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:36.824536 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-3b58825c-51e2-4dc2-91cc-82b2d0a122e5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.620350 Sep 25 00:51:36.827092 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:51:36.837457 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-1ea2af39-b02e-451a-8924-d163b1c0955e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:36.868900 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-1ea2af39-b02e-451a-8924-d163b1c0955e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035139 Sep 25 00:51:36.869790 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Sun Sep 25 00:51:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:51:39.548798 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-3b58825c-51e2-4dc2-91cc-82b2d0a122e5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:39.549744 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-3b58825c-51e2-4dc2-91cc-82b2d0a122e5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 25 00:51:39.550145 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:40.052486 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-03adf249-a18a-4abe-b513-45bb896cbb99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:40.077909 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-03adf249-a18a-4abe-b513-45bb896cbb99 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520915 Sep 25 00:51:40.079231 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:51:40.093304 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-659659f1-cab7-4f3d-adb1-86fc524e3e75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:40.128918 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-659659f1-cab7-4f3d-adb1-86fc524e3e75 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040789 Sep 25 00:51:40.133472 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Sun Sep 25 00:51:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:51:42.956036 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-03adf249-a18a-4abe-b513-45bb896cbb99 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:42.957656 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-03adf249-a18a-4abe-b513-45bb896cbb99 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Sep 25 00:51:42.963556 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:43.454673 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-b295d7b7-bd14-41f7-82c2-17897a0e9814 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:43.477126 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-b295d7b7-bd14-41f7-82c2-17897a0e9814 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511467 Sep 25 00:51:43.478448 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:51:43.490912 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b0c190bd-0b59-4de9-beb0-9b7e15cb9561 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:43.524685 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-b0c190bd-0b59-4de9-beb0-9b7e15cb9561 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037217 Sep 25 00:51:43.538689 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Sun Sep 25 00:51:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:51:46.379803 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-b295d7b7-bd14-41f7-82c2-17897a0e9814 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:46.381160 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-b295d7b7-bd14-41f7-82c2-17897a0e9814 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Sep 25 00:51:46.381744 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 00:51:46.870243 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-8cc01f6e-2afc-4640-972d-2f1018042c4c admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:46.900961 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-8cc01f6e-2afc-4640-972d-2f1018042c4c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.511567 Sep 25 00:51:46.903432 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 00:51:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:51:49.736822 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-b295d7b7-bd14-41f7-82c2-17897a0e9814 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:49.737881 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-b295d7b7-bd14-41f7-82c2-17897a0e9814 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 25 00:51:49.738300 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 00:51:50.274837 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-33dd2475-88d3-4018-a7fb-682c9138fce7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "disk": 1, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:50.297569 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-33dd2475-88d3-4018-a7fb-682c9138fce7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.552281 Sep 25 00:51:50.298244 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:51:50.311535 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-58d74482-57fc-4922-ae7e-bd27486122e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:50.341893 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-58d74482-57fc-4922-ae7e-bd27486122e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034841 Sep 25 00:51:50.342331 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Sun Sep 25 00:51:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:51:53.087058 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-33dd2475-88d3-4018-a7fb-682c9138fce7 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:53.088092 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-33dd2475-88d3-4018-a7fb-682c9138fce7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 25 00:51:53.089014 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:53.528513 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-91b4f2a8-064c-4ccf-b730-1398413c9fc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:53.549295 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-91b4f2a8-064c-4ccf-b730-1398413c9fc1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453866 Sep 25 00:51:53.550100 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:51:53.562503 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-0ea9760d-6f5c-464b-99d1-d873e1a9a438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:53.588947 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-0ea9760d-6f5c-464b-99d1-d873e1a9a438 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029494 Sep 25 00:51:53.589531 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Sun Sep 25 00:51:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:51:56.284276 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-91b4f2a8-064c-4ccf-b730-1398413c9fc1 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:56.285320 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-91b4f2a8-064c-4ccf-b730-1398413c9fc1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 25 00:51:56.285766 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:51:56.758225 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-7f1f6953-7191-4c90-8c7b-8df3704c7883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:56.794439 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-7f1f6953-7191-4c90-8c7b-8df3704c7883 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.501710 Sep 25 00:51:56.795450 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:51:56.807701 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-e888bd5a-0b28-4040-ad17-9acae2c68221 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:51:56.812588 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:51:56.836936 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-e888bd5a-0b28-4040-ad17-9acae2c68221 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032855 Sep 25 00:51:56.837783 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Sun Sep 25 00:51:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:51:59.639188 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-7f1f6953-7191-4c90-8c7b-8df3704c7883 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:51:59.641105 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-7f1f6953-7191-4c90-8c7b-8df3704c7883 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007711 Sep 25 00:51:59.641863 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:00.120998 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-ae270bc1-4fc5-44bd-8d53-ba7095c35507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:00.147008 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-ae270bc1-4fc5-44bd-8d53-ba7095c35507 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498721 Sep 25 00:52:00.153511 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:51:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:00.167637 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-ee27a098-5f90-45cb-bd55-f136ba6afb16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:00.172349 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:00.195659 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-ee27a098-5f90-45cb-bd55-f136ba6afb16 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032660 Sep 25 00:52:00.196557 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Sun Sep 25 00:52:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:52:02.956303 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-ae270bc1-4fc5-44bd-8d53-ba7095c35507 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:02.957965 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-ae270bc1-4fc5-44bd-8d53-ba7095c35507 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 Sep 25 00:52:02.958560 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:03.445282 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b31eec82-56da-402e-a5b2-9d533e946b71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:03.470201 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-b31eec82-56da-402e-a5b2-9d533e946b71 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.499779 Sep 25 00:52:03.470201 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Sun Sep 25 00:52:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:52:03.481895 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-10d3de39-f456-449c-92cd-ce6720d9eb9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:03.519411 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-10d3de39-f456-449c-92cd-ce6720d9eb9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042202 Sep 25 00:52:03.525593 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Sun Sep 25 00:52:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:52:23.590801 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b31eec82-56da-402e-a5b2-9d533e946b71 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:23.591847 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-b31eec82-56da-402e-a5b2-9d533e946b71 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 25 00:52:23.592249 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 00:52:23.603454 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:23.990756 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-49413fbd-9e75-4d47-951d-eb8705d89c14 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:24.008961 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-49413fbd-9e75-4d47-951d-eb8705d89c14 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410285 Sep 25 00:52:24.009470 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 00:52:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:52:25.333099 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-b31eec82-56da-402e-a5b2-9d533e946b71 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:25.334166 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-b31eec82-56da-402e-a5b2-9d533e946b71 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 25 00:52:25.334569 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:25.891796 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-5f62282a-1716-4cf0-b86e-4f41189ef2cd admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:25.897092 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.wsgi [None req-5f62282a-1716-4cf0-b86e-4f41189ef2cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-5f62282a-1716-4cf0-b86e-4f41189ef2cd admin admin] Request method failure captured: Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Accept: application/json Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Accept-Encoding: gzip, deflate Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Connection: keep-alive Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Content-Length: 0 Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Host: 10.222.0.16 Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Openstack-Api-Version: compute 2.92 Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: Openstack-System-Scope: None Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: User-Agent: python-novaclient Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Auth-Token: gAAAAABjL6ZJK29y03dRxU37VTa9zfnu0RcSg85O6TnDIodzp5dBE_0LdiXUybeij1UBzr2OMD-oVUKCcQx6_0T1N00IyQSjSM864c-HWUCT4T3nyc-t3vCcwCtHF3y8b4jEsV_cViWHGuN4PLgVYlI-SzYxqGwdNpKu_JLK25qoCmbKy4Yiu_g Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Domain-Id: None Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Domain-Name: None Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Identity-Status: Confirmed Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Is-Admin-Project: True Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Project-Domain-Id: default Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Project-Domain-Name: Default Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Project-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Project-Name: admin Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Role: reader,admin,member Sep 25 00:52:25.901147 n-d-master-1 devstack@n-api.service[106313]: X-Roles: reader,admin,member Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_703ca81b507b4a13a3d49269a53cbe77"}]}] Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-Tenant: admin Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-Tenant-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-Tenant-Name: admin Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-User: admin Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-User-Domain-Id: default Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-User-Domain-Name: Default Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-User-Id: 90697e4fcb7e4bb39c8b9cc770ece301 Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: X-User-Name: admin Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: method: > Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: exception: Flavor 42 could not be found. Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: action_args: {'id': '42'} Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:52:25.902684 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:25.903585 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:25.904728 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-5f62282a-1716-4cf0-b86e-4f41189ef2cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:52:25.905841 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-5f62282a-1716-4cf0-b86e-4f41189ef2cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.419340 Sep 25 00:52:25.905841 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Sun Sep 25 00:52:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:25.912506 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-c62c807e-c7ac-4834-9021-051c5de958d3 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:25.917027 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:25.937757 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-c62c807e-c7ac-4834-9021-051c5de958d3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028798 Sep 25 00:52:25.938649 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Sun Sep 25 00:52:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 00:52:25.954574 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-f6d7ec1d-192b-4025-a776-7f8f16a95581 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:25.982238 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-f6d7ec1d-192b-4025-a776-7f8f16a95581 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.036047 Sep 25 00:52:25.982807 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Sun Sep 25 00:52:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:52:25.992272 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-d7d80b56-c5b9-45c2-b546-57d3355328d3 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:25.998244 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-d7d80b56-c5b9-45c2-b546-57d3355328d3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-d7d80b56-c5b9-45c2-b546-57d3355328d3 admin admin] Request method failure captured: Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Accept: application/json Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Connection: keep-alive Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Content-Length: 0 Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Host: 10.222.0.16 Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.92 Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: Openstack-System-Scope: None Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: User-Agent: python-novaclient Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjL6ZJK29y03dRxU37VTa9zfnu0RcSg85O6TnDIodzp5dBE_0LdiXUybeij1UBzr2OMD-oVUKCcQx6_0T1N00IyQSjSM864c-HWUCT4T3nyc-t3vCcwCtHF3y8b4jEsV_cViWHGuN4PLgVYlI-SzYxqGwdNpKu_JLK25qoCmbKy4Yiu_g Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Domain-Id: None Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Domain-Name: None Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Identity-Status: Confirmed Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Is-Admin-Project: True Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Project-Domain-Id: default Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Project-Domain-Name: Default Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Project-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Project-Name: admin Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Role: reader,admin,member Sep 25 00:52:26.001552 n-d-master-1 devstack@n-api.service[106314]: X-Roles: reader,admin,member Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_703ca81b507b4a13a3d49269a53cbe77"}]}] Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-Tenant: admin Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-Tenant-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-Tenant-Name: admin Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-User: admin Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-User-Domain-Id: default Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-User-Domain-Name: Default Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-User-Id: 90697e4fcb7e4bb39c8b9cc770ece301 Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: X-User-Name: admin Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: method: > Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: exception: Flavor 42 could not be found. Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: action_args: {'id': '42'} Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:52:26.003152 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:26.004209 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:26.005390 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-d7d80b56-c5b9-45c2-b546-57d3355328d3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:52:26.006756 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-d7d80b56-c5b9-45c2-b546-57d3355328d3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014275 Sep 25 00:52:26.006756 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Sun Sep 25 00:52:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:27.309069 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-f6d7ec1d-192b-4025-a776-7f8f16a95581 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:27.310127 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-f6d7ec1d-192b-4025-a776-7f8f16a95581 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 25 00:52:27.310532 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:27.875135 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fd390dd6-d888-436c-b3b0-7a883a8e0a89 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:27.880493 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-fd390dd6-d888-436c-b3b0-7a883a8e0a89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fd390dd6-d888-436c-b3b0-7a883a8e0a89 admin admin] Request method failure captured: Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Accept: application/json Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Connection: keep-alive Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Content-Length: 0 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Host: 10.222.0.16 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.92 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: Openstack-System-Scope: None Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: User-Agent: python-novaclient Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjL6ZLtd7jGq9-cU42BeUViI5acnPbktfhID0cBjMoPPr1PQL0vRrS25CE6BwIf2Y20DEQHUVg_UEQ_Ylcpn-b0SVkdmzIvkCt6_1tk5MQXxsib_Yw_q9OrICv1TMJPnIWJGIlEEQfoTVzQG41lZLcwlj0BR0qM7BUwKayeRkEok2O2d8 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Domain-Id: None Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Domain-Name: None Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Identity-Status: Confirmed Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Is-Admin-Project: True Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Project-Domain-Id: default Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Project-Domain-Name: Default Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Project-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Project-Name: admin Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Role: reader,admin,member Sep 25 00:52:27.882076 n-d-master-1 devstack@n-api.service[106314]: X-Roles: reader,admin,member Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_703ca81b507b4a13a3d49269a53cbe77"}]}] Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-Tenant: admin Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-Tenant-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-Tenant-Name: admin Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-User: admin Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-User-Domain-Id: default Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-User-Domain-Name: Default Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-User-Id: 90697e4fcb7e4bb39c8b9cc770ece301 Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: X-User-Name: admin Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: method: > Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: exception: Flavor 84 could not be found. Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: action_args: {'id': '84'} Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:52:27.883629 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:27.884517 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.885834 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fd390dd6-d888-436c-b3b0-7a883a8e0a89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:52:27.887038 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fd390dd6-d888-436c-b3b0-7a883a8e0a89 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.424290 Sep 25 00:52:27.887038 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Sun Sep 25 00:52:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:27.894107 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-967ff34c-0edd-490c-8a42-8e22f68dbdf3 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:27.909791 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-967ff34c-0edd-490c-8a42-8e22f68dbdf3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019272 Sep 25 00:52:27.910325 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Sun Sep 25 00:52:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:52:27.920687 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-83994408-f113-47e5-acab-69f29f11fa12 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:27.936283 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-83994408-f113-47e5-acab-69f29f11fa12 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019110 Sep 25 00:52:27.936836 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Sun Sep 25 00:52:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:52:27.946890 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-1126dd89-7d36-401b-8231-c9fa0bf722dd admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:27.951956 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.wsgi [None req-1126dd89-7d36-401b-8231-c9fa0bf722dd admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-1126dd89-7d36-401b-8231-c9fa0bf722dd admin admin] Request method failure captured: Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Accept: application/json Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Accept-Encoding: gzip, deflate Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Connection: keep-alive Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Content-Length: 0 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Host: 10.222.0.16 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Openstack-Api-Version: compute 2.92 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: Openstack-System-Scope: None Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: User-Agent: python-novaclient Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Auth-Token: gAAAAABjL6ZLtd7jGq9-cU42BeUViI5acnPbktfhID0cBjMoPPr1PQL0vRrS25CE6BwIf2Y20DEQHUVg_UEQ_Ylcpn-b0SVkdmzIvkCt6_1tk5MQXxsib_Yw_q9OrICv1TMJPnIWJGIlEEQfoTVzQG41lZLcwlj0BR0qM7BUwKayeRkEok2O2d8 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Domain-Id: None Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Domain-Name: None Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Identity-Status: Confirmed Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Is-Admin-Project: True Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Project-Domain-Id: default Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Project-Domain-Name: Default Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Project-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Project-Name: admin Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Role: reader,admin,member Sep 25 00:52:27.953486 n-d-master-1 devstack@n-api.service[106313]: X-Roles: reader,admin,member Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_703ca81b507b4a13a3d49269a53cbe77"}]}] Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-Tenant: admin Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-Tenant-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-Tenant-Name: admin Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-User: admin Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-User-Domain-Id: default Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-User-Domain-Name: Default Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-User-Id: 90697e4fcb7e4bb39c8b9cc770ece301 Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: X-User-Name: admin Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: method: > Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: exception: Flavor 84 could not be found. Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: action_args: {'id': '84'} Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:52:27.955110 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:27.955919 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:27.956980 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-1126dd89-7d36-401b-8231-c9fa0bf722dd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:52:27.958008 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-1126dd89-7d36-401b-8231-c9fa0bf722dd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012059 Sep 25 00:52:27.958008 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Sun Sep 25 00:52:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:29.207660 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-83994408-f113-47e5-acab-69f29f11fa12 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:29.208667 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-83994408-f113-47e5-acab-69f29f11fa12 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 25 00:52:29.209060 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:29.744576 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-24279c36-090a-4131-9cd1-f97e08a995a6 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:29.750561 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.wsgi [None req-24279c36-090a-4131-9cd1-f97e08a995a6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-24279c36-090a-4131-9cd1-f97e08a995a6 admin admin] Request method failure captured: Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Accept: application/json Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Accept-Encoding: gzip, deflate Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Connection: keep-alive Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Content-Length: 0 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Host: 10.222.0.16 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Openstack-Api-Version: compute 2.92 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: Openstack-System-Scope: None Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: User-Agent: python-novaclient Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Auth-Token: gAAAAABjL6ZNIMKP-NN2aT1ZypUfsSsLGguRxQHZ_qmy7_I8ViSUmNlmvuGL3TRcV1W04BVVlazNtxzzK9uVTrxAA6Xk43adlTrknLe0iHouUm21huhbTrfzsHEc3U7xEdCvGmO3Uo5K5HfrpYDEWNc5YKPqchCYdADGHpDohyUKiLAJ90U9224 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Domain-Id: None Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Domain-Name: None Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Identity-Status: Confirmed Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Is-Admin-Project: True Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Project-Domain-Id: default Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Project-Domain-Name: Default Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Project-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Project-Name: admin Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Role: reader,admin,member Sep 25 00:52:29.752073 n-d-master-1 devstack@n-api.service[106313]: X-Roles: reader,admin,member Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_703ca81b507b4a13a3d49269a53cbe77"}]}] Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-Tenant: admin Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-Tenant-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-Tenant-Name: admin Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-User: admin Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-User-Domain-Id: default Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-User-Domain-Name: Default Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-User-Id: 90697e4fcb7e4bb39c8b9cc770ece301 Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: X-User-Name: admin Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: method: > Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: exception: Flavor 451 could not be found. Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: action_args: {'id': '451'} Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:52:29.753719 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:29.754601 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.755642 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-24279c36-090a-4131-9cd1-f97e08a995a6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:52:29.756658 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-24279c36-090a-4131-9cd1-f97e08a995a6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.405572 Sep 25 00:52:29.756658 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 00:52:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:29.763684 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fe4259fa-23a8-45a5-9b1e-8d72bec33809 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:29.778974 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fe4259fa-23a8-45a5-9b1e-8d72bec33809 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019104 Sep 25 00:52:29.779513 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Sun Sep 25 00:52:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 00:52:29.789222 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:29.804493 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018900 Sep 25 00:52:29.805037 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Sun Sep 25 00:52:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:52:29.815127 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e3fdb35f-3f21-466d-bda2-9c7a5697b557 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:29.820041 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-e3fdb35f-3f21-466d-bda2-9c7a5697b557 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e3fdb35f-3f21-466d-bda2-9c7a5697b557 admin admin] Request method failure captured: Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Accept: application/json Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Connection: keep-alive Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Content-Length: 0 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Host: 10.222.0.16 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.92 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: Openstack-System-Scope: None Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: User-Agent: python-novaclient Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjL6ZNIMKP-NN2aT1ZypUfsSsLGguRxQHZ_qmy7_I8ViSUmNlmvuGL3TRcV1W04BVVlazNtxzzK9uVTrxAA6Xk43adlTrknLe0iHouUm21huhbTrfzsHEc3U7xEdCvGmO3Uo5K5HfrpYDEWNc5YKPqchCYdADGHpDohyUKiLAJ90U9224 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Domain-Id: None Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Domain-Name: None Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Identity-Status: Confirmed Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Is-Admin-Project: True Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Project-Domain-Id: default Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Project-Domain-Name: Default Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Project-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Project-Name: admin Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Role: reader,admin,member Sep 25 00:52:29.821660 n-d-master-1 devstack@n-api.service[106314]: X-Roles: reader,admin,member Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/703ca81b507b4a13a3d49269a53cbe77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_703ca81b507b4a13a3d49269a53cbe77"}]}] Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-Tenant: admin Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-Tenant-Id: 703ca81b507b4a13a3d49269a53cbe77 Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-Tenant-Name: admin Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-User: admin Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-User-Domain-Id: default Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-User-Domain-Name: Default Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-User-Id: 90697e4fcb7e4bb39c8b9cc770ece301 Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: X-User-Name: admin Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: method: > Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: exception: Flavor 451 could not be found. Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: action_args: {'id': '451'} Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:52:29.823293 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:29.824235 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Sep 25 00:52:29.825557 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e3fdb35f-3f21-466d-bda2-9c7a5697b557 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:52:29.826814 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-e3fdb35f-3f21-466d-bda2-9c7a5697b557 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011380 Sep 25 00:52:29.826814 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 00:52:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:52:31.069895 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:31.070889 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 25 00:52:31.071924 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:31.611078 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5e7146ab-5eb8-4d0d-833d-1b7e0423e69d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:31.630742 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5e7146ab-5eb8-4d0d-833d-1b7e0423e69d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.418470 Sep 25 00:52:31.631291 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Sun Sep 25 00:52:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:32.856854 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:32.857899 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 25 00:52:32.858294 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:33.380868 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-79369ef3-e3f5-402d-9aa9-34218e837634 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:33.400882 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-79369ef3-e3f5-402d-9aa9-34218e837634 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404238 Sep 25 00:52:33.401452 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Sun Sep 25 00:52:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:34.650675 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:34.651683 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 25 00:52:34.652085 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:35.193258 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-c2bfd495-f347-49da-9f61-18077b33caa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:35.212776 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-c2bfd495-f347-49da-9f61-18077b33caa9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.420857 Sep 25 00:52:35.213308 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Sun Sep 25 00:52:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:36.455083 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:36.456087 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 25 00:52:36.456504 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:37.001380 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-09ac75e5-7795-46aa-84f6-40297e9d8691 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:37.020005 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-09ac75e5-7795-46aa-84f6-40297e9d8691 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.421543 Sep 25 00:52:37.020540 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Sun Sep 25 00:52:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:38.244554 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:38.245583 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 25 00:52:38.245983 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:38.775408 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-555ac39f-1354-424d-a8fd-9675d76cdaf9 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:38.796195 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-555ac39f-1354-424d-a8fd-9675d76cdaf9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.408011 Sep 25 00:52:38.796736 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Sun Sep 25 00:52:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:37.144390 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.145458 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-d5de990f-2b86-490b-a681-3298ac7382d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 25 00:53:37.145867 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:37.156637 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:37.540611 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-268ebff2-cb44-4b88-a004-c5746e05adec admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.561395 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-268ebff2-cb44-4b88-a004-c5746e05adec admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409158 Sep 25 00:53:37.561956 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 00:53:37.583553 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_api:SELECT=14 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:37.587824 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-89164eaa-acce-4189-959f-3637320b842c admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.595631 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-89164eaa-acce-4189-959f-3637320b842c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013602 Sep 25 00:53:37.596166 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:37.609392 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-8745a9d1-0379-46c9-8482-6529affbcd95 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.617353 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-8745a9d1-0379-46c9-8482-6529affbcd95 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012090 Sep 25 00:53:37.617927 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:37.629588 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-35b3f2e6-677b-486e-a719-d9fa7d2b834e admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.637492 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-35b3f2e6-677b-486e-a719-d9fa7d2b834e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011437 Sep 25 00:53:37.638068 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:37.662984 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d43288f-9e39-4a3c-9a50-fc29ba1c9ebe admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.670582 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d43288f-9e39-4a3c-9a50-fc29ba1c9ebe admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012064 Sep 25 00:53:37.671114 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:58:58.068062 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-35b3f2e6-677b-486e-a719-d9fa7d2b834e admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:58.069081 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-35b3f2e6-677b-486e-a719-d9fa7d2b834e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 25 00:58:58.069513 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:58:58.215277 n-d-master-1 devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=6 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:58.365107 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:58.370048 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:58.371330 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:58.371767 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:58.372493 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:58.372936 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:58.373355 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:58.413840 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-c17af882-5075-482b-ac45-96c2aba1fcdd admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.199779 Sep 25 00:58:58.414429 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 00:58:58 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:58:59.571128 n-d-master-1 devstack@n-api.service[106313]: DEBUG nova.api.openstack.wsgi [None req-35b3f2e6-677b-486e-a719-d9fa7d2b834e admin admin] Calling method '>' {{(pid=106313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:59.572642 n-d-master-1 devstack@n-api.service[106313]: INFO nova.api.openstack.requestlog [None req-35b3f2e6-677b-486e-a719-d9fa7d2b834e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Sep 25 00:58:59.573343 n-d-master-1 devstack@n-api.service[106313]: [pid: 106313|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Sun Sep 25 00:58:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:58:59.783996 n-d-master-1 devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:59.790451 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:59.791080 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:59.791632 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:59.792639 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:59.793224 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:59.793680 n-d-master-1 devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:59.819395 n-d-master-1 devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-a343c073-5eac-4703-8bd1-1ef0fa9c6f19 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.094741 Sep 25 00:58:59.820030 n-d-master-1 devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 00:58:59 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 00:59:46.180599 n-d-master-1 devstack@n-api.service[106312]: Sun Sep 25 00:59:46 2022 - graceful shutdown triggered... Sep 25 00:59:46.181187 n-d-master-1 devstack@n-api.service[106313]: Gracefully killing worker 1 (pid: 106313)... Sep 25 00:59:46.181697 n-d-master-1 devstack@n-api.service[106314]: Gracefully killing worker 2 (pid: 106314)... Sep 25 00:59:46.183202 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 25 00:59:46.312870 n-d-master-1 devstack@n-api.service[106313]: DEBUG dbcounter [-] [106313] Writing DB stats nova_api:SELECT=4 {{(pid=106313) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:47.182016 n-d-master-1 devstack@n-api.service[106312]: worker 1 buried after 1 seconds Sep 25 00:59:47.182016 n-d-master-1 devstack@n-api.service[106312]: worker 2 buried after 1 seconds Sep 25 00:59:47.182016 n-d-master-1 devstack@n-api.service[106312]: goodbye to uWSGI. Sep 25 00:59:47.183722 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 25 00:59:47.184326 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 25 00:59:47.187539 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 25 00:59:47.211898 n-d-master-1 devstack@n-api.service[122373]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 00:59:47 2022] *** Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: nodename: n-d-master-1 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: machine: x86_64 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: clock source: unix Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: pcre jit disabled Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: detected number of CPU cores: 4 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: current working directory: / Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: detected binary path: /usr/bin/uwsgi-core Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: your processes number limit is 47680 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: your memory page size is 4096 bytes Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: detected max file descriptor number: 2048 Sep 25 00:59:47.214879 n-d-master-1 devstack@n-api.service[122373]: lock engine: pthread robust mutexes Sep 25 00:59:47.215935 n-d-master-1 devstack@n-api.service[122373]: thunder lock: enabled Sep 25 00:59:47.215935 n-d-master-1 devstack@n-api.service[122373]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 25 00:59:47.215935 n-d-master-1 devstack@n-api.service[122373]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 00:59:47.261150 n-d-master-1 devstack@n-api.service[122373]: Python main interpreter initialized at 0x55582d3f39c0 Sep 25 00:59:47.261150 n-d-master-1 devstack@n-api.service[122373]: python threads support enabled Sep 25 00:59:47.261150 n-d-master-1 devstack@n-api.service[122373]: your server socket listen backlog is limited to 100 connections Sep 25 00:59:47.261150 n-d-master-1 devstack@n-api.service[122373]: your mercy for graceful operations on workers is 90 seconds Sep 25 00:59:47.261652 n-d-master-1 devstack@n-api.service[122373]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 00:59:47.261652 n-d-master-1 devstack@n-api.service[122373]: *** Operational MODE: preforking *** Sep 25 00:59:47.261944 n-d-master-1 devstack@n-api.service[122373]: *** uWSGI is running in multiple interpreter mode *** Sep 25 00:59:47.261944 n-d-master-1 devstack@n-api.service[122373]: spawned uWSGI master process (pid: 122373) Sep 25 00:59:47.262168 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 25 00:59:47.262794 n-d-master-1 devstack@n-api.service[122373]: spawned uWSGI worker 1 (pid: 122384, cores: 1) Sep 25 00:59:47.263460 n-d-master-1 devstack@n-api.service[122373]: spawned uWSGI worker 2 (pid: 122385, cores: 1) Sep 25 00:59:47.263569 n-d-master-1 devstack@n-api.service[122373]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 00:59:47.953798 n-d-master-1 devstack@n-api.service[122384]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:59:47.967345 n-d-master-1 devstack@n-api.service[122385]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:59:49.146005 n-d-master-1 devstack@n-api.service[122384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:49.146005 n-d-master-1 devstack@n-api.service[122384]: from cryptography.utils import int_from_bytes Sep 25 00:59:49.147037 n-d-master-1 devstack@n-api.service[122384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:49.147037 n-d-master-1 devstack@n-api.service[122384]: from cryptography.utils import int_from_bytes Sep 25 00:59:49.176555 n-d-master-1 devstack@n-api.service[122385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:49.176555 n-d-master-1 devstack@n-api.service[122385]: from cryptography.utils import int_from_bytes Sep 25 00:59:49.177200 n-d-master-1 devstack@n-api.service[122385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:49.177200 n-d-master-1 devstack@n-api.service[122385]: from cryptography.utils import int_from_bytes Sep 25 00:59:51.680036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:59:51.680905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:59:51.680905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:59:51.681324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:59:51.681611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:59:51.682042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.682372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.682737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.683070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.683409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.683723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.684056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.684377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.684708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.684976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.685288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.685835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.686162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.686584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.686958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.687296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.687610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.687937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.688251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.688766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.689325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.689620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.689879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.690497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.690802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.691022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.691246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.691486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.691790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.692107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.692533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.692853 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.693170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.693592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.694038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.694581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.694979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.695400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.695820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.695820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.696436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.696436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.697467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.697728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.698027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.698413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.698735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.699156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.699374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.699693 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.699931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.700352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.700611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.700892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.701268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.701632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.702115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.702115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.703056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.703056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.703056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.703651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.703651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.704006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.704226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.704615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.704786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.705089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.705452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.705762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.706075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.706400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.706821 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.707154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.707387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.707846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.708207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.708523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.708852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.709186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.709532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.709849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.710159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.710499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.710850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.711159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.711417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.711734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.712056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.712467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.712935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.713259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.713600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.713908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.714221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.714679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.714858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.715161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.715476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.715789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.716090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.716402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.716715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.717022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.717356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.717711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.718031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.718371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.718698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.719012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.719341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.719652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.719966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.720298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.720612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.720920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.721246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.721589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.721899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.722223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.722526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.722837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.723158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.723469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.723784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.724089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.724394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.724696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.725005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.725314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.725671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.726005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.726337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.726668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.726985 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.727296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.727606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.728769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.729134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.729727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.729913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.730153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.730491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.730890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.731149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.731954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.731954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.732162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.732415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.732737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.733125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.733360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.733727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.734063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.734389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.734714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.735035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.735349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.735675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.736014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.736344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.736658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.737007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.737461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.737707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.738035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.738367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.738780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.739005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.739320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.739676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.739998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.740317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.740646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.741036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.741287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.741685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.742001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.742324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.742643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.742960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.743334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.743846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.744204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.744528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.744846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.745168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.745515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.745838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.746156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.746466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.746774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.747083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.747404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.747711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.748039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.748380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.748691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.749033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.749345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.749701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.750020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.750337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.750648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.750967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.751284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.751594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.751924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.752241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.752554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.752888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.753201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.753619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.753852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.754168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.754483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.754797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.755112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.755454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.755762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.756078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.756420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.756754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.757069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.757393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.757857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.758177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.758481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.758795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.759106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.759106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.760323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.760537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.760840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.761148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.761476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.761790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.762093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.762420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.762735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.763327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.763587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.763999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.764246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.764555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.764903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.765245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.765669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.765920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.766230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.766554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.766872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.767085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:59:51.767613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.767719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:59:51.767802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.767802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.767976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:59:51.768107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.768256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:59:51.768404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.768498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:59:51.768722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.768875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.769020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.769164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.769355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.769538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.769736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.769917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.770129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.770339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.770511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.770686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.770824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.770929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.771127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.771236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.771410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.771520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.771605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.771740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.771885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.771997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.772194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.772444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.772628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.772795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.772979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.773147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.773291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.773389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.773615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.773772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.773918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.774045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.774196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.774331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.774431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.774575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.774749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.775085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.775215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.775505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.775624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.775878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.776082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.776277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.776389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.776592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.776737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.776915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.777052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.777253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.777348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.777617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.777792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.777937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.778043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.778256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.778350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.778584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.778686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.778902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.779004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.779218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.779360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.779546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.779653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.779845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.780016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.780158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.780308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.780474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.780662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.780843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.780977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.781098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.781336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.781458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.781689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.781797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.781995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.782099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.782441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.782567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.782666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.782762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.782942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.783038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.783259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.783442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.783585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.783691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.783891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.784028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.784201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.784356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.784518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.784665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.784822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.784977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.785128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.785236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.785376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.785550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.785707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.785801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.786034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.786241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.786407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.786568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.786740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.786895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.787061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.787267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.787433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.787602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.787788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.787971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.788144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.788317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.788477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.788639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.788820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.788984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.789124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.789271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.789469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.789647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.789800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.789969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.790136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.790280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.790985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.791123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.791272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.791432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.791598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.791752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.791912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.792089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.792089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.792427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.792586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.792748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.792906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.793068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.793234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.793759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.793933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.794185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.794439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.794608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.794789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.795005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.795168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.795337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.795503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.795695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.795695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.796008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.796162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.796492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.796695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.796920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.797075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.797220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.797381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.797560 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.797712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.797889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.798058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.798228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.798402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.798402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.798692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.798851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.799001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.799150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.799308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.799463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.799628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.799727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.799813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.799905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.800029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.800127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.800218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.800379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.800541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.800710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.800883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.801036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.801197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.801359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.801548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.801701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.801869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.802091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.802245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.802407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.802569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.802731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.802957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.803098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.803281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.803430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.803594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.803819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.803987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.804149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.804357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.804516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.804672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.804863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.805013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.805176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.805331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.805577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.805744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.805966 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.806235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.806329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.806680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.806838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.806992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.807158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.807312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.807469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.807640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.807793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.807942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.808157 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.808324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.808499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.808664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.808840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.808999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.808999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.809271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.809481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.809644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.809800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.810000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.810152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.810286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.810531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.810696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.810843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.810992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.811152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.811309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.811528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.811736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.811884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.812024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.812211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.812331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.812415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.812560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.812723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.812846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.812979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.813164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.813302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.813302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.813598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.813707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.813838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.813981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.814078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.814163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.814262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.814407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.814546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.814650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.814650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.814844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.814950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:51.815139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.815988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.816967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.817931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.818968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.819063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.819283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.819431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.819594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.819743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.819905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.820923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.821120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.821295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.821478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.822331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.822503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.822675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.822828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.823079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.823238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.823433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.823669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.823843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.824067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.824220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.824378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.824531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.824746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.824964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.825115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.825270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.825452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.825606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.825770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.825930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.826090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.826251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.826400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.826550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.826716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.826967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.827123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.827277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.827424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.827585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.827750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.827922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.828076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.828410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.828572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.828729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.828899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.829063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.829219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.829372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.829661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.829836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.829991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.830932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.831221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.831387 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.831541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.831713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.831931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.832092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.832240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.832391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.832558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.832729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.832895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.833114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.833332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.833543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.833715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.833886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.834037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.834258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.834411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.834411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.834749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.834910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.835998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.836145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.836281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.836425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.836584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.836739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.836889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.837043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.837209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.837209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.837695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.837695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.838965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.839131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.839296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.839449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.839611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.839773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.839926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.840097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.840261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.840412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.840560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.840723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.840897 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.841050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.841215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.841375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.841602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.841750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.841923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.842081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.842233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.842385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.842567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.842721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.842901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.843055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.843273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.843483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.843640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.843793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.843961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.844130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.844348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.844505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.844674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.844909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.845069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.845286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.845468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.845624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.845777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.845959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.846114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.846267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.846431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.846431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.846733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.846963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.847164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.847324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.847481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.847631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.847783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.847958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.848118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.848273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.848273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.848564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.848746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.848911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.849076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.849233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.849383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.849704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.849882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.850969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.851941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.852797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.853419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.853520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.853597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.853676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.853826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.854003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.854156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.854399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.854505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.854763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.854876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.855079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.855210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.855393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.855497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.855709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.855813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.856987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.857175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.857332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.857544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.857722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.857833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.857931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.858959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.859182 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.859301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.859510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.859613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.859840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.859944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.860148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.860246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.860466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.860561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.860771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.860876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.861080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.861174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.861388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.861514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.861732 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.861837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.862045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.862168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.862359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.862472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.862679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.862789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.863987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.864943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.865128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.865240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.865475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.865658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.865796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.865917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.866986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.867081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.867302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.867407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.867622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.867725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.867934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.868030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.868254 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.868356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.868796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.869930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.870960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.871186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.871279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.871512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.871606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.871830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.871992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.872137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.872248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.872459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.872567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.872778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.872880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.873095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.873231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.873463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.873576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.873758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.873897 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.874082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.874195 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.874403 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.874511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.874718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.874809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.875978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.876160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.876328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.876558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.876729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.876902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.877072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.877270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.877516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.877691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.877852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.878824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.879990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.880141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.880300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.880441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.880691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.880850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.880987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.881122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.881271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.881462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.881623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.881793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.881935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.882106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.882260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.882409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.882560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.882698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.883080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.883428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.883625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.883798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.884024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.884226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.884369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.884524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.884666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.885067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.885239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.885395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.885592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.885760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.885760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.886154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.886316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.886468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.886615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.886762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.886915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.887089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.887242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.887407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.887633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.887790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.887945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.888368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.888520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.888691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.888858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.889027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.889198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.889378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.889565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.889722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.889876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.890031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.890031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.890343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.890501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.890660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.890823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.891906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.892072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.892240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.892402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.892571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.892737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.892899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.893086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.893242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.893694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.893851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.894949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.895382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.895526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.895682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.895869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.896101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.896295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.896456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.896456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.896752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.896919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.897084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.897250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.897443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.897601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.897825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.898965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.899134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.899289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.899458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.899612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.900643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.901037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.901211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.901381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.901593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.901764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.901938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.902975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.903135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.903300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.903455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.903455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.904066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.904226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.904393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.904534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.904687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.904947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.905099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.905307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.905500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.905644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.905818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.905993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.906142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.906293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.906439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.906844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.907994 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.934154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.934694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.934934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.935164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.935389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.937695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.937835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.937968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.938091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.938205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.938343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.938537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.938718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.938920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.939109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.939316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.939504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.939697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.939861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.939990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.940145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.940330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.940445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.940572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.940705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.940852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.941151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.941151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.941546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.941751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.941944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.941944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.942539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.942539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.942969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.943190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.943413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.943644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.943915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.945550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.945550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.946243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.946433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.946605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.946772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.946906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.947069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.947848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.948056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.948241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.949282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.949477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.949618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.949770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.949965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.950138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.950290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.950484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.950606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.950713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.950992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.951701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.952981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.953984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.954932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.955867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.956943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.957998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.958220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.958427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.958563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.958691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.958820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.958943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.959959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960288 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.960959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.961965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.962766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.962901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.963933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.964690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.965935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.966233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.966233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.966233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.966756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.966931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.967104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.967104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.967425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.967425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.967690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.967824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.968074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.968307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.968537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.968777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.969023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.969023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.969471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.969702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.969948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.972979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.973996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.974998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.975822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.976040 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.976224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.976403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.976403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.976711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.976895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.977963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.978836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.979849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.980812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.981711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.982470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.983967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.984800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.985723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.986570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.986570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.986570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.986570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.986570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.986570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.987302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.987302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.987302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.987641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.987887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.988220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.988559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.988889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.989211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.989554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.989881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.990455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.990775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.991108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.991441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.991771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.992095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.992517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.992745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.993066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.993372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.994276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.994799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.995301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.995641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.995960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.996273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.996602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.996919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.997519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.997934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.998187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.998517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.999422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.999422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.999422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:51.999774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.000082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.000389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.000709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.001025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.001334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.001776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.002016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.002330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.002712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.002944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.003263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.003601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.003908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.004213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.004520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.004833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.005142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.005471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.005784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.006212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.006533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.006841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.007255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.007565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.007879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.008232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.008543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.008851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.009221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.009745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.010288 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.010628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.010949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.011279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.011599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.011913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.012269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.012594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.013506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.013794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.014119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.014459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.014796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.015110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.015422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.015734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.016063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.016381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.016703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.017053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.017326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.017664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.017978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.018292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.018605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.018917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.019231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.019548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.019859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.020175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.020484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.020802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.021153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.021509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.021830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.022155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.022476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.022792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.023102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.023419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.023728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.024047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.024376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.024582 n-d-master-1 devstack@n-api.service[122384]: INFO dbcounter [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Registered counter for database nova_api Sep 25 00:59:52.024692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.025796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.026586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.027059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.027635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.028043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.028371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.028882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.029477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.029948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.030309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.030727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.031128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.031481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.031818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.032161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.032473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.032792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.033533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.033868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.034200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.034512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.034823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.035133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.035451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.035759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.036072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.036380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.036691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.037005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.037313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.037669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.037958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.038264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.038572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.038876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.039188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.039496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.039877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.040107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.040492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.040906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.041535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.041930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.042257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.042617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.042913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.043516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.043643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.043880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.044207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.044535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.044847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.045191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.045529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.045846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.046165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.046483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.046656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_db.sqlalchemy.engines [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.047021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.047183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.047428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.047761 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.048076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.048399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.048726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.049044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.049363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.049707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.050041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.050353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.050676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.050987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.051301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.051614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.051933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.052247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.052562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.052882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.053200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.053579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.053873 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writer thread running {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.053987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.054183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.054653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.054987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.055337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.055655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.056534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.056969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.057572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.057902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.058208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:52.058450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:59:52.114287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.context [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=122384) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:59:52.118662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:52.119143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:52.120854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:52.121639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:52.122090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:52.122274 n-d-master-1 devstack@n-api.service[122385]: INFO dbcounter [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Registered counter for database nova_api Sep 25 00:59:52.124124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:52.126208 n-d-master-1 devstack@n-api.service[122384]: INFO dbcounter [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Registered counter for database nova_cell0 Sep 25 00:59:52.130318 n-d-master-1 devstack@n-api.service[122384]: INFO dbcounter [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Registered counter for database nova_cell1 Sep 25 00:59:52.139130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_db.sqlalchemy.engines [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.141728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_db.sqlalchemy.engines [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.143838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.145801 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writer thread running {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.153292 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writer thread running {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.213675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.context [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=122385) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:59:52.218226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:52.218918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:52.220667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:52.221630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:52.222239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:52.224513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:52.226956 n-d-master-1 devstack@n-api.service[122385]: INFO dbcounter [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Registered counter for database nova_cell0 Sep 25 00:59:52.232471 n-d-master-1 devstack@n-api.service[122385]: INFO dbcounter [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Registered counter for database nova_cell1 Sep 25 00:59:52.240598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.243212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.253748 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writer thread running {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.255548 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writer thread running {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.303763 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writer thread running {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.319860 n-d-master-1 devstack@n-api.service[122384]: INFO dbcounter [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Registered counter for database nova_cell0 Sep 25 00:59:52.330544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_db.sqlalchemy.engines [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.338832 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writer thread running {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.418424 n-d-master-1 devstack@n-api.service[122385]: INFO dbcounter [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Registered counter for database nova_cell0 Sep 25 00:59:52.427776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:52.438089 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writer thread running {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:52.687769 n-d-master-1 devstack@n-api.service[122384]: WARNING keystonemiddleware.auth_token [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:52.695917 n-d-master-1 devstack@n-api.service[122384]: WARNING keystonemiddleware.auth_token [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:52.791439 n-d-master-1 devstack@n-api.service[122385]: WARNING keystonemiddleware.auth_token [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:52.798830 n-d-master-1 devstack@n-api.service[122385]: WARNING keystonemiddleware.auth_token [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:53.043341 n-d-master-1 devstack@n-api.service[122384]: WARNING keystonemiddleware.auth_token [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:53.049782 n-d-master-1 devstack@n-api.service[122384]: WARNING keystonemiddleware.auth_token [None req-28ceaa7e-79ac-4e4d-8ad7-8e3f809542de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:53.055387 n-d-master-1 devstack@n-api.service[122384]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55582d3f39c0 pid: 122384 (default app) Sep 25 00:59:53.147383 n-d-master-1 devstack@n-api.service[122385]: WARNING keystonemiddleware.auth_token [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:53.154770 n-d-master-1 devstack@n-api.service[122385]: WARNING keystonemiddleware.auth_token [None req-6b3a5aa6-bdbf-475e-a4de-41b87e9d0277 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:53.160289 n-d-master-1 devstack@n-api.service[122385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55582d3f39c0 pid: 122385 (default app) Sep 25 01:00:34.724954 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.725894 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.728151 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:34.729003 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.702893 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.704077 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.704870 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:35.705905 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:36.110579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:36.112202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:36.112771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:36.113264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:36.113876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:36.114327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:36.114737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:36.169847 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b5065ae2-bfc1-43bb-90fb-357867a944a4 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.455069 Sep 25 01:00:36.176642 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1164 bytes} [Sun Sep 25 01:00:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:00:36.186061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:36.188325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:36.189089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:36.189712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:36.190919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:36.191578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:36.192202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:36.217308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29d09615-689d-4aaa-9e03-152f25774526 tempest-AZAdminV2TestJSON-1540847426 tempest-AZAdminV2TestJSON-1540847426-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.035935 Sep 25 01:00:36.217959 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:00:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:36.971478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7158c4d-902b-4e29-936e-004d641984a9 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-665054216", "id": 964770703, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:37.065206 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d7158c4d-902b-4e29-936e-004d641984a9 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.653306 Sep 25 01:00:37.066202 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3/3] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:36 2022] POST /compute/v2.1/flavors => generated 426 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:37.172818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Calling method '.version_select at 0x7f7bf17a1430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.184363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=122385) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 25 01:00:37.185363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.185869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.186312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.214229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.214730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.215167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.229345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.229866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.230381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.237926 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad28d777-66ee-473c-a956-0b346c11f1da tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.546227 Sep 25 01:00:37.238528 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1/4] 10.222.0.16 () {60 vars in 1208 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:00:37.386048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.390872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.391692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.392327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.393151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.393766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.394524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.425104 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22ee72f5-12d7-41ca-aa08-38e7e0816cb4 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.357222 Sep 25 01:00:37.426603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 4/5] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:00:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:37.432076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a97f2c5c-8c68-46fd-9044-b5f36a029e7c tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.465062 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a97f2c5c-8c68-46fd-9044-b5f36a029e7c tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/964770703" status: 202 len: 0 microversion: 2.1 time: 0.035859 Sep 25 01:00:37.468790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 5/6] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:00:37 2022] DELETE /compute/v2.1/flavors/964770703 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:37.588659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '.version_select at 0x7f7bf1743c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.591459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.592562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.593257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.616390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.617317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.618589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.637245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:37.637768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:37.638251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:37.647475 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2c5f200-238a-46a8-ac56-52375f3dce73 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.407824 Sep 25 01:00:37.649229 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2/7] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:00:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:37.654294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b4a8c63-f52e-4db2-b48b-fdc325964951 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1506411568"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:37.680591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-6b4a8c63-f52e-4db2-b48b-fdc325964951 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Generated uuid d45daa30-58b1-4b54-a838-d039a032a566 for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:37.742480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-583607823", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:37.781149 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b4a8c63-f52e-4db2-b48b-fdc325964951 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.130534 Sep 25 01:00:37.782357 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3/8] 10.222.0.16 () {62 vars in 1205 bytes} [Sun Sep 25 01:00:37 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:37.928271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf15d8430>, body: {"quota_set": {"ram": "5120"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:38.390007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:00:38.605672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:38.606223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:38.606593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:38.607519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:38.609810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:38.610358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:38.724468 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a4a3341-839a-4208-b2b2-90ddd35bb764 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83" status: 200 len: 148 microversion: 2.57 time: 0.940919 Sep 25 01:00:38.725086 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 4/9] 10.222.0.16 () {62 vars in 1303 bytes} [Sun Sep 25 01:00:37 2022] PUT /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83 => generated 148 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:38.731137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f365ffa-4e1f-43a1-b09a-5a2acce03db7 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:38.740380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:00:38.740811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:00:38.741289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:00:38.741722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:00:38.742353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:00:38.761050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:38.761623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:38.762344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:38.763145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:38.763921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:38.764436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:38.781580 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f365ffa-4e1f-43a1-b09a-5a2acce03db7 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055000 Sep 25 01:00:38.782506 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 5/10] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:38.792059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c31cab1-cf7b-419a-aa99-e54fec0c1949 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-527167141"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:38.796243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Getting quotas for project 7b3b7f9e3f494890ac14e46a66585d0d. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:00:38.805830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Getting quotas for user 549ac14b43eb4f0d85c9d9e975515df1 and project 7b3b7f9e3f494890ac14e46a66585d0d. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:00:38.821079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:00:38.824778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:00:38.930396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80b913c6-f3aa-4dcb-a421-538a84f1a633 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461062 Sep 25 01:00:38.935183 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 6/11] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:00:38.945900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Calling method '.version_select at 0x7f7bf0d08700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:38.969203 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c31cab1-cf7b-419a-aa99-e54fec0c1949 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.185211 Sep 25 01:00:38.970552 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 6/12] 10.222.0.16 () {62 vars in 1210 bytes} [Sun Sep 25 01:00:38 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:38.977002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc66ca8e-d774-4afd-bae7-71fa4c783904 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-347657234", "id": 1034161498, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:39.021206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc66ca8e-d774-4afd-bae7-71fa4c783904 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.049038 Sep 25 01:00:39.022543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 7/13] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:38 2022] POST /compute/v2.1/flavors => generated 416 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:39.031447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fda9ba95-f9e0-49c7-97a1-27b64eb62fa2 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:39.032194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fda9ba95-f9e0-49c7-97a1-27b64eb62fa2 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:39.310378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:39.311074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:39.311680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:39.312588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:39.313033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:39.313701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:39.342615 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7bd2b6c8-26fe-43a9-9ca7-b08f085973cb tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83/detail" status: 200 len: 463 microversion: 2.57 time: 0.405974 Sep 25 01:00:39.353970 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 7/14] 10.222.0.16 () {60 vars in 1304 bytes} [Sun Sep 25 01:00:38 2022] GET /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83/detail => generated 463 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:39.360386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-688612ed-c286-4001-ad8f-d5f34156b7f5 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:39.378228 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-688612ed-c286-4001-ad8f-d5f34156b7f5 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.022867 Sep 25 01:00:39.379404 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 8/15] 10.222.0.16 () {60 vars in 1190 bytes} [Sun Sep 25 01:00:39 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:39.393511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-348e0f34-1377-4c76-bf6c-9d3f87b99ba3 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:39.431732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-348e0f34-1377-4c76-bf6c-9d3f87b99ba3 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.050978 Sep 25 01:00:39.432703 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:39 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:39.437306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5fcaa63a-c50a-4390-8df2-6eec3050eeb2 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:39.485645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fcaa63a-c50a-4390-8df2-6eec3050eeb2 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:39.485911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fcaa63a-c50a-4390-8df2-6eec3050eeb2 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:39.486339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fcaa63a-c50a-4390-8df2-6eec3050eeb2 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:39.778661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fda9ba95-f9e0-49c7-97a1-27b64eb62fa2 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:39.807013 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fda9ba95-f9e0-49c7-97a1-27b64eb62fa2 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1222 microversion: 2.1 time: 0.781767 Sep 25 01:00:39.807642 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:39 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1222 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:39.817139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1958ee38-944a-40ff-b65e-4fff056fe762 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:39.848204 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1958ee38-944a-40ff-b65e-4fff056fe762 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1034161498" status: 202 len: 0 microversion: 2.1 time: 0.038831 Sep 25 01:00:39.849269 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:00:39 2022] DELETE /compute/v2.1/flavors/1034161498 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:39.854113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1958ee38-944a-40ff-b65e-4fff056fe762 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:39.856063 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1958ee38-944a-40ff-b65e-4fff056fe762 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002305 Sep 25 01:00:39.857180 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 886 bytes} [Sun Sep 25 01:00:39 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 25 01:00:39.863768 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf0d6bd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.040437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5fcaa63a-c50a-4390-8df2-6eec3050eeb2 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.604602 Sep 25 01:00:40.042751 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 10/20] 10.222.0.16 () {62 vars in 1232 bytes} [Sun Sep 25 01:00:39 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:40.050394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d7a4120-0ca9-4365-8863-4a6335a03c0a tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.080985 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d7a4120-0ca9-4365-8863-4a6335a03c0a tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036183 Sep 25 01:00:40.082069 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:40.088779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af0dc8bb-b94d-4fd0-a6dd-110e29b74630 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.105749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af0dc8bb-b94d-4fd0-a6dd-110e29b74630 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.107324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af0dc8bb-b94d-4fd0-a6dd-110e29b74630 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.108457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af0dc8bb-b94d-4fd0-a6dd-110e29b74630 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.253320 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af0dc8bb-b94d-4fd0-a6dd-110e29b74630 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.169719 Sep 25 01:00:40.264120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 12/22] 10.222.0.16 () {62 vars in 1232 bytes} [Sun Sep 25 01:00:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:40.268929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a17a7103-b750-4550-80be-67c08c72a137 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-713670945", "id": 1987813702, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.298877 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a17a7103-b750-4550-80be-67c08c72a137 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.033475 Sep 25 01:00:40.299509 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 13/23] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:40 2022] POST /compute/v2.1/flavors => generated 428 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:40.309607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-002d113f-78d2-47c8-9d12-5ff55f76f7a9 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.342856 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-002d113f-78d2-47c8-9d12-5ff55f76f7a9 tempest-AggregatesAdminTestV241-1047012968 tempest-AggregatesAdminTestV241-1047012968-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.037964 Sep 25 01:00:40.345529 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 14/24] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 01:00:40 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:40.359364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06b38d73-0148-433c-9690-a98abaf0e9a2 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.394602 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06b38d73-0148-433c-9690-a98abaf0e9a2 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1987813702" status: 202 len: 0 microversion: 2.1 time: 0.044589 Sep 25 01:00:40.400000 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 15/25] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:00:40 2022] DELETE /compute/v2.1/flavors/1987813702 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:40.402692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.403255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.403737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.404521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.404925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.405349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.405878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-babc2124-b705-4e1b-9794-461e7a0e663c tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-160167289"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.409292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-babc2124-b705-4e1b-9794-461e7a0e663c tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid fc0bfaaa-e009-4224-a23c-8b17c56373c2 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:40.454032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-babc2124-b705-4e1b-9794-461e7a0e663c tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052775 Sep 25 01:00:40.454637 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 16/26] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:40.467979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc7ab1c7-a02c-497b-a715-a4a448a70dae tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.487629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.488548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.489244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.490203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.490864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.491466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.509634 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc7ab1c7-a02c-497b-a715-a4a448a70dae tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050904 Sep 25 01:00:40.525697 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 17/27] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:40.541196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28687bfa-dbef-4bd7-8cac-8cbdba9a5d1a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.553339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28687bfa-dbef-4bd7-8cac-8cbdba9a5d1a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.554031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28687bfa-dbef-4bd7-8cac-8cbdba9a5d1a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.555313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28687bfa-dbef-4bd7-8cac-8cbdba9a5d1a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.616587 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4bf5e068-6e34-4aa3-965e-d9f5be6eb5b7 tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83?user_id=4dbc5a002d7b44c1aca282c190b395f4" status: 200 len: 148 microversion: 2.57 time: 0.757311 Sep 25 01:00:40.617886 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 11/28] 10.222.0.16 () {62 vars in 1384 bytes} [Sun Sep 25 01:00:39 2022] PUT /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83?user_id=4dbc5a002d7b44c1aca282c190b395f4 => generated 148 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:40.622930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cec801bd-2307-4507-8aa3-50c92b41b720 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-737975100", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.646847 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cec801bd-2307-4507-8aa3-50c92b41b720 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.027410 Sep 25 01:00:40.657039 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 12/29] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:40 2022] POST /compute/v2.1/flavors => generated 506 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:40.664210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-52a7d694-0c5d-465e-8e64-2a93f2b7f4ef tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] Calling method '.version_select at 0x7f7bf0ca0160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.759447 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-28687bfa-dbef-4bd7-8cac-8cbdba9a5d1a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.228217 Sep 25 01:00:40.760911 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 18/30] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:00:40 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:40.767741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7cc36844-8e98-4ff2-872a-d02b894c812e tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.779221 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=11 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:40.791258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7cc36844-8e98-4ff2-872a-d02b894c812e tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/04d8c7bb-6867-434e-b3f2-816ee2954677" status: 202 len: 0 microversion: 2.1 time: 0.029037 Sep 25 01:00:40.793543 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 19/31] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:00:40 2022] DELETE /compute/v2.1/flavors/04d8c7bb-6867-434e-b3f2-816ee2954677 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:40.805465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:40.818021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.818508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.818943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.863333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-master-1. Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 39 Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:40.890826 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: {"add_host": {"host": "n-h1-master-1"}} Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:40.892174 n-d-master-1 devstack@n-api.service[122384]: exception: Aggregate 2 already has host n-h1-master-1. Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result.read() Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:00:40.892964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi session.flush() Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 01:00:40.894212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 01:00:40.895601 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:00:40.896764 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result.read() Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 25, 1, 0, 40, 841787), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 2}] Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:40.897863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-master-1. Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.898996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-master-1. Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:40.900576 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:40.904011 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-master-1. Sep 25 01:00:40.904011 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:40.915532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-master-1. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:40.920078 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a5146fb-fde1-4546-8a40-50e7ff28291f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.122401 Sep 25 01:00:40.921719 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 20/32] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:00:40 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 25 01:00:40.930266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93c812fe-1834-4cd8-a635-de98b8235e98 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.962386 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-93c812fe-1834-4cd8-a635-de98b8235e98 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039170 Sep 25 01:00:40.963766 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 21/33] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:40.968603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:40.969334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:40.984744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.985243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.985719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:40.986432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:40.986890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:40.987634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:41.166657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:41.199004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-da8fcedd-2ef0-41c6-b4cd-636a498b518a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1274 microversion: 2.1 time: 0.233961 Sep 25 01:00:41.200427 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 22/34] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:40 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:41.205876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3ce0578-90d2-4463-9e95-b0b7131e6fa9 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:41.219117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3ce0578-90d2-4463-9e95-b0b7131e6fa9 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:41.219888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3ce0578-90d2-4463-9e95-b0b7131e6fa9 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:41.221006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3ce0578-90d2-4463-9e95-b0b7131e6fa9 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:41.243925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-52a7d694-0c5d-465e-8e64-2a93f2b7f4ef tempest-QuotasAdminTestV257-743423311 tempest-QuotasAdminTestV257-743423311-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83?user_id=4dbc5a002d7b44c1aca282c190b395f4" status: 200 len: 190 microversion: 2.57 time: 0.584985 Sep 25 01:00:41.245665 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 13/35] 10.222.0.16 () {60 vars in 1364 bytes} [Sun Sep 25 01:00:40 2022] GET /compute/v2.1/os-quota-sets/36c46355d34346969dadad0bd090fe83?user_id=4dbc5a002d7b44c1aca282c190b395f4 => generated 190 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:00:41.251282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1974575c-6cad-4b65-b965-6e9bb1de96d7 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1192911273", "id": "82cd779c-c50d-4233-8158-285d5fdab553", "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:41.276299 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1974575c-6cad-4b65-b965-6e9bb1de96d7 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028732 Sep 25 01:00:41.277938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 14/36] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:41 2022] POST /compute/v2.1/flavors => generated 507 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:41.291429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a050fe14-7678-4d16-bbfe-96783045ee78 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:41.347347 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a050fe14-7678-4d16-bbfe-96783045ee78 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/82cd779c-c50d-4233-8158-285d5fdab553" status: 202 len: 0 microversion: 2.1 time: 0.058858 Sep 25 01:00:41.348802 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 15/37] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:00:41 2022] DELETE /compute/v2.1/flavors/82cd779c-c50d-4233-8158-285d5fdab553 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:41.369736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccad4b24-3637-4873-bfac-91d6cc97f549 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:41.438512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccad4b24-3637-4873-bfac-91d6cc97f549 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081819 Sep 25 01:00:41.439504 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 16/38] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:41.454589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3ce0578-90d2-4463-9e95-b0b7131e6fa9 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.252463 Sep 25 01:00:41.457289 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 23/39] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:00:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:41.484565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb94445f-4655-4246-b87e-9135efe0db99 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-966764556", "id": 21687521, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:41.487908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4ebdb76-1690-4efd-9342-dcb04af998f7 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:41.507555 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:41.538698 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4ebdb76-1690-4efd-9342-dcb04af998f7 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.060102 Sep 25 01:00:41.541304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 17/40] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:41 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:00:41.550429 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb94445f-4655-4246-b87e-9135efe0db99 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.072758 Sep 25 01:00:41.552153 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 24/41] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:41.575081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79aa77fc-6324-47a8-ae13-e897b5a0ea37 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-822474440"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:41.576581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de5b800a-9b1f-4e3f-b008-5db30d31caf3 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:41.588117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-79aa77fc-6324-47a8-ae13-e897b5a0ea37 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid 29b93b46-a19b-4338-bf42-cdb08ca4deba for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:41.615852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de5b800a-9b1f-4e3f-b008-5db30d31caf3 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/21687521" status: 200 len: 407 microversion: 2.1 time: 0.047301 Sep 25 01:00:41.619564 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 25/42] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:41 2022] GET /compute/v2.1/flavors/21687521 => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:41.631998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d3e4bd5-48fb-4476-92d6-7a97dc41e29e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1003519675", "name": "tempest-test_aggregate-1982064410"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:41.660465 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-79aa77fc-6324-47a8-ae13-e897b5a0ea37 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.105032 Sep 25 01:00:41.669542 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 18/43] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:41.722980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-7d3e4bd5-48fb-4476-92d6-7a97dc41e29e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid 31f07e6f-5193-4310-aa0f-94f30258df1b for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:41.800011 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d3e4bd5-48fb-4476-92d6-7a97dc41e29e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.175475 Sep 25 01:00:41.803981 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 26/44] 10.222.0.16 () {60 vars in 1165 bytes} [Sun Sep 25 01:00:41 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:42.559226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04d386dd-9b7f-47e8-bec7-4738cd7ea58a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:42.566699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-04d386dd-9b7f-47e8-bec7-4738cd7ea58a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a86f4e46084b4343b80d07e1ebffb237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e2bd25bf09473c9a209cc718dec687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04d386dd-9b7f-47e8-bec7-4738cd7ea58a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Request method failure captured: Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 39 Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gx98Q4Lvkfpb2sQEsqaQk4X8hWU8sMBF1FwgVc03gf4pdjc21MfjfosHP4PIki_aN3PDhFLzSZhoQnt9VR3zioUielHLObTE_vmrYYXagxMuDBncDOtFOz3t8Tbbaq3xiftEVzlliyikbhCbINIxOL1bELrqw2HjjIhanc6gGpkZs Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:42.575950 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76e2bd25bf09473c9a209cc718dec687"}]}] Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a86f4e46084b4343b80d07e1ebffb237 Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: {"add_host": {"host": "n-h1-master-1"}} Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:42.577231 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:42.578038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 25 01:00:42.579209 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:42.584430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04d386dd-9b7f-47e8-bec7-4738cd7ea58a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:42.586441 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-04d386dd-9b7f-47e8-bec7-4738cd7ea58a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.781070 Sep 25 01:00:42.590140 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 27/45] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:00:41 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 784 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:42.598347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e17f11d-4255-4ba7-a158-e55ceaf9ccb8 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:42.604710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90621aca-1c48-44cc-b520-af0fc5c58b8b tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:42.638106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e17f11d-4255-4ba7-a158-e55ceaf9ccb8 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.046455 Sep 25 01:00:42.641500 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 28/46] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:00:42 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:42.653790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:42.656447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:42.668485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:42.669173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:42.670971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:42.672795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:42.674699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:42.676695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:42.720636 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90621aca-1c48-44cc-b520-af0fc5c58b8b tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5388 microversion: 2.1 time: 1.049043 Sep 25 01:00:42.722762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 19/47] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:41 2022] GET /compute/v2.1/flavors/detail => generated 5388 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:42.730338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fc8f0d7c-cb9a-4eb7-8908-63a908cd39b8 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:42.769198 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fc8f0d7c-cb9a-4eb7-8908-63a908cd39b8 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.044791 Sep 25 01:00:42.776903 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 20/48] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:42 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:00:42.784519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62d40cf9-ed06-4351-ac00-ae0c18b433e1 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:42.803607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d40cf9-ed06-4351-ac00-ae0c18b433e1 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:42.806446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d40cf9-ed06-4351-ac00-ae0c18b433e1 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:42.807324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d40cf9-ed06-4351-ac00-ae0c18b433e1 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:43.140838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:43.149342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-94008ec1-411d-40ab-b4ac-b5278bacc162 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1280 microversion: 2.1 time: 0.505292 Sep 25 01:00:43.169172 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 29/49] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:42 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1280 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:43.189098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99f1910f-0fdc-4cca-902b-dbd28df458ff tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:43.237623 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99f1910f-0fdc-4cca-902b-dbd28df458ff tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/21687521" status: 202 len: 0 microversion: 2.1 time: 0.064216 Sep 25 01:00:43.238321 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 30/50] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:00:43 2022] DELETE /compute/v2.1/flavors/21687521 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:43.259256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d39bae74-2098-44ec-acc8-d09cd1df1603 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-652916016"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.261149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-d39bae74-2098-44ec-acc8-d09cd1df1603 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid 0e350a7b-5863-456b-8ab0-ef6358e11056 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:43.299819 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d39bae74-2098-44ec-acc8-d09cd1df1603 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053723 Sep 25 01:00:43.300617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 31/51] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:43.323591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6c18643-bea4-4550-8df6-189cd994e7ac tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:43.371299 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6c18643-bea4-4550-8df6-189cd994e7ac tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058324 Sep 25 01:00:43.391753 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 32/52] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:43.407199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2143701505"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.427476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=122384) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 25 01:00:43.428654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:43.429317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:43.431113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:43.441869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:43.442629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:43.443524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:43.455844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2143701505 could not be found. Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 58 Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:43.458753 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: {"add_host": {"host": "tempest-nonexist_host-2143701505"}} Sep 25 01:00:43.460062 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: exception: Compute host tempest-nonexist_host-2143701505 could not be found. Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-2143701505'}}} Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2143701505' is not mapped to any cell Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.462079 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 25 01:00:43.463565 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2143701505 could not be found. Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2143701505 could not be found. Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.464714 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2143701505 could not be found. Sep 25 01:00:43.465956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.469317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2143701505 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:43.470223 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-724502e4-4de1-4039-9bd2-3f0ba3a87f89 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.076265 Sep 25 01:00:43.470813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 33/53] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:43.501079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5246a525-395b-494e-914b-d9d58ae5433d tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1381585585", "id": 1461999930, "os-flavor-access:is_public": "False"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.552760 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5246a525-395b-494e-914b-d9d58ae5433d tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.074203 Sep 25 01:00:43.555315 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 34/54] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/flavors => generated 430 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:43.568304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73961523-0a79-4897-94d2-8e1270f10b6d tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:43.614793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73961523-0a79-4897-94d2-8e1270f10b6d tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.058237 Sep 25 01:00:43.626373 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 35/55] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:43 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:00:43.641666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3423f4bf-b880-4620-8ab1-d280b7657782 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "1461999930"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.668641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3423f4bf-b880-4620-8ab1-d280b7657782 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] HTTP exception thrown: Flavor 1461999930 could not be found. Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3423f4bf-b880-4620-8ab1-d280b7657782 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] Request method failure captured: Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 107 Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gxKnZs97dK2OoO2NlvbPLPPlKRgEYLGJ5qfaT3RSXUPnZi3deZK-R4fHZSSDxplDokhsKRaNszw6zLs6bC5VAKdYxi3-fuqU3kURG6SXu0L78f-txFQCDPXAJciXlzZ9-Zds6D_-SAJv0yWoGUFjUF1qG9udnL1N4nfji1aWbciw0 Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 30785e233cce4faf935d12f26be0db4d Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsAdminTestJSON-1240293118 Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:43.677359 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30785e233cce4faf935d12f26be0db4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30785e233cce4faf935d12f26be0db4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30785e233cce4faf935d12f26be0db4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30785e233cce4faf935d12f26be0db4d"}]}] Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsAdminTestJSON-1240293118 Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 30785e233cce4faf935d12f26be0db4d Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1240293118 Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsAdminTestJSON-1240293118-project Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8fa94183119e4b1e93721001f72404c5 Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsAdminTestJSON-1240293118-project Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "test", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "1461999930"}} Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:43.678802 n-d-master-1 devstack@n-api.service[122384]: exception: Flavor 1461999930 could not be found. Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '1461999930'}}} Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1461999930 could not be found. Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.680304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1461999930 could not be found. Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.681844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.683168 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.683168 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:43.683168 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:43.683168 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1461999930 could not be found. Sep 25 01:00:43.683168 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.684440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3423f4bf-b880-4620-8ab1-d280b7657782 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] Returning 400 to user: Flavor 1461999930 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:43.685955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3423f4bf-b880-4620-8ab1-d280b7657782 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.057820 Sep 25 01:00:43.693299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 36/56] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/servers => generated 81 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:43.700176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-217ee36a-4bba-467b-974f-3fb6fcee8fe1 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-217ee36a-4bba-467b-974f-3fb6fcee8fe1 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 283 Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:43.713339 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:43.714722 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:00:43.715281 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:43.715844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.716847 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.717775 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:00:43.717775 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:00:43.717775 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:00:43.717775 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.720385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-217ee36a-4bba-467b-974f-3fb6fcee8fe1 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:43.721449 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-217ee36a-4bba-467b-974f-3fb6fcee8fe1 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.026882 Sep 25 01:00:43.722239 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 37/57] 10.222.0.16 () {60 vars in 1165 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:00:43.735321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab023fa1-1faf-4904-a84e-47ab3620d23f tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:43.761595 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab023fa1-1faf-4904-a84e-47ab3620d23f tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1461999930" status: 202 len: 0 microversion: 2.1 time: 0.031484 Sep 25 01:00:43.762585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 38/58] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:00:43 2022] DELETE /compute/v2.1/flavors/1461999930 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:43.774864 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-435c7272-fc34-4405-b212-4025db8ed7e3 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-435c7272-fc34-4405-b212-4025db8ed7e3 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 27 Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:43.781091 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: {"aggregate": {"name": ""}} Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:43.782398 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '' Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:43.783231 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:00:43.784490 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.786447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-435c7272-fc34-4405-b212-4025db8ed7e3 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:43.787958 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-435c7272-fc34-4405-b212-4025db8ed7e3 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023663 Sep 25 01:00:43.795702 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 39/59] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:00:43.801941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe2cc8f5-bef7-4b99-8629-3c1f73265631 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:43.847197 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe2cc8f5-bef7-4b99-8629-3c1f73265631 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048682 Sep 25 01:00:43.853578 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 40/60] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:43.863895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ad35149-4782-4d70-8929-49bfd9b0b631 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1711300745"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.874137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ad35149-4782-4d70-8929-49bfd9b0b631 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a86f4e46084b4343b80d07e1ebffb237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e2bd25bf09473c9a209cc718dec687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ad35149-4782-4d70-8929-49bfd9b0b631 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Request method failure captured: Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 60 Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gx98Q4Lvkfpb2sQEsqaQk4X8hWU8sMBF1FwgVc03gf4pdjc21MfjfosHP4PIki_aN3PDhFLzSZhoQnt9VR3zioUielHLObTE_vmrYYXagxMuDBncDOtFOz3t8Tbbaq3xiftEVzlliyikbhCbINIxOL1bELrqw2HjjIhanc6gGpkZs Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:43.879817 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76e2bd25bf09473c9a209cc718dec687"}]}] Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a86f4e46084b4343b80d07e1ebffb237 Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: {"aggregate": {"name": "tempest-test_aggregate-1711300745"}} Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:43.880972 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1711300745'}}} Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:43.881666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:43.883119 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 25 01:00:43.884192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:43.890414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ad35149-4782-4d70-8929-49bfd9b0b631 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:43.891628 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ad35149-4782-4d70-8929-49bfd9b0b631 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.036441 Sep 25 01:00:43.893210 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 41/61] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:43.907054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c366644f-dbd6-47ed-a9d1-a55e59dcc4d6 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-83344079", "id": 928751403, "os-flavor-access:is_public": "False"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.940600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c366644f-dbd6-47ed-a9d1-a55e59dcc4d6 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.045859 Sep 25 01:00:43.944124 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 42/62] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/flavors => generated 410 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:43.954523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c239a1c5-e19b-456c-a245-586c09b16100 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2052064362"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:43.963319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-c239a1c5-e19b-456c-a245-586c09b16100 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid b76eb1e6-a61f-4244-bd6f-af8db0592d65 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:44.007894 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c239a1c5-e19b-456c-a245-586c09b16100 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060631 Sep 25 01:00:44.010974 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 43/63] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.024256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-16b49e53-6fe9-4afe-80c0-b3d71fc764fb tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-395178571", "id": 597355166, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:44.066585 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-16b49e53-6fe9-4afe-80c0-b3d71fc764fb tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.054039 Sep 25 01:00:44.067863 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 44/64] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:44 2022] POST /compute/v2.1/flavors => generated 410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.074371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ab8c3ef-2933-4ab0-84b9-2f9091fee43f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2052064362"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:44.078840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-7ab8c3ef-2933-4ab0-84b9-2f9091fee43f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid bbf10296-c3bb-46e1-a51e-3116a24e6ebf for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:44.090772 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7ab8c3ef-2933-4ab0-84b9-2f9091fee43f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2052064362 already exists. Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ab8c3ef-2933-4ab0-84b9-2f9091fee43f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 60 Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:44.093653 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: {"aggregate": {"name": "tempest-test_aggregate-2052064362"}} Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:44.094884 n-d-master-1 devstack@n-api.service[122384]: exception: Aggregate tempest-test_aggregate-2052064362 already exists. Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2052064362'}}} Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 25 01:00:44.095661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2052064362 already exists. Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:44.097061 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2052064362 already exists. Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2052064362 already exists. Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ab8c3ef-2933-4ab0-84b9-2f9091fee43f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2052064362 already exists. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:44.098552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ab8c3ef-2933-4ab0-84b9-2f9091fee43f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.026801 Sep 25 01:00:44.099280 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 45/65] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:44 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:00:44.149895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bac8331-a005-400d-a0f5-a2cf36b82331 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.269264 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bac8331-a005-400d-a0f5-a2cf36b82331 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.171528 Sep 25 01:00:44.280274 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 46/66] 10.222.0.16 () {58 vars in 1169 bytes} [Sun Sep 25 01:00:44 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.298486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e204ff01-33dd-424c-85b2-232ed5d8d055 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.305423 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62d40cf9-ed06-4351-ac00-ae0c18b433e1 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 1.525898 Sep 25 01:00:44.311058 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 21/67] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:00:42 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.336709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.345981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:44.365442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:44.376953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:44.381579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:44.390242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:44.393190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:44.400101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:44.402245 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e204ff01-33dd-424c-85b2-232ed5d8d055 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.120361 Sep 25 01:00:44.408363 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 47/68] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:00:44.427332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0e3d855-d1e9-4bbe-bde5-29a02c489745 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.455131 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=12,nova_api:INSERT=9 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:44.496153 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0e3d855-d1e9-4bbe-bde5-29a02c489745 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.086536 Sep 25 01:00:44.498073 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 48/69] 10.222.0.16 () {58 vars in 1177 bytes} [Sun Sep 25 01:00:44 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.527786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d3e01f1-1f57-448c-90e7-593844bf002f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-230835641"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:44.548830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-4d3e01f1-1f57-448c-90e7-593844bf002f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid 9c211256-57da-4aa8-ac1e-e4dcfb6cfa15 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:44.612350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d3e01f1-1f57-448c-90e7-593844bf002f tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.109983 Sep 25 01:00:44.613013 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 49/70] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.625072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a721e80-a84d-4712-8a67-b75119324944 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.678459 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a721e80-a84d-4712-8a67-b75119324944 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.064239 Sep 25 01:00:44.678968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 50/71] 10.222.0.16 () {58 vars in 1171 bytes} [Sun Sep 25 01:00:44 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.685167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ff5644e-719d-4c68-b107-7f3e08009f3a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.699399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ff5644e-719d-4c68-b107-7f3e08009f3a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a86f4e46084b4343b80d07e1ebffb237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e2bd25bf09473c9a209cc718dec687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ff5644e-719d-4c68-b107-7f3e08009f3a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Request method failure captured: Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gx98Q4Lvkfpb2sQEsqaQk4X8hWU8sMBF1FwgVc03gf4pdjc21MfjfosHP4PIki_aN3PDhFLzSZhoQnt9VR3zioUielHLObTE_vmrYYXagxMuDBncDOtFOz3t8Tbbaq3xiftEVzlliyikbhCbINIxOL1bELrqw2HjjIhanc6gGpkZs Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:44.703665 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76e2bd25bf09473c9a209cc718dec687"}]}] Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a86f4e46084b4343b80d07e1ebffb237 Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 25 01:00:44.705034 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7'} Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:44.705749 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 25 01:00:44.706896 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:44.714976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ff5644e-719d-4c68-b107-7f3e08009f3a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:44.716092 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ff5644e-719d-4c68-b107-7f3e08009f3a tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.034647 Sep 25 01:00:44.719497 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 51/72] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:44.732528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e28783c2-412b-4002-9169-c44c3c87fdf8 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.779260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e28783c2-412b-4002-9169-c44c3c87fdf8 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.056880 Sep 25 01:00:44.782239 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 52/73] 10.222.0.16 () {58 vars in 1169 bytes} [Sun Sep 25 01:00:44 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:44.801870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e29484dc-af46-49f1-854b-a73c17b39612 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:44.863069 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e29484dc-af46-49f1-854b-a73c17b39612 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.075289 Sep 25 01:00:44.878373 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 53/74] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:44 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:00:45.231281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1330277809", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "availability_zone": "tempest-test_az-1003519675"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:45.292432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:45.296164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:45.296651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:45.300796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:45.301577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:45.301858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:45.520696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:00:45.956986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:45.984622 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63974b30-d750-4c23-b2ed-a7dc49a2db80 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.665429 Sep 25 01:00:45.991524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 22/75] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:44 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:46.006442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f8fda91-036b-4279-8b97-ba4801622c70 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.064471 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f8fda91-036b-4279-8b97-ba4801622c70 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.070527 Sep 25 01:00:46.105514 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 23/76] 10.222.0.16 () {58 vars in 1169 bytes} [Sun Sep 25 01:00:45 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:46.116490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2aa6d297-a60b-45b8-b6e3-18e6a582fa49 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.176981 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2aa6d297-a60b-45b8-b6e3-18e6a582fa49 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2aa6d297-a60b-45b8-b6e3-18e6a582fa49 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:00:46.202928 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: exception: Aggregate -1 could not be found. Sep 25 01:00:46.204571 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '-1'} Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 25 01:00:46.205520 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.206855 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.208249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.208249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.208249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:46.208249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:46.208249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 25 01:00:46.208249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.216952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2aa6d297-a60b-45b8-b6e3-18e6a582fa49 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:46.222754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2aa6d297-a60b-45b8-b6e3-18e6a582fa49 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.116077 Sep 25 01:00:46.223596 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 24/77] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:00:46 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:00:46.239295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c8e639e-7f16-49b0-8d3d-3ade9d741505 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.284191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c8e639e-7f16-49b0-8d3d-3ade9d741505 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.053769 Sep 25 01:00:46.287762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 25/78] 10.222.0.16 () {58 vars in 1175 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:46.336905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c323d0d-9861-446a-9767-efd67005aa0b tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-489128224"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:46.344489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-2c323d0d-9861-446a-9767-efd67005aa0b tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid 76be31e4-d6bb-4e14-bc54-492554d9744d for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:00:46.419570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c323d0d-9861-446a-9767-efd67005aa0b tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.130421 Sep 25 01:00:46.420659 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 26/79] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:00:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:46.427043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae9719e-ac00-417f-b22a-f9de54bb4adb tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.485308 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ae9719e-ac00-417f-b22a-f9de54bb4adb tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.063109 Sep 25 01:00:46.487110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 27/80] 10.222.0.16 () {58 vars in 1173 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:46.494430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5b460f5-b239-4b40-b91c-5caf0186f5c8 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.496171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5b460f5-b239-4b40-b91c-5caf0186f5c8 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a86f4e46084b4343b80d07e1ebffb237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e2bd25bf09473c9a209cc718dec687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5b460f5-b239-4b40-b91c-5caf0186f5c8 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Request method failure captured: Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6gx98Q4Lvkfpb2sQEsqaQk4X8hWU8sMBF1FwgVc03gf4pdjc21MfjfosHP4PIki_aN3PDhFLzSZhoQnt9VR3zioUielHLObTE_vmrYYXagxMuDBncDOtFOz3t8Tbbaq3xiftEVzlliyikbhCbINIxOL1bELrqw2HjjIhanc6gGpkZs Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:00:46.500810 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76e2bd25bf09473c9a209cc718dec687"}]}] Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a86f4e46084b4343b80d07e1ebffb237 Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 25 01:00:46.502121 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '8'} Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:46.502800 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 25 01:00:46.504250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.505159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5b460f5-b239-4b40-b91c-5caf0186f5c8 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:46.506480 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5b460f5-b239-4b40-b91c-5caf0186f5c8 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.018245 Sep 25 01:00:46.507443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 28/81] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:46.515402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d8b47c6-6b0f-4d10-996f-44f965bc02af tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.551588 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d8b47c6-6b0f-4d10-996f-44f965bc02af tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.042280 Sep 25 01:00:46.563426 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 29/82] 10.222.0.16 () {58 vars in 1169 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:46.576773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e9f4aff-57d8-49a0-b8d7-86e33af5966a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.610109 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e9f4aff-57d8-49a0-b8d7-86e33af5966a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.044620 Sep 25 01:00:46.615283 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 30/83] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:46 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:00:46.635267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc6c5245-37ce-4d3c-a986-f24d765b740c tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.687210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc6c5245-37ce-4d3c-a986-f24d765b740c tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/597355166" status: 202 len: 0 microversion: 2.1 time: 0.070070 Sep 25 01:00:46.689742 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 31/84] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:00:46 2022] DELETE /compute/v2.1/flavors/597355166 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:46.705516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5350e99c-7a2a-42d3-a7c0-ed5b0d14217e tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.742956 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5350e99c-7a2a-42d3-a7c0-ed5b0d14217e tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5350e99c-7a2a-42d3-a7c0-ed5b0d14217e tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:00:46.747613 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: exception: Aggregate -1 could not be found. Sep 25 01:00:46.749357 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '-1'} Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.750894 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 25 01:00:46.752879 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.756098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5350e99c-7a2a-42d3-a7c0-ed5b0d14217e tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:46.761703 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5350e99c-7a2a-42d3-a7c0-ed5b0d14217e tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.068789 Sep 25 01:00:46.762772 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 32/85] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:00:46.776115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc05526d-ea4b-4639-97a3-859390512e06 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.856870 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc05526d-ea4b-4639-97a3-859390512e06 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091562 Sep 25 01:00:46.876501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 33/86] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:46.897844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d035ac93-4d64-4675-adcb-00311f486342 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.900671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d035ac93-4d64-4675-adcb-00311f486342 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a86f4e46084b4343b80d07e1ebffb237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e2bd25bf09473c9a209cc718dec687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d035ac93-4d64-4675-adcb-00311f486342 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Request method failure captured: Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6gx98Q4Lvkfpb2sQEsqaQk4X8hWU8sMBF1FwgVc03gf4pdjc21MfjfosHP4PIki_aN3PDhFLzSZhoQnt9VR3zioUielHLObTE_vmrYYXagxMuDBncDOtFOz3t8Tbbaq3xiftEVzlliyikbhCbINIxOL1bELrqw2HjjIhanc6gGpkZs Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:00:46.904633 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76e2bd25bf09473c9a209cc718dec687"}]}] Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a86f4e46084b4343b80d07e1ebffb237 Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 25 01:00:46.905818 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:46.906463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 25 01:00:46.907405 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:46.910544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d035ac93-4d64-4675-adcb-00311f486342 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:46.912462 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d035ac93-4d64-4675-adcb-00311f486342 tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.034961 Sep 25 01:00:46.913285 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 34/87] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:46.929320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-abde92a4-280f-423b-9533-674d01cba936 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:46.964045 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-abde92a4-280f-423b-9533-674d01cba936 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/928751403" status: 202 len: 0 microversion: 2.1 time: 0.048576 Sep 25 01:00:46.970973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 35/88] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:00:46 2022] DELETE /compute/v2.1/flavors/928751403 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:46.982918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0aaaa901-c3d7-4b5a-8939-b7694c74924f tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.018544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0aaaa901-c3d7-4b5a-8939-b7694c74924f tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046010 Sep 25 01:00:47.020861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 36/89] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:47.031356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.032474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:47.043453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:47.044094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:47.044793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:47.045873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:47.046739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:47.047243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:47.413684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:00:47.416141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:00:47.423205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:00:47.426241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:00:47.427745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:00:47.473491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:47.475953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:47.479869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:47.482391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:47.484099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:47.485642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:47.499675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:47.508514 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d372dce0-2778-448d-af17-554b896147b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.487152 Sep 25 01:00:47.514467 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 37/90] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:47 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:47.519329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c00d509-3ebc-43d7-8fb7-a49e40d60324 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-377653803", "id": 376916281, "os-flavor-access:is_public": "False"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:47.571814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Getting quotas for project 92c7bea122934e44b7908c805f431e0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:00:47.591672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Getting quotas for user 725bbefab51841029b79a380ca8b54da and project 92c7bea122934e44b7908c805f431e0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:00:47.598806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c00d509-3ebc-43d7-8fb7-a49e40d60324 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.081672 Sep 25 01:00:47.601184 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 38/91] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:47 2022] POST /compute/v2.1/flavors => generated 411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:47.616741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-130da8e2-5c9a-4968-a0e4-4fdd5e6a98fa tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.624362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:00:47.645612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:00:47.686853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-130da8e2-5c9a-4968-a0e4-4fdd5e6a98fa tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075875 Sep 25 01:00:47.690212 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 39/92] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:00:47.714527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-afea4505-c204-4654-9845-22eee0b7e583 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.751068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-afea4505-c204-4654-9845-22eee0b7e583 tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040461 Sep 25 01:00:47.752204 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 40/93] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:00:47.777995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ede109e0-753b-49cb-9d4d-b11fe9fc56bd tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.784426 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0c1beb9c-0fa2-47d9-93fe-9906ceea4e3b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.904739 Sep 25 01:00:47.788095 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 54/94] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:00:47.805108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-358086da-e480-4878-b4bd-80b92f41f7d8 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.806038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-358086da-e480-4878-b4bd-80b92f41f7d8 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:47.891777 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ede109e0-753b-49cb-9d4d-b11fe9fc56bd tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/376916281" status: 202 len: 0 microversion: 2.1 time: 0.122944 Sep 25 01:00:47.892532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 41/95] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:00:47 2022] DELETE /compute/v2.1/flavors/376916281 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:47.903905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-347487bd-a004-48c0-bcd5-e8b4ad615efd tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:47.931287 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-347487bd-a004-48c0-bcd5-e8b4ad615efd tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032505 Sep 25 01:00:47.946793 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 42/96] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:47.953164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-09de8352-e44f-4026-84d8-6684551b0009 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1510914758", "id": 433548113, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:47.991252 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-09de8352-e44f-4026-84d8-6684551b0009 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.042060 Sep 25 01:00:48.005809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 43/97] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:47 2022] POST /compute/v2.1/flavors => generated 411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:48.023984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85da1ba9-a06b-4aa0-bd6a-f9fe90ab7ffe tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:48.033323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-358086da-e480-4878-b4bd-80b92f41f7d8 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:48.060304 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-358086da-e480-4878-b4bd-80b92f41f7d8 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1243 microversion: 2.1 time: 0.261446 Sep 25 01:00:48.061697 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 55/98] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:47 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1243 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:48.105499 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85da1ba9-a06b-4aa0-bd6a-f9fe90ab7ffe tempest-FlavorsAdminTestJSON-1240293118 tempest-FlavorsAdminTestJSON-1240293118-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.092863 Sep 25 01:00:48.106160 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 44/99] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:48 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:48.127812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b761ee7-4905-4461-b4aa-53989465e566 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:48.157730 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b761ee7-4905-4461-b4aa-53989465e566 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/433548113" status: 202 len: 0 microversion: 2.1 time: 0.032757 Sep 25 01:00:48.164754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 56/100] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:00:48 2022] DELETE /compute/v2.1/flavors/433548113 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:48.173036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9007f74-56d7-47b3-a768-44ce7b3e7184 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:48.217558 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9007f74-56d7-47b3-a768-44ce7b3e7184 tempest-FlavorsAdminTestJSON-1177480371 tempest-FlavorsAdminTestJSON-1177480371-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048324 Sep 25 01:00:48.222002 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 45/101] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:48.544760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:48.545445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:48.555612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:48.560635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:48.562201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:48.562970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:48.563436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:48.571818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:49.162659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0da75db7-7d22-476b-a62f-8395abd86487 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Calling method '.version_select at 0x7f7bf0929430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:49.615487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:49.640856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b590ec5f-6fe5-4e7e-a48c-00559c45b080 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.100335 Sep 25 01:00:49.645372 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 46/102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:48 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:49.657074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60670fc9-6ad5-47b7-a554-8ac687b7aa86 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:49.670457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60670fc9-6ad5-47b7-a554-8ac687b7aa86 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:49.705895 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:50.004467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-60670fc9-6ad5-47b7-a554-8ac687b7aa86 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:50.012552 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60670fc9-6ad5-47b7-a554-8ac687b7aa86 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1243 microversion: 2.1 time: 0.365749 Sep 25 01:00:50.017168 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 47/103] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:49 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1243 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:50.402926 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0da75db7-7d22-476b-a62f-8395abd86487 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 371 microversion: 2.1 time: 2.111573 Sep 25 01:00:50.417988 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:00:48 2022] GET /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 371 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:50.420537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf0a21af0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:50.539888 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=7 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:50.574035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.582564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.583278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.584251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.584896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.585329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.650585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef", "tag": "b667bc3d-e073-426c-8c68-3ec5f75448d8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:50.685194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb0781ca-1e08-4bf7-9059-0ac77db186fc tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 328 microversion: 2.1 time: 0.268572 Sep 25 01:00:50.686182 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 48/105] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:00:50 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:50.688670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.689800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.690741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.693437 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:50.698631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:50.736784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.744775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.753649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.756106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.756968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.760121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.770759 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Creating event network-changed:b667bc3d-e073-426c-8c68-3ec5f75448d8 for instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef on n-h2-master-1 Sep 25 01:00:50.772871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:00:50.774801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2a31c76-95f4-4ae3-87c8-cd992b6ea69f req-619221bd-a385-4047-be76-45a6405e1ba2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:00:50.781295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.782292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.782966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.785525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:50.787714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:50.791074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:50.854953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.rpcapi [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 25 01:00:50.859712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] Releasing lock "compute-rpcapi-router" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:00:50.904866 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f1882703-5231-4fac-a2d5-b713ed914643 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.430859 Sep 25 01:00:50.919453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 58/106] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:51.897658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-458204243", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:52.055231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:00:52.245125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:52.259441 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-548fe92b-6661-426c-b422-64458e340b83 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.571931 Sep 25 01:00:52.260258 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 49/107] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:50 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:52.288428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:52.291147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:52.307880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:52.308473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:52.308942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:52.319555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:52.320243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:52.320785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:52.604656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:52.621026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da54bd73-6f1d-41df-afbe-10aa76266d9e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1297 microversion: 2.1 time: 0.336773 Sep 25 01:00:52.649157 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 50/108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:52 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1297 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:53.159126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84d938b8-4cb2-4678-a624-fd23d2d4cdd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-277634125", "ram": 512, "vcpus": 1, "disk": 10, "id": 344300110, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:53.256181 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84d938b8-4cb2-4678-a624-fd23d2d4cdd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.600988 Sep 25 01:00:53.260136 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 51/109] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:52 2022] POST /compute/v2.1/flavors => generated 412 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:53.436550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:00:53.437095 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:00:53.437501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:00:53.437927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:00:53.438345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:00:53.459020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:53.468658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:53.469358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:53.472708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:53.477548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:53.481799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:53.566776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Getting quotas for project 3376ef868ee24293bb5d11ce59505667. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:00:53.582946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Getting quotas for user eb6c7e141ee847598b81de2821521ee2 and project 3376ef868ee24293bb5d11ce59505667. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:00:53.630930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.utils [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] cores quota exceeded for 3376ef868ee24293bb5d11ce59505667, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122384) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 25 01:00:53.632283 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Request method failure captured: Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 144 Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g9n6Oxle4H4UTgQRe3y9QCxReyheSsxjx9Y2PVGW7eH2vUyn5w_0GCETti3j_qXRuZBhf17xculFYBD63c_GAr10lsnKgafk0mTVjVq0TdogAQcafDUrf5iUNJfGOCSuLm6JCp4ZH7Mm7b7iD3pIR1Evk5JHFJqwJKOqaO9HEV-Dg Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:53.641323 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3376ef868ee24293bb5d11ce59505667"}]}] Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: eb6c7e141ee847598b81de2821521ee2 Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-458204243", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} Sep 25 01:00:53.642699 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-458204243', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452'}}} Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 25 01:00:53.643423 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.644467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.645692 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.646783 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.646783 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.646783 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:53.646783 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:53.646783 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 25 01:00:53.646783 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.648364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:53.649867 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-018f37e5-ba53-473f-b874-014e9abeabff tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.637347 Sep 25 01:00:53.654776 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 59/110] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:51 2022] POST /compute/v2.1/servers => generated 111 bytes in 2643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:53.663206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:53.666377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:53.684817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:53.687132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:53.687970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:53.691006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:53.692808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:53.693997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:54.020552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-574bbfdf-0ca3-47d7-abd8-110ceae0b893 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:54.096524 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-574bbfdf-0ca3-47d7-abd8-110ceae0b893 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] HTTP exception thrown: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-574bbfdf-0ca3-47d7-abd8-110ceae0b893 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Request method failure captured: Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/flavors/344300110/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hBhuhNXk53vhxN2X9k5SiXL9RXIuCnPrmOwqihrr4VIgfcu-FJj5gY9vXbAXmwxHpcPA6apphKfyNw-LnAVjPhOVlynGwyPYFLpUUB2A32SpIIOfPmszsD3RooImrkYM_lUplA7kwLTcazle3URcrVqn6jKaVI1iw19-UYlWsXq9Y Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:00:54.105583 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e229bbd4baef4f60bf5d39787b04ee8a"}]}] Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d928fb6cc5dd45a78f6b5a7bd4e3e823 Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:00:54.107494 n-d-master-1 devstack@n-api.service[122385]: exception: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: action_args: {'flavor_id': '344300110', 'id': 'hw:cpu_thread_policy'} Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.108452 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:54.110243 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.112643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-574bbfdf-0ca3-47d7-abd8-110ceae0b893 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Returning 404 to user: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:54.116122 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-574bbfdf-0ca3-47d7-abd8-110ceae0b893 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] 10.222.0.16 "GET /compute/v2.1/flavors/344300110/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.838226 Sep 25 01:00:54.125879 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 52/111] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:00:53 2022] GET /compute/v2.1/flavors/344300110/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 848 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:54.138981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:54.146614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:54.185435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:54.186291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:54.187102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:54.188672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:54.190345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:54.191016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:54.440480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:54.463262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae2ba561-ef98-4db0-a001-3f77724860bb tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1297 microversion: 2.1 time: 0.335047 Sep 25 01:00:54.485026 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 53/112] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:54 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1297 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:54.502609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf09dd790>, body: {"quota_set": {"cores": 20}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:54.715424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:54.728018 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15f096be-2d44-4433-aa90-7b0520d831b0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.068256 Sep 25 01:00:54.728664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 60/113] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:53 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:54.753039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b309cb33-30f3-44fa-9d5b-8ecab100e63f tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:54.770976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b309cb33-30f3-44fa-9d5b-8ecab100e63f tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'd928fb6cc5dd45a78f6b5a7bd4e3e823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e229bbd4baef4f60bf5d39787b04ee8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b309cb33-30f3-44fa-9d5b-8ecab100e63f tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Request method failure captured: Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/flavors/344300110/os-extra_specs HTTP/1.1 Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 66 Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hBhuhNXk53vhxN2X9k5SiXL9RXIuCnPrmOwqihrr4VIgfcu-FJj5gY9vXbAXmwxHpcPA6apphKfyNw-LnAVjPhOVlynGwyPYFLpUUB2A32SpIIOfPmszsD3RooImrkYM_lUplA7kwLTcazle3URcrVqn6jKaVI1iw19-UYlWsXq9Y Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:54.782783 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e229bbd4baef4f60bf5d39787b04ee8a"}]}] Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d928fb6cc5dd45a78f6b5a7bd4e3e823 Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 25 01:00:54.784209 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: action_args: {'flavor_id': '344300110', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:54.784956 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 25 01:00:54.786083 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.797714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b309cb33-30f3-44fa-9d5b-8ecab100e63f tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:54.809455 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b309cb33-30f3-44fa-9d5b-8ecab100e63f tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] 10.222.0.16 "POST /compute/v2.1/flavors/344300110/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.078938 Sep 25 01:00:54.814174 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 61/114] 10.222.0.16 () {60 vars in 1221 bytes} [Sun Sep 25 01:00:54 2022] POST /compute/v2.1/flavors/344300110/os-extra_specs => generated 124 bytes in 85 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:54.844431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae23271c-ab04-4115-8d19-2988e9b3f072 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:54.931470 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae23271c-ab04-4115-8d19-2988e9b3f072 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/344300110/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.110466 Sep 25 01:00:54.934894 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 62/115] 10.222.0.16 () {60 vars in 1221 bytes} [Sun Sep 25 01:00:54 2022] POST /compute/v2.1/flavors/344300110/os-extra_specs => generated 66 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:00:54.950470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdbe9f1e-f8bb-4aa2-926d-e6faa7b67332 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:54.955416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bdbe9f1e-f8bb-4aa2-926d-e6faa7b67332 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'd928fb6cc5dd45a78f6b5a7bd4e3e823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e229bbd4baef4f60bf5d39787b04ee8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdbe9f1e-f8bb-4aa2-926d-e6faa7b67332 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Request method failure captured: Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hBhuhNXk53vhxN2X9k5SiXL9RXIuCnPrmOwqihrr4VIgfcu-FJj5gY9vXbAXmwxHpcPA6apphKfyNw-LnAVjPhOVlynGwyPYFLpUUB2A32SpIIOfPmszsD3RooImrkYM_lUplA7kwLTcazle3URcrVqn6jKaVI1iw19-UYlWsXq9Y Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:54.959329 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e229bbd4baef4f60bf5d39787b04ee8a"}]}] Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d928fb6cc5dd45a78f6b5a7bd4e3e823 Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:54.961224 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: action_args: {'flavor_id': '344300110', 'id': 'hw:numa_nodes'} Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:54.962067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 25 01:00:54.963453 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.967381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdbe9f1e-f8bb-4aa2-926d-e6faa7b67332 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:54.968720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bdbe9f1e-f8bb-4aa2-926d-e6faa7b67332 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022473 Sep 25 01:00:54.970534 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 63/116] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:54 2022] DELETE /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:55.004126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7338bd29-d3f3-458f-8256-40016972b748 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:55.121810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:55.123179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:55.127120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:55.132754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7338bd29-d3f3-458f-8256-40016972b748 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/344300110/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.148930 Sep 25 01:00:55.133374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:55.135109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:55.135908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:55.139667 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 64/117] 10.222.0.16 () {60 vars in 1221 bytes} [Sun Sep 25 01:00:54 2022] POST /compute/v2.1/flavors/344300110/os-extra_specs => generated 66 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:00:55.153927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a761bf96-500c-4fe4-b1c4-e1aed8203091 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:55.165212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a761bf96-500c-4fe4-b1c4-e1aed8203091 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'd928fb6cc5dd45a78f6b5a7bd4e3e823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e229bbd4baef4f60bf5d39787b04ee8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a761bf96-500c-4fe4-b1c4-e1aed8203091 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Request method failure captured: Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 22 Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hBhuhNXk53vhxN2X9k5SiXL9RXIuCnPrmOwqihrr4VIgfcu-FJj5gY9vXbAXmwxHpcPA6apphKfyNw-LnAVjPhOVlynGwyPYFLpUUB2A32SpIIOfPmszsD3RooImrkYM_lUplA7kwLTcazle3URcrVqn6jKaVI1iw19-UYlWsXq9Y Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:00:55.167889 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e229bbd4baef4f60bf5d39787b04ee8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e229bbd4baef4f60bf5d39787b04ee8a"}]}] Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e229bbd4baef4f60bf5d39787b04ee8a Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d928fb6cc5dd45a78f6b5a7bd4e3e823 Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: {"hw:numa_nodes": "1"} Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:55.169216 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: action_args: {'flavor_id': '344300110', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:00:55.170120 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 25 01:00:55.171122 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.178032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a761bf96-500c-4fe4-b1c4-e1aed8203091 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:55.181143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a761bf96-500c-4fe4-b1c4-e1aed8203091 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338 tempest-FlavorsExtraSpecsNegativeTestJSON-469081338-project] 10.222.0.16 "PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.030175 Sep 25 01:00:55.182744 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 65/118] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:00:55 2022] PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:55.207076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ca1ad3-3836-41a2-afca-fd9e74c5a81d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:55.250629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-67ca1ad3-3836-41a2-afca-fd9e74c5a81d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] HTTP exception thrown: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ca1ad3-3836-41a2-afca-fd9e74c5a81d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Request method failure captured: Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/flavors/344300110/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hDJpNAVgRloy_uAz129fechu9BN8E4qo2mDrLYcH4FDCmUhVki44bgWCzKJiGSosFa94YwpAIJU2yp896gAirz6ZAo2AFcuIbh2Grf4RyI83yg5KFm6EzvpL8BzuN9jn-i-VkZhL0td22KgFjVMU0ZKWKaDQIbERhuDGy1L52pkC0 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7d695f9d4a0e4dd3980de606cbd33530 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:55.256084 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d695f9d4a0e4dd3980de606cbd33530"}]}] Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7d695f9d4a0e4dd3980de606cbd33530 Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 26e0092d2dfd4ae698aa8fb9ac07a840 Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:55.257945 n-d-master-1 devstack@n-api.service[122384]: exception: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: action_args: {'flavor_id': '344300110', 'id': 'hw:cpu_thread_policy'} Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:55.258541 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. Sep 25 01:00:55.259726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.263281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ca1ad3-3836-41a2-afca-fd9e74c5a81d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Returning 404 to user: Flavor 344300110 has no extra specs with key hw:cpu_thread_policy. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:55.267409 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67ca1ad3-3836-41a2-afca-fd9e74c5a81d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/344300110/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.076837 Sep 25 01:00:55.275912 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 66/119] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:00:55 2022] DELETE /compute/v2.1/flavors/344300110/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:55.292260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a586b8a8-0367-4800-bd07-4658bae09813 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:55.297236 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d63606cf-a42a-42ae-b764-ca7622d5d7d6 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 329 microversion: 2.1 time: 0.810041 Sep 25 01:00:55.299960 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 54/120] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:00:54 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 329 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:55.316916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad34789e-7775-442b-8185-c52cf1eb9235 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Calling method '.version_select at 0x7f7bf0a68b80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:55.331471 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a586b8a8-0367-4800-bd07-4658bae09813 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a586b8a8-0367-4800-bd07-4658bae09813 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Request method failure captured: Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 27 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hDJpNAVgRloy_uAz129fechu9BN8E4qo2mDrLYcH4FDCmUhVki44bgWCzKJiGSosFa94YwpAIJU2yp896gAirz6ZAo2AFcuIbh2Grf4RyI83yg5KFm6EzvpL8BzuN9jn-i-VkZhL0td22KgFjVMU0ZKWKaDQIbERhuDGy1L52pkC0 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7d695f9d4a0e4dd3980de606cbd33530 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:55.333060 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d695f9d4a0e4dd3980de606cbd33530"}]}] Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7d695f9d4a0e4dd3980de606cbd33530 Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 26e0092d2dfd4ae698aa8fb9ac07a840 Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: {"hw:cpu_policy": "shared"} Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:55.334719 n-d-master-1 devstack@n-api.service[122384]: exception: Request body and URI mismatch Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: action_args: {'flavor_id': '344300110', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.336183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.339142 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:55.339142 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:55.339142 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 25 01:00:55.339142 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.339142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a586b8a8-0367-4800-bd07-4658bae09813 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:55.339142 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a586b8a8-0367-4800-bd07-4658bae09813 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.058547 Sep 25 01:00:55.345192 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 67/121] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:00:55 2022] PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes => generated 73 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:00:55.368250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78650258-9f42-4b3d-9bf4-0a65f3cd2d6d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78650258-9f42-4b3d-9bf4-0a65f3cd2d6d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Request method failure captured: Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 49 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hDJpNAVgRloy_uAz129fechu9BN8E4qo2mDrLYcH4FDCmUhVki44bgWCzKJiGSosFa94YwpAIJU2yp896gAirz6ZAo2AFcuIbh2Grf4RyI83yg5KFm6EzvpL8BzuN9jn-i-VkZhL0td22KgFjVMU0ZKWKaDQIbERhuDGy1L52pkC0 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7d695f9d4a0e4dd3980de606cbd33530 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:00:55.391587 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d695f9d4a0e4dd3980de606cbd33530"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d695f9d4a0e4dd3980de606cbd33530"}]}] Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7d695f9d4a0e4dd3980de606cbd33530 Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 26e0092d2dfd4ae698aa8fb9ac07a840 Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 25 01:00:55.393025 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: action_args: {'flavor_id': '344300110', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance: Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 25 01:00:55.397076 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.399478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:55.401548 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:55.401548 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:55.401548 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:00:55.401548 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:00:55.401548 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 25 01:00:55.401548 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:00:55.409974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78650258-9f42-4b3d-9bf4-0a65f3cd2d6d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:55.414779 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-78650258-9f42-4b3d-9bf4-0a65f3cd2d6d tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.065971 Sep 25 01:00:55.424419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 68/122] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:00:55 2022] PUT /compute/v2.1/flavors/344300110/os-extra_specs/hw:numa_nodes => generated 117 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:00:55.441096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38a563e9-94b1-4eaf-b9eb-4a72147501cb tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:55.484081 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38a563e9-94b1-4eaf-b9eb-4a72147501cb tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/344300110" status: 202 len: 0 microversion: 2.1 time: 0.055658 Sep 25 01:00:55.489489 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 69/123] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:00:55 2022] DELETE /compute/v2.1/flavors/344300110 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:55.496221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-309956e8-fa72-453c-a63f-2ce4c9cbda80 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:55.566881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-309956e8-fa72-453c-a63f-2ce4c9cbda80 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337 tempest-FlavorsExtraSpecsNegativeTestJSON-1819305337-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073222 Sep 25 01:00:55.567707 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 70/124] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:00:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:55.608704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:55.609336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:55.622122 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:55.625440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:55.626010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:55.626468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:55.627611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:55.628081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:55.628511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:55.892120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad34789e-7775-442b-8185-c52cf1eb9235 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 371 microversion: 2.1 time: 0.581465 Sep 25 01:00:55.898382 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 55/125] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:00:55 2022] GET /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:55.910219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:55.914588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:55.924252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:55.925992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:55.926636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:55.927553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:55.928146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:55.928709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:56.602640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:56.615769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e7b785bc-1176-423c-8dc9-f8911cf8b229 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 1.015359 Sep 25 01:00:56.630515 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 71/126] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:55 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:56.648206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf0869820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:56.659702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:56.673216 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-34f32355-a016-402c-a865-25d02ceac31f tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.771251 Sep 25 01:00:56.676877 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 56/127] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:55 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:57.644108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:57.644787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:57.665617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:57.666455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:57.667137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:57.669705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:57.670591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:57.672200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:58.057906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:58.059700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:58.067172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:58.072685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:58.075781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:58.078782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:58.264536 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:58.278037 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-99bab01f-f931-4985-939d-df087bd2b06d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.637775 Sep 25 01:00:58.279079 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 57/128] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:57 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:00:58.295455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:58.296588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:58.310434 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2399f11-89b7-44b5-9a1d-e241139fe389 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 328 microversion: 2.1 time: 1.677547 Sep 25 01:00:58.311437 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 72/129] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:00:56 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 328 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:58.311816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:58.324055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:58.324946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:58.326075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:58.327887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:58.331178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:58.803698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1264335795", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:59.449201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:00:59.514429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5c331f8-6391-4fc2-b01f-562b9bd8cc60 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.229157 Sep 25 01:00:59.533432 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 58/130] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:58 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:59.549961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:59.551198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:00:59.582600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:59.586713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:59.590698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:59.595968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:59.597357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:59.603862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:00.656191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:00.687752 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0fc2b39-eabf-439b-804e-4f2985fe08fc tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 1.163725 Sep 25 01:01:00.696393 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 59/131] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:00:59 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:00.738282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:00.741042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:00.764534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:00.765669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:00.768545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:00.774176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:00.776716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:00.779082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:01.431784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:01.465450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6eecc202-dce8-4be0-b779-ed8db79b3461 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.766967 Sep 25 01:01:01.470300 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 60/132] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:00 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:01.718337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:01.719368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:01.733733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:01.737435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:01.740422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:01.746162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:01.747076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:01.749070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:02.233689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:02.246786 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e760fcfa-dce6-43f5-b52e-92f1eef23755 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.532606 Sep 25 01:01:02.261864 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 61/133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:01 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:03.274190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba5f37a0-5605-41fe-ba5f-3f19280d25fd tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1254193680", "id": 1753823303, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:03.343204 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba5f37a0-5605-41fe-ba5f-3f19280d25fd tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.927182 Sep 25 01:01:03.346880 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 62/134] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:01:02 2022] POST /compute/v2.1/flavors => generated 471 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:01:03.359891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:03.360542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:03.395404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:03.395917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:03.396363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:03.400438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:03.400874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:03.401259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:03.444107 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:04.111210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:04.525495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:04.550810 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-94772bfc-9c44-4e4b-b304-f78b920bc2a9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.202406 Sep 25 01:01:04.555847 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 63/135] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:03 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:04.564210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787cab23-8c9f-4900-9d3d-f0560c55ebdb", "tag": "92d07b9d-caf3-4f7a-9d7f-b648f09b9308"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:04.606770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:04.607579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:04.608434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:04.690194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Creating event network-changed:92d07b9d-caf3-4f7a-9d7f-b648f09b9308 for instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb on n-h1-master-1 Sep 25 01:01:04.691835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:01:04.706625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ab62b338-d370-4bc9-af75-7baa95e3ba7f req-7237fb39-9fd0-4c42-a207-41cdb4b507b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:01:04.709806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:04.721358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:04.722808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:04.724551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:04.726329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:04.727504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:04.771193 n-d-master-1 devstack@n-api.service[122385]: INFO nova.compute.rpcapi [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 25 01:01:04.773384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] Releasing lock "compute-rpcapi-router" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:01:04.881590 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2836c07f-7fa0-4763-b9fb-77925aa68996 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323644 Sep 25 01:01:04.888797 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 64/136] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:04.951871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:04.956459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:04.986251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:05.004100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:05.005242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:05.007155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:05.008025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:05.008898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:05.655044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:05.655612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:05.661586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:05.662271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:05.662942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:05.694005 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=33 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:05.705190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:05.714981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:05.719467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:05.722735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:05.729692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:05.733236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:05.807112 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=23 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:05.810078 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=67 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:05.853671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:05.868432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8532d199-9eac-4610-9541-c92165b974e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.977071 Sep 25 01:01:05.869046 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 65/137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:04 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:05.888369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ed3aa7b-aa1a-4f05-b825-5f715172878e tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:05.934130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Getting quotas for project 3376ef868ee24293bb5d11ce59505667. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:05.973719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Getting quotas for user eb6c7e141ee847598b81de2821521ee2 and project 3376ef868ee24293bb5d11ce59505667. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:06.074400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.utils [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] instances quota exceeded for 3376ef868ee24293bb5d11ce59505667, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122384) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 25 01:01:06.078681 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Request method failure captured: Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 145 Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g9n6Oxle4H4UTgQRe3y9QCxReyheSsxjx9Y2PVGW7eH2vUyn5w_0GCETti3j_qXRuZBhf17xculFYBD63c_GAr10lsnKgafk0mTVjVq0TdogAQcafDUrf5iUNJfGOCSuLm6JCp4ZH7Mm7b7iD3pIR1Evk5JHFJqwJKOqaO9HEV-Dg Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:06.095207 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3376ef868ee24293bb5d11ce59505667"}]}] Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: eb6c7e141ee847598b81de2821521ee2 Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1264335795", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} Sep 25 01:01:06.098061 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1264335795', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452'}}} Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 25 01:01:06.099542 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:06.102716 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.105234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:06.107943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:06.107943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:06.107943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:06.107943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:06.107943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 25 01:01:06.107943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:06.110638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:06.113022 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9334cafe-25aa-4703-a90b-27886cd7c393 tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 7.320350 Sep 25 01:01:06.114799 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 73/138] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:58 2022] POST /compute/v2.1/servers => generated 119 bytes in 7324 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:01:06.125128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:06.126614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:06.157223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:06.158597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:06.159568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:06.160945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:06.167148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:06.168366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:06.605995 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=46 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:06.740388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2ed3aa7b-aa1a-4f05-b825-5f715172878e tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1753823303/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.856381 Sep 25 01:01:06.743320 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 66/139] 10.222.0.16 () {62 vars in 1265 bytes} [Sun Sep 25 01:01:05 2022] POST /compute/v2.1/flavors/1753823303/os-extra_specs => generated 62 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:06.777248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf098caf0>, body: {"quota_set": {"instances": 10}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:06.866921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:06.887989 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9872087e-6da5-4dc4-ac77-9f751d60f923 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.768132 Sep 25 01:01:06.909553 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 74/140] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:06 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:07.198142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.198914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.199248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.200489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.202449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.203093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.338986 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8550b63b-55fb-4f4b-8316-7cc31f8786ba tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 329 microversion: 2.1 time: 0.587814 Sep 25 01:01:07.344387 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 67/141] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:01:06 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 329 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:07.349828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-370d3742-e9fa-4ea2-9623-34bd8103b38a tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.373902 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:07.401891 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-370d3742-e9fa-4ea2-9623-34bd8103b38a tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1753823303" status: 202 len: 0 microversion: 2.86 time: 0.055671 Sep 25 01:01:07.407920 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 68/142] 10.222.0.16 () {60 vars in 1202 bytes} [Sun Sep 25 01:01:07 2022] DELETE /compute/v2.1/flavors/1753823303 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:01:07.416502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.420252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:07.427814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf06dc550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.429842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.430383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.431015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.438587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.441689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.443417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.446534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.447013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.447644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.517376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.524591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.525265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.562346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.563611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.564638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.587262 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f051ecec-d03c-4879-b1e0-56739130703f tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.673398 Sep 25 01:01:07.589281 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 75/143] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:01:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:07.602993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3cc40580-e8a8-4455-bc27-092f8dbb7f72 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Calling method '.version_select at 0x7f7bf06dcc10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.772183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:07.784201 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c8f8e2a-86d3-4ec1-a685-09d4a8b1f75d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.372068 Sep 25 01:01:07.784201 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 69/144] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:07.793039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0516ba6c-5fbd-4bfb-bdc4-e7f749fe49c7 tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.816648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0516ba6c-5fbd-4bfb-bdc4-e7f749fe49c7 tempest-FlavorMetadataValidation-1094737590 tempest-FlavorMetadataValidation-1094737590-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.033419 Sep 25 01:01:07.834284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 70/145] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:07.840137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf0a68e50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.842033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.842533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.842973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.862443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.864526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.866929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.882540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.883087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.883718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.890746 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63acf20a-636f-411d-bec7-dad705ee1da9 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.055279 Sep 25 01:01:07.891345 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 71/146] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:07.909607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf0a255e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.911488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.911973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.912415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.927462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.927958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.928586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.940751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.941326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.941974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.949299 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ecbfec3b-bf40-4b48-acf9-debbf6cd3ebe tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044195 Sep 25 01:01:07.950537 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 72/147] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:07.958030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.958030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:07.963914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.964377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.964973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.965591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.966360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.966722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.112988 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3cc40580-e8a8-4455-bc27-092f8dbb7f72 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 371 microversion: 2.1 time: 0.519616 Sep 25 01:01:08.116905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 76/148] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.146618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf06e2a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.162358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.163929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.164766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.270324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.272885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.273609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.290989 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dcf8a71d-88bf-46e8-8a22-99ffddbf6367 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.167376 Sep 25 01:01:08.294134 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 77/149] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.302359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf06e2ca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:08.416601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:08.416601 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cbfb9110-de64-454f-8b40-73894d600f20 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.462971 Sep 25 01:01:08.440094 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 73/150] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:08.452995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec706382-f41b-4ba9-98bc-e9eba25e1d69 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf09ddf70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.455297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec706382-f41b-4ba9-98bc-e9eba25e1d69 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.461178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec706382-f41b-4ba9-98bc-e9eba25e1d69 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.462140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec706382-f41b-4ba9-98bc-e9eba25e1d69 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.496853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec706382-f41b-4ba9-98bc-e9eba25e1d69 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055129 Sep 25 01:01:08.501799 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 74/151] 10.222.0.16 () {58 vars in 1179 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.520023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf09dd550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.522433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.523739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.524196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.559465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.559880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.560307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.579733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.580711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.581588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.590383 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-995ee035-fda2-4e6c-b7a3-035d2af9643d tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074042 Sep 25 01:01:08.591856 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 75/152] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.602912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf0a68d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.609457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.612211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.613019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.639013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.639776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.640399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.649579 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0350af4c-d468-4125-821c-158d77b0026b tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.050727 Sep 25 01:01:08.650836 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.665290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf0a68b80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.670319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.670746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.671195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.688867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.689362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.689857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.703234 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b6d8125e-a75a-4e43-a022-b6427b7cf1dc tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.041995 Sep 25 01:01:08.704132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 77/154] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.719462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Calling method '.version_select at 0x7f7bf0a68ca0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.721917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.722417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.722681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.722858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.723529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.723656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.724072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.724504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.724719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.739068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.739962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.740672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.755754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.756564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.757448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.793393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c93dff74-cd9b-4221-9d44-59ed09f4bbb1 tempest-HypervisorAdminTestJSON-1192039449 tempest-HypervisorAdminTestJSON-1192039449-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.076533 Sep 25 01:01:08.805255 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 78/155] 10.222.0.16 () {58 vars in 1173 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:08.827453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.831666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:08.866062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.871402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.873515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.876652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.880277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.883419 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ff0b25b-caec-49dc-a2cd-4da9ab451600 tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 325 microversion: 2.1 time: 0.587448 Sep 25 01:01:08.885911 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 78/156] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:01:08 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 325 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:08.887262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.215046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:09.234785 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6da52072-2ddf-4b4f-ba19-bc3a67761365 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.427569 Sep 25 01:01:09.235735 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 79/157] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:09.350820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-289618933", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:09.445911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:09.450208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:09.484093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:09.485244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:09.485995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.487117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:09.487828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:09.489978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.520045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:09.952022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:09.979905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e096dec6-2c22-463c-8202-37f5346eb7e9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.543455 Sep 25 01:01:09.981958 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:09 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:10.169169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:10.169169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:10.169169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:10.169169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:10.169675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:10.182086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:10.182692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:10.192874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:10.192874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:10.192874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:10.192874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:10.207430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Getting quotas for project 3376ef868ee24293bb5d11ce59505667. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:10.212160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Getting quotas for user eb6c7e141ee847598b81de2821521ee2 and project 3376ef868ee24293bb5d11ce59505667. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:10.232147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.utils [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] ram quota exceeded for 3376ef868ee24293bb5d11ce59505667, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122384) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 25 01:01:10.233007 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Request method failure captured: Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 144 Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g9n6Oxle4H4UTgQRe3y9QCxReyheSsxjx9Y2PVGW7eH2vUyn5w_0GCETti3j_qXRuZBhf17xculFYBD63c_GAr10lsnKgafk0mTVjVq0TdogAQcafDUrf5iUNJfGOCSuLm6JCp4ZH7Mm7b7iD3pIR1Evk5JHFJqwJKOqaO9HEV-Dg Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:10.236678 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3376ef868ee24293bb5d11ce59505667"}]}] Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: eb6c7e141ee847598b81de2821521ee2 Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-289618933", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} Sep 25 01:01:10.239076 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-289618933', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452'}}} Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 25 01:01:10.240357 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:10.245415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.250319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:10.254023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:10.256419 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4dafb47f-0b38-4b24-b77d-06470ee06c1d tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.916815 Sep 25 01:01:10.258406 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 79/159] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 920 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:01:10.265446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:10.266596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:10.275710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:10.277199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:10.277918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:10.278889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:10.279677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:10.281259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:10.620918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:10.636315 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7c982c1-7f48-46a4-b850-2d827ebce983 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.375306 Sep 25 01:01:10.638000 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 80/160] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:10 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:10.665804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf08e3a60>, body: {"quota_set": {"ram": 51200}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:10.914346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0af5afff-b3ed-4a39-a1cd-374fd772f9af tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:10.938544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0af5afff-b3ed-4a39-a1cd-374fd772f9af tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.706016 Sep 25 01:01:10.943299 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 81/161] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:01:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:11.759460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:11.760867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:11.761494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:11.762403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:11.763147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:11.763925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:11.892346 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-536b8603-f9ba-4492-88db-8e2f8e966e6a tempest-QuotasAdminNegativeTest-456692786 tempest-QuotasAdminNegativeTest-456692786-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 200 len: 329 microversion: 2.1 time: 1.252556 Sep 25 01:01:11.894333 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 81/162] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:01:10 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 329 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:11.901894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:11.902750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:11.911148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:11.912096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:11.912978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:11.914653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:11.915278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:11.915866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:11.918559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a689b718-7e48-479c-9f86-2112ccb9da3b tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-477005912", "id": 1437912271, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:12.019045 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a689b718-7e48-479c-9f86-2112ccb9da3b tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.070149 Sep 25 01:01:12.020495 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 82/163] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:10 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:12.172651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:12.183379 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f64d2f2a-57a7-4763-9865-e6b493809626 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.287656 Sep 25 01:01:12.184145 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 82/164] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:11 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:12.189652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:12.190296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:12.197289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:12.197823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:12.198429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:12.199290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:12.199915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:12.200490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:12.254739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1603934601", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:12.373434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:12.749166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:12.778927 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-910a53d0-5ad1-4754-a1b5-51bc417506e4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.592691 Sep 25 01:01:12.797304 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 83/165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:12 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:12.800236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d51492da-fd1f-487d-9f14-6cfd7256e39a tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Action: 'update', calling method: .version_select at 0x7f7bf06e29d0>, body: {"quota_set": {"ram": 0}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:12.806537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d51492da-fd1f-487d-9f14-6cfd7256e39a tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'eb6c7e141ee847598b81de2821521ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3376ef868ee24293bb5d11ce59505667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d51492da-fd1f-487d-9f14-6cfd7256e39a tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Request method failure captured: Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 HTTP/1.1 Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 25 Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g9n6Oxle4H4UTgQRe3y9QCxReyheSsxjx9Y2PVGW7eH2vUyn5w_0GCETti3j_qXRuZBhf17xculFYBD63c_GAr10lsnKgafk0mTVjVq0TdogAQcafDUrf5iUNJfGOCSuLm6JCp4ZH7Mm7b7iD3pIR1Evk5JHFJqwJKOqaO9HEV-Dg Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:12.808038 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3376ef868ee24293bb5d11ce59505667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3376ef868ee24293bb5d11ce59505667"}]}] Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3376ef868ee24293bb5d11ce59505667 Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-676489888 Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: eb6c7e141ee847598b81de2821521ee2 Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-QuotasAdminNegativeTest-676489888-project Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: {"quota_set": {"ram": 0}} Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 25 01:01:12.809238 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3376ef868ee24293bb5d11ce59505667', 'body': {'quota_set': {'ram': 0}}} Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:12.810554 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:12.812414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d51492da-fd1f-487d-9f14-6cfd7256e39a tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:12.813581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d51492da-fd1f-487d-9f14-6cfd7256e39a tempest-QuotasAdminNegativeTest-676489888 tempest-QuotasAdminNegativeTest-676489888-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667" status: 403 len: 116 microversion: 2.1 time: 0.015034 Sep 25 01:01:12.815726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 84/166] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:01:12 2022] PUT /compute/v2.1/os-quota-sets/3376ef868ee24293bb5d11ce59505667 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:12.821226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-852cafae-df6e-47d7-a199-bf2f283979b8 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:12.831751 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-852cafae-df6e-47d7-a199-bf2f283979b8 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015722 Sep 25 01:01:12.832340 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 85/167] 10.222.0.16 () {58 vars in 1182 bytes} [Sun Sep 25 01:01:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:12.851679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d927fed6-5ada-4543-9b63-54d09bdfca74 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-802980196", "id": 640328424, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:12.887219 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d927fed6-5ada-4543-9b63-54d09bdfca74 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.043258 Sep 25 01:01:12.888024 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 86/168] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:12 2022] POST /compute/v2.1/flavors => generated 421 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:12.901591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc466054-a8d1-4a7b-8aee-d587f7b05567 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:12.910517 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc466054-a8d1-4a7b-8aee-d587f7b05567 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013015 Sep 25 01:01:12.920229 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 87/169] 10.222.0.16 () {58 vars in 1182 bytes} [Sun Sep 25 01:01:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:12.926494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-49e95458-aa20-497b-968a-47152e364e56 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Action: 'create', calling method: .version_select at 0x7f7bf06e24c0>, body: {"keypair": {"name": "tempest-keypair-1102063023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8GxLK/CNr7R3mJEwnbPhz4Gp8bL/LQ+tUx4flCxFPxOgIWMTdeBIYt9qZd0+cjpaZYmTvHqxgcuZrY9XCiuUWB0s17dcz446VYyQANXcdDz4HghLci5vUT/kLv+UYcRQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:12.937542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:12.938844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:12.940058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:12.940786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:12.941554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:12.954934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:12.955422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:12.955866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:12.956597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:12.957047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:12.957496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:12.976375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-49e95458-aa20-497b-968a-47152e364e56 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Getting quotas for project fbd08c233d6944199beebf1a2e1a1a23. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:12.977709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Getting quotas for project 66b3353b3fbc4f97a0387a6c40e4fb15. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:12.980454 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:12.982737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Getting quotas for user 2eddf0cd4fb54de2ab7f26843380a1be and project 66b3353b3fbc4f97a0387a6c40e4fb15. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:12.988031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-49e95458-aa20-497b-968a-47152e364e56 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Getting quotas for user 98ed412afded46c49d993a2749e42c65 and project fbd08c233d6944199beebf1a2e1a1a23. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:12.996900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:13.000276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:13.049866 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-49e95458-aa20-497b-968a-47152e364e56 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127075 Sep 25 01:01:13.050490 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 88/170] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:01:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:13.065302 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d87b9b5-2772-4560-8721-a32e698d2587 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042257 Sep 25 01:01:13.068064 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 83/171] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:13.211193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:13.212166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:13.230007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.231825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.232838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.235478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.236946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.240859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.328448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-577027968", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:13.422034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:13.607571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:13.619327 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87dbd386-f9b4-4f64-9c60-42739821af40 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.412694 Sep 25 01:01:13.619849 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 89/172] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:13 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:13.821622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:13.823432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:13.842738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.844811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.846802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.848689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:13.849119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:13.849847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:13.850230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.851189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:13.851972 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:13.852977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.853810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.871950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.872866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.875378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.876557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.877986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.880831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.928414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Getting quotas for project 66b3353b3fbc4f97a0387a6c40e4fb15. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:13.940020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Getting quotas for user 2eddf0cd4fb54de2ab7f26843380a1be and project 66b3353b3fbc4f97a0387a6c40e4fb15. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:13.978224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:13.980799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:14.084335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aedf10c3-a8b7-431f-933b-26d522c212a6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757073 Sep 25 01:01:14.087298 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 84/173] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:14.113248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-041a8713-3912-4c8b-afda-e050cdcc1463 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:14.122345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-041a8713-3912-4c8b-afda-e050cdcc1463 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:14.268604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-041a8713-3912-4c8b-afda-e050cdcc1463 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:14.288801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-041a8713-3912-4c8b-afda-e050cdcc1463 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1213 microversion: 2.1 time: 0.188538 Sep 25 01:01:14.291796 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 85/174] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:14 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1213 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:14.313462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:14.323516 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e82f0836-b27e-4918-a9c2-42c0f49cfdd5 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.522670 Sep 25 01:01:14.324104 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 90/175] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:13 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:14.645297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:14.645952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:14.661372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:14.664506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:14.665283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:14.668854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:14.669678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:14.670305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:14.971019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:14.984373 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-514dc106-4700-4822-8784-130d57010cea tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.344388 Sep 25 01:01:14.984970 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 86/176] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:14 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:15.328592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:15.329887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:15.348219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:15.349109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:15.355394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:15.371625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:15.371860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:15.373601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:15.374529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:15.376183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:15.378399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:15.379482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:15.380034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:15.400006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:15.403112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:15.410014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.060658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:16.070776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b464bf44-a016-4443-956f-1cbfd6e27696 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1209 microversion: 2.1 time: 0.746408 Sep 25 01:01:16.083829 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 91/177] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:15 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1209 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:16.099245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:16.099984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:16.113020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:16.135568 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-39859157-a7e5-4842-a4e2-b9d1402cb7df tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.791213 Sep 25 01:01:16.136200 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 87/178] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:15 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:16.151304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.154481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.157240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.161202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.162290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.164517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.010219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6227cd62-a424-4925-9c31-18b923c6ba9d req-991ec704-a8c0-434d-b208-c2e5563bd718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef", "name": "network-vif-plugged", "status": "completed", "tag": "b667bc3d-e073-426c-8c68-3ec5f75448d8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:17.034826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6227cd62-a424-4925-9c31-18b923c6ba9d req-991ec704-a8c0-434d-b208-c2e5563bd718 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.035698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6227cd62-a424-4925-9c31-18b923c6ba9d req-991ec704-a8c0-434d-b208-c2e5563bd718 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.036365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6227cd62-a424-4925-9c31-18b923c6ba9d req-991ec704-a8c0-434d-b208-c2e5563bd718 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.057878 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6227cd62-a424-4925-9c31-18b923c6ba9d req-991ec704-a8c0-434d-b208-c2e5563bd718 service nova] Creating event network-vif-plugged:b667bc3d-e073-426c-8c68-3ec5f75448d8 for instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef on n-h2-master-1 Sep 25 01:01:17.066017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6227cd62-a424-4925-9c31-18b923c6ba9d req-991ec704-a8c0-434d-b208-c2e5563bd718 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.829686 Sep 25 01:01:17.067254 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 88/179] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:17.135852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:17.146589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b80246ae-4d5c-4d73-bf80-54f35903214d tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 1.061567 Sep 25 01:01:17.147165 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 92/180] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:16 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:17.343472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-87bdd084-6e97-4459-9ce3-ecfb3707d5b7 tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1359175773", "id": 1969535469, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:17.379340 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-87bdd084-6e97-4459-9ce3-ecfb3707d5b7 tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.310704 Sep 25 01:01:17.379527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Calling method '.version_select at 0x7f7bf06e2b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:17.380724 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 89/181] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:01:17 2022] POST /compute/v2.1/flavors => generated 468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:17.381315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.382364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.383084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.387837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:17.389565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:17.397725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.398527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.399617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.400561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.401265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.401921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.450562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.451293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.455206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.481075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.482083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.482745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.490640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e70a362-1d41-47d9-8973-4bc289fd0683 tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.342104 Sep 25 01:01:17.492046 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 93/182] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:17.497639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:17.499942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:17.529377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.530336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.535824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.537202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.538246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.539997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.679958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:17.693206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b211e12-abc9-43bc-b2f5-b459198fd6c5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1271 microversion: 2.1 time: 0.310393 Sep 25 01:01:17.694113 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 90/183] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:17 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:17.711731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-857319359", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "640328424", "adminPass": "***", "networks": [{"uuid": "05b8edd7-0d55-4cc2-95d1-062ba1456fe1"}], "security_groups": [{"name": "tempest-securitygroup--893337408"}], "key_name": "tempest-keypair-1102063023", "user_data": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:18.165712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] validate_networks() for [('05b8edd7-0d55-4cc2-95d1-062ba1456fe1', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:18.319230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:18.327274 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43cc6777-e818-44b2-b4bd-c1c107506ff4 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.833970 Sep 25 01:01:18.341847 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 94/184] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:17 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:18.726540 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-178da6ae-1327-4723-92af-2e6c356da57d tempest-FlavorsV261TestJSON-1582336678 tempest-FlavorsV261TestJSON-1582336678-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:18.742128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-178da6ae-1327-4723-92af-2e6c356da57d tempest-FlavorsV261TestJSON-1582336678 tempest-FlavorsV261TestJSON-1582336678-project] 10.222.0.16 "GET /compute/v2.1/flavors/1969535469" status: 200 len: 468 microversion: 2.61 time: 0.398340 Sep 25 01:01:18.752383 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 95/185] 10.222.0.16 () {60 vars in 1199 bytes} [Sun Sep 25 01:01:18 2022] GET /compute/v2.1/flavors/1969535469 => generated 468 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:18.758356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Calling method '.version_select at 0x7f7bf069a670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:18.760509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:18.761243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:18.761860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:18.780633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:18.781120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:18.781604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:18.790266 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-402703fd-ee4d-4de5-b7b4-187ff2a145ee tempest-HypervisorAdminV228Test-1974881420 tempest-HypervisorAdminV228Test-1974881420-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.035944 Sep 25 01:01:18.790903 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 96/186] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 01:01:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:18.808657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:18.810581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:18.827106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:18.827990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:18.829765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:18.831481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:18.832391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:18.833933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.275607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:19.285652 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9f2e1b50-9a36-496e-a672-0059751e69b9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.486637 Sep 25 01:01:19.286252 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 97/187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:18 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:19.307697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:19.307697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:19.314866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.315603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.316754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.317853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.318468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.319578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.644351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:19.660965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad85afdf-3f2b-4551-8f48-13718118f012 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.372725 Sep 25 01:01:19.662127 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 98/188] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:19 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:19.687415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13abb4ea-d0a4-4ea7-bec2-ed3d4e13fd1e tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf1b5ab80>, body: {"flavor": {"description": "new"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:19.752201 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13abb4ea-d0a4-4ea7-bec2-ed3d4e13fd1e tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1969535469" status: 200 len: 469 microversion: 2.61 time: 0.088556 Sep 25 01:01:19.762157 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 99/189] 10.222.0.16 () {62 vars in 1219 bytes} [Sun Sep 25 01:01:19 2022] PUT /compute/v2.1/flavors/1969535469 => generated 469 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:19.771181 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-09197686-574b-4c9e-8c61-ad3f036c40b3 req-77c99a0f-fe47-4098-a21d-69cb916ef9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787cab23-8c9f-4900-9d3d-f0560c55ebdb", "name": "network-vif-plugged", "status": "completed", "tag": "92d07b9d-caf3-4f7a-9d7f-b648f09b9308"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:19.791597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-09197686-574b-4c9e-8c61-ad3f036c40b3 req-77c99a0f-fe47-4098-a21d-69cb916ef9cb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.792714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-09197686-574b-4c9e-8c61-ad3f036c40b3 req-77c99a0f-fe47-4098-a21d-69cb916ef9cb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.793517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-09197686-574b-4c9e-8c61-ad3f036c40b3 req-77c99a0f-fe47-4098-a21d-69cb916ef9cb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.818466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-09197686-574b-4c9e-8c61-ad3f036c40b3 req-77c99a0f-fe47-4098-a21d-69cb916ef9cb service nova] Creating event network-vif-plugged:92d07b9d-caf3-4f7a-9d7f-b648f09b9308 for instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb on n-h1-master-1 Sep 25 01:01:19.829224 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-09197686-574b-4c9e-8c61-ad3f036c40b3 req-77c99a0f-fe47-4098-a21d-69cb916ef9cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074607 Sep 25 01:01:19.830754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 100/190] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:19.849768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:19.852067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:19.874702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.876583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.878988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.880365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.884127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.884679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.645144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:20.648402 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:20.657105 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7db842c1-7d6e-4b33-8656-329bdec9d64d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.818225 Sep 25 01:01:20.658316 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 101/191] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:19 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:20.663823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6fb35d8-8169-4433-89de-d093a495d402 tempest-FlavorsV261TestJSON-1582336678 tempest-FlavorsV261TestJSON-1582336678-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:20.720315 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6fb35d8-8169-4433-89de-d093a495d402 tempest-FlavorsV261TestJSON-1582336678 tempest-FlavorsV261TestJSON-1582336678-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 7155 microversion: 2.61 time: 0.060141 Sep 25 01:01:20.726112 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 102/192] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:20 2022] GET /compute/v2.1/flavors/detail => generated 7155 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:20.744917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:20.746105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:20.757091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:20.758017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:20.758793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.760554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:20.760866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:20.761678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.972742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:20.973286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:20.973721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:20.974133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:20.974549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:20.984765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:20.985253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:20.985721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.986469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:20.989866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:20.990392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.997866 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=13 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:20.999013 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:21.018967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Getting quotas for project fbd08c233d6944199beebf1a2e1a1a23. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:21.028656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Getting quotas for user 98ed412afded46c49d993a2749e42c65 and project fbd08c233d6944199beebf1a2e1a1a23. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:21.034542 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=90,nova_api:INSERT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:21.052222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:21.058477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:21.103104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:21.118597 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e36b2632-d4aa-4557-b0ec-c5af74ce0ad9 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1322 microversion: 2.1 time: 0.394520 Sep 25 01:01:21.134274 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 103/193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:20 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:21.181017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c1a533ee-ef91-4136-9799-a42a62471fe1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.482349 Sep 25 01:01:21.186409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 91/194] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 3490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:21.254561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf06dc4c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:21.264637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.265213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.266910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.283073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cdc828a7-66da-4940-b917-cfabe0422e27 req-b7eece40-a83d-494e-9f35-2ac52a043840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e946773-1b66-480a-9649-0d43d11b5bec", "tag": "39a86b01-b486-4428-aaa6-72b27f4471a8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:21.301745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdc828a7-66da-4940-b917-cfabe0422e27 req-b7eece40-a83d-494e-9f35-2ac52a043840 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.302747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdc828a7-66da-4940-b917-cfabe0422e27 req-b7eece40-a83d-494e-9f35-2ac52a043840 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.303753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdc828a7-66da-4940-b917-cfabe0422e27 req-b7eece40-a83d-494e-9f35-2ac52a043840 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.317747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.318579 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cdc828a7-66da-4940-b917-cfabe0422e27 req-b7eece40-a83d-494e-9f35-2ac52a043840 service nova] Creating event network-changed:39a86b01-b486-4428-aaa6-72b27f4471a8 for instance 4e946773-1b66-480a-9649-0d43d11b5bec on n-h2-master-1 Sep 25 01:01:21.326839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.328355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.340556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cdc828a7-66da-4940-b917-cfabe0422e27 req-b7eece40-a83d-494e-9f35-2ac52a043840 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151959 Sep 25 01:01:21.341955 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 92/195] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:21.351198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.352177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:21.358756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] HTTP exception thrown: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Request method failure captured: Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 HTTP/1.1 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 56 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hgal3DsFDKvhA1HkyHB0BrbIh4uIhYj-J1-AarqkYsqqdWZcF4Bk9LLe7uO-Mj-LzmH6u2yg5HUwJZXz1ssnKVtrgRHSXZ3oNfxBzKMt9TE0LXBLRNCiOEbV7dWqikPNrSrooZSN4ilRFX0yLr-wm6tF9DE12CHjupDPYx1XhPzPg Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.53 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e0f6cbbc798e4ba3be5ec506dcecc072 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:21.362145 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0f6cbbc798e4ba3be5ec506dcecc072"}]}] Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e0f6cbbc798e4ba3be5ec506dcecc072 Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb679d9d32c441bbb114e13d3dd8f208 Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:21.363610 n-d-master-1 devstack@n-api.service[122384]: exception: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.364915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:21.366236 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:21.367330 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:21.367330 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.367330 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.367330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Returning 404 to user: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:21.367330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2640afc6-2966-45f4-bb0e-00de19fe3359 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6" status: 404 len: 110 microversion: 2.53 time: 0.225227 Sep 25 01:01:21.369533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.370495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.370608 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 104/196] 10.222.0.16 () {62 vars in 1309 bytes} [Sun Sep 25 01:01:21 2022] PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 => generated 110 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:21.372101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.373239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.373966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.374647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.376078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6651a5e-d213-47f3-9eb1-46e3bf8b989b tempest-FlavorsV261TestJSON-1582336678 tempest-FlavorsV261TestJSON-1582336678-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.438217 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6651a5e-d213-47f3-9eb1-46e3bf8b989b tempest-FlavorsV261TestJSON-1582336678 tempest-FlavorsV261TestJSON-1582336678-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.61 time: 0.065407 Sep 25 01:01:21.453447 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 105/197] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:21.453447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9cdd7d82-d7ec-4fd4-b74f-d7d92b14218f req-68daed05-5c58-4e75-ab36-f1e5c0235c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:21.466724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9cdd7d82-d7ec-4fd4-b74f-d7d92b14218f req-68daed05-5c58-4e75-ab36-f1e5c0235c98 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.466724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9cdd7d82-d7ec-4fd4-b74f-d7d92b14218f req-68daed05-5c58-4e75-ab36-f1e5c0235c98 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.466724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9cdd7d82-d7ec-4fd4-b74f-d7d92b14218f req-68daed05-5c58-4e75-ab36-f1e5c0235c98 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.481068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9cdd7d82-d7ec-4fd4-b74f-d7d92b14218f req-68daed05-5c58-4e75-ab36-f1e5c0235c98 service nova] Creating event network-changed:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:01:21.491751 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9cdd7d82-d7ec-4fd4-b74f-d7d92b14218f req-68daed05-5c58-4e75-ab36-f1e5c0235c98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050750 Sep 25 01:01:21.492377 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 106/198] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:21.503625 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46d8e85d-2027-4ad2-bede-3be828033ee1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.504808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46d8e85d-2027-4ad2-bede-3be828033ee1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:21.635531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-46d8e85d-2027-4ad2-bede-3be828033ee1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:21.652488 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46d8e85d-2027-4ad2-bede-3be828033ee1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1262 microversion: 2.1 time: 0.154066 Sep 25 01:01:21.654169 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 107/199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:21.666859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf075d040>, body: {"status": "disabled"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:21.677098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.678156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.679705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.691310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.692315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.693215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.704157 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] HTTP exception thrown: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Request method failure captured: Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 HTTP/1.1 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 22 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hgal3DsFDKvhA1HkyHB0BrbIh4uIhYj-J1-AarqkYsqqdWZcF4Bk9LLe7uO-Mj-LzmH6u2yg5HUwJZXz1ssnKVtrgRHSXZ3oNfxBzKMt9TE0LXBLRNCiOEbV7dWqikPNrSrooZSN4ilRFX0yLr-wm6tF9DE12CHjupDPYx1XhPzPg Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.53 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e0f6cbbc798e4ba3be5ec506dcecc072 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:21.707993 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0f6cbbc798e4ba3be5ec506dcecc072"}]}] Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e0f6cbbc798e4ba3be5ec506dcecc072 Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb679d9d32c441bbb114e13d3dd8f208 Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: {"status": "disabled"} Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: exception: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.710310 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6', 'body': {'status': 'disabled'}} Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.711280 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:21.712618 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:21.713965 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.713965 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.713965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Returning 404 to user: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:21.716048 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2d4671c-fcc5-4686-874f-05ae98c5d9e9 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6" status: 404 len: 110 microversion: 2.53 time: 0.057628 Sep 25 01:01:21.717190 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 108/200] 10.222.0.16 () {62 vars in 1309 bytes} [Sun Sep 25 01:01:21 2022] PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:21.737172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-967aaf0e-94ef-471f-90c6-c9646565ec4d tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.784096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:21.786717 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-967aaf0e-94ef-471f-90c6-c9646565ec4d tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1969535469" status: 202 len: 0 microversion: 2.61 time: 0.058635 Sep 25 01:01:21.788144 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 109/201] 10.222.0.16 () {60 vars in 1202 bytes} [Sun Sep 25 01:01:21 2022] DELETE /compute/v2.1/flavors/1969535469 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:01:21.795398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.796305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:21.804324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.805009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.805655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.806588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.807067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.807490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.813448 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49ed4f63-09b1-45c6-b3f2-8bcdf407a485 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.469848 Sep 25 01:01:21.814151 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 93/202] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:21.820106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf08605e0>, body: {"status": "enabled"} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:21.824834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.825772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.826497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.837835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.838781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.839302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.848067 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] HTTP exception thrown: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Request method failure captured: Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: request: PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 HTTP/1.1 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 21 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hgal3DsFDKvhA1HkyHB0BrbIh4uIhYj-J1-AarqkYsqqdWZcF4Bk9LLe7uO-Mj-LzmH6u2yg5HUwJZXz1ssnKVtrgRHSXZ3oNfxBzKMt9TE0LXBLRNCiOEbV7dWqikPNrSrooZSN4ilRFX0yLr-wm6tF9DE12CHjupDPYx1XhPzPg Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.53 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: e0f6cbbc798e4ba3be5ec506dcecc072 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:21.852072 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0f6cbbc798e4ba3be5ec506dcecc072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0f6cbbc798e4ba3be5ec506dcecc072"}]}] Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: e0f6cbbc798e4ba3be5ec506dcecc072 Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693 Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb679d9d32c441bbb114e13d3dd8f208 Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: {"status": "enabled"} Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: exception: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.853469 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6', 'body': {'status': 'enabled'}} Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.854209 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:21.855286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:21.856365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. Sep 25 01:01:21.856365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:21.856365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Returning 404 to user: Service 4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:21.856365 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a69c2a9-0c66-4523-865c-00e73bada367 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6" status: 404 len: 110 microversion: 2.53 time: 0.039367 Sep 25 01:01:21.856365 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 94/203] 10.222.0.16 () {62 vars in 1309 bytes} [Sun Sep 25 01:01:21 2022] PUT /compute/v2.1/os-services/4edac4aa-e5e9-4e99-9ca3-84cc990a3eb6 => generated 110 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:21.865664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-739bd620-f49a-4b96-8418-7e0f981f95de tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.904529 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-739bd620-f49a-4b96-8418-7e0f981f95de tempest-FlavorsV261TestJSON-1007040974 tempest-FlavorsV261TestJSON-1007040974-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6696 microversion: 2.61 time: 0.047381 Sep 25 01:01:21.905540 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 95/204] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/flavors/detail => generated 6696 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:21.910274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.916218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.916938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.917665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.918632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.919293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.919953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.960342 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-193ce44c-553a-4227-bffb-2625de758038 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.053303 Sep 25 01:01:21.961452 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 96/205] 10.222.0.16 () {60 vars in 1178 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:21.989234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.999748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.000953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.002050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.003794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.004928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.005986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.043032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:22.059437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d15c8d7-e92c-477b-bc7b-7f1f9e3fa08d tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1339 microversion: 2.1 time: 0.268453 Sep 25 01:01:22.067545 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd2c6146-5d46-4f27-b6ea-75e5404268ab tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.086689 Sep 25 01:01:22.068422 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 97/206] 10.222.0.16 () {60 vars in 1211 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:22.074863 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 110/207] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1339 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:22.096791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.102365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.103169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.103732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.104742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.105635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.106490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.135822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3dc11eea-ee40-4e18-98b9-72607ea09cb7 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.043123 Sep 25 01:01:22.137290 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 98/208] 10.222.0.16 () {60 vars in 1178 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:22.147609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.148353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:22.163056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.164776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.166441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.168581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.169052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.170578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.171787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.185219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.187108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.187861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.192069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.193233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.194869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.236656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27bf6494-6444-4e7d-bb52-ce1d1678aeed tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.078733 Sep 25 01:01:22.237882 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 99/209] 10.222.0.16 () {60 vars in 1235 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:22.261248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.266262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.266765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.267217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.267991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.268459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.268895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.308247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61f46a38-cf8a-4ddc-85fa-dbcfadc82b5c tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.060696 Sep 25 01:01:22.309273 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 100/210] 10.222.0.16 () {60 vars in 1178 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:22.328012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.342102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.343648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.344339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.345688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.346903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.347165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.414099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:22.423339 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19f127fe-6356-4b76-9f7e-afd0dead5b05 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1471 microversion: 2.1 time: 0.280803 Sep 25 01:01:22.425863 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 111/211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:22.450202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.451084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:22.458806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.460450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.461081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.462060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.462703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.463334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.548891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Request method failure captured: Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef/diagnostics HTTP/1.1 Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gxX4gueVXFbRSua5UTQch-DkrGpx1xOO8teYNDK7TWQaNrcr0TRLYpb5kDW8rfyZwOoZmDK2m3F3uEhh-3c72kTk0_NHBNNtOOcbx7eiWPLnQmD04EEKN6KPGZWRWpT6OtHPTfm2-mtPUwD_AcKHDzOPUT0aEIESln0yfBeSRP_Ew Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7b3b7f9e3f494890ac14e46a66585d0d Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-733456924 Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:22.551101 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b3b7f9e3f494890ac14e46a66585d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b3b7f9e3f494890ac14e46a66585d0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b3b7f9e3f494890ac14e46a66585d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b3b7f9e3f494890ac14e46a66585d0d"}]}] Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-733456924 Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7b3b7f9e3f494890ac14e46a66585d0d Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-733456924 Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerDiagnosticsNegativeTest-733456924-project Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 549ac14b43eb4f0d85c9d9e975515df1 Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-733456924-project Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:22.553603 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': '3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef'} Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:22.554833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:22.557023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:22.560050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2bd43df0-bd1d-4dad-a6dd-712a32d92a5a tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.106281 Sep 25 01:01:22.562758 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 112/212] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef/diagnostics => generated 117 bytes in 116 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:01:22.568243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.569514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:22.577113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.577781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.578225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.578967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.594189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.595761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.652643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ce10e02-1b04-4f58-b885-42ed997bb4d2 tempest-ServicesAdminNegativeV253TestJSON-1293088693 tempest-ServicesAdminNegativeV253TestJSON-1293088693-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.333960 Sep 25 01:01:22.660490 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 101/213] 10.222.0.16 () {60 vars in 1239 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:22.663245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:01:22.837389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-576df0e7-1576-411d-8f9c-b18f416db9ff tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 204 len: 0 microversion: 2.1 time: 0.273852 Sep 25 01:01:22.841422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 113/214] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:01:22 2022] DELETE /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:01:22.851652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.857327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:22.877750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.883150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.887047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.893676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.894793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.895597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.104858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:23.131661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77126295-5c66-4ee1-8488-eccdd6baa873 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1280 microversion: 2.1 time: 0.287947 Sep 25 01:01:23.133049 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 114/215] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:23.143841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:23.145036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:23.145202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12674203-6032-49b0-afd1-3dce04cd328b tempest-ServicesAdminNegativeV253TestJSON-821980485 tempest-ServicesAdminNegativeV253TestJSON-821980485-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:23.158549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:23.159440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:23.164603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.164942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12674203-6032-49b0-afd1-3dce04cd328b tempest-ServicesAdminNegativeV253TestJSON-821980485 tempest-ServicesAdminNegativeV253TestJSON-821980485-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '54bb9e01043646d0bd8de49a0f5a5717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688235e54844aa4885b5b11b02bd716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:23.166793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12674203-6032-49b0-afd1-3dce04cd328b tempest-ServicesAdminNegativeV253TestJSON-821980485 tempest-ServicesAdminNegativeV253TestJSON-821980485-project] Request method failure captured: Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hfXBKQ6ApBSsZGMl_X-5k-LZi2VLLNb2UNh2ngbZUpxQGpdrvR0fZypw_DJFfBmISBuaxnNPOpv4ujlDCaqGQxhREPAJD1a1Ybn_ZR4T-wZ4F_Bs_baqXvVGF1rl9ixS5BKDG9KGsE1H6uUGYzl06terDkg95RfEgcNmjqObvnt_s Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.53 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 7688235e54844aa4885b5b11b02bd716 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-821980485 Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:23.167982 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7688235e54844aa4885b5b11b02bd716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7688235e54844aa4885b5b11b02bd716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7688235e54844aa4885b5b11b02bd716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7688235e54844aa4885b5b11b02bd716"}]}] Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-821980485 Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 7688235e54844aa4885b5b11b02bd716 Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-821980485 Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServicesAdminNegativeV253TestJSON-821980485-project Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 54bb9e01043646d0bd8de49a0f5a5717 Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-821980485-project Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 25 01:01:23.171811 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:23.173264 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 25 01:01:23.177731 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:23.184935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12674203-6032-49b0-afd1-3dce04cd328b tempest-ServicesAdminNegativeV253TestJSON-821980485 tempest-ServicesAdminNegativeV253TestJSON-821980485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:23.184935 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12674203-6032-49b0-afd1-3dce04cd328b tempest-ServicesAdminNegativeV253TestJSON-821980485 tempest-ServicesAdminNegativeV253TestJSON-821980485-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.508542 Sep 25 01:01:23.184935 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 102/216] 10.222.0.16 () {60 vars in 1178 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 521 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:23.196672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:23.200806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.208257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:23.212211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:23.234767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:23.250864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:23.251192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.258204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:23.261207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:23.264631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.643307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:23.663104 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ddbdbd2-97ea-4550-a81e-1aa5e066c7c0 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1477 microversion: 2.1 time: 0.527831 Sep 25 01:01:23.673869 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 115/217] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:23 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:23.673869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:23.673869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:23.695015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:23.698854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:23.701080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.703068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:23.704458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:23.706080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:23.709495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:23.734853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2efbefb-aded-4883-899c-59a65c190aff tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.546407 Sep 25 01:01:23.736783 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 103/218] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:23 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:24.178053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:24.179342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:24.227324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:24.239858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.249833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a91ae78a-38ea-4014-8561-18574734ff32 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1489 microversion: 2.1 time: 0.584402 Sep 25 01:01:24.259465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.262233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.267656 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 116/219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:23 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1489 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:24.274797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.279621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.280751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.284929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:24.285655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:24.304753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.306714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.307190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.308891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.310746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.311383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.780616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:24.793320 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a98b8cc-ad70-460d-acaa-fdf3f9ec2d30 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1342 microversion: 2.1 time: 0.639519 Sep 25 01:01:24.793969 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 104/220] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:24 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1342 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:24.798815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:24.799453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:24.814726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.815306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.816160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.817210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.817969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.818563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:25.294852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:25.307923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e30cd631-114f-4f2f-beb8-230834925089 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1477 microversion: 2.1 time: 0.512807 Sep 25 01:01:25.309043 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 105/221] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:24 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1477 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:25.314929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:25.315941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:25.323817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:25.324687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:25.325357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:25.341562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:25.342836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:25.343717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:25.534737 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ddf77fc-2d34-4e64-9fa5-59369dd22788 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1640 microversion: 2.1 time: 1.259916 Sep 25 01:01:25.552082 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 117/222] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:24 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1640 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:25.571433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:25.573176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:25.603270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:25.604718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:25.605866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:25.607514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:25.608734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:25.610117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:25.687865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:01:25.923639 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b72a3b4-2fed-4dea-b2e9-712b495f7069 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "DELETE /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 204 len: 0 microversion: 2.1 time: 0.362522 Sep 25 01:01:25.926073 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 118/223] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:01:25 2022] DELETE /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:01:25.942121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:25.945927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:25.964762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:25.966810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:25.973162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:25.976210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:25.977726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:25.981330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:26.094003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:26.106669 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b56ba868-dd0c-44ec-bb26-b0411c8742ae tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.795788 Sep 25 01:01:26.108541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 106/224] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:25 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:26.118482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:26.120873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:26.134116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:26.135324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:26.137858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:26.139928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:26.143387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:26.144551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:26.154648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:26.177023 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ddd101e7-21d9-45bb-9ad8-ddb12ff7acfd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1342 microversion: 2.1 time: 0.247401 Sep 25 01:01:26.179060 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 119/225] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:25 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:26.355603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:26.356400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:26.367527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:26.372297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:26.372916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:26.373853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:26.374468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:26.375166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:26.676765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:26.689574 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f3ad794-847a-4eda-b316-d30af9f85331 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1495 microversion: 2.1 time: 0.579137 Sep 25 01:01:26.702304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 107/226] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:26 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1495 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:26.837530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:26.854455 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce23f8a5-4670-48ab-9e9f-db5503fe0b87 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1477 microversion: 2.1 time: 0.503841 Sep 25 01:01:26.856458 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 120/227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:26 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:27.165340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:27.166736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:27.187343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.190428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.192534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.196386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.197926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.199563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.250910 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:27.345868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Calling method '.version_select at 0x7f7bf0a21af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:27.355403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.356709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.358064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.415233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.427432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.432314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.527013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.529023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.530963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.584249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.586656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.588060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.702654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:27.727719 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4414031b-3eb4-4285-9c37-47ebee403cc2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.575470 Sep 25 01:01:27.741559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 121/228] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:27 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:27.741896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.741896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.741896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.758714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:27.767935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:27.787733 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c618781-e6d4-4104-8b35-e3f5038f7a0a tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 1.026132 Sep 25 01:01:27.792964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.794352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.795691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.796866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.800411 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 108/229] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 25 01:01:26 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:27.803932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.804693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.810866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:27.823617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:27.839250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.840428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.842353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.844969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.846314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.847445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.468520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:28.496844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:28.502007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da402447-325e-48ba-9657-4a5afe3a2b1c tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1495 microversion: 2.1 time: 0.685913 Sep 25 01:01:28.507623 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 109/230] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:27 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1495 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:28.521116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Calling method '.version_select at 0x7f7bf0a255e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:28.530173 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f40778b0-5b69-401c-b496-df53c5319c32 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1409 microversion: 2.1 time: 0.788654 Sep 25 01:01:28.543922 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 122/231] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:27 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1409 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:28.547063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.554127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:28.554127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:28.555900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.557091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.583017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.587142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.588255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.590935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.597100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.598672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.618723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.619146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.619583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.716021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.722570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.723357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.758973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.762271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.763579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.821741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.823504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.824168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.832701 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84f22d27-3538-4bc6-bc8d-9bfda471f7c3 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.319360 Sep 25 01:01:28.834231 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 110/232] 10.222.0.16 () {60 vars in 1222 bytes} [Sun Sep 25 01:01:28 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:28.843714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:28.844770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:28.854499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.855799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.856833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.858843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.859974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.861001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.733932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.747773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.763205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b7af96e-e892-4672-9a54-d24fa2da9278 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.925271 Sep 25 01:01:29.764802 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 111/233] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:28 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:29.768267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-70ee989e-2bc3-41c4-9d5e-42942513d6e3 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1477 microversion: 2.1 time: 1.230093 Sep 25 01:01:29.769182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Calling method '.version_select at 0x7f7bf0844b80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:29.769759 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 123/234] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:28 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1477 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:29.782480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:29.783664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:29.784343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.859366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:29.860376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:29.861356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.888358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b8b0584-9e24-4b34-82e9-ed972d8231f8 tempest-HypervisorAdminV253TestBase-185708812 tempest-HypervisorAdminV253TestBase-185708812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/7c01c20a-e78e-4df9-a47a-90382faa866d" status: 200 len: 792 microversion: 2.53 time: 0.114053 Sep 25 01:01:29.906153 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 112/235] 10.222.0.16 () {60 vars in 1298 bytes} [Sun Sep 25 01:01:29 2022] GET /compute/v2.1/os-hypervisors/7c01c20a-e78e-4df9-a47a-90382faa866d => generated 792 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:01:29.927404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-339fef89-ad07-4257-820a-09c329aaec35 req-d7243e2a-923d-4876-a8bb-8377dc3d2965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e946773-1b66-480a-9649-0d43d11b5bec", "name": "network-vif-plugged", "status": "completed", "tag": "39a86b01-b486-4428-aaa6-72b27f4471a8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:29.947198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-339fef89-ad07-4257-820a-09c329aaec35 req-d7243e2a-923d-4876-a8bb-8377dc3d2965 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:29.948347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-339fef89-ad07-4257-820a-09c329aaec35 req-d7243e2a-923d-4876-a8bb-8377dc3d2965 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:29.949345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-339fef89-ad07-4257-820a-09c329aaec35 req-d7243e2a-923d-4876-a8bb-8377dc3d2965 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.974548 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-339fef89-ad07-4257-820a-09c329aaec35 req-d7243e2a-923d-4876-a8bb-8377dc3d2965 service nova] Creating event network-vif-plugged:39a86b01-b486-4428-aaa6-72b27f4471a8 for instance 4e946773-1b66-480a-9649-0d43d11b5bec on n-h2-master-1 Sep 25 01:01:30.014833 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-339fef89-ad07-4257-820a-09c329aaec35 req-d7243e2a-923d-4876-a8bb-8377dc3d2965 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099744 Sep 25 01:01:30.024952 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 113/236] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:30.058632 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.058632 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:30.091389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.095072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.097159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.100629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.101373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.102043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.107641 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:30.320020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a38edc2-afe1-472b-95e7-26b048633486 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.338461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a38edc2-afe1-472b-95e7-26b048633486 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.566392 Sep 25 01:01:30.340070 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 124/237] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:01:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:30.361645 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:30.476007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Calling method '.version_select at 0x7f7bf07c21f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.489252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.490258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.491430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.493309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.495395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.496698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.578730 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f99fde3-d992-449b-95ff-4c56ff862e4d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.222689 Sep 25 01:01:30.581603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 125/238] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:30.612459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.615795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:30.621828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725bbefab51841029b79a380ca8b54da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c7bea122934e44b7908c805f431e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:30.625581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.626368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.627199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.628848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.629714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.630353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.665284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-68e34877-7e07-4e1d-83af-678527eb1ae7 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 200 len: 1453 microversion: 2.1 time: 0.631639 Sep 25 01:01:30.666208 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 114/239] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 1453 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:30.712987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fbc272a1-e0cb-4c48-be5b-731aa44adc72 req-1fe598a1-e957-4481-a5f2-e619db9f12d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787cab23-8c9f-4900-9d3d-f0560c55ebdb", "name": "network-vif-deleted", "tag": "92d07b9d-caf3-4f7a-9d7f-b648f09b9308"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:30.733576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbc272a1-e0cb-4c48-be5b-731aa44adc72 req-1fe598a1-e957-4481-a5f2-e619db9f12d8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.734469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbc272a1-e0cb-4c48-be5b-731aa44adc72 req-1fe598a1-e957-4481-a5f2-e619db9f12d8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.735212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbc272a1-e0cb-4c48-be5b-731aa44adc72 req-1fe598a1-e957-4481-a5f2-e619db9f12d8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.762760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fbc272a1-e0cb-4c48-be5b-731aa44adc72 req-1fe598a1-e957-4481-a5f2-e619db9f12d8 service nova] Creating event network-vif-deleted:92d07b9d-caf3-4f7a-9d7f-b648f09b9308 for instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb on n-h1-master-1 Sep 25 01:01:30.774983 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fbc272a1-e0cb-4c48-be5b-731aa44adc72 req-1fe598a1-e957-4481-a5f2-e619db9f12d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089141 Sep 25 01:01:30.777545 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 115/240] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:31.041970 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=28 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:31.157559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.167453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d37358d-ba04-4e35-a0e6-45a34c4d4e50 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1409 microversion: 2.1 time: 0.583700 Sep 25 01:01:31.181318 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 126/241] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1409 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:31.198253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.199062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:31.210294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.210807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.211270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.212096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.218034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.218544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.354731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0cd2e7e-1be8-4d1e-9b0d-f062eeef3e7e tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Calling method '.version_select at 0x7f7bf08279d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.364541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e0cd2e7e-1be8-4d1e-9b0d-f062eeef3e7e tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9c9e29782e034096a25a72eff7337607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0cd2e7e-1be8-4d1e-9b0d-f062eeef3e7e tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Request method failure captured: Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hn9AYCnIcO8m1ZOuKkaoFnL_XvB21BXGqj3cx3cn2A7RaKSjCG-RcogGs8cxJnwyJOr8ivxFparHtZqcNHU_8-_BcCj63RDowUslJERUW7acp6mGmZx-0DEbi038bNZu67uMwdEA8pdKC_k-lZKDcEKjg_XCoac9k2QR1sMoDTFxg Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:31.372650 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3e90256e814bb9ab1e25b7a1f6a30e"}]}] Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9c9e29782e034096a25a72eff7337607 Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:01:31.376579 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:31.378172 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 25 01:01:31.382021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:31.394791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0cd2e7e-1be8-4d1e-9b0d-f062eeef3e7e tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:31.396760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0cd2e7e-1be8-4d1e-9b0d-f062eeef3e7e tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.616861 Sep 25 01:01:31.409827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 116/242] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 631 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:31.430400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.431832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:31.458659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.460628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.463613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.465717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.469009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.470980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.643789 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=35 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:31.800374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '549ac14b43eb4f0d85c9d9e975515df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b3b7f9e3f494890ac14e46a66585d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.832636 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2fec5f5-efbc-450e-a426-89a2f140a699 tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 200 len: 1435 microversion: 2.1 time: 0.418310 Sep 25 01:01:31.836999 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 117/243] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 1435 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:31.860947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e449e027-d35e-4abc-b558-e69767df94f3 req-655767c3-23db-4cfd-b379-b4dfded45334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9", "tag": "33acd010-934e-4f55-8380-0cfef9002b2f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:31.912327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.918772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e449e027-d35e-4abc-b558-e69767df94f3 req-655767c3-23db-4cfd-b379-b4dfded45334 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.923663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e449e027-d35e-4abc-b558-e69767df94f3 req-655767c3-23db-4cfd-b379-b4dfded45334 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.927461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e449e027-d35e-4abc-b558-e69767df94f3 req-655767c3-23db-4cfd-b379-b4dfded45334 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.928893 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4e025a6-879e-4868-b4d5-fd6a46e70e27 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1313 microversion: 2.1 time: 0.745894 Sep 25 01:01:31.929465 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 127/244] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:31.943047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4437b690-45bb-4690-9a0f-ba6aef8646a2 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Calling method '.version_select at 0x7f7bf06bd550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.946103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4437b690-45bb-4690-9a0f-ba6aef8646a2 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9c9e29782e034096a25a72eff7337607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4437b690-45bb-4690-9a0f-ba6aef8646a2 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Request method failure captured: Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hn9AYCnIcO8m1ZOuKkaoFnL_XvB21BXGqj3cx3cn2A7RaKSjCG-RcogGs8cxJnwyJOr8ivxFparHtZqcNHU_8-_BcCj63RDowUslJERUW7acp6mGmZx-0DEbi038bNZu67uMwdEA8pdKC_k-lZKDcEKjg_XCoac9k2QR1sMoDTFxg Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:31.961341 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3e90256e814bb9ab1e25b7a1f6a30e"}]}] Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9c9e29782e034096a25a72eff7337607 Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'n-d-master-1'} Sep 25 01:01:31.964084 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:31.972983 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 25 01:01:31.976699 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:31.979474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4437b690-45bb-4690-9a0f-ba6aef8646a2 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:31.979474 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4437b690-45bb-4690-9a0f-ba6aef8646a2 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.032181 Sep 25 01:01:31.979474 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 128/245] 10.222.0.16 () {58 vars in 1188 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:31.981022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.981702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:31.985621 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e449e027-d35e-4abc-b558-e69767df94f3 req-655767c3-23db-4cfd-b379-b4dfded45334 service nova] Creating event network-changed:33acd010-934e-4f55-8380-0cfef9002b2f for instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 on n-h1-master-1 Sep 25 01:01:31.993832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e449e027-d35e-4abc-b558-e69767df94f3 req-655767c3-23db-4cfd-b379-b4dfded45334 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152038 Sep 25 01:01:31.995251 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 118/246] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:32.001197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.001939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.002286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.002908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.003368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.003727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6c1e11e-bdff-4d64-a50f-22f290d90995 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Calling method '.version_select at 0x7f7bf0dbb670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.003900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.021362 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-a6c1e11e-bdff-4d64-a50f-22f290d90995 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6c1e11e-bdff-4d64-a50f-22f290d90995 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:32.026360 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'nonexistent_hostname'} Sep 25 01:01:32.029536 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:32.031511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 25 01:01:32.038274 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.041258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.041924 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] HTTP exception thrown: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:32.042001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6c1e11e-bdff-4d64-a50f-22f290d90995 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.042001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6c1e11e-bdff-4d64-a50f-22f290d90995 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.036490 Sep 25 01:01:32.042001 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 119/247] 10.222.0.16 () {58 vars in 1212 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Request method failure captured: Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb HTTP/1.1 Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gx1Y-yvML3jNgowIJ-zH6lGIVGtain-kDvWTO2opz5yIw4icdfULdrEqOpGEEJDh3QgtVCeRAaUKiJmo6UN6COQDzmUKuoBmkGkuOrY72vsXFvivSMbtygXTMyJF3NoL_H_kcF7KPKHySjbnn59Myig1-qbZN0EvlB-2ZOeOZ-RWU Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 92c7bea122934e44b7908c805f431e0a Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:32.042194 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92c7bea122934e44b7908c805f431e0a"}]}] Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 92c7bea122934e44b7908c805f431e0a Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminTestJSON-1457782521-project Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 725bbefab51841029b79a380ca8b54da Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminTestJSON-1457782521-project Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:32.043326 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '787cab23-8c9f-4900-9d3d-f0560c55ebdb'} Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.044089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:32.045145 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.046156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Returning 404 to user: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.046156 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76b99a23-fb01-49a1-8443-48865f91b4e3 tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 404 len: 111 microversion: 2.1 time: 0.066165 Sep 25 01:01:32.046156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 129/248] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:32.059831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbd19622-c8f5-40d7-9918-fd409ca0febf tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:32.063206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a1ce5c1-5aba-48f1-8ccd-6907c725cc83 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Calling method '.version_select at 0x7f7bf06bd160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.065176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a1ce5c1-5aba-48f1-8ccd-6907c725cc83 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9c9e29782e034096a25a72eff7337607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.072689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbd19622-c8f5-40d7-9918-fd409ca0febf tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.073202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbd19622-c8f5-40d7-9918-fd409ca0febf tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.073696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbd19622-c8f5-40d7-9918-fd409ca0febf tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a1ce5c1-5aba-48f1-8ccd-6907c725cc83 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Request method failure captured: Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hn9AYCnIcO8m1ZOuKkaoFnL_XvB21BXGqj3cx3cn2A7RaKSjCG-RcogGs8cxJnwyJOr8ivxFparHtZqcNHU_8-_BcCj63RDowUslJERUW7acp6mGmZx-0DEbi038bNZu67uMwdEA8pdKC_k-lZKDcEKjg_XCoac9k2QR1sMoDTFxg Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:32.077747 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3e90256e814bb9ab1e25b7a1f6a30e"}]}] Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9c9e29782e034096a25a72eff7337607 Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'n-d-master-1'} Sep 25 01:01:32.080437 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:32.082136 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 25 01:01:32.089626 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.093627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a1ce5c1-5aba-48f1-8ccd-6907c725cc83 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.093627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a1ce5c1-5aba-48f1-8ccd-6907c725cc83 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023783 Sep 25 01:01:32.093627 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 130/249] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:32.096555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-678c6e3c-c104-42f8-8e14-7830eaa29594 req-c7ca1e97-749e-4aaf-bd82-dfd0b83a7cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef", "name": "network-vif-unplugged", "status": "completed", "tag": "b667bc3d-e073-426c-8c68-3ec5f75448d8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:32.155697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-678c6e3c-c104-42f8-8e14-7830eaa29594 req-c7ca1e97-749e-4aaf-bd82-dfd0b83a7cc1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.158062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-678c6e3c-c104-42f8-8e14-7830eaa29594 req-c7ca1e97-749e-4aaf-bd82-dfd0b83a7cc1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.159369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-678c6e3c-c104-42f8-8e14-7830eaa29594 req-c7ca1e97-749e-4aaf-bd82-dfd0b83a7cc1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.207168 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-678c6e3c-c104-42f8-8e14-7830eaa29594 req-c7ca1e97-749e-4aaf-bd82-dfd0b83a7cc1 service nova] Creating event network-vif-unplugged:b667bc3d-e073-426c-8c68-3ec5f75448d8 for instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef on n-h2-master-1 Sep 25 01:01:32.222981 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-678c6e3c-c104-42f8-8e14-7830eaa29594 req-c7ca1e97-749e-4aaf-bd82-dfd0b83a7cc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137904 Sep 25 01:01:32.227428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 131/250] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:32.242056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c947158f-1300-4112-96fd-471cf99ab9e1 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Calling method '.version_select at 0x7f7bf075df70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.258100 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c947158f-1300-4112-96fd-471cf99ab9e1 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c947158f-1300-4112-96fd-471cf99ab9e1 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:32.263669 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'nonexistent_hostname'} Sep 25 01:01:32.265601 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.266417 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.267627 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.268822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c947158f-1300-4112-96fd-471cf99ab9e1 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.269309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c947158f-1300-4112-96fd-471cf99ab9e1 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.040239 Sep 25 01:01:32.272834 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 132/251] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:32.289450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.290692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:32.308870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.309389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.309836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.313811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.318167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.322105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.343078 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbd19622-c8f5-40d7-9918-fd409ca0febf tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.287306 Sep 25 01:01:32.344385 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 120/252] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:01:32 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:32.355308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18306ec5-648a-46bf-9892-4370d073051c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Calling method '.version_select at 0x7f7bf0905c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.359595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-18306ec5-648a-46bf-9892-4370d073051c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9c9e29782e034096a25a72eff7337607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18306ec5-648a-46bf-9892-4370d073051c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Request method failure captured: Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hn9AYCnIcO8m1ZOuKkaoFnL_XvB21BXGqj3cx3cn2A7RaKSjCG-RcogGs8cxJnwyJOr8ivxFparHtZqcNHU_8-_BcCj63RDowUslJERUW7acp6mGmZx-0DEbi038bNZu67uMwdEA8pdKC_k-lZKDcEKjg_XCoac9k2QR1sMoDTFxg Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:32.361245 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3e90256e814bb9ab1e25b7a1f6a30e"}]}] Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9c9e29782e034096a25a72eff7337607 Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'n-d-master-1'} Sep 25 01:01:32.362489 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:32.363204 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 25 01:01:32.364301 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.367539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18306ec5-648a-46bf-9892-4370d073051c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.368867 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-18306ec5-648a-46bf-9892-4370d073051c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.023360 Sep 25 01:01:32.369967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 121/253] 10.222.0.16 () {58 vars in 1194 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:32.376967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97d06af4-8202-4e22-9294-fa85c6e5969b tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.380726 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=15 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:32.461359 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97d06af4-8202-4e22-9294-fa85c6e5969b tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.087232 Sep 25 01:01:32.466912 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 122/254] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:32 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:32.493870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03e502eb-85b5-4110-8073-a929e5625b3d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Calling method '.version_select at 0x7f7bf098caf0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.527901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-03e502eb-85b5-4110-8073-a929e5625b3d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03e502eb-85b5-4110-8073-a929e5625b3d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:32.532117 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'nonexistent_hostname'} Sep 25 01:01:32.533433 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:32.534179 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 25 01:01:32.535219 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03e502eb-85b5-4110-8073-a929e5625b3d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03e502eb-85b5-4110-8073-a929e5625b3d tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.063586 Sep 25 01:01:32.536261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 123/255] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:32.551069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f8383d7-0f8a-41e1-8fc3-4118227346a7 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-202837797"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:32.559065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-0f8383d7-0f8a-41e1-8fc3-4118227346a7 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid 786b019d-8430-4efa-9665-f3c4aec2b271 for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:32.576392 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:32.606729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f8383d7-0f8a-41e1-8fc3-4118227346a7 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069092 Sep 25 01:01:32.607684 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 124/256] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:32.625913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90b0a915-5d9a-4554-8a09-1128af094a5c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Calling method '.version_select at 0x7f7bf0d00940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.628475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90b0a915-5d9a-4554-8a09-1128af094a5c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9c9e29782e034096a25a72eff7337607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90b0a915-5d9a-4554-8a09-1128af094a5c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Request method failure captured: Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hn9AYCnIcO8m1ZOuKkaoFnL_XvB21BXGqj3cx3cn2A7RaKSjCG-RcogGs8cxJnwyJOr8ivxFparHtZqcNHU_8-_BcCj63RDowUslJERUW7acp6mGmZx-0DEbi038bNZu67uMwdEA8pdKC_k-lZKDcEKjg_XCoac9k2QR1sMoDTFxg Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:32.632289 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3e90256e814bb9ab1e25b7a1f6a30e"}]}] Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9c9e29782e034096a25a72eff7337607 Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'n-d-master-1'} Sep 25 01:01:32.633611 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:32.634370 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 25 01:01:32.635400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.637664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90b0a915-5d9a-4554-8a09-1128af094a5c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.639767 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90b0a915-5d9a-4554-8a09-1128af094a5c tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.029315 Sep 25 01:01:32.640945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 125/257] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:32.646567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-912640ce-6aad-424f-9f68-46bfa48b68d0 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:32.664657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912640ce-6aad-424f-9f68-46bfa48b68d0 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.666763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912640ce-6aad-424f-9f68-46bfa48b68d0 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.667305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912640ce-6aad-424f-9f68-46bfa48b68d0 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.824595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.841947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e178f320-3a2f-404b-8ac0-4cefd8e4fa19 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1387 microversion: 2.1 time: 0.566975 Sep 25 01:01:32.843574 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 133/258] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1387 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:32.853003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ce277e9-0dbd-482e-8b20-69dda0989f05 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Calling method '.version_select at 0x7f7bf08e3a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.871169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3ce277e9-0dbd-482e-8b20-69dda0989f05 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ce277e9-0dbd-482e-8b20-69dda0989f05 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:32.876151 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'nonexistent_hostname'} Sep 25 01:01:32.878994 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:32.883025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 25 01:01:32.885767 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ce277e9-0dbd-482e-8b20-69dda0989f05 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ce277e9-0dbd-482e-8b20-69dda0989f05 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033739 Sep 25 01:01:32.891485 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 134/259] 10.222.0.16 () {58 vars in 1215 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:32.900263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43c3743c-8e8a-4e1b-9e02-499598a04756 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1790277002", "imageRef": "eb339cd4-cbcf-42f5-9e08-ea88ee87b1f1", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:32.900516 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-912640ce-6aad-424f-9f68-46bfa48b68d0 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.254235 Sep 25 01:01:32.909758 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 126/260] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:01:32 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:32.921273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.923103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] [instance: 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:32.940102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.941186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.942287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.944717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.945682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.946778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.985575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] HTTP exception thrown: Instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef could not be found. Sep 25 01:01:32.990264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-43c3743c-8e8a-4e1b-9e02-499598a04756 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Request method failure captured: Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef HTTP/1.1 Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6gxX4gueVXFbRSua5UTQch-DkrGpx1xOO8teYNDK7TWQaNrcr0TRLYpb5kDW8rfyZwOoZmDK2m3F3uEhh-3c72kTk0_NHBNNtOOcbx7eiWPLnQmD04EEKN6KPGZWRWpT6OtHPTfm2-mtPUwD_AcKHDzOPUT0aEIESln0yfBeSRP_Ew Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 7b3b7f9e3f494890ac14e46a66585d0d Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-733456924 Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:32.990465 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b3b7f9e3f494890ac14e46a66585d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b3b7f9e3f494890ac14e46a66585d0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b3b7f9e3f494890ac14e46a66585d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b3b7f9e3f494890ac14e46a66585d0d"}]}] Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-733456924 Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 7b3b7f9e3f494890ac14e46a66585d0d Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-733456924 Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerDiagnosticsNegativeTest-733456924-project Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 549ac14b43eb4f0d85c9d9e975515df1 Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-733456924-project Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef could not be found. Sep 25 01:01:32.991880 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef'} Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef could not be found. Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:32.992558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef could not be found. Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef could not be found. Sep 25 01:01:32.993767 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:32.994761 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] Returning 404 to user: Instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:32.994761 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-720a5c57-9ab6-4424-8a0f-694aaf8a745c tempest-ServerDiagnosticsNegativeTest-733456924 tempest-ServerDiagnosticsNegativeTest-733456924-project] 10.222.0.16 "GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef" status: 404 len: 111 microversion: 2.1 time: 0.081829 Sep 25 01:01:32.999945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 127/261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/servers/3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:33.012345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf5f3c48-4934-4b28-b2f8-f213b7ed6c36 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf0d00670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf5f3c48-4934-4b28-b2f8-f213b7ed6c36 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 51 Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:33.052770 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: {"status": "enable", "maintenance_mode": "invalid"} Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:33.055261 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'disable', Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'Enable', Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'Disable', Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance: Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'invalid' Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.056652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.063404 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf5f3c48-4934-4b28-b2f8-f213b7ed6c36 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf5f3c48-4934-4b28-b2f8-f213b7ed6c36 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.054012 Sep 25 01:01:33.068438 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 128/262] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:32 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:33.070435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e908b28e-f6a9-48e1-881b-18181d16b633 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:33.086117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e908b28e-f6a9-48e1-881b-18181d16b633 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.026767 Sep 25 01:01:33.087384 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 129/263] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:01:33 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:33.108673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:33.110423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:33.125924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.126940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.128798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.130643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.132370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.134737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.723151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:33.741745 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2673f323-f2d2-46f7-91f5-fe2e2f94b503 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1462 microversion: 2.1 time: 0.652460 Sep 25 01:01:33.742648 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:33 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1462 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:33.757831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3cc38408-403a-470e-af90-b830fd60a37f tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf074ab80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3cc38408-403a-470e-af90-b830fd60a37f tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 51 Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:33.765842 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: {"status": "invalid", "maintenance_mode": "enable"} Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:33.767862 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'disable', Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'Enable', Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'Disable', Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance: Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'invalid' Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.769276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.774733 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3cc38408-403a-470e-af90-b830fd60a37f tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:33.778331 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3cc38408-403a-470e-af90-b830fd60a37f tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.023734 Sep 25 01:01:33.779524 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-43c3743c-8e8a-4e1b-9e02-499598a04756 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 25 01:01:33.781526 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 131/265] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:33 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43c3743c-8e8a-4e1b-9e02-499598a04756 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] Request method failure captured: Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 143 Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hokArlOfl1O_s3bGQ-8ag_apPH90TQd0J31a_1mHDySn8qRasQ3AD30cTt5YJ7PztobSlygba6GpF-FGGMpNHzRJHESl6d2xD9yyAYfSZP73uQJ95Vrla1G_xd8oCvbGNlUg1nE7SyKUd9Ml4rbHB9ZEWjls-EM0IS12L_TSdft_c Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56f622f71d6749ceab4ac71e80902f47 Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsV2NegativeTest-485220031 Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:33.781823 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56f622f71d6749ceab4ac71e80902f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56f622f71d6749ceab4ac71e80902f47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56f622f71d6749ceab4ac71e80902f47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56f622f71d6749ceab4ac71e80902f47"}]}] Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsV2NegativeTest-485220031 Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56f622f71d6749ceab4ac71e80902f47 Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-485220031 Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsV2NegativeTest-485220031-project Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 90e14a719e7b46dfbe2f2fd3473180c5 Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsV2NegativeTest-485220031-project Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1790277002", "imageRef": "eb339cd4-cbcf-42f5-9e08-ea88ee87b1f1", "flavorRef": "452"}} Sep 25 01:01:33.788965 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: exception: Flavor's memory is too small for requested image. Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1790277002', 'imageRef': 'eb339cd4-cbcf-42f5-9e08-ea88ee87b1f1', 'flavorRef': '452'}}} Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:33.791203 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.793993 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43c3743c-8e8a-4e1b-9e02-499598a04756 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:33.796842 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43c3743c-8e8a-4e1b-9e02-499598a04756 tempest-FlavorsV2NegativeTest-485220031 tempest-FlavorsV2NegativeTest-485220031-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.889610 Sep 25 01:01:33.798027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca060111-3cd2-4332-9f7a-90f94d7b01da tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:33.798252 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 135/266] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 899 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:01:33.817345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:33.818385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca060111-3cd2-4332-9f7a-90f94d7b01da tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.818942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca060111-3cd2-4332-9f7a-90f94d7b01da tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.819389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca060111-3cd2-4332-9f7a-90f94d7b01da tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.819523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:33.885902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.886855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.894281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.897224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.901683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.904913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.989801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca060111-3cd2-4332-9f7a-90f94d7b01da tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.219614 Sep 25 01:01:33.993246 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 132/267] 10.222.0.16 () {60 vars in 1191 bytes} [Sun Sep 25 01:01:33 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:34.005948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b779929-f5c7-44a7-b2f6-179b52e40549 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Action: 'update', calling method: .version_select at 0x7f7bf07f98b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.019503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4b779929-f5c7-44a7-b2f6-179b52e40549 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9c9e29782e034096a25a72eff7337607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3e90256e814bb9ab1e25b7a1f6a30e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b779929-f5c7-44a7-b2f6-179b52e40549 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Request method failure captured: Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 50 Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hn9AYCnIcO8m1ZOuKkaoFnL_XvB21BXGqj3cx3cn2A7RaKSjCG-RcogGs8cxJnwyJOr8ivxFparHtZqcNHU_8-_BcCj63RDowUslJERUW7acp6mGmZx-0DEbi038bNZu67uMwdEA8pdKC_k-lZKDcEKjg_XCoac9k2QR1sMoDTFxg Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:34.025463 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6b3e90256e814bb9ab1e25b7a1f6a30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6b3e90256e814bb9ab1e25b7a1f6a30e"}]}] Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 6b3e90256e814bb9ab1e25b7a1f6a30e Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-96691321 Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9c9e29782e034096a25a72eff7337607 Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HostsAdminNegativeTestJSON-96691321-project Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: {"status": "enable", "maintenance_mode": "enable"} Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 25 01:01:34.026705 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:34.027459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 25 01:01:34.028614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.032145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b779929-f5c7-44a7-b2f6-179b52e40549 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:34.033649 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b779929-f5c7-44a7-b2f6-179b52e40549 tempest-HostsAdminNegativeTestJSON-96691321 tempest-HostsAdminNegativeTestJSON-96691321-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.038282 Sep 25 01:01:34.034615 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 133/268] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:33 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:34.054398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:34.055785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:34.066905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:34.068642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:34.070775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:34.072969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:34.074072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:34.075486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:34.236459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:34.249668 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-692edd48-db26-4599-b40f-33b218c27cc6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1314 microversion: 2.1 time: 0.453450 Sep 25 01:01:34.252691 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 136/269] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:33 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:34.259448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e20d769d-4305-4f89-acae-9bcfe0e06a4e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:34.314057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e20d769d-4305-4f89-acae-9bcfe0e06a4e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.059474 Sep 25 01:01:34.324516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 137/270] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:34 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:34.330466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81302b84-931d-4e6c-8223-a8cecadfad68 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf06bdf70>, body: {"status": null, "maintenance_mode": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81302b84-931d-4e6c-8223-a8cecadfad68 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 42 Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:34.336603 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: {"status": null, "maintenance_mode": null} Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 25 01:01:34.339103 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'disable', Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'Enable', Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'Disable', Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance: Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi None Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:34.341804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:34.347414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81302b84-931d-4e6c-8223-a8cecadfad68 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81302b84-931d-4e6c-8223-a8cecadfad68 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.012312 Sep 25 01:01:34.356724 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 138/271] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:01:34 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:01:34.358822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1647c53f-90bb-455a-836f-95766b963d86 req-97602312-df98-4518-a10d-229045407577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef", "name": "network-vif-deleted", "tag": "b667bc3d-e073-426c-8c68-3ec5f75448d8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.369901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1647c53f-90bb-455a-836f-95766b963d86 req-97602312-df98-4518-a10d-229045407577 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:34.370532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1647c53f-90bb-455a-836f-95766b963d86 req-97602312-df98-4518-a10d-229045407577 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:34.371152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1647c53f-90bb-455a-836f-95766b963d86 req-97602312-df98-4518-a10d-229045407577 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:34.395831 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1647c53f-90bb-455a-836f-95766b963d86 req-97602312-df98-4518-a10d-229045407577 service nova] Creating event network-vif-deleted:b667bc3d-e073-426c-8c68-3ec5f75448d8 for instance 3306d5ac-9b81-4aa1-bcc2-38b2b00be6ef on n-h2-master-1 Sep 25 01:01:34.402841 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1647c53f-90bb-455a-836f-95766b963d86 req-97602312-df98-4518-a10d-229045407577 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054519 Sep 25 01:01:34.403802 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 139/272] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:34.409328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bbffaef0-cc48-4c42-b005-64ad47f38a96 req-641325ee-338b-4e87-8690-54728f49f574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "name": "network-vif-plugged", "status": "completed", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.434920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bbffaef0-cc48-4c42-b005-64ad47f38a96 req-641325ee-338b-4e87-8690-54728f49f574 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:34.435411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bbffaef0-cc48-4c42-b005-64ad47f38a96 req-641325ee-338b-4e87-8690-54728f49f574 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:34.435836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bbffaef0-cc48-4c42-b005-64ad47f38a96 req-641325ee-338b-4e87-8690-54728f49f574 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:34.451012 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bbffaef0-cc48-4c42-b005-64ad47f38a96 req-641325ee-338b-4e87-8690-54728f49f574 service nova] Creating event network-vif-plugged:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:01:34.456844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bbffaef0-cc48-4c42-b005-64ad47f38a96 req-641325ee-338b-4e87-8690-54728f49f574 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051541 Sep 25 01:01:34.462261 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 140/273] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:34.468557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2a2e133-1507-4e6b-921f-535efdc156c4 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-781127891"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.472466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-e2a2e133-1507-4e6b-921f-535efdc156c4 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid e3cd72b3-af85-4e13-bd1d-0c5bb01445da for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:34.498450 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2a2e133-1507-4e6b-921f-535efdc156c4 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034601 Sep 25 01:01:34.506820 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 141/274] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:34.512592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e72443e2-5004-4845-9513-08d8e3d0c132 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf0660ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.524626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:34.529593 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.hosts [None req-e72443e2-5004-4845-9513-08d8e3d0c132 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Enabling host nonexistent_hostname. Sep 25 01:01:34.536890 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-245b7c2f-70d3-4608-876d-ee61275b6ddd tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1387 microversion: 2.1 time: 0.494117 Sep 25 01:01:34.540503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e72443e2-5004-4845-9513-08d8e3d0c132 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e72443e2-5004-4845-9513-08d8e3d0c132 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Request method failure captured: Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 50 Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hpE28_xCBS0DnVfrHHQ4LvhE5AQrKUaTYS8eyUiAHrwYHmb8ByvRaQzaHzM_PTqugwuGyfD3rNfHr1edAlOKNx4eMG4yGmxlpROf4cSsRBjTJXrBtW94sNWE8ie_OPuqy74P7oxrdihIb-w1vva4NiDdpCSaVQooaWBbaObg_Idr4 Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:34.543177 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ec02d0555d3747c8bcfef870ff8e413c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ec02d0555d3747c8bcfef870ff8e413c"}]}] Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ec02d0555d3747c8bcfef870ff8e413c Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1461541390 Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 029589b1b2a64b828dcb33ca06ea5bda Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1461541390-project-admin Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: {"status": "enable", "maintenance_mode": "enable"} Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:34.544509 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:01:34.545290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:34.546324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 25 01:01:34.547556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:34.550048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e72443e2-5004-4845-9513-08d8e3d0c132 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:34.550984 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e72443e2-5004-4845-9513-08d8e3d0c132 tempest-HostsAdminNegativeTestJSON-1461541390 tempest-HostsAdminNegativeTestJSON-1461541390-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.042471 Sep 25 01:01:34.551553 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 142/275] 10.222.0.16 () {60 vars in 1211 bytes} [Sun Sep 25 01:01:34 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:34.556879 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 134/276] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:34 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1387 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:34.567705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8cb85507-d101-4293-b841-263896be4286 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:34.584079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cb85507-d101-4293-b841-263896be4286 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:34.585771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cb85507-d101-4293-b841-263896be4286 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:34.586624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cb85507-d101-4293-b841-263896be4286 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:34.918769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8cb85507-d101-4293-b841-263896be4286 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.365387 Sep 25 01:01:34.921559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 143/277] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:34 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:34.936980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-252b81e0-e855-49bc-a7b0-b25ff25fc0fc tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:34.982541 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-252b81e0-e855-49bc-a7b0-b25ff25fc0fc tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.052637 Sep 25 01:01:34.988139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 135/278] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:01:34 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:35.000149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f4d3cb2-16fc-449f-934a-1409ea2bc8fb tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:35.017626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f4d3cb2-16fc-449f-934a-1409ea2bc8fb tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.022163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f4d3cb2-16fc-449f-934a-1409ea2bc8fb tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.023266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f4d3cb2-16fc-449f-934a-1409ea2bc8fb tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.190970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f4d3cb2-16fc-449f-934a-1409ea2bc8fb tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.194395 Sep 25 01:01:35.194226 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 144/279] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:34 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:35.206080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae44168b-8c8b-45f0-b063-70caf5a753e2 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:35.243599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae44168b-8c8b-45f0-b063-70caf5a753e2 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.042532 Sep 25 01:01:35.244478 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 136/280] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:35 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:35.259169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-964df32b-6c2f-4b4e-a4cd-c5594453f025 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1270628798"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:35.261274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-964df32b-6c2f-4b4e-a4cd-c5594453f025 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid b5efde7a-fa80-4363-9762-e78ec6135251 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:35.283749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:35.285310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:35.298836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.305638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.308425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.309273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.309959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.317769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-964df32b-6c2f-4b4e-a4cd-c5594453f025 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066489 Sep 25 01:01:35.318744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.325045 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 145/281] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:35.338066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b42be670-a708-4ab9-abb1-37907e474e35 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:35.350898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b42be670-a708-4ab9-abb1-37907e474e35 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.352447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b42be670-a708-4ab9-abb1-37907e474e35 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.353055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b42be670-a708-4ab9-abb1-37907e474e35 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.540213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.552911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cba00c5a-5a4f-40e2-8d48-de03b4753f3d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1314 microversion: 2.1 time: 0.274066 Sep 25 01:01:35.555442 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 137/282] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:35 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:35.573499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:35.574654 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:35.594379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.596470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.597776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b42be670-a708-4ab9-abb1-37907e474e35 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.265625 Sep 25 01:01:35.598334 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 146/283] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:35 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:35.599477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.601785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.602518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.603339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.628654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a06341f4-a3fc-455c-bae1-d9eeecb01e77 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:35.686051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a06341f4-a3fc-455c-bae1-d9eeecb01e77 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.696614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a06341f4-a3fc-455c-bae1-d9eeecb01e77 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.700500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a06341f4-a3fc-455c-bae1-d9eeecb01e77 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.887596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.914306 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-449ef66f-9284-4e79-b187-0a7cbc1c8f24 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1387 microversion: 2.1 time: 0.337835 Sep 25 01:01:35.916851 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 138/284] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:35 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1387 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:36.003024 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a06341f4-a3fc-455c-bae1-d9eeecb01e77 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.393045 Sep 25 01:01:36.007482 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 147/285] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:35 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:36.026211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8adbd7a-77f7-46e1-a76e-488556c20147 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.067331 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8adbd7a-77f7-46e1-a76e-488556c20147 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.045505 Sep 25 01:01:36.074087 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 139/286] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:36 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:36.093257 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7bbba2eb-0395-4e7d-9653-2e39273f7ce4 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1248701350"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:36.107270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f92eeb81-e2cd-4d19-8217-a99e21c4cab2 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-90467148"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:36.108963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-7bbba2eb-0395-4e7d-9653-2e39273f7ce4 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid ee7cd391-c876-4daa-86a7-1159a97c39bc for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:36.112053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-f92eeb81-e2cd-4d19-8217-a99e21c4cab2 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid e4b61a31-8618-48b3-b7ee-9fc90a776281 for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:36.157839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f92eeb81-e2cd-4d19-8217-a99e21c4cab2 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054259 Sep 25 01:01:36.167956 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 140/287] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:36.179197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f43532c6-d79b-40a2-babe-67083abf10ed tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:36.191640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f43532c6-d79b-40a2-babe-67083abf10ed tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.193015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f43532c6-d79b-40a2-babe-67083abf10ed tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.194230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f43532c6-d79b-40a2-babe-67083abf10ed tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.217982 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7bbba2eb-0395-4e7d-9653-2e39273f7ce4 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.132408 Sep 25 01:01:36.234868 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 148/288] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:36.253506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f45ba544-9436-49e1-9e2f-76208ba3a889 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.323223 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f45ba544-9436-49e1-9e2f-76208ba3a889 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.077057 Sep 25 01:01:36.327214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 149/289] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:36 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 25 01:01:36.339845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76b28708-b15b-4edf-b637-053a862e028c tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.358713 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-76b28708-b15b-4edf-b637-053a862e028c tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76b28708-b15b-4edf-b637-053a862e028c tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Request method failure captured: Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0uGCX6r1EgB61tGVajqnLzzPpPcHIxdJQRS-1DI6MeyRqbkIuOWUrZlFnCzjLz3nBLH8gD27iXSkvrxT8SQFvomyNb3ic3fjm4OlvhoyuFIYT_3JS45hODk4WX6kV9HPdzZARguD-S2jeW30_L3-fynfMAskG19tGOdG3OMuSg6g Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:36.365120 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f7a84df4fc24fc4898dfb1a0aef9b92"}]}] Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7b488e3b4e064b559907146f62175f37 Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: exception: Aggregate 13 could not be found. Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '13'} Sep 25 01:01:36.367678 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.368851 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 25 01:01:36.373523 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.377686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76b28708-b15b-4edf-b637-053a862e028c tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:36.380129 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76b28708-b15b-4edf-b637-053a862e028c tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.045959 Sep 25 01:01:36.382610 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 150/290] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:36 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:01:36.403511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8f6c992-e17b-4c22-9238-4c385af6073d tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.434674 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c8f6c992-e17b-4c22-9238-4c385af6073d tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8f6c992-e17b-4c22-9238-4c385af6073d tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Request method failure captured: Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0uGCX6r1EgB61tGVajqnLzzPpPcHIxdJQRS-1DI6MeyRqbkIuOWUrZlFnCzjLz3nBLH8gD27iXSkvrxT8SQFvomyNb3ic3fjm4OlvhoyuFIYT_3JS45hODk4WX6kV9HPdzZARguD-S2jeW30_L3-fynfMAskG19tGOdG3OMuSg6g Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:36.436946 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f7a84df4fc24fc4898dfb1a0aef9b92"}]}] Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7b488e3b4e064b559907146f62175f37 Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: exception: Aggregate 13 could not be found. Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '13'} Sep 25 01:01:36.438243 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:36.438963 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.440024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.441175 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.441175 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:36.441175 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:36.441175 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 25 01:01:36.441175 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.444511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8f6c992-e17b-4c22-9238-4c385af6073d tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:36.446262 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c8f6c992-e17b-4c22-9238-4c385af6073d tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.048302 Sep 25 01:01:36.447375 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 151/291] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:36 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:36.462664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d57c199-f7fa-446e-933b-1240194447dd tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-60274344", "name": "tempest-test_aggregate-990396013"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:36.468880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-5d57c199-f7fa-446e-933b-1240194447dd tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid 1d76af4b-27de-46a6-be4e-d39d66213d44 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:36.552105 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d57c199-f7fa-446e-933b-1240194447dd tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.095275 Sep 25 01:01:36.554516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 152/292] 10.222.0.16 () {60 vars in 1165 bytes} [Sun Sep 25 01:01:36 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:36.583813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfd41eec-4516-4409-b3c8-14c3a1c0453e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.629481 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:36.656095 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfd41eec-4516-4409-b3c8-14c3a1c0453e tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.085605 Sep 25 01:01:36.657518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 153/293] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:36 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:36.670327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.671259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:36.682704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.683567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.684349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.686339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.687058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.688559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.811323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f43532c6-d79b-40a2-babe-67083abf10ed tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 241 microversion: 2.1 time: 0.641361 Sep 25 01:01:36.819125 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 141/294] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:36 2022] POST /compute/v2.1/os-aggregates/12/action => generated 241 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:36.827198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c38d419-6d9c-4444-8783-b0ff10518789 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.843011 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4c38d419-6d9c-4444-8783-b0ff10518789 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c38d419-6d9c-4444-8783-b0ff10518789 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Request method failure captured: Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6g0uGCX6r1EgB61tGVajqnLzzPpPcHIxdJQRS-1DI6MeyRqbkIuOWUrZlFnCzjLz3nBLH8gD27iXSkvrxT8SQFvomyNb3ic3fjm4OlvhoyuFIYT_3JS45hODk4WX6kV9HPdzZARguD-S2jeW30_L3-fynfMAskG19tGOdG3OMuSg6g Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:36.850072 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f7a84df4fc24fc4898dfb1a0aef9b92"}]}] Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7b488e3b4e064b559907146f62175f37 Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: exception: Aggregate 14 could not be found. Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '14'} Sep 25 01:01:36.851563 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.852293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 25 01:01:36.853388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.857864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c38d419-6d9c-4444-8783-b0ff10518789 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:36.859231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c38d419-6d9c-4444-8783-b0ff10518789 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.037567 Sep 25 01:01:36.860693 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 142/295] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:36 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:36.867551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79b0af71-bcb5-4f1d-b3eb-b46a491cde9f tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:36.872369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-79b0af71-bcb5-4f1d-b3eb-b46a491cde9f tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a86f4e46084b4343b80d07e1ebffb237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e2bd25bf09473c9a209cc718dec687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79b0af71-bcb5-4f1d-b3eb-b46a491cde9f tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Request method failure captured: Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 42 Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6gx98Q4Lvkfpb2sQEsqaQk4X8hWU8sMBF1FwgVc03gf4pdjc21MfjfosHP4PIki_aN3PDhFLzSZhoQnt9VR3zioUielHLObTE_vmrYYXagxMuDBncDOtFOz3t8Tbbaq3xiftEVzlliyikbhCbINIxOL1bELrqw2HjjIhanc6gGpkZs Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:36.875754 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76e2bd25bf09473c9a209cc718dec687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76e2bd25bf09473c9a209cc718dec687"}]}] Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 76e2bd25bf09473c9a209cc718dec687 Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420 Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a86f4e46084b4343b80d07e1ebffb237 Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1341023420-project Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: {"remove_host": {"host": "n-h1-master-1"}} Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:01:36.877080 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:36.878214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 25 01:01:36.879250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.883554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79b0af71-bcb5-4f1d-b3eb-b46a491cde9f tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:36.886830 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-79b0af71-bcb5-4f1d-b3eb-b46a491cde9f tempest-AggregatesAdminNegativeTestJSON-1341023420 tempest-AggregatesAdminNegativeTestJSON-1341023420-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.024422 Sep 25 01:01:36.892471 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 143/296] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:36 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:36.903004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e66e3140-3597-491c-a39a-5e5fb32fc476 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.918406 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e66e3140-3597-491c-a39a-5e5fb32fc476 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e66e3140-3597-491c-a39a-5e5fb32fc476 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Request method failure captured: Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6g0uGCX6r1EgB61tGVajqnLzzPpPcHIxdJQRS-1DI6MeyRqbkIuOWUrZlFnCzjLz3nBLH8gD27iXSkvrxT8SQFvomyNb3ic3fjm4OlvhoyuFIYT_3JS45hODk4WX6kV9HPdzZARguD-S2jeW30_L3-fynfMAskG19tGOdG3OMuSg6g Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:01:36.920902 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f7a84df4fc24fc4898dfb1a0aef9b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f7a84df4fc24fc4898dfb1a0aef9b92"}]}] Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0f7a84df4fc24fc4898dfb1a0aef9b92 Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1550469218 Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7b488e3b4e064b559907146f62175f37 Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AggregatesAdminTestJSON-1550469218-project-admin Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: exception: Aggregate 14 could not be found. Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '14'} Sep 25 01:01:36.922497 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:36.923381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:36.924628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:36.926028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:36.926028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:36.926028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:36.926028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 25 01:01:36.926028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:36.927370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e66e3140-3597-491c-a39a-5e5fb32fc476 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:36.929118 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e66e3140-3597-491c-a39a-5e5fb32fc476 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.035335 Sep 25 01:01:36.930351 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 144/297] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:36 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:36.936414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-318b3a6b-a407-4121-b754-d0462ea335f0 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:36.968394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-318b3a6b-a407-4121-b754-d0462ea335f0 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.969642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-318b3a6b-a407-4121-b754-d0462ea335f0 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.970512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-318b3a6b-a407-4121-b754-d0462ea335f0 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.131787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.145780 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7083a16e-e6a0-435a-9678-e17a76216f86 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1464 microversion: 2.1 time: 0.486401 Sep 25 01:01:37.147831 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 154/298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:36 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1464 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:37.154824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4bc8e856-c90b-4ba0-b19a-60e6094fd690 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-737790435"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:37.158779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-4bc8e856-c90b-4ba0-b19a-60e6094fd690 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid 252767a6-5af8-44cf-8652-2c5facae6e68 for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:37.203922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-318b3a6b-a407-4121-b754-d0462ea335f0 tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 226 microversion: 2.1 time: 0.270219 Sep 25 01:01:37.212733 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 145/299] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:36 2022] POST /compute/v2.1/os-aggregates/12/action => generated 226 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.227392 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4bc8e856-c90b-4ba0-b19a-60e6094fd690 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077863 Sep 25 01:01:37.229310 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 155/300] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.233984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.234960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:37.241727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-acedcd28-673a-4ca4-a5c5-42053bb4f17d tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.251991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:37.252943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:37.253961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.255464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:37.256967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:37.258250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.324978 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-acedcd28-673a-4ca4-a5c5-42053bb4f17d tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.094272 Sep 25 01:01:37.326049 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 156/301] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:37 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:37.336568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2de2a6fe-6c4a-4a4a-899e-9a11986bf5f8 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.347278 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2de2a6fe-6c4a-4a4a-899e-9a11986bf5f8 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.019852 Sep 25 01:01:37.348491 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 157/302] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:37 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.357183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce623771-3a7b-456a-9cea-25454fdea9fe tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-640141604"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:37.363501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.aggregate [None req-ce623771-3a7b-456a-9cea-25454fdea9fe tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Generated uuid 32c8fa48-4d59-4acb-a075-7a215b71ecad for aggregate {{(pid=122384) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:37.420090 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce623771-3a7b-456a-9cea-25454fdea9fe tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067137 Sep 25 01:01:37.421990 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 158/303] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.444700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c7eabff-e3e3-456f-ac01-14ce30ee5938 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:37.510440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c7eabff-e3e3-456f-ac01-14ce30ee5938 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.084699 Sep 25 01:01:37.526146 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 159/304] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:37 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.535929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:37.555922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.567450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d7d2fd8-c7dc-4132-989b-6922e3c1bc9d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1387 microversion: 2.1 time: 0.353289 Sep 25 01:01:37.572761 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 146/305] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:37 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1387 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:37.585052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:37.585957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:37.586829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.588056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-563854e0-c704-46f5-a9d1-129c12665298 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.607118 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-563854e0-c704-46f5-a9d1-129c12665298 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.031399 Sep 25 01:01:37.609439 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 147/306] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:01:37 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.624677 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:37.628780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5268464-aacb-45d6-8b8c-5811ef5496b9 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.635767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:37.637927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:37.640246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.672144 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5268464-aacb-45d6-8b8c-5811ef5496b9 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.047358 Sep 25 01:01:37.673304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 148/307] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:37 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:37.689116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.compute.aggregates [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 25 01:01:37.690125 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Sep 25 01:01:37.692457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7196ea82-0124-4c1b-af19-77904ac0f571 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1267813991", "availability_zone": "tempest-test_az-1523721242"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Request method failure captured: Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 42 Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6g0L4YwYtrpR8u9uUbnR9m3QEdndgLrsfq6KrbpGLu22djP_BvJ3wVqsm-FwC0pjbxc1P30-EjCSIO6rINr-bmJ0-mAx9XDxYGQaL6MOYRrL_IDz_LV5DA9zszQ1cX9f07rWafraxV2n9KsPJPKYmWt10GuGlzemwUcmQfaXryIJts Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:01:37.694977 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cce574297d2a41358efbef3d79964980"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cce574297d2a41358efbef3d79964980"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cce574297d2a41358efbef3d79964980"}]}] Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cce574297d2a41358efbef3d79964980 Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033 Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2dbda9f37d5c4ab880e9511f12bdc086 Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: {"remove_host": {"host": "nonexist_host"}} Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:37.696486 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot remove host nonexist_host in aggregate 16 Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 25 01:01:37.697210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 25 01:01:37.698403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.699481 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:37.700608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:37.702733 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37ab7c82-d3f0-4448-9910-044462aa155a tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.177262 Sep 25 01:01:37.709711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 160/308] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:01:37 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:01:37.727817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-7196ea82-0124-4c1b-af19-77904ac0f571 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid 33ccdd02-a0ee-4097-83b8-33da91afff70 for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:37.728068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b50bbe0c-d289-4ec5-b99f-30fb49c3e5fc tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.768428 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7196ea82-0124-4c1b-af19-77904ac0f571 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.090069 Sep 25 01:01:37.772271 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 149/309] 10.222.0.16 () {60 vars in 1165 bytes} [Sun Sep 25 01:01:37 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:37.787300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-493b1226-08e8-4d00-aec9-c63385ba2143 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1267813991_new", "availability_zone": "tempest-test_az-1523721242_new"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:37.806120 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b50bbe0c-d289-4ec5-b99f-30fb49c3e5fc tempest-AggregatesAdminNegativeTestJSON-1672235033 tempest-AggregatesAdminNegativeTestJSON-1672235033-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.090570 Sep 25 01:01:37.813506 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 161/310] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:37 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:37.899169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-794199432", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d0a01236-83f5-4729-abc0-e5ea5216c149"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:38.062648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-493b1226-08e8-4d00-aec9-c63385ba2143 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.063550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-493b1226-08e8-4d00-aec9-c63385ba2143 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.065557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:38.079426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-493b1226-08e8-4d00-aec9-c63385ba2143 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.192124 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-493b1226-08e8-4d00-aec9-c63385ba2143 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.411351 Sep 25 01:01:38.193283 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 150/311] 10.222.0.16 () {60 vars in 1173 bytes} [Sun Sep 25 01:01:37 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:38.239132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d7100a46-e295-4921-8f4a-81099c054f99 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.273573 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d7100a46-e295-4921-8f4a-81099c054f99 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.064096 Sep 25 01:01:38.292546 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 151/312] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:01:38 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:38.323737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bcf809c4-3603-4c3f-83c9-5689dec25255 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.340370 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:38.378939 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bcf809c4-3603-4c3f-83c9-5689dec25255 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.078638 Sep 25 01:01:38.380288 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 152/313] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:38 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 25 01:01:38.404968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f70b54c7-c384-4a39-97b0-ee9df44923c6 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1266464830"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:38.429188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-f70b54c7-c384-4a39-97b0-ee9df44923c6 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Generated uuid 8f5f5e1b-cfa5-4d94-ba47-7ce36c24ecfd for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:01:38.484319 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f70b54c7-c384-4a39-97b0-ee9df44923c6 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.086987 Sep 25 01:01:38.486357 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 153/314] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:01:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:38.511777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22a72294-4c74-4d62-8df8-30a8d1a2fd6a tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.544345 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22a72294-4c74-4d62-8df8-30a8d1a2fd6a tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.043623 Sep 25 01:01:38.547162 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 154/315] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:01:38 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:38.583609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-257bd328-a47a-41e3-9619-8164f9ed0189 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.659641 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-257bd328-a47a-41e3-9619-8164f9ed0189 tempest-AggregatesAdminTestJSON-1550469218 tempest-AggregatesAdminTestJSON-1550469218-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.091165 Sep 25 01:01:38.660712 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 155/316] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:01:38 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:38.683037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:38.683865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.684740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:38.685005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:38.686629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:38.687241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:38.687922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:38.703624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.705578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.706351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.708239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.708597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.709395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.710849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.712842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.713559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.715233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.715381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.716432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.767676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Getting quotas for project 66b3353b3fbc4f97a0387a6c40e4fb15. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:38.795764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Getting quotas for user 2eddf0cd4fb54de2ab7f26843380a1be and project 66b3353b3fbc4f97a0387a6c40e4fb15. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:38.836422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:38.841204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:38.993277 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f108541c-e591-4695-828b-8220e4fe09e4 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101612 Sep 25 01:01:39.001940 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 162/317] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:01:39.008220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:39.008734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:39.032974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.033504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.033955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.034683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.034944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:39.035157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.035557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.055470 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49928d95-ca19-4ac4-84b8-53fb41ac5ca2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1387 microversion: 2.1 time: 0.379811 Sep 25 01:01:39.056572 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 156/318] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:38 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1387 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:39.068368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c4a1fb5-583f-4011-af39-bfac12701f65 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:39.072021 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] HTTP exception thrown: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.076780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c4a1fb5-583f-4011-af39-bfac12701f65 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Request method failure captured: Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb HTTP/1.1 Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gx1Y-yvML3jNgowIJ-zH6lGIVGtain-kDvWTO2opz5yIw4icdfULdrEqOpGEEJDh3QgtVCeRAaUKiJmo6UN6COQDzmUKuoBmkGkuOrY72vsXFvivSMbtygXTMyJF3NoL_H_kcF7KPKHySjbnn59Myig1-qbZN0EvlB-2ZOeOZ-RWU Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 92c7bea122934e44b7908c805f431e0a Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:39.077804 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92c7bea122934e44b7908c805f431e0a"}]}] Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 92c7bea122934e44b7908c805f431e0a Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminTestJSON-1457782521-project Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 725bbefab51841029b79a380ca8b54da Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminTestJSON-1457782521-project Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.080207 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '787cab23-8c9f-4900-9d3d-f0560c55ebdb'} Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:39.082484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.086826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.093440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Returning 404 to user: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:39.093440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25edf030-c573-47f9-9b3c-349a01d34d7b tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "DELETE /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 404 len: 111 microversion: 2.1 time: 0.076462 Sep 25 01:01:39.093440 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 163/319] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:01:39 2022] DELETE /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:39.095818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a61ffba8-2899-48a3-bb43-6a9274da33e1 req-12ec5716-5d5b-4143-9a43-5674f1cd2dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9", "name": "network-vif-plugged", "status": "completed", "tag": "33acd010-934e-4f55-8380-0cfef9002b2f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:39.120691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a61ffba8-2899-48a3-bb43-6a9274da33e1 req-12ec5716-5d5b-4143-9a43-5674f1cd2dc7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.121189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a61ffba8-2899-48a3-bb43-6a9274da33e1 req-12ec5716-5d5b-4143-9a43-5674f1cd2dc7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.121765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a61ffba8-2899-48a3-bb43-6a9274da33e1 req-12ec5716-5d5b-4143-9a43-5674f1cd2dc7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.145331 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a61ffba8-2899-48a3-bb43-6a9274da33e1 req-12ec5716-5d5b-4143-9a43-5674f1cd2dc7 service nova] Creating event network-vif-plugged:33acd010-934e-4f55-8380-0cfef9002b2f for instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 on n-h1-master-1 Sep 25 01:01:39.158353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a61ffba8-2899-48a3-bb43-6a9274da33e1 req-12ec5716-5d5b-4143-9a43-5674f1cd2dc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069794 Sep 25 01:01:39.158959 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 164/320] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:39.167356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:39.175883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] [instance: 787cab23-8c9f-4900-9d3d-f0560c55ebdb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:39.190133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.195526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.196370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.197342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.200112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.201911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.230812 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] HTTP exception thrown: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Request method failure captured: Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb HTTP/1.1 Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6gx1Y-yvML3jNgowIJ-zH6lGIVGtain-kDvWTO2opz5yIw4icdfULdrEqOpGEEJDh3QgtVCeRAaUKiJmo6UN6COQDzmUKuoBmkGkuOrY72vsXFvivSMbtygXTMyJF3NoL_H_kcF7KPKHySjbnn59Myig1-qbZN0EvlB-2ZOeOZ-RWU Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 92c7bea122934e44b7908c805f431e0a Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:01:39.234086 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92c7bea122934e44b7908c805f431e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92c7bea122934e44b7908c805f431e0a"}]}] Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 92c7bea122934e44b7908c805f431e0a Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1457782521 Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AggregatesAdminTestJSON-1457782521-project Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 725bbefab51841029b79a380ca8b54da Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AggregatesAdminTestJSON-1457782521-project Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.235536 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '787cab23-8c9f-4900-9d3d-f0560c55ebdb'} Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:39.236329 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. Sep 25 01:01:39.237644 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:01:39.242976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] Returning 404 to user: Instance 787cab23-8c9f-4900-9d3d-f0560c55ebdb could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:39.246551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b187cd8-94b5-43ee-ac68-c05bcd29ba5e tempest-AggregatesAdminTestJSON-1457782521 tempest-AggregatesAdminTestJSON-1457782521-project] 10.222.0.16 "GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb" status: 404 len: 111 microversion: 2.1 time: 0.083138 Sep 25 01:01:39.247492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 165/321] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/servers/787cab23-8c9f-4900-9d3d-f0560c55ebdb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:39.269260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7c4a1fb5-583f-4011-af39-bfac12701f65 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:39.287117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c4a1fb5-583f-4011-af39-bfac12701f65 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1213 microversion: 2.1 time: 0.223538 Sep 25 01:01:39.289848 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 157/322] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:40.116817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:40.120352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:40.141262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.143123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe48a8e5-eace-4f50-8126-559ee5fd6b1a tempest-InstanceUsageAuditLogTestJSON-1329667815 tempest-InstanceUsageAuditLogTestJSON-1329667815-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:40.144890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.146327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.148566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.149842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.153826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.183532 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe48a8e5-eace-4f50-8126-559ee5fd6b1a tempest-InstanceUsageAuditLogTestJSON-1329667815 tempest-InstanceUsageAuditLogTestJSON-1329667815-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-25 01:01:39" status: 200 len: 318 microversion: 2.1 time: 0.668831 Sep 25 01:01:40.184418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 166/323] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-25%2001%3A01%3A39 => generated 318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:40.200582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b5ef1ee-459d-4976-b554-06867aaf64ff tempest-InstanceUsageAuditLogTestJSON-1329667815 tempest-InstanceUsageAuditLogTestJSON-1329667815-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:40.218265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b5ef1ee-459d-4976-b554-06867aaf64ff tempest-InstanceUsageAuditLogTestJSON-1329667815 tempest-InstanceUsageAuditLogTestJSON-1329667815-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021292 Sep 25 01:01:40.229130 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 167/324] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:01:40 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:40.320133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:40.321173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:40.340294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.341480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.342104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.347042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.347783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.348484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.505236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:40.516217 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c386a826-9629-4971-b085-7bd9dc62e3dc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1209 microversion: 2.1 time: 0.206358 Sep 25 01:01:40.516805 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 168/325] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:40 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1209 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:40.673570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:40.683962 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9f7159f-9903-444c-8681-24f2d343a5a4 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1387 microversion: 2.1 time: 0.590905 Sep 25 01:01:40.685049 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 158/326] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:40 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1387 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:41.549011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:41.550156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:41.580014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.580847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.586933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.591287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.592614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.606722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.709689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:41.710812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:41.727082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.729816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.731796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.733942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.737922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.738784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.858109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:41.868158 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e25a3a9-6da6-43ca-922c-a5feed52fdd9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1271 microversion: 2.1 time: 0.326825 Sep 25 01:01:41.881784 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 169/327] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:41 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1271 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:42.752471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:42.775973 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c4011d9-ecec-4d6b-8817-8d625ab59043 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1585 microversion: 2.1 time: 1.071642 Sep 25 01:01:42.778002 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 159/328] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:41 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1585 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:42.812353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:42.820067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:42.846287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.847029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.847814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.851354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.852103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.853785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.901677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:42.902813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:42.916852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.918572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.919029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.920154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.924718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.924718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.047731 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a98592c-120c-4392-810e-4d0c20443c95 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249205 Sep 25 01:01:43.048762 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 170/329] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:01:42 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:43.094335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:43.135307 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-067a36df-bb85-400e-a465-c5790eb8c2f0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1271 microversion: 2.1 time: 0.242970 Sep 25 01:01:43.142651 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 160/330] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:42 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:43.606003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-974730767", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:43.722711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:44.189099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:44.191942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:44.236197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:44.238710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:44.242316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:44.251326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:44.251891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:44.252353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:44.629918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:44.631218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:44.632002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:44.633459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:44.633982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:44.647712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:44.648688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:44.649477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:44.650583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:44.651383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:44.652145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:44.683849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Getting quotas for project 4ea70b1c1150462fb7ad97fa83ef8060. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:44.694472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Getting quotas for user 54541ffbbb8d4f24a054d1d7a80f7152 and project 4ea70b1c1150462fb7ad97fa83ef8060. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:44.740765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:44.747351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:44.909573 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f0171e8-225a-4a21-b0c0-c91d74367f0d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859477 Sep 25 01:01:44.913065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 171/331] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:44.925139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cfac5146-c87f-4d20-8ce9-4b2a366ba34a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:44.927211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cfac5146-c87f-4d20-8ce9-4b2a366ba34a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:45.450499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cfac5146-c87f-4d20-8ce9-4b2a366ba34a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:45.500282 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cfac5146-c87f-4d20-8ce9-4b2a366ba34a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1221 microversion: 2.1 time: 0.575177 Sep 25 01:01:45.514816 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 172/332] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:44 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1221 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:45.964139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:45.999233 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10277c6d-5d56-4ab9-b3d0-8b538624f2f7 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 1.823524 Sep 25 01:01:46.008581 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 161/333] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:44 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:46.551320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:46.557660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:46.594270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:46.596749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:46.602270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:46.604035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:46.606635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:46.607551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:46.626290 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:47.371996 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:47.412284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-98577fe3-39ce-4e0a-9b7a-fab7e3257f7d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1217 microversion: 2.1 time: 0.880424 Sep 25 01:01:47.437732 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 162/334] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:46 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1217 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:47.457452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:47.459551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:47.473003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.474365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.475467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.477193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.478338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.479378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.740245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Calling method '.version_select at 0x7f7bf06604c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:47.750487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.751453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.752165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.787896 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:47.836398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.838690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.839707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.885426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.888267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.889874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.908244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c395dbc-d866-4c22-b060-250eec5bb006 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.662753 Sep 25 01:01:47.910705 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 173/335] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:01:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:47.960420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Calling method '.version_select at 0x7f7bf05d9ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:47.967624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.969589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.970996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.062429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.063788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.065830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.194757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.195390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.195950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.207349 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c3714a9-8bb0-4d42-8707-1791f794a412 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.283731 Sep 25 01:01:48.213872 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 174/336] 10.222.0.16 () {58 vars in 1212 bytes} [Sun Sep 25 01:01:47 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:48.231381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Calling method '.version_select at 0x7f7bf05d9940>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:48.235730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.238935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.239827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.276607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.277517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.278247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.306585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.307507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.309315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.318127 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2b0689b-6d9d-481c-accf-e926181a9205 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093880 Sep 25 01:01:48.319183 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 175/337] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:01:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:48.331978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Calling method '.version_select at 0x7f7bf08015e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:48.335298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.336127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.336957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.354364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.355213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.356560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.368995 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f808046d-599e-4171-bc7f-a4968fdf3455 tempest-HypervisorAdminUnderV252Test-1416958954 tempest-HypervisorAdminUnderV252Test-1416958954-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.040351 Sep 25 01:01:48.380029 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 176/338] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:01:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:48.457609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:48.458360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:48.468064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.472646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.476783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.480432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.481960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.482591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.645800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:48.680857 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7b2baf0f-b031-4a97-8e7b-c855f1c14294 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 1.229801 Sep 25 01:01:48.681849 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 163/339] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:47 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:48.788054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:48.830766 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56a467cb-861e-4400-b4f0-6da4165e2e7f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1279 microversion: 2.1 time: 0.372923 Sep 25 01:01:48.834769 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 177/340] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:48 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1279 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:49.719018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:49.721266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:49.732695 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:49.756168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.757511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.762324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.764672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.767340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.769341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.878034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:49.878843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:49.895651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.901356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.902202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.909121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.909984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.911237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.985510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.005236 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-46cf6501-9538-4a21-a38a-a89721d8c1e3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 1.300575 Sep 25 01:01:51.019685 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 164/341] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:49 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:51.073680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.088255 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a36e7e00-f2cd-4f71-8b52-d800338dd8dd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1279 microversion: 2.1 time: 1.214559 Sep 25 01:01:51.096596 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 178/342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:49 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1279 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:51.104321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:51.108689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:51.137550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.143337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.149365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.154881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.156473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.159162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.290531 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:51.590112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb18480-ae17-402c-8133-498248ddf315 tempest-AZAdminNegativeTestJSON-1437641643 tempest-AZAdminNegativeTestJSON-1437641643-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:51.592755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7cb18480-ae17-402c-8133-498248ddf315 tempest-AZAdminNegativeTestJSON-1437641643 tempest-AZAdminNegativeTestJSON-1437641643-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'eb6ccf9572bb43fe90785249bb9ea41f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ae1333727f4b3f93a5a473981243b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb18480-ae17-402c-8133-498248ddf315 tempest-AZAdminNegativeTestJSON-1437641643 tempest-AZAdminNegativeTestJSON-1437641643-project] Request method failure captured: Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6h7bl_Sol_BH-eo7IMkoetCVBKxwRnfye1CxmKqL3UpVyIdjAvn9WNSLqyfYGzJYmutLsHpq_CKbR2WVmxTdwQdfdGl8mAXgxYKue30d3ngH2-Pv2gjE9Q5C4q6Onxh7fKJGAs61h_wcAvMvJ6x_X9aVysjLucEhYwZ0AIQIuFahXY Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 81ae1333727f4b3f93a5a473981243b4 Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1437641643 Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:01:51.596684 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81ae1333727f4b3f93a5a473981243b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81ae1333727f4b3f93a5a473981243b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81ae1333727f4b3f93a5a473981243b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81ae1333727f4b3f93a5a473981243b4"}]}] Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AZAdminNegativeTestJSON-1437641643 Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 81ae1333727f4b3f93a5a473981243b4 Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1437641643 Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AZAdminNegativeTestJSON-1437641643-project Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: eb6ccf9572bb43fe90785249bb9ea41f Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AZAdminNegativeTestJSON-1437641643-project Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 25 01:01:51.599070 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:01:51.601029 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 25 01:01:51.602517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:01:51.613371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb18480-ae17-402c-8133-498248ddf315 tempest-AZAdminNegativeTestJSON-1437641643 tempest-AZAdminNegativeTestJSON-1437641643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:01:51.619445 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7cb18480-ae17-402c-8133-498248ddf315 tempest-AZAdminNegativeTestJSON-1437641643 tempest-AZAdminNegativeTestJSON-1437641643-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.586896 Sep 25 01:01:51.621501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 165/343] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:01:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 590 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:01:52.043969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82a8c279-2108-417f-bd09-719aeef10965 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-104378620", "ram": 512, "vcpus": 1, "disk": 10, "id": 1874492471, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:52.085829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82a8c279-2108-417f-bd09-719aeef10965 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.462428 Sep 25 01:01:52.100081 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 166/344] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:51 2022] POST /compute/v2.1/flavors => generated 415 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:52.111480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-512d2d20-02c4-4cbf-9509-d057b8531509 req-e389c3a0-15a8-4410-bd50-78efbbc5c883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9", "tag": "33acd010-934e-4f55-8380-0cfef9002b2f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:52.137237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-512d2d20-02c4-4cbf-9509-d057b8531509 req-e389c3a0-15a8-4410-bd50-78efbbc5c883 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.140414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-512d2d20-02c4-4cbf-9509-d057b8531509 req-e389c3a0-15a8-4410-bd50-78efbbc5c883 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.144745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-512d2d20-02c4-4cbf-9509-d057b8531509 req-e389c3a0-15a8-4410-bd50-78efbbc5c883 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.207386 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-512d2d20-02c4-4cbf-9509-d057b8531509 req-e389c3a0-15a8-4410-bd50-78efbbc5c883 service nova] Creating event network-changed:33acd010-934e-4f55-8380-0cfef9002b2f for instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 on n-h1-master-1 Sep 25 01:01:52.228156 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-512d2d20-02c4-4cbf-9509-d057b8531509 req-e389c3a0-15a8-4410-bd50-78efbbc5c883 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126361 Sep 25 01:01:52.246775 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 167/345] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:52.276358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:52.280494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:52.317514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.335775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.337274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.341247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.345061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.351268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:53.024188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:53.035344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-013d8fac-4573-473c-941d-ad4fc85113b6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 200 len: 1585 microversion: 2.1 time: 1.936874 Sep 25 01:01:53.041636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 179/346] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:51 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 1585 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:53.053626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28fb9b82-002c-40dd-bd32-93f961315f8e tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:53.123017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-28fb9b82-002c-40dd-bd32-93f961315f8e tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078456 Sep 25 01:01:53.124922 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 180/347] 10.222.0.16 () {60 vars in 1224 bytes} [Sun Sep 25 01:01:53 2022] POST /compute/v2.1/flavors/1874492471/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:53.139531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:53.142256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:53.158714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:53.159524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:53.160124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:53.161397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:53.163048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:53.164045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:53.459891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:53.485248 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4513752e-73c7-47b2-ab18-55a1b94f352a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1279 microversion: 2.1 time: 0.355673 Sep 25 01:01:53.494381 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 181/348] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:53 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1279 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:53.805549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:53.828822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27650212-24e3-4ae7-b79f-f02a8ed2f393 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 1.575417 Sep 25 01:01:53.846347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-349153413", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:53.846499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 168/349] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:52 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:54.060105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:54.215850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-213ca74d-a8e1-4a58-bb02-95e3fda5f9fe tempest-FlavorsExtraSpecsTestJSON-2121346492 tempest-FlavorsExtraSpecsTestJSON-2121346492-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:54.253946 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-213ca74d-a8e1-4a58-bb02-95e3fda5f9fe tempest-FlavorsExtraSpecsTestJSON-2121346492 tempest-FlavorsExtraSpecsTestJSON-2121346492-project] 10.222.0.16 "GET /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.419230 Sep 25 01:01:54.263774 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 169/350] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:01:53 2022] GET /compute/v2.1/flavors/1874492471/os-extra_specs => generated 66 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:54.297385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5e3f2a00-d2a3-4bef-9982-6156fee99292 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:54.403088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5e3f2a00-d2a3-4bef-9982-6156fee99292 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.127208 Sep 25 01:01:54.404525 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 170/351] 10.222.0.16 () {60 vars in 1224 bytes} [Sun Sep 25 01:01:54 2022] POST /compute/v2.1/flavors/1874492471/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:01:54.420553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e0dcdc0b-ac3f-4c7d-b374-bebdd373c107 req-67abfafe-c42f-4b33-adb2-c670db98a2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa95a264-1a20-4603-afec-9a327196920a", "tag": "49af7cda-f46e-41cb-8981-c2ce676ada7d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:54.435677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e0dcdc0b-ac3f-4c7d-b374-bebdd373c107 req-67abfafe-c42f-4b33-adb2-c670db98a2f4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:54.436567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e0dcdc0b-ac3f-4c7d-b374-bebdd373c107 req-67abfafe-c42f-4b33-adb2-c670db98a2f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:54.437222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e0dcdc0b-ac3f-4c7d-b374-bebdd373c107 req-67abfafe-c42f-4b33-adb2-c670db98a2f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:54.491910 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e0dcdc0b-ac3f-4c7d-b374-bebdd373c107 req-67abfafe-c42f-4b33-adb2-c670db98a2f4 service nova] Creating event network-changed:49af7cda-f46e-41cb-8981-c2ce676ada7d for instance aa95a264-1a20-4603-afec-9a327196920a on n-h2-master-1 Sep 25 01:01:54.508798 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e0dcdc0b-ac3f-4c7d-b374-bebdd373c107 req-67abfafe-c42f-4b33-adb2-c670db98a2f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099442 Sep 25 01:01:54.512198 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 171/352] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:54.526619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a2a7cb4-b2b9-4292-aaaa-20e23c2f0598 tempest-FlavorsExtraSpecsTestJSON-2121346492 tempest-FlavorsExtraSpecsTestJSON-2121346492-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:54.543283 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a2a7cb4-b2b9-4292-aaaa-20e23c2f0598 tempest-FlavorsExtraSpecsTestJSON-2121346492 tempest-FlavorsExtraSpecsTestJSON-2121346492-project] 10.222.0.16 "GET /compute/v2.1/flavors/1874492471/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.029268 Sep 25 01:01:54.546164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 172/353] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:01:54 2022] GET /compute/v2.1/flavors/1874492471/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:54.557667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:54.559744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:54.585685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:54.589222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:54.590176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:54.591342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:54.592443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:54.593199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:54.668344 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=5 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:54.961178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:55.009379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01f9803b-9554-4d9b-94ae-17f785459d72 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1279 microversion: 2.1 time: 0.461856 Sep 25 01:01:55.015929 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 173/354] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:54 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1279 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:55.055763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f63d3de3-3d25-486c-857b-e80bb8028e7d tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:55.125245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:55.125998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:55.127087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:55.128020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:55.128654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:55.165102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.170992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.172053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.174835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.179016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.179989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.195660 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f63d3de3-3d25-486c-857b-e80bb8028e7d tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.164684 Sep 25 01:01:55.196961 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 174/355] 10.222.0.16 () {60 vars in 1224 bytes} [Sun Sep 25 01:01:55 2022] POST /compute/v2.1/flavors/1874492471/os-extra_specs => generated 66 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:55.228844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:55.235740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:55.272647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Getting quotas for project 065df012fefb435e9a3329b6b1b51b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:55.274172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.274857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.277300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.282038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.283707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.286024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.299504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Getting quotas for user f8c135c37b804252a8275d28972d8c31 and project 065df012fefb435e9a3329b6b1b51b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:55.361922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:55.368439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:55.572336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de63e325-fb87-417d-b9dc-f7b326226735 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075973 Sep 25 01:01:55.573007 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 182/356] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:55.590465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aec93690-6343-46de-a4ad-6ab6db7e1783 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:55.612310 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aec93690-6343-46de-a4ad-6ab6db7e1783 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032922 Sep 25 01:01:55.613254 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 183/357] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:01:55 2022] GET /compute/v2.1/flavors/1874492471/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:55.892918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63070b2f-1ef8-4fa6-a0e6-96bd8bc1e6d2 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Action: 'create', calling method: .version_select at 0x7f7bf06e2700>, body: {"pool": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:56.051289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:56.098428 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-56f203fd-fc1c-472e-a6af-83acf7df40e0 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 0.886983 Sep 25 01:01:56.117193 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 175/358] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:55 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:56.144848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-05521e82-d8ee-459f-b702-534ee3554d78 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:56.147457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-05521e82-d8ee-459f-b702-534ee3554d78 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:56.392525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-05521e82-d8ee-459f-b702-534ee3554d78 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:56.401267 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-05521e82-d8ee-459f-b702-534ee3554d78 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1218 microversion: 2.1 time: 0.282428 Sep 25 01:01:56.403064 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 176/359] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:56 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1218 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:56.414637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ece16848-4202-483f-bfa3-c659778e33a5 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:56.517760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ece16848-4202-483f-bfa3-c659778e33a5 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1874492471/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.111265 Sep 25 01:01:56.532221 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 177/360] 10.222.0.16 () {60 vars in 1265 bytes} [Sun Sep 25 01:01:56 2022] PUT /compute/v2.1/flavors/1874492471/os-extra_specs/hw:numa_nodes => generated 22 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:56.553836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:56.555383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:56.593916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:56.594422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:56.598364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:56.600400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:56.601436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:56.603132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:57.658704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:57.681506 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-72d4e4f2-4a78-49dd-9d55-7237f4694150 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 1.146793 Sep 25 01:01:57.682887 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 178/361] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:56 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:57.694210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d3f5884-d67c-45b6-94ac-59d35919ba77 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:57.710483 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d3f5884-d67c-45b6-94ac-59d35919ba77 tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024292 Sep 25 01:01:57.715719 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 179/362] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:01:57 2022] GET /compute/v2.1/flavors/1874492471/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:01:57.729714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:57.730836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:57.740683 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=4,nova_api:INSERT=2,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:57.751237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:57.753461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:57.754978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:57.758759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:57.760179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:57.761197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.513564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:58.552456 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4bdbc4f1-7fcc-441f-b6d5-7de0c330f86a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 0.834351 Sep 25 01:01:58.553970 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 180/363] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:57 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:58.566061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:58.567584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:58.579077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.580563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.581653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.583108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.585829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.586946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:59.056585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:59.073965 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4106be9-c71d-48e9-b8d8-718df26d8d69 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1288 microversion: 2.1 time: 0.517525 Sep 25 01:01:59.085507 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:58 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1288 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:59.085507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0fa251e-aaa3-4f7c-9229-ca204e3a49cc tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:59.133996 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0fa251e-aaa3-4f7c-9229-ca204e3a49cc tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1874492471/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.055240 Sep 25 01:01:59.134766 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 182/365] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:01:59 2022] DELETE /compute/v2.1/flavors/1874492471/os-extra_specs/hw:numa_nodes => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:01:59.146334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:59.147548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:59.164475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:59.165216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:59.165999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:59.167579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:59.169446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:59.171456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:00.125057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:00.144240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b727647c-95e3-4d1f-8dbf-283d6358a85e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 1.008208 Sep 25 01:02:00.152268 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 183/366] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:59 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:00.181175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3bf61ae1-080a-41a6-b257-e9d9695c5acd tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:00.299902 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3bf61ae1-080a-41a6-b257-e9d9695c5acd tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1874492471/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.139526 Sep 25 01:02:00.301880 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 184/367] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:02:00 2022] DELETE /compute/v2.1/flavors/1874492471/os-extra_specs/hw:cpu_policy => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:02:00.340103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:00.350982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:00.379716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:00.382188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:00.387406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:00.390245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:00.394760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:00.398156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.821721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:01.835793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d893987b-951d-4a0a-8126-f0afe98cad78 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 1.527399 Sep 25 01:02:01.843018 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 185/368] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:00 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:01.873078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:01.891105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:01.909581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.910916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.912123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.915287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.919500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.920746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.276968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:02.327671 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7332845d-0f9a-4663-823c-6b85ff358a3f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1276 microversion: 2.1 time: 0.474531 Sep 25 01:02:02.330497 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 186/369] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:01 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1276 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:02.348204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-38f5b552-35eb-486c-a513-7ed5f0de1bf5 req-40bb5ea0-5597-4297-81ea-7b717d74e2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9146f07-eb2d-4aa7-b34f-6fee344aa4b6", "tag": "861cf8e4-f251-4647-a4f9-f68bf01ccc26"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:02.377630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38f5b552-35eb-486c-a513-7ed5f0de1bf5 req-40bb5ea0-5597-4297-81ea-7b717d74e2fc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.382536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38f5b552-35eb-486c-a513-7ed5f0de1bf5 req-40bb5ea0-5597-4297-81ea-7b717d74e2fc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.383857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38f5b552-35eb-486c-a513-7ed5f0de1bf5 req-40bb5ea0-5597-4297-81ea-7b717d74e2fc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.428039 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-38f5b552-35eb-486c-a513-7ed5f0de1bf5 req-40bb5ea0-5597-4297-81ea-7b717d74e2fc service nova] Creating event network-changed:861cf8e4-f251-4647-a4f9-f68bf01ccc26 for instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 on n-h1-master-1 Sep 25 01:02:02.444801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-38f5b552-35eb-486c-a513-7ed5f0de1bf5 req-40bb5ea0-5597-4297-81ea-7b717d74e2fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111696 Sep 25 01:02:02.447009 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 187/370] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:02.459708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7ee356aa-cefe-48b6-b44f-0f0ffb105dbb tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:02.490969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7ee356aa-cefe-48b6-b44f-0f0ffb105dbb tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1874492471/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040601 Sep 25 01:02:02.493944 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 188/371] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 25 01:02:02 2022] GET /compute/v2.1/flavors/1874492471/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:02.505808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:02.506401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:02.524199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.525568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.526810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.528872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.530669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.533257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.138818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:03.163681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b704f95-1a90-40ef-a573-0ebd647ec871 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 0.666364 Sep 25 01:02:03.165344 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 189/372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:02 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:03.176799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-580213e4-1c24-4c37-a096-c9887f8d5103 req-415cb2a9-96dc-45ac-805a-06fa2a18dabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa95a264-1a20-4603-afec-9a327196920a", "name": "network-vif-plugged", "status": "completed", "tag": "49af7cda-f46e-41cb-8981-c2ce676ada7d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:03.199407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-580213e4-1c24-4c37-a096-c9887f8d5103 req-415cb2a9-96dc-45ac-805a-06fa2a18dabd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.200396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-580213e4-1c24-4c37-a096-c9887f8d5103 req-415cb2a9-96dc-45ac-805a-06fa2a18dabd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:03.201260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-580213e4-1c24-4c37-a096-c9887f8d5103 req-415cb2a9-96dc-45ac-805a-06fa2a18dabd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.234090 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-580213e4-1c24-4c37-a096-c9887f8d5103 req-415cb2a9-96dc-45ac-805a-06fa2a18dabd service nova] Creating event network-vif-plugged:49af7cda-f46e-41cb-8981-c2ce676ada7d for instance aa95a264-1a20-4603-afec-9a327196920a on n-h2-master-1 Sep 25 01:02:03.246836 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-580213e4-1c24-4c37-a096-c9887f8d5103 req-415cb2a9-96dc-45ac-805a-06fa2a18dabd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078374 Sep 25 01:02:03.248476 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 190/373] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:03.302960 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63070b2f-1ef8-4fa6-a0e6-96bd8bc1e6d2 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.684060 Sep 25 01:02:03.319573 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 184/374] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:01:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:03.338915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f97b86c-5d09-43a7-b43a-7f5eeb74f0fb tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:03.381835 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7f97b86c-5d09-43a7-b43a-7f5eeb74f0fb tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1874492471" status: 202 len: 0 microversion: 2.1 time: 0.054102 Sep 25 01:02:03.395009 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 185/375] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:02:03 2022] DELETE /compute/v2.1/flavors/1874492471 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:03.406934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:03.410105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:03.424541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.425049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:03.427373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.429980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.431645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:03.432512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.727107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-444bbe40-bed0-4757-bbac-90f0057ad5af tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-62294073", "id": 34973164, "os-flavor-access:is_public": "False"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:03.793989 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-444bbe40-bed0-4757-bbac-90f0057ad5af tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.529427 Sep 25 01:02:03.806351 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 191/376] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:03 2022] POST /compute/v2.1/flavors => generated 431 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:03.813066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6b815f4-55b5-4bb9-ae21-85d78248acf7 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Calling method '.version_select at 0x7f7bf08274c0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:04.251529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:04.297895 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f0c08677-1586-478f-822e-c085ea4c36c2 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1313 microversion: 2.1 time: 0.901212 Sep 25 01:02:04.303305 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 186/377] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:03 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:04.319438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:04.331243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:04.364438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.366342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.367164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.368616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.369868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.371453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.947061 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6b815f4-55b5-4bb9-ae21-85d78248acf7 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/cf5ff4e5-74ef-400e-9585-ca31ec45c008" status: 200 len: 142 microversion: 2.1 time: 1.138179 Sep 25 01:02:04.950609 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 192/378] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:02:03 2022] GET /compute/v2.1/os-floating-ips/cf5ff4e5-74ef-400e-9585-ca31ec45c008 => generated 142 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:04.970298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da00e340-c0b5-4168-aa80-2ce680a715bd tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:05.023021 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da00e340-c0b5-4168-aa80-2ce680a715bd tempest-FlavorsExtraSpecsTestJSON-1791727938 tempest-FlavorsExtraSpecsTestJSON-1791727938-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.070553 Sep 25 01:02:05.031186 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 193/379] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:04 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:05.049641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e735f1a9-67f5-4282-a73a-14b0a79351ac tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:05.218175 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:05.225919 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e735f1a9-67f5-4282-a73a-14b0a79351ac tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/34973164/action" status: 200 len: 95 microversion: 2.1 time: 0.192730 Sep 25 01:02:05.228937 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 194/380] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:02:05 2022] POST /compute/v2.1/flavors/34973164/action => generated 95 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:05.237213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:05.240733 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:05.249071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:05.250439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:05.253763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:05.259165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:05.260268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:05.260944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:05.328756 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=28 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:05.342922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.366648 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-619fb0dd-371d-42a1-be78-819c48a18cb6 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 1.059325 Sep 25 01:02:05.369514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 187/381] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:04 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:05.377199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3c027b1-5a9b-4e4b-96d7-adc2ace6efde tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Calling method '.version_select at 0x7f7bf0506b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:05.884784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.903178 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df9b7b17-3de4-43b4-80cb-bdc25ca19d3a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 0.672521 Sep 25 01:02:05.923192 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 195/382] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:05 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:05.929597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f109c1c6-fd74-496f-82fd-3185ed7acb18 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:06.339933 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-f109c1c6-fd74-496f-82fd-3185ed7acb18 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 57fad5b693b748178d29d74b8db37170 combination. Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f109c1c6-fd74-496f-82fd-3185ed7acb18 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Request method failure captured: Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/flavors/34973164/action HTTP/1.1 Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 67 Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iIDwoxVy87nTs9xGC2lBMQ6I3aeIsAodY_70ptYdkWQecMHcLFTLXMpGcp8cND7lhudoyJ0BNmqg5VGnSBWG6Cge8eP2dHdARs0rGPPRGcu8Alf2eXI5hl0pOM6_OpvCY2WH_-ZJ4XWKqos6RlBIAD83z_yo227zX3DLTICnuVAJQ Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 46d06f64c93c49af8d1e9d9c6cb46d4e Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:06.366627 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46d06f64c93c49af8d1e9d9c6cb46d4e"}]}] Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 46d06f64c93c49af8d1e9d9c6cb46d4e Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b7e34e5ca888434db19d7ab9139a30f7 Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: {"addTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} Sep 25 01:02:06.367982 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: exception: Flavor access already exists for flavor 32 and project 57fad5b693b748178d29d74b8db37170 combination. Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '34973164', 'body': {'addTenantAccess': {'tenant': '57fad5b693b748178d29d74b8db37170'}}} Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result.read() Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:02:06.368791 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-57fad5b693b748178d29d74b8db37170' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi session.flush() Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 01:02:06.369891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 01:02:06.372094 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:02:06.373317 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result.read() Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-57fad5b693b748178d29d74b8db37170' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 25, 1, 2, 6, 330309), 'updated_at': None, 'flavor_id': 32, 'project_id': '57fad5b693b748178d29d74b8db37170'}] Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:06.374750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 57fad5b693b748178d29d74b8db37170 combination. Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:06.376379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 57fad5b693b748178d29d74b8db37170 combination. Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:06.377736 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:06.381784 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 57fad5b693b748178d29d74b8db37170 combination. Sep 25 01:02:06.381784 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:06.381784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f109c1c6-fd74-496f-82fd-3185ed7acb18 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 57fad5b693b748178d29d74b8db37170 combination. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:06.381784 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f109c1c6-fd74-496f-82fd-3185ed7acb18 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/34973164/action" status: 409 len: 152 microversion: 2.1 time: 0.443186 Sep 25 01:02:06.381784 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 196/383] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:02:05 2022] POST /compute/v2.1/flavors/34973164/action => generated 152 bytes in 445 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:02:06.383769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:06.383769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:06.399178 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:06.403450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.404155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.404738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.405618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.406164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.406878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.413531 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3c027b1-5a9b-4e4b-96d7-adc2ace6efde tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.042511 Sep 25 01:02:06.414968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 188/384] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:02:05 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:06.420107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9486ca62-3d56-455b-a415-85b8e41ee876 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:06.593970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9486ca62-3d56-455b-a415-85b8e41ee876 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/34973164/action" status: 200 len: 21 microversion: 2.1 time: 0.177506 Sep 25 01:02:06.595043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 189/385] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:02:06 2022] POST /compute/v2.1/flavors/34973164/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:06.650250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:06.662155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:06.687711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.691093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.694478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.698347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.699956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.700737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.156460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:07.165638 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2b634f9-bc34-4c87-9d00-912c166b106f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.562967 Sep 25 01:02:07.166276 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 190/386] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:06 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:07.189992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c2ad80b-f3a5-4ffb-ab2e-19d3130c754e tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Calling method '.version_select at 0x7f7bf0506310>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:07.259730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:07.284063 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-34b0e764-343c-4fc5-87e6-c945a50cbcb6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1462 microversion: 2.1 time: 0.913317 Sep 25 01:02:07.303744 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:06 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1462 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:07.323628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-46f51ae6-c88f-483b-a985-3355d0407a32 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:07.385978 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-46f51ae6-c88f-483b-a985-3355d0407a32 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/34973164" status: 202 len: 0 microversion: 2.1 time: 0.079720 Sep 25 01:02:07.387068 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 198/388] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:02:07 2022] DELETE /compute/v2.1/flavors/34973164 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:07.421775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:07.427369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:07.457438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.458499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.475049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.476619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.477590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.478282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.542336 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:07.967850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:07.983828 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-65fcf990-1944-4c4d-9c4b-03af2bbd6b8e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 0.591426 Sep 25 01:02:07.998465 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 199/389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:07 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:08.660054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:08.689328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'deleted': False, 'project_id': 'f14704bcf9e547a88595a26c70a98a00'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:08.706713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:08.707644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:08.709304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:08.711329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:08.717476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:08.717476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:08.921924 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-812de028-ff07-4f91-a1d5-2d7dffb15a39 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.920570 Sep 25 01:02:08.937154 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 200/390] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:08.960921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c3e8180-4791-47ee-b788-043cf37f6950 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.052396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c3e8180-4791-47ee-b788-043cf37f6950 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.113559 Sep 25 01:02:09.056319 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 201/391] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:08 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:09.061700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e0d5023b-f90e-40ca-b998-8697ae7669f2 req-ab12d4ea-b5eb-40ce-98a4-fcd68e078011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5ac0ec-3af1-4bbe-b344-63a288ec6344", "tag": "b38c1410-4bb1-4aba-9f89-06cbac454855"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:09.072586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e0d5023b-f90e-40ca-b998-8697ae7669f2 req-ab12d4ea-b5eb-40ce-98a4-fcd68e078011 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.075625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e0d5023b-f90e-40ca-b998-8697ae7669f2 req-ab12d4ea-b5eb-40ce-98a4-fcd68e078011 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.081622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e0d5023b-f90e-40ca-b998-8697ae7669f2 req-ab12d4ea-b5eb-40ce-98a4-fcd68e078011 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.109038 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e0d5023b-f90e-40ca-b998-8697ae7669f2 req-ab12d4ea-b5eb-40ce-98a4-fcd68e078011 service nova] Creating event network-changed:b38c1410-4bb1-4aba-9f89-06cbac454855 for instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 on n-h2-master-1 Sep 25 01:02:09.126328 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e0d5023b-f90e-40ca-b998-8697ae7669f2 req-ab12d4ea-b5eb-40ce-98a4-fcd68e078011 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067976 Sep 25 01:02:09.130717 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 202/392] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:09.149721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.152309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:09.168765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.171172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.173909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.176809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.179810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.181217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.444764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:09.456169 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-faf33a9f-b24c-4b84-b9e1-04c06da32d70 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.321905 Sep 25 01:02:09.456767 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 203/393] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:09 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:09.481960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.490812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'deleted': False} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:09.505009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.506065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.506517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.507329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.507871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.508310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.699771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:02:09.818207 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c2ad80b-f3a5-4ffb-ab2e-19d3130c754e tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cf5ff4e5-74ef-400e-9585-ca31ec45c008" status: 202 len: 0 microversion: 2.1 time: 2.637006 Sep 25 01:02:09.819063 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 191/394] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:02:07 2022] DELETE /compute/v2.1/os-floating-ips/cf5ff4e5-74ef-400e-9585-ca31ec45c008 => generated 0 bytes in 2639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:09.825327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.826166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:09.839676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.842357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.846302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.847455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.848191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.848931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.869143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.870404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.871053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:10.193361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:10.226949 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19a250b1-f160-408b-b920-38be5a3271f0 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 0.406051 Sep 25 01:02:10.238400 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 192/395] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:09 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:10.254070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a304fab-beaa-48eb-9257-65b43f53e187 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-600062960", "id": 556979020, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:10.296342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a304fab-beaa-48eb-9257-65b43f53e187 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.059530 Sep 25 01:02:10.306006 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 193/396] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:10 2022] POST /compute/v2.1/flavors => generated 434 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:10.320898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-835c025b-35ee-458c-972c-bb45a8f9ab7e req-e2954ad0-6d9c-4289-8c00-e4c3c8ede011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9146f07-eb2d-4aa7-b34f-6fee344aa4b6", "name": "network-vif-plugged", "status": "completed", "tag": "861cf8e4-f251-4647-a4f9-f68bf01ccc26"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:10.343363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-835c025b-35ee-458c-972c-bb45a8f9ab7e req-e2954ad0-6d9c-4289-8c00-e4c3c8ede011 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:10.344516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-835c025b-35ee-458c-972c-bb45a8f9ab7e req-e2954ad0-6d9c-4289-8c00-e4c3c8ede011 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:10.345756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-835c025b-35ee-458c-972c-bb45a8f9ab7e req-e2954ad0-6d9c-4289-8c00-e4c3c8ede011 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:10.375440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-835c025b-35ee-458c-972c-bb45a8f9ab7e req-e2954ad0-6d9c-4289-8c00-e4c3c8ede011 service nova] Creating event network-vif-plugged:861cf8e4-f251-4647-a4f9-f68bf01ccc26 for instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 on n-h1-master-1 Sep 25 01:02:10.391580 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-835c025b-35ee-458c-972c-bb45a8f9ab7e req-e2954ad0-6d9c-4289-8c00-e4c3c8ede011 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089544 Sep 25 01:02:10.392240 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 194/397] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:10.408278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20ffa5cd-3323-4e7f-9956-1b0dca04227c tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Action: 'create', calling method: .version_select at 0x7f7bf0506700>, body: {"pool": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:11.053044 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccd70e4c-5f47-4251-a036-73e71fd3fd32 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9589 microversion: 2.1 time: 1.592672 Sep 25 01:02:11.055183 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 204/398] 10.222.0.16 () {58 vars in 1171 bytes} [Sun Sep 25 01:02:09 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9589 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:11.076015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69d62ff8-56d0-42f7-a568-740ea116a033 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.103145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-69d62ff8-56d0-42f7-a568-740ea116a033 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69d62ff8-56d0-42f7-a568-740ea116a033 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Request method failure captured: Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/flavors/556979020/os-flavor-access HTTP/1.1 Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iIDwoxVy87nTs9xGC2lBMQ6I3aeIsAodY_70ptYdkWQecMHcLFTLXMpGcp8cND7lhudoyJ0BNmqg5VGnSBWG6Cge8eP2dHdARs0rGPPRGcu8Alf2eXI5hl0pOM6_OpvCY2WH_-ZJ4XWKqos6RlBIAD83z_yo227zX3DLTICnuVAJQ Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 46d06f64c93c49af8d1e9d9c6cb46d4e Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:11.106334 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46d06f64c93c49af8d1e9d9c6cb46d4e"}]}] Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 46d06f64c93c49af8d1e9d9c6cb46d4e Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b7e34e5ca888434db19d7ab9139a30f7 Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: exception: Access list not available for public flavors. Sep 25 01:02:11.109007 n-d-master-1 devstack@n-api.service[122385]: action_args: {'flavor_id': '556979020'} Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 25 01:02:11.110582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.126594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69d62ff8-56d0-42f7-a568-740ea116a033 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:11.128511 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69d62ff8-56d0-42f7-a568-740ea116a033 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/556979020/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.071193 Sep 25 01:02:11.131169 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 205/399] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:02:11 2022] GET /compute/v2.1/flavors/556979020/os-flavor-access => generated 91 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:02:11.140509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.157034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:11.201707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.202864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.203548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.204877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.205737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.206543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.647588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:11.662555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ec30363-c8f2-4a35-a952-1ddeba079f5c tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.529387 Sep 25 01:02:11.698909 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 206/400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:11 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:11.707731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.736719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'deleted': False, 'project_id': 'f14704bcf9e547a88595a26c70a98a00'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:11.756621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.757596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.758248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.759629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.760509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.761270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.871793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-815d2338-acde-4d56-b373-cd2e482f8509 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=66b3353b3fbc4f97a0387a6c40e4fb15" status: 200 len: 15 microversion: 2.1 time: 0.170800 Sep 25 01:02:11.882596 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 207/401] 10.222.0.16 () {58 vars in 1231 bytes} [Sun Sep 25 01:02:11 2022] GET /compute/v2.1/servers/detail?tenant_id=66b3353b3fbc4f97a0387a6c40e4fb15 => generated 15 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:11.922955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a8d4f2b-7c63-4f7b-884b-ea243dcf1cde tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.957352 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a8d4f2b-7c63-4f7b-884b-ea243dcf1cde tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/556979020" status: 202 len: 0 microversion: 2.1 time: 0.061777 Sep 25 01:02:11.961900 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 208/402] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:02:11 2022] DELETE /compute/v2.1/flavors/556979020 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:11.973200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.976476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:11.990245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.991550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.992900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.995065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.996529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.997913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:12.297430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:12.312211 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2eb8cc30-7fff-4762-bec0-75b05973ad2f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1321 microversion: 2.1 time: 0.345355 Sep 25 01:02:12.325454 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 209/403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:11 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:12.325454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:12.337457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'tenant_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'deleted': False} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:12.351579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:12.352154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:12.352596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:12.353367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:12.353897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:12.354248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:12.431041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:02:12.605747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:12.606515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:12.607120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:12.982534 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9bfc04d7-07ac-459c-a690-c792273ef93a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=66b3353b3fbc4f97a0387a6c40e4fb15" status: 200 len: 4824 microversion: 2.1 time: 0.666309 Sep 25 01:02:12.998101 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 210/404] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:02:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=66b3353b3fbc4f97a0387a6c40e4fb15 => generated 4824 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:13.013062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a521283-e4d1-474c-81f1-eea7fbfae3c6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:13.030761 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=8,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:13.041501 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a521283-e4d1-474c-81f1-eea7fbfae3c6 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.041787 Sep 25 01:02:13.057610 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 211/405] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:12 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:13.069490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:13.070295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:13.078517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:13.079448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:13.080499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:13.081445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:13.082222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:13.082811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.028856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:14.045996 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4c2f94c-538e-4a35-a895-9870748d4d37 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.986027 Sep 25 01:02:14.047101 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 212/406] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:13 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:14.056441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:14.070835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'tenant_id': 'f14704bcf9e547a88595a26c70a98a00', 'deleted': False} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:14.089975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.090827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.092080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.099678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.101368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.102497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.172092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff98e56c-c4b6-4115-9536-069468045cfe tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f14704bcf9e547a88595a26c70a98a00" status: 200 len: 15 microversion: 2.1 time: 0.122744 Sep 25 01:02:14.173484 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 213/407] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:02:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f14704bcf9e547a88595a26c70a98a00 => generated 15 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:14.182770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74b87094-7530-47e7-bed9-e45d5b5f1fdb tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-378415522", "id": 202706380, "os-flavor-access:is_public": "False"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:14.217923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74b87094-7530-47e7-bed9-e45d5b5f1fdb tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.042444 Sep 25 01:02:14.238215 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 214/408] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:14 2022] POST /compute/v2.1/flavors => generated 435 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:14.248398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:14.249031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:14.285561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.288375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.289369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.290840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.291769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.292628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.649894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:14.668404 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cd660f5d-15e6-46a3-bb00-e7697205bb44 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1471 microversion: 2.1 time: 0.428776 Sep 25 01:02:14.669356 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 215/409] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:14 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:14.875100 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20ffa5cd-3323-4e7f-9956-1b0dca04227c tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.480521 Sep 25 01:02:14.876780 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 195/410] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:02:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:14.899549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5553d59b-1304-4113-b479-de492fb47341 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:14.914759 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5553d59b-1304-4113-b479-de492fb47341 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.036545 Sep 25 01:02:14.916142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 196/411] 10.222.0.16 () {58 vars in 1189 bytes} [Sun Sep 25 01:02:14 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:14.970142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf0341040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:14.974798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.976703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.977446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.978484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.979219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.983366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:15.052304 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-25cbb31b-6685-4741-9aa4-4d0cc18568cd tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.369257 Sep 25 01:02:15.054441 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 216/412] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:02:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:15.199386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ec65728-67db-4cd3-9f07-74d757981af0 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:15.203781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ec65728-67db-4cd3-9f07-74d757981af0 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '0b7b5f495d0642e7a9a22d36fd047d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fad5b693b748178d29d74b8db37170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ec65728-67db-4cd3-9f07-74d757981af0 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Request method failure captured: Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/flavors/202706380/action HTTP/1.1 Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 67 Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iHy5MW3aHK45JMbpx3WieerMaa4u2k7GsFqrlmuivX-gqq21Qzp2mXVq4G72JyrqcJFQsQMKGqYcnDF9ktS-cqeCw6wc9gwy0X8sisUax9OL1WmsAKmNNzyRGPUEQpW42o7ztzY-o87yn15vDn57UFBx9GHuBu4S4HHTp9MB8-sgQ Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 57fad5b693b748178d29d74b8db37170 Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-275069492 Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:02:15.210637 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57fad5b693b748178d29d74b8db37170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57fad5b693b748178d29d74b8db37170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57fad5b693b748178d29d74b8db37170"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57fad5b693b748178d29d74b8db37170"}]}] Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-275069492 Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 57fad5b693b748178d29d74b8db37170 Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-275069492 Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsAccessNegativeTestJSON-275069492-project Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b7b5f495d0642e7a9a22d36fd047d80 Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-275069492-project Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: {"addTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} Sep 25 01:02:15.212173 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '202706380', 'body': {'addTenantAccess': {'tenant': '57fad5b693b748178d29d74b8db37170'}}} Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:15.213089 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 25 01:02:15.214609 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.218072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ec65728-67db-4cd3-9f07-74d757981af0 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:15.220071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ec65728-67db-4cd3-9f07-74d757981af0 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] 10.222.0.16 "POST /compute/v2.1/flavors/202706380/action" status: 403 len: 130 microversion: 2.1 time: 0.302363 Sep 25 01:02:15.221247 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 197/413] 10.222.0.16 () {60 vars in 1197 bytes} [Sun Sep 25 01:02:14 2022] POST /compute/v2.1/flavors/202706380/action => generated 130 bytes in 304 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:15.230321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a211c3f5-dd8f-43e7-85cd-010fb921acbe tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Calling method '.version_select at 0x7f7bf08e38b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:15.311089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bf6fcc0-ac31-4de3-88ba-e6bb2d6cd00d tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:15.312009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9bf6fcc0-ac31-4de3-88ba-e6bb2d6cd00d tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] [instance: 362cf5de-65bb-44ae-96e1-65b8b7a2ea21] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:15.318794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-9bf6fcc0-ac31-4de3-88ba-e6bb2d6cd00d tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] HTTP exception thrown: Instance 362cf5de-65bb-44ae-96e1-65b8b7a2ea21 could not be found. Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bf6fcc0-ac31-4de3-88ba-e6bb2d6cd00d tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Request method failure captured: Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/362cf5de-65bb-44ae-96e1-65b8b7a2ea21/action HTTP/1.1 Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 15 Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6h20k-c5ahThM3FTCJO_O2q2pqa3JL2oAHnDiYrlmRsyINrtkHJDw653dDmGeG91hmy39stbMSDtt79G71PO1NqnW3HnwAgdWxekeuX8Zgm717Z_mNYacdrk06FKLqBtFJCAnajLVepe0p38Z7hWsBDDKcEU8GP48Ogu6TaygL8pgk Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:15.326112 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7222c94675e14a4381e48c17b360a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7222c94675e14a4381e48c17b360a351"}]}] Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: e860f05decda4dd9a319ea6efba0a1ca Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: {"migrate": {}} Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:15.327656 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 362cf5de-65bb-44ae-96e1-65b8b7a2ea21 could not be found. Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '362cf5de-65bb-44ae-96e1-65b8b7a2ea21', 'body': {'migrate': {}}} Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362cf5de-65bb-44ae-96e1-65b8b7a2ea21 could not be found. Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:15.328542 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362cf5de-65bb-44ae-96e1-65b8b7a2ea21 could not be found. Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362cf5de-65bb-44ae-96e1-65b8b7a2ea21 could not be found. Sep 25 01:02:15.329863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:15.330991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bf6fcc0-ac31-4de3-88ba-e6bb2d6cd00d tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Returning 404 to user: Instance 362cf5de-65bb-44ae-96e1-65b8b7a2ea21 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:15.338062 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9bf6fcc0-ac31-4de3-88ba-e6bb2d6cd00d tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/362cf5de-65bb-44ae-96e1-65b8b7a2ea21/action" status: 404 len: 111 microversion: 2.1 time: 0.279155 Sep 25 01:02:15.339417 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 217/414] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:15 2022] POST /compute/v2.1/servers/362cf5de-65bb-44ae-96e1-65b8b7a2ea21/action => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:15.347218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:15.359602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:15.396919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:15.398224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:15.399511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:15.403964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:15.404481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:15.404939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:15.947477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a7bad828-1fe4-46c6-95d1-9e7d0e695722 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 0 microversion: 2.1 time: 0.606540 Sep 25 01:02:15.954259 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 218/415] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:15 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:15.966926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf0db4d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:15.976591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:15.977284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:15.977787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:15.981109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:15.981917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:15.986527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:16.069114 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c1e7e1ec-2381-4ca3-a338-95339439132b tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.107723 Sep 25 01:02:16.071191 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 219/416] 10.222.0.16 () {58 vars in 1139 bytes} [Sun Sep 25 01:02:15 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:16.085095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:16.089279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:16.108819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:16.109778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:16.110618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:16.111527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:16.112165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:16.112786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:16.512329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:16.525527 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b305780-7eee-49fb-8d98-915a435b2991 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.452728 Sep 25 01:02:16.526031 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 220/417] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:16 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:16.535038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80d2db8a-69a5-498c-9d7f-d5108366b747 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:16.582083 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80d2db8a-69a5-498c-9d7f-d5108366b747 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/202706380" status: 202 len: 0 microversion: 2.1 time: 0.054801 Sep 25 01:02:16.582678 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 221/418] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:02:16 2022] DELETE /compute/v2.1/flavors/202706380 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:16.598019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1932415186", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:16.818961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:17.327311 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a211c3f5-dd8f-43e7-85cd-010fb921acbe tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416" status: 202 len: 0 microversion: 2.1 time: 2.103962 Sep 25 01:02:17.327898 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 198/419] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:02:15 2022] DELETE /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416 => generated 0 bytes in 2106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:17.334234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:17.352955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:17.357244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:17.369617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.371052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.371671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.372895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.373551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.374336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.581255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:02:17.634201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:17.634850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:17.635623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:17.636070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:17.636500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:17.649749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.650113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.650557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.651323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.659677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.660478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.702964 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a956b26-67f4-40a8-8982-4c47e3d54ca8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.373774 Sep 25 01:02:17.705008 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 199/420] 10.222.0.16 () {58 vars in 1150 bytes} [Sun Sep 25 01:02:17 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:17.712921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Getting quotas for project 4ea70b1c1150462fb7ad97fa83ef8060. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:17.726024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Getting quotas for user 54541ffbbb8d4f24a054d1d7a80f7152 and project 4ea70b1c1150462fb7ad97fa83ef8060. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:17.727912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf08e38b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:17.740413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.744506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.746002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.747549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.748632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.750551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.760234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:17.770354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:17.857020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-debe15d6-7296-4221-bd00-17b4d9a1055a tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.150356 Sep 25 01:02:17.859247 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 200/421] 10.222.0.16 () {58 vars in 1145 bytes} [Sun Sep 25 01:02:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:17.869689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad90da64-763e-4f13-95bb-7cfb460ae155 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:17.931959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad90da64-763e-4f13-95bb-7cfb460ae155 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.069378 Sep 25 01:02:17.933144 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 201/422] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:17 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:17.939592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0983224a-f354-4c4f-85d8-ce5eb13b84c9 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Calling method '.version_select at 0x7f7bf0506e50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:17.950048 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0cb9c28e-bd8d-4455-8342-0abcfb1339c5 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363085 Sep 25 01:02:17.963431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 222/423] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:17.976252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:17.977493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:17.990630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:17.993736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:17.995994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.998325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.000029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.001224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.185712 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-0983224a-f354-4c4f-85d8-ce5eb13b84c9 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 71f78323-6d12-4eb6-bcd3-e508fdf03416 could not be found", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:02:18.186798 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0983224a-f354-4c4f-85d8-ce5eb13b84c9 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] HTTP exception thrown: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0983224a-f354-4c4f-85d8-ce5eb13b84c9 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Request method failure captured: Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416 HTTP/1.1 Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iDIUJ1Tx4705QIT0cebqMVDVlO6HQGjYAlmsoaOKKkAjIvSwckCD4Qkz4kiYIiyRd3ssz5VGJj6xw4c4KTXBR-v5HoCF7Mzd7qGPWAPTYt0G-DoR1nr0Ac8Dqqi1hk8AHcMCIhRYWCEkDFoRFX4bbdkmkkQEPw0PqMoThEVTwEzmI Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: adf199769d374f4a8de93bc25408c83a Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsTestJSON-618010526 Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:02:18.200994 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adf199769d374f4a8de93bc25408c83a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adf199769d374f4a8de93bc25408c83a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adf199769d374f4a8de93bc25408c83a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adf199769d374f4a8de93bc25408c83a"}]}] Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsTestJSON-618010526 Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: adf199769d374f4a8de93bc25408c83a Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsTestJSON-618010526 Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsTestJSON-618010526-project Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 170ea9ab3d444c28bdd566817773f3c9 Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsTestJSON-618010526-project Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: exception: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '71f78323-6d12-4eb6-bcd3-e508fdf03416'} Sep 25 01:02:18.202734 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:02:18.203602 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 71f78323-6d12-4eb6-bcd3-e508fdf03416 could not be found Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b87358e-3c69-4bd9-a7c1-f121ea59a6b1'] Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416. Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:18.204753 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:18.205975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:18.207165 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:18.207165 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:18.207165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0983224a-f354-4c4f-85d8-ce5eb13b84c9 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Returning 404 to user: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:18.207165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0983224a-f354-4c4f-85d8-ce5eb13b84c9 tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416" status: 404 len: 111 microversion: 2.1 time: 0.267901 Sep 25 01:02:18.209242 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 202/424] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:02:17 2022] GET /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416 => generated 111 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:18.227984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:18.238998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:18.266907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.270023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.271514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.272557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.273078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.273675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.387148 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=86 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:18.565030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:18.587287 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a4a3f28-23f8-448e-a41d-4f4ccb982cae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.622098 Sep 25 01:02:18.587968 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 223/425] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:17 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:18.613493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:18.615054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:18.633342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56aba5e3-d349-4a13-a304-ad41d266143c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 0 microversion: 2.1 time: 0.420929 Sep 25 01:02:18.636219 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 203/426] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:18 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:18.643621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.647049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.650840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.651810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf02e21f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:18.652488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.653381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.654316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.669312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.670226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.672901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.675613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.676806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.683158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.747446 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81c2f1fe-6c29-4676-9c3a-4dbda10afc50 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.107582 Sep 25 01:02:18.748572 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 204/427] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:02:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:18.755785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34f56354-ee04-4ac8-8e98-cc305361ad7e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1945019847", "id": 322552817, "os-flavor-access:is_public": "False"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:18.805222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:02:18.811317 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34f56354-ee04-4ac8-8e98-cc305361ad7e tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.060647 Sep 25 01:02:18.814030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 205/428] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:18 2022] POST /compute/v2.1/flavors => generated 436 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:18.823325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ef78dd98-cb1f-4b04-b690-98969c702797 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:18.828235 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:18.830485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ef78dd98-cb1f-4b04-b690-98969c702797 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:18.962290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ef78dd98-cb1f-4b04-b690-98969c702797 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:18.981657 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ef78dd98-cb1f-4b04-b690-98969c702797 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1222 microversion: 2.1 time: 0.165909 Sep 25 01:02:18.982743 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 206/429] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:18 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:18.990345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa7eaf30-5a75-402f-a3b9-c1156538c3be tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Calling method '.version_select at 0x7f7bf025a820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:19.111842 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-aa7eaf30-5a75-402f-a3b9-c1156538c3be tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 71f78323-6d12-4eb6-bcd3-e508fdf03416 could not be found", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:02:19.112608 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-aa7eaf30-5a75-402f-a3b9-c1156538c3be tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] HTTP exception thrown: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa7eaf30-5a75-402f-a3b9-c1156538c3be tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Request method failure captured: Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416 HTTP/1.1 Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iDIUJ1Tx4705QIT0cebqMVDVlO6HQGjYAlmsoaOKKkAjIvSwckCD4Qkz4kiYIiyRd3ssz5VGJj6xw4c4KTXBR-v5HoCF7Mzd7qGPWAPTYt0G-DoR1nr0Ac8Dqqi1hk8AHcMCIhRYWCEkDFoRFX4bbdkmkkQEPw0PqMoThEVTwEzmI Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: adf199769d374f4a8de93bc25408c83a Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsTestJSON-618010526 Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:02:19.115768 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adf199769d374f4a8de93bc25408c83a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adf199769d374f4a8de93bc25408c83a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adf199769d374f4a8de93bc25408c83a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adf199769d374f4a8de93bc25408c83a"}]}] Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsTestJSON-618010526 Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: adf199769d374f4a8de93bc25408c83a Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsTestJSON-618010526 Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsTestJSON-618010526-project Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 170ea9ab3d444c28bdd566817773f3c9 Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsTestJSON-618010526-project Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: exception: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '71f78323-6d12-4eb6-bcd3-e508fdf03416'} Sep 25 01:02:19.117319 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:02:19.118248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 71f78323-6d12-4eb6-bcd3-e508fdf03416 could not be found Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e58c40a-4bf8-465f-a99c-16fc252af2dc'] Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416. Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:19.119524 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:19.120703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:19.121825 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 Sep 25 01:02:19.121825 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:19.121825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa7eaf30-5a75-402f-a3b9-c1156538c3be tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] Returning 404 to user: Floating IP not found for ID 71f78323-6d12-4eb6-bcd3-e508fdf03416 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:19.121825 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa7eaf30-5a75-402f-a3b9-c1156538c3be tempest-FloatingIPsTestJSON-618010526 tempest-FloatingIPsTestJSON-618010526-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416" status: 404 len: 111 microversion: 2.1 time: 0.133730 Sep 25 01:02:19.123140 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 207/430] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:02:18 2022] DELETE /compute/v2.1/os-floating-ips/71f78323-6d12-4eb6-bcd3-e508fdf03416 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:19.150209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:19.161334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:19.200534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.201540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.201649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.202348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.202866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.203299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.296075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fd85cde-f493-4082-b69e-af4a1dc08291 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 204 len: 0 microversion: 2.1 time: 0.694777 Sep 25 01:02:19.307857 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 224/431] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:02:18 2022] DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:02:19.320212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf0256c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:19.336800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.337865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.338729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.342729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.345445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.350026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.449269 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e58adde3-abae-4057-9fd4-7c0b79ef37d6 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.134454 Sep 25 01:02:19.450504 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 225/432] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:02:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:19.469961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61dd19a4-d038-416d-8ca4-0da423380f75 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:19.806785 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61dd19a4-d038-416d-8ca4-0da423380f75 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/322552817/action" status: 200 len: 96 microversion: 2.1 time: 0.352513 Sep 25 01:02:19.809135 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 226/433] 10.222.0.16 () {60 vars in 1197 bytes} [Sun Sep 25 01:02:19 2022] POST /compute/v2.1/flavors/322552817/action => generated 96 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:19.821024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c2862291-aba0-4764-8f25-425a5670f3cf req-41b6d968-7ccb-41f5-b755-500658f6d59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5ac0ec-3af1-4bbe-b344-63a288ec6344", "name": "network-vif-plugged", "status": "completed", "tag": "b38c1410-4bb1-4aba-9f89-06cbac454855"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:19.830625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a194a178-2ac4-4015-b716-58fb6c552674 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1615 microversion: 2.1 time: 0.704639 Sep 25 01:02:19.832663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 208/434] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:19 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1615 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:19.834549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c2862291-aba0-4764-8f25-425a5670f3cf req-41b6d968-7ccb-41f5-b755-500658f6d59d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.835334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c2862291-aba0-4764-8f25-425a5670f3cf req-41b6d968-7ccb-41f5-b755-500658f6d59d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.835770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c2862291-aba0-4764-8f25-425a5670f3cf req-41b6d968-7ccb-41f5-b755-500658f6d59d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.839548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf02b75e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:19.843626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.844619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.845273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.846292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.847001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.847636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.856238 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c2862291-aba0-4764-8f25-425a5670f3cf req-41b6d968-7ccb-41f5-b755-500658f6d59d service nova] Creating event network-vif-plugged:b38c1410-4bb1-4aba-9f89-06cbac454855 for instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 on n-h2-master-1 Sep 25 01:02:19.873935 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c2862291-aba0-4764-8f25-425a5670f3cf req-41b6d968-7ccb-41f5-b755-500658f6d59d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062688 Sep 25 01:02:19.874638 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 227/435] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:19.881058 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11c7631f-be75-4fa7-9bbe-79211e644150 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.045892 Sep 25 01:02:19.881995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 209/436] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:02:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:19.888255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-102259205", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "1437912271", "adminPass": "***", "networks": [{"uuid": "05b8edd7-0d55-4cc2-95d1-062ba1456fe1"}], "security_groups": [{"name": "tempest-securitygroup--893337408"}], "key_name": "tempest-keypair-1102063023", "user_data": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:19.894556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:19.895189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:19.902981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.903603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.904057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.904865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.905331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.905790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:20.292077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] validate_networks() for [('05b8edd7-0d55-4cc2-95d1-062ba1456fe1', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:20.698312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:20.707864 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80f159f4-628a-4bc9-b8c7-b8183661225e tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1318 microversion: 2.1 time: 0.818844 Sep 25 01:02:20.710596 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 210/437] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:19 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:20.715828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f39c709-0f5a-483a-9bab-62fe747169b1 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:20.719392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f39c709-0f5a-483a-9bab-62fe747169b1 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '0b7b5f495d0642e7a9a22d36fd047d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57fad5b693b748178d29d74b8db37170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f39c709-0f5a-483a-9bab-62fe747169b1 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Request method failure captured: Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/flavors/322552817/action HTTP/1.1 Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 70 Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iHy5MW3aHK45JMbpx3WieerMaa4u2k7GsFqrlmuivX-gqq21Qzp2mXVq4G72JyrqcJFQsQMKGqYcnDF9ktS-cqeCw6wc9gwy0X8sisUax9OL1WmsAKmNNzyRGPUEQpW42o7ztzY-o87yn15vDn57UFBx9GHuBu4S4HHTp9MB8-sgQ Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 57fad5b693b748178d29d74b8db37170 Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-275069492 Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:02:20.721867 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57fad5b693b748178d29d74b8db37170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57fad5b693b748178d29d74b8db37170"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57fad5b693b748178d29d74b8db37170"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57fad5b693b748178d29d74b8db37170"}]}] Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-275069492 Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 57fad5b693b748178d29d74b8db37170 Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-275069492 Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FlavorsAccessNegativeTestJSON-275069492-project Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b7b5f495d0642e7a9a22d36fd047d80 Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-275069492-project Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: {"removeTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} Sep 25 01:02:20.723444 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '322552817', 'body': {'removeTenantAccess': {'tenant': '57fad5b693b748178d29d74b8db37170'}}} Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can( Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:20.725178 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 25 01:02:20.727630 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:20.729045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f39c709-0f5a-483a-9bab-62fe747169b1 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:20.729045 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f39c709-0f5a-483a-9bab-62fe747169b1 tempest-FlavorsAccessNegativeTestJSON-275069492 tempest-FlavorsAccessNegativeTestJSON-275069492-project] 10.222.0.16 "POST /compute/v2.1/flavors/322552817/action" status: 403 len: 133 microversion: 2.1 time: 0.011671 Sep 25 01:02:20.729045 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 211/438] 10.222.0.16 () {60 vars in 1197 bytes} [Sun Sep 25 01:02:20 2022] POST /compute/v2.1/flavors/322552817/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:20.804311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2077076996", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4f8a553d-e325-4d96-bf39-28985d951e27"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:20.873537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] validate_networks() for [('4f8a553d-e325-4d96-bf39-28985d951e27', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:22.017603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:22.019354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:22.020058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:22.021658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:22.022304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:22.044137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:22.045343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:22.047134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:22.048361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:22.049017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:22.049662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:22.075728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Getting quotas for project fbd08c233d6944199beebf1a2e1a1a23. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:22.082424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Getting quotas for user 98ed412afded46c49d993a2749e42c65 and project fbd08c233d6944199beebf1a2e1a1a23. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:22.101693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:22.104991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:22.197063 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c92f577-4d32-4fe5-9576-f6512c20fea5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.318054 Sep 25 01:02:22.206165 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 228/439] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:22.212377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:22.213275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:22.222370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:22.223083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:22.225106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:22.226179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:22.226990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:22.227652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:22.999191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:22.999739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:23.000208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:23.000830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:23.001647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:23.006122 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=78,nova_api:SAVEPOINT=2,nova_api:INSERT=7,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:23.059304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.060337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.060935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.062106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.062736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.063341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.095932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:23.116621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for user fe77600029ff40f8b738c097bf184495 and project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:23.138967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:23.142762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:23.240103 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4103ca5-90af-4e2f-8647-07886ced1f5a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.511710 Sep 25 01:02:23.242219 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 212/440] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:23.272419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf0209160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:23.286740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.287480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.287923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.322759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.323256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.323880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.351693 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09607e15-d9a5-4a34-be60-5bfb429baa87 tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 598 microversion: 2.1 time: 0.107814 Sep 25 01:02:23.357765 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 213/441] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:02:23 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 598 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:23.369696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:23.370623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:23.378094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.378877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.379552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.380717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.381368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.381981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.737174 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6629b04c-b44b-4a44-ab5a-fe294713930a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1615 microversion: 2.1 time: 1.529394 Sep 25 01:02:23.759211 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 229/442] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:22 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1615 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:23.781850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a8918f9c-3015-4ab3-b33f-6d47651c2795 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "57fad5b693b748178d29d74b8db37170"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:24.034033 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a8918f9c-3015-4ab3-b33f-6d47651c2795 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/322552817/action" status: 200 len: 21 microversion: 2.1 time: 0.266461 Sep 25 01:02:24.035446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 230/443] 10.222.0.16 () {60 vars in 1197 bytes} [Sun Sep 25 01:02:23 2022] POST /compute/v2.1/flavors/322552817/action => generated 21 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:24.074506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:24.077252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:24.115237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.116253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.118271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.119301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.120058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.121458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.182740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:24.191487 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-071e0110-6fa6-4433-9a38-9d09608aa2a7 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1322 microversion: 2.1 time: 0.828070 Sep 25 01:02:24.200724 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 214/444] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:23 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1322 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:24.209815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:24.211206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:24.231581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.232213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.232947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.236777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.237552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.238213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.481730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:24.525175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d85ac1b9-a469-4faf-93f7-a74e3ed2c59b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1324 microversion: 2.1 time: 0.322426 Sep 25 01:02:24.548682 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 215/445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:24 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:24.578084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:24.597083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:24.624760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.628046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.631384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.638480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.639029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.639722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.972237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:24.997108 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c19d8152-5fb1-443d-86c4-ec8897d0804f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1468 microversion: 2.1 time: 0.959710 Sep 25 01:02:25.022375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 231/446] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:24 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1468 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:25.028221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Calling method '.version_select at 0x7f7bf023ed30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:25.046475 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:25.048108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.052739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.053657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.077595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.078434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.079321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.188333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:25.198307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7496de3-2678-4d17-b585-6ed22e441df3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1215 microversion: 2.1 time: 0.647825 Sep 25 01:02:25.202977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b232112f-5086-46a2-9b64-c5299b48b44e tempest-HostsAdminTestJSON-1182294383 tempest-HostsAdminTestJSON-1182294383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 860 microversion: 2.1 time: 0.174378 Sep 25 01:02:25.205420 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 216/447] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:24 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1215 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:25.221535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:25.227910 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 232/448] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:02:25 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 860 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:25.242596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'host': 'n-h2-master-1', 'deleted': False} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:25.260640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.261306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.262102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.262906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.263382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.263816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.275801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90ec632a-3e9e-466b-a108-7ed725412958 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:25.344092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90ec632a-3e9e-466b-a108-7ed725412958 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/322552817" status: 202 len: 0 microversion: 2.1 time: 0.113051 Sep 25 01:02:25.345239 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 233/449] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:02:25 2022] DELETE /compute/v2.1/flavors/322552817 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:25.360817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b599abda-e6e6-4335-a4f2-66cf82006d18 req-721a24a4-33d8-47d8-9691-f753ef1f066f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115fce23-5f1d-4023-86e4-1d8abbafbfef", "tag": "a3afbcda-b0bb-4b2a-8d0f-e8467ca2f1c4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:25.437781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b599abda-e6e6-4335-a4f2-66cf82006d18 req-721a24a4-33d8-47d8-9691-f753ef1f066f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.444987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b599abda-e6e6-4335-a4f2-66cf82006d18 req-721a24a4-33d8-47d8-9691-f753ef1f066f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.445796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b599abda-e6e6-4335-a4f2-66cf82006d18 req-721a24a4-33d8-47d8-9691-f753ef1f066f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.484975 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b599abda-e6e6-4335-a4f2-66cf82006d18 req-721a24a4-33d8-47d8-9691-f753ef1f066f service nova] Creating event network-changed:a3afbcda-b0bb-4b2a-8d0f-e8467ca2f1c4 for instance 115fce23-5f1d-4023-86e4-1d8abbafbfef on n-h1-master-1 Sep 25 01:02:25.498521 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b599abda-e6e6-4335-a4f2-66cf82006d18 req-721a24a4-33d8-47d8-9691-f753ef1f066f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151216 Sep 25 01:02:25.499944 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 234/450] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:25.547614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:02:25.702418 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e29e4fa-14d3-40a7-b48d-071023b3040b tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1" status: 200 len: 1980 microversion: 2.1 time: 0.495542 Sep 25 01:02:25.716356 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 217/451] 10.222.0.16 () {58 vars in 1190 bytes} [Sun Sep 25 01:02:25 2022] GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1 => generated 1980 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:25.726664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:25.728382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:25.740571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.741598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.742241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.743307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.744021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.745083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.804974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-979578031", "block_migration": true, "disk_over_commit": false}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:25.822436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:25.842983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.844039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.844951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:25.846189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:25.847254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:25.848086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.155383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lazy-loading 'flavor' on Instance uuid 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:26.265180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Going to try to live migrate instance to tempest-host-979578031 {{(pid=122385) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:02:26.274803 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] HTTP exception thrown: Compute host tempest-host-979578031 could not be found. Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Request method failure captured: Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344/action HTTP/1.1 Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 106 Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iA4lUxsSXFylT1VWIfL9PlFF4Hty7q4nQ0y8qWLu9Z9lygOrxO_krX5Oq5SA_Dzx0H0AT_vU2lHbz2kLL4AfNlOFsoYWO3ukjCA_RnO1h-GZLTvo0t23l7YMwQIl9RspZHWq6fHi6UVuiTLYAizDL8luByUp3ONZfBHBQfP8UWL90 Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 07de72db09664c1fa135a784f54b3cab Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-LiveMigrationNegativeTest-1653006975 Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:26.280636 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07de72db09664c1fa135a784f54b3cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07de72db09664c1fa135a784f54b3cab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07de72db09664c1fa135a784f54b3cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07de72db09664c1fa135a784f54b3cab"}]}] Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-LiveMigrationNegativeTest-1653006975 Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 07de72db09664c1fa135a784f54b3cab Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1653006975 Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-LiveMigrationNegativeTest-1653006975-project-admin Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 09a8ec918453488f85edc4a79af2b11d Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-LiveMigrationNegativeTest-1653006975-project-admin Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: {"os-migrateLive": {"host": "tempest-host-979578031", "block_migration": true, "disk_over_commit": false}} Sep 25 01:02:26.282327 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: exception: Compute host tempest-host-979578031 could not be found. Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5b5ac0ec-3af1-4bbe-b344-63a288ec6344', 'body': {'os-migrateLive': {'host': 'tempest-host-979578031', 'block_migration': True, 'disk_over_commit': False}}} Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:26.283113 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-979578031 could not be found. Sep 25 01:02:26.284228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-979578031 could not be found. Sep 25 01:02:26.285294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-979578031 could not be found. Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:26.288969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Returning 400 to user: Compute host tempest-host-979578031 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:26.293089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-997bf9f8-5d5b-478d-b2df-b8c1bbc8a3ed tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344/action" status: 400 len: 99 microversion: 2.1 time: 0.788053 Sep 25 01:02:26.293739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 235/452] 10.222.0.16 () {60 vars in 1279 bytes} [Sun Sep 25 01:02:25 2022] POST /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344/action => generated 99 bytes in 793 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:02:26.311310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f47e430f-a142-4531-829b-cee953d74080 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:26.383350 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f47e430f-a142-4531-829b-cee953d74080 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.085158 Sep 25 01:02:26.391947 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 236/453] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:26.397919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:26.398543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:26.408625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.409147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.409654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.410428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.410942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.419159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.571393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:26.591319 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62ea2c63-b537-4d60-87a5-61fededca10f tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1322 microversion: 2.1 time: 0.872942 Sep 25 01:02:26.610216 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 218/454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:25 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1322 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:26.635302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:26.637207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:26.646872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:02:26.652768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.653263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.654004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.654874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.655355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.656071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.660773 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76e2c3f0-2084-47e5-8253-ffc36016946d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1322 microversion: 2.1 time: 0.265876 Sep 25 01:02:26.673265 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 237/455] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:26 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:26.681588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-294ecf63-7da0-42ff-800d-d5b52aca983a tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.066087 Sep 25 01:02:26.682843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 219/456] 10.222.0.16 () {58 vars in 1196 bytes} [Sun Sep 25 01:02:26 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:26.697752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:26.699121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:26.701248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:26.703021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:26.715404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.720038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.720967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.726097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.726936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.727791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.733014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.734155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.736093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.737331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.738218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.742295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:27.298802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:27.319769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31eb2757-408c-411a-bec8-5cc757aca358 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1269 microversion: 2.1 time: 0.645102 Sep 25 01:02:27.320367 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 238/457] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:26 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1269 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:27.352433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-26891728-d20a-4600-9ac5-30b3504a427d tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-695012429", "id": 1266427036, "os-flavor-access:is_public": "False"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:27.385213 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-26891728-d20a-4600-9ac5-30b3504a427d tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052053 Sep 25 01:02:27.394835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 239/458] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:27 2022] POST /compute/v2.1/flavors => generated 438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:27.401076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:27.404240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:27.412178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:27.414085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:27.414846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:27.416249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:27.417072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:27.417471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:27.542608 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a260ca4f-4340-4c34-b659-24b1042628ac tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 0 microversion: 2.1 time: 0.145310 Sep 25 01:02:27.547840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 240/459] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:27 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:27.554254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b390a89-931b-48e2-af6a-85fa2bd7577b tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "192c948ab03344b6b2b723333916a7d5"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:28.013506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:28.051272 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2df0c089-6189-4652-b8a6-7f29ccfd6123 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1468 microversion: 2.1 time: 1.364968 Sep 25 01:02:28.059713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 220/460] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:26 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1468 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:28.092369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:28.109175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:28.146495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.147259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.148055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.168456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.169557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.170183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.267133 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6b390a89-931b-48e2-af6a-85fa2bd7577b tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] HTTP exception thrown: Flavor access not found for 36 / 192c948ab03344b6b2b723333916a7d5 combination. Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b390a89-931b-48e2-af6a-85fa2bd7577b tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Request method failure captured: Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/flavors/1266427036/action HTTP/1.1 Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 70 Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iIDwoxVy87nTs9xGC2lBMQ6I3aeIsAodY_70ptYdkWQecMHcLFTLXMpGcp8cND7lhudoyJ0BNmqg5VGnSBWG6Cge8eP2dHdARs0rGPPRGcu8Alf2eXI5hl0pOM6_OpvCY2WH_-ZJ4XWKqos6RlBIAD83z_yo227zX3DLTICnuVAJQ Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 46d06f64c93c49af8d1e9d9c6cb46d4e Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:28.271832 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46d06f64c93c49af8d1e9d9c6cb46d4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46d06f64c93c49af8d1e9d9c6cb46d4e"}]}] Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 46d06f64c93c49af8d1e9d9c6cb46d4e Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-62435348 Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b7e34e5ca888434db19d7ab9139a30f7 Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: {"removeTenantAccess": {"tenant": "192c948ab03344b6b2b723333916a7d5"}} Sep 25 01:02:28.273338 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: exception: Flavor access not found for 36 / 192c948ab03344b6b2b723333916a7d5 combination. Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1266427036', 'body': {'removeTenantAccess': {'tenant': '192c948ab03344b6b2b723333916a7d5'}}} Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 25 01:02:28.274153 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 192c948ab03344b6b2b723333916a7d5 combination. Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 192c948ab03344b6b2b723333916a7d5 combination. Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:28.275258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 192c948ab03344b6b2b723333916a7d5 combination. Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:28.278905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b390a89-931b-48e2-af6a-85fa2bd7577b tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Returning 404 to user: Flavor access not found for 36 / 192c948ab03344b6b2b723333916a7d5 combination. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:28.281368 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b390a89-931b-48e2-af6a-85fa2bd7577b tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1266427036/action" status: 404 len: 124 microversion: 2.1 time: 0.731556 Sep 25 01:02:28.286530 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 241/461] 10.222.0.16 () {60 vars in 1200 bytes} [Sun Sep 25 01:02:27 2022] POST /compute/v2.1/flavors/1266427036/action => generated 124 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:28.314970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:28.315883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:28.356585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.357098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.357589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.358337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.358808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.372251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.401806 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:28.403456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:28.405393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:28.419931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:28.424963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:28.620587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:28.653760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.654679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.655374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.659736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.661309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.670024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.749823 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-04e146f6-72c6-4995-ae78-591f45130a2a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 1068 microversion: 2.1 time: 0.688203 Sep 25 01:02:28.752101 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 221/462] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:28 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 1068 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 25 01:02:28.794175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:28.802568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:28.863047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.870789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.873566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.884416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.889773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.890962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:29.045582 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:29.278690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:29.330447 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1872d97-662f-48bb-94fe-a7b14e99280e tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1322 microversion: 2.1 time: 0.551747 Sep 25 01:02:29.331908 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 222/463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:28 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:29.386652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-66fcd0b1-7f1d-46a3-b069-7b3517db14a0 req-84376428-c08a-40bd-b38b-89e036be1249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9", "name": "network-vif-deleted", "tag": "33acd010-934e-4f55-8380-0cfef9002b2f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:29.422003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66fcd0b1-7f1d-46a3-b069-7b3517db14a0 req-84376428-c08a-40bd-b38b-89e036be1249 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:29.428949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66fcd0b1-7f1d-46a3-b069-7b3517db14a0 req-84376428-c08a-40bd-b38b-89e036be1249 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:29.430147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66fcd0b1-7f1d-46a3-b069-7b3517db14a0 req-84376428-c08a-40bd-b38b-89e036be1249 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:29.463229 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-66fcd0b1-7f1d-46a3-b069-7b3517db14a0 req-84376428-c08a-40bd-b38b-89e036be1249 service nova] Creating event network-vif-deleted:33acd010-934e-4f55-8380-0cfef9002b2f for instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 on n-h1-master-1 Sep 25 01:02:29.484217 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-66fcd0b1-7f1d-46a3-b069-7b3517db14a0 req-84376428-c08a-40bd-b38b-89e036be1249 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115484 Sep 25 01:02:29.485352 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 223/464] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:29.499012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-212392054", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:29.618551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:29.722578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:29.740504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54fc59eb-590b-4581-b3c8-4825e6e0cb9d tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1322 microversion: 2.1 time: 1.449761 Sep 25 01:02:29.741184 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 242/465] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:28 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1322 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:29.792440 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ac3deba-5181-4200-8003-44b94eb91504 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:29.820669 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ac3deba-5181-4200-8003-44b94eb91504 tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1266427036" status: 202 len: 0 microversion: 2.1 time: 0.060189 Sep 25 01:02:29.825163 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 243/466] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:02:29 2022] DELETE /compute/v2.1/flavors/1266427036 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:29.851077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:29.851769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:29.881206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:29.882878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:29.886341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:29.889037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:29.891021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:29.893658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:30.682681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:30.694649 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5755dc63-c1b0-4d44-ac27-910acd98a8f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.868027 Sep 25 01:02:30.695241 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 244/467] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:29 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:30.710523 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:30.715051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:30.735095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:30.742109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:30.743130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:30.743979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:30.747240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:30.747983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.097254 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:31.098991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:31.100119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:31.101528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:31.102800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:31.136121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:31.137806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:31.138497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.140080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:31.141244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:31.146843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.223112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Getting quotas for project 065df012fefb435e9a3329b6b1b51b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:31.252934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Getting quotas for user f8c135c37b804252a8275d28972d8c31 and project 065df012fefb435e9a3329b6b1b51b4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:31.301468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:31.308163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:31.360738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:31.371860 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85eb1731-12bf-4588-b649-2a87a1cf4ffe tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.666912 Sep 25 01:02:31.380935 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 245/468] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:30 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:31.393645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e70b485-8ed1-4190-b127-d406e393814d tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:31.469528 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e70b485-8ed1-4190-b127-d406e393814d tempest-FlavorsAccessNegativeTestJSON-62435348 tempest-FlavorsAccessNegativeTestJSON-62435348-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.086802 Sep 25 01:02:31.470964 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 246/469] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:31 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:31.471714 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd613a0c-1dc4-4e40-bd65-998a449527be tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984864 Sep 25 01:02:31.477333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:31.481646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:31.483538 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 224/470] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:31.490050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:31.491449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:31.498618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:31.499381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:31.499982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.501438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:31.502095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:31.502682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.503573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:31.504177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:31.506942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.506942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:31.506942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:31.507473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:32.064168 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=20 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:32.097383 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=16 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:32.162585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:32.178498 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-70ab205a-dd37-4e52-8ecd-a85b1fc76942 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.705558 Sep 25 01:02:32.181881 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 247/471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:31 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:32.194152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce85dd3c-b4d7-40ff-9a04-517eee7bdec7 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:32.196044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce85dd3c-b4d7-40ff-9a04-517eee7bdec7 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:32.278206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:32.292936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c07277ec-57a9-41b3-bd71-aaec4bd0a8a1 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1322 microversion: 2.1 time: 0.807906 Sep 25 01:02:32.304331 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 225/472] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:31 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1322 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:32.317614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:32.323271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:32.331117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:32.331922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:32.332511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:32.334149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:32.334891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:32.335474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:32.392965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce85dd3c-b4d7-40ff-9a04-517eee7bdec7 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:32.409884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce85dd3c-b4d7-40ff-9a04-517eee7bdec7 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1218 microversion: 2.1 time: 0.226524 Sep 25 01:02:32.423597 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 248/473] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:32 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:32.446075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:32.450722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:32.472939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:32.479659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:32.480489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:32.481642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:32.482273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:32.483006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:33.151316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:33.162966 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e190bcb-74cb-4444-9548-4023caef60d0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.857178 Sep 25 01:02:33.163563 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 226/474] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:32 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:33.186923 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-81da4efd-999c-4997-a3e5-997f4297245b req-d999263f-c494-4386-a459-9b0e4905c1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115fce23-5f1d-4023-86e4-1d8abbafbfef", "name": "network-vif-plugged", "status": "completed", "tag": "a3afbcda-b0bb-4b2a-8d0f-e8467ca2f1c4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:33.198961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-81da4efd-999c-4997-a3e5-997f4297245b req-d999263f-c494-4386-a459-9b0e4905c1b5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.200730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-81da4efd-999c-4997-a3e5-997f4297245b req-d999263f-c494-4386-a459-9b0e4905c1b5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.201663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-81da4efd-999c-4997-a3e5-997f4297245b req-d999263f-c494-4386-a459-9b0e4905c1b5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:33.203628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:33.208777 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:33.215348 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-527b0b6b-3f8f-4d69-b714-08030ee374bd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.789998 Sep 25 01:02:33.216352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 249/475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:32 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:33.245331 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-81da4efd-999c-4997-a3e5-997f4297245b req-d999263f-c494-4386-a459-9b0e4905c1b5 service nova] Creating event network-vif-plugged:a3afbcda-b0bb-4b2a-8d0f-e8467ca2f1c4 for instance 115fce23-5f1d-4023-86e4-1d8abbafbfef on n-h1-master-1 Sep 25 01:02:33.256378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-81da4efd-999c-4997-a3e5-997f4297245b req-d999263f-c494-4386-a459-9b0e4905c1b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070834 Sep 25 01:02:33.262573 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 227/476] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:33.274344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:33.276875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:33.293372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.294076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.295626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:33.296612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.298059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.298747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:33.473071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d678527-385c-4877-b4d2-80989258c69f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Action: 'create', calling method: .version_select at 0x7f7bf000e430>, body: {"keypair": {"name": "tempest-keypair-17070291", "type": "ssh", "user_id": "b837dd692d2c4cf0ae6106c1459f4914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9aY/BX5r+Zqwz2irYOLBxaLhbjwDDT61FLiWdJ5GquTcgvP2IaDMamo90UxVdwxc1/7ElEG9rdfhyR5oaHxE/8A9oeWzU2L/efQrjbLli/8yU+XqVs6QV5BVqADVd9nQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:33.516829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3d678527-385c-4877-b4d2-80989258c69f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Getting quotas for project 15a9a3fcc27f4156938ab4e3a3867dac. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:33.546739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3d678527-385c-4877-b4d2-80989258c69f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Getting quotas for user f09382cdd438452ab095b3381c0b2dad and project 15a9a3fcc27f4156938ab4e3a3867dac. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:33.596868 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d678527-385c-4877-b4d2-80989258c69f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.379239 Sep 25 01:02:33.597870 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 250/477] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:02:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 381 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:02:33.605060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:33.605886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:33.625679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.626970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.632448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:33.633826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.635531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.636301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.143546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:34.177443 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf8e8862-19a2-4606-a450-c1b338183865 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.913055 Sep 25 01:02:34.180823 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 228/478] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:33 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:34.188904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:34.190009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:34.213241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.214154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.214829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.216960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.217674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.218408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.356271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:34.358089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:34.369927 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ee97b0d-35c0-4ffa-9196-350decad371f tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1278 microversion: 2.1 time: 0.186495 Sep 25 01:02:34.370137 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7935099-b21b-40eb-be3f-bfbcd48e4ecd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1322 microversion: 2.1 time: 0.768840 Sep 25 01:02:34.373310 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 229/479] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:34 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:34.386058 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 251/480] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:33 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:34.406680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aafb00c1-e5a1-4db4-a6bb-4f232456d03f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Action: 'create', calling method: .version_select at 0x7f7bf0209a60>, body: {"keypair": {"name": "tempest-keypair-1491369720", "type": "ssh", "user_id": "b837dd692d2c4cf0ae6106c1459f4914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb1pJLTqTJRp6citZGAy2TisRbDLL6RS4MkKtYAhKCJM0ycstiUS5cRhzYOjAzFmhp0Q2BcWVDUDmSiuJtnUKQKmfh30GhusvpPrwLCEXHYWRUiqseU0gjqKOTBxQ6bPg=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:34.412375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fd5057ba-0d32-403a-97f7-d8cb2203ef61 req-1e575f48-e3ba-46d8-8caf-b6c7e324cc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ee4a8d-4967-43af-9593-6c2313fbfa31", "tag": "3501c234-a011-456a-af52-2fa317ef4f4e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:34.441704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd5057ba-0d32-403a-97f7-d8cb2203ef61 req-1e575f48-e3ba-46d8-8caf-b6c7e324cc41 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.445056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd5057ba-0d32-403a-97f7-d8cb2203ef61 req-1e575f48-e3ba-46d8-8caf-b6c7e324cc41 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.445601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd5057ba-0d32-403a-97f7-d8cb2203ef61 req-1e575f48-e3ba-46d8-8caf-b6c7e324cc41 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.466256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-aafb00c1-e5a1-4db4-a6bb-4f232456d03f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Getting quotas for project 15a9a3fcc27f4156938ab4e3a3867dac. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:34.469490 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fd5057ba-0d32-403a-97f7-d8cb2203ef61 req-1e575f48-e3ba-46d8-8caf-b6c7e324cc41 service nova] Creating event network-changed:3501c234-a011-456a-af52-2fa317ef4f4e for instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 on n-h2-master-1 Sep 25 01:02:34.471818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-aafb00c1-e5a1-4db4-a6bb-4f232456d03f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Getting quotas for user f09382cdd438452ab095b3381c0b2dad and project 15a9a3fcc27f4156938ab4e3a3867dac. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:34.485771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fd5057ba-0d32-403a-97f7-d8cb2203ef61 req-1e575f48-e3ba-46d8-8caf-b6c7e324cc41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097396 Sep 25 01:02:34.486739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 252/481] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:34.498374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:34.501824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:34.517049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.519727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.522633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.524155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aafb00c1-e5a1-4db4-a6bb-4f232456d03f tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.149105 Sep 25 01:02:34.525500 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 230/482] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:02:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:02:34.525886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.526493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.526939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.533275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:34.534284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:34.544883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.545833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.546458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.547535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:34.548146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:34.548844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.042230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:35.054020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-39acc41f-97fe-426c-a012-2e2b7d72dfb5 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.523574 Sep 25 01:02:35.054848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 231/483] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:34 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:35.059599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c62a3c4-83c4-425f-adc4-fea92c23d8bc tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Calling method '.version_select at 0x7f7bf0209af0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.069081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:35.085338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f09965cd-2eff-44d6-83da-2dad3f3ad210 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.596747 Sep 25 01:02:35.086279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 253/484] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:34 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:35.101717 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c62a3c4-83c4-425f-adc4-fea92c23d8bc tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-17070291?user_id=b837dd692d2c4cf0ae6106c1459f4914" status: 200 len: 510 microversion: 2.10 time: 0.045469 Sep 25 01:02:35.117255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0752186-c325-453e-a638-df849e874436 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Action: 'create', calling method: .version_select at 0x7f7bf0028700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1645311193", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB45FBx8SvbG+B3G0QOZQLGrZ9aqfgnwLXYHPScyEN2DNq3M/KuhE48WQ2G9O2SEyKVIs7QOD/fMEtFz3T2Swwi2HAxMWeAOMEA+bGsMh8yXGi/e5y1UqS1K2rp/e9hkQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:35.121224 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 232/485] 10.222.0.16 () {60 vars in 1334 bytes} [Sun Sep 25 01:02:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-17070291?user_id=b837dd692d2c4cf0ae6106c1459f4914 => generated 510 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:35.136647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c0752186-c325-453e-a638-df849e874436 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Getting quotas for project 15a9a3fcc27f4156938ab4e3a3867dac. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:35.141616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c0752186-c325-453e-a638-df849e874436 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Getting quotas for user f09382cdd438452ab095b3381c0b2dad and project 15a9a3fcc27f4156938ab4e3a3867dac. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:35.174310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0752186-c325-453e-a638-df849e874436 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.061163 Sep 25 01:02:35.188431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f0c34f24-5532-4f11-b5a2-7fb92c9e1853 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Calling method '.version_select at 0x7f7bf010dca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.193581 n-d-master-1 devstack@n-api.service[122384]: WARNING oslo_db.sqlalchemy.utils [None req-f0c34f24-5532-4f11-b5a2-7fb92c9e1853 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 25 01:02:35.194069 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 254/486] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:02:35 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:02:35.208753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.209517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:35.215073 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f0c34f24-5532-4f11-b5a2-7fb92c9e1853 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=b837dd692d2c4cf0ae6106c1459f4914" status: 200 len: 724 microversion: 2.10 time: 0.031015 Sep 25 01:02:35.223675 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 233/487] 10.222.0.16 () {60 vars in 1259 bytes} [Sun Sep 25 01:02:35 2022] GET /compute/v2.1/os-keypairs?user_id=b837dd692d2c4cf0ae6106c1459f4914 => generated 724 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:35.232621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.233716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.234435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.236501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.237203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22de8c11-7915-4f57-95c4-db5c47346ff9 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Calling method '.version_select at 0x7f7bf02ee5e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.238674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.240189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.285165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22de8c11-7915-4f57-95c4-db5c47346ff9 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1645311193" status: 204 len: 0 microversion: 2.10 time: 0.057951 Sep 25 01:02:35.290235 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 234/488] 10.222.0.16 () {60 vars in 1325 bytes} [Sun Sep 25 01:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1645311193 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:02:35.305857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9429aec8-ad77-4756-a91c-ed7c09c96d52 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Calling method '.version_select at 0x7f7bf010d280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.340126 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9429aec8-ad77-4756-a91c-ed7c09c96d52 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491369720?user_id=b837dd692d2c4cf0ae6106c1459f4914" status: 204 len: 0 microversion: 2.10 time: 0.048151 Sep 25 01:02:35.340958 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 235/489] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491369720?user_id=b837dd692d2c4cf0ae6106c1459f4914 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:02:35.353481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4fef9321-7d9a-4e36-be32-8479980dbac0 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] Calling method '.version_select at 0x7f7bf016f430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.401142 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4fef9321-7d9a-4e36-be32-8479980dbac0 tempest-KeyPairsV210TestJSON-1044801485 tempest-KeyPairsV210TestJSON-1044801485-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17070291?user_id=b837dd692d2c4cf0ae6106c1459f4914" status: 204 len: 0 microversion: 2.10 time: 0.054796 Sep 25 01:02:35.402832 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 236/490] 10.222.0.16 () {60 vars in 1337 bytes} [Sun Sep 25 01:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17070291?user_id=b837dd692d2c4cf0ae6106c1459f4914 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:02:35.413169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.415916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:35.435576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.440401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.441476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.443503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.445834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.448345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.587834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:35.601703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa3ffb32-9e67-4707-845a-7ff6fb1ebcff tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1276 microversion: 2.1 time: 0.196037 Sep 25 01:02:35.604532 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 237/491] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:35 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:35.618230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.619132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:35.632586 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:35.634030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:35.639205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.640043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.640526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.641611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.642072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.642780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.646966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fcec22cb-4c51-4cc7-ac50-99a00e343e7b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.442722 Sep 25 01:02:35.648063 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 255/492] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:35 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:35.846228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:35.854939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0223d401-e62e-41dd-bc5b-341b66b22c65 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1472 microversion: 2.1 time: 0.247308 Sep 25 01:02:35.856968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 238/493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:35 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:35.878922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:35.880557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:35.887399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.898204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.898654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.899406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.899870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.900287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.958801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lazy-loading 'flavor' on Instance uuid 115fce23-5f1d-4023-86e4-1d8abbafbfef {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:36.079323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:36.080847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:36.088659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.089525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.090695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.091928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.092542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.093106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.131741 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4767d30-b074-4010-944a-13ddd5b04ac6 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef/action" status: 202 len: 0 microversion: 2.1 time: 0.256496 Sep 25 01:02:36.132512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 256/494] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:35 2022] POST /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:36.144303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:36.149569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:36.165798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.166674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.167382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.168474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.169428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.170722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.733702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:36.736098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:36.746573 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-056fc4a2-31ca-4a4c-b4bf-59a5bd6e36ed tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.610969 Sep 25 01:02:36.747418 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 257/495] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:36 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:36.758845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:36.759819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:36.772124 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-68bc8dcf-746c-43c4-849a-9be1e0c509c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.697323 Sep 25 01:02:36.774039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.774639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.774774 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 239/496] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:36 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:36.776147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.777414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.777947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.778495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.788451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-cb1fa14b-508c-40ff-9d23-447d9b435f41 req-d244a895-3a1e-4b9e-ac42-fc29c00a81cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b", "tag": "9aca0ece-499a-498f-b1c4-04c09afa2a9c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:36.801307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cb1fa14b-508c-40ff-9d23-447d9b435f41 req-d244a895-3a1e-4b9e-ac42-fc29c00a81cd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.803169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cb1fa14b-508c-40ff-9d23-447d9b435f41 req-d244a895-3a1e-4b9e-ac42-fc29c00a81cd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.803782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cb1fa14b-508c-40ff-9d23-447d9b435f41 req-d244a895-3a1e-4b9e-ac42-fc29c00a81cd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.820618 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-cb1fa14b-508c-40ff-9d23-447d9b435f41 req-d244a895-3a1e-4b9e-ac42-fc29c00a81cd service nova] Creating event network-changed:9aca0ece-499a-498f-b1c4-04c09afa2a9c for instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b on n-h2-master-1 Sep 25 01:02:36.828055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-cb1fa14b-508c-40ff-9d23-447d9b435f41 req-d244a895-3a1e-4b9e-ac42-fc29c00a81cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051294 Sep 25 01:02:36.829064 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 240/497] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:36.836590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:36.837264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:36.845609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.846113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.846548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.849265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:36.850375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:36.851359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.183748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:37.196842 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2383d4ab-3d95-492e-8bf7-3e630c73ccae tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.366662 Sep 25 01:02:37.200801 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 241/498] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:36 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:37.212205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:37.215935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:37.230593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.231125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.231589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.234468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.236768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.237212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.427639 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e422a2b-16af-46ec-b8cc-7a9b8d7ea9bf tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1631 microversion: 2.1 time: 0.678325 Sep 25 01:02:37.445443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 258/499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:36 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1631 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:37.451420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5ba5e38f-7130-4ee4-b5cb-1e06d057cf17 req-6436a6fd-d8ed-4a66-a5e0-02c8b6363689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d94cc9-60f6-42c6-8695-c70085ead5a2", "tag": "59c280ab-2924-4e4f-91a8-15d67cc1947f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:37.462379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:37.473906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fda94ac5-f9ff-4222-bc05-0210d5b35161 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.271461 Sep 25 01:02:37.478351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 242/500] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:37 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:37.486995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ba5e38f-7130-4ee4-b5cb-1e06d057cf17 req-6436a6fd-d8ed-4a66-a5e0-02c8b6363689 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.487494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ba5e38f-7130-4ee4-b5cb-1e06d057cf17 req-6436a6fd-d8ed-4a66-a5e0-02c8b6363689 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.487934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ba5e38f-7130-4ee4-b5cb-1e06d057cf17 req-6436a6fd-d8ed-4a66-a5e0-02c8b6363689 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.506584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5ba5e38f-7130-4ee4-b5cb-1e06d057cf17 req-6436a6fd-d8ed-4a66-a5e0-02c8b6363689 service nova] Creating event network-changed:59c280ab-2924-4e4f-91a8-15d67cc1947f for instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 on n-h1-master-1 Sep 25 01:02:37.512482 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5ba5e38f-7130-4ee4-b5cb-1e06d057cf17 req-6436a6fd-d8ed-4a66-a5e0-02c8b6363689 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065403 Sep 25 01:02:37.513117 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 259/501] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:37.783069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:37.786056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:37.803507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.804641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:37.806870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.808727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.810215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.811376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:37.812166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.814054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.827941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.835447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.836123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.837463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.838031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.838710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.139719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:38.152881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43276142-6c58-4e45-8a22-f8892652a848 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.381178 Sep 25 01:02:38.153786 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 243/502] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:37 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:38.155529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:38.165336 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11f76326-c71a-41f2-a251-eb6448dcd430 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.371544 Sep 25 01:02:38.165928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 260/503] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:37 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:38.225606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:38.226609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:38.243281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.244114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.244856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.246083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.246869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.247626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.455785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:38.456749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:38.493129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.496833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.498766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.499460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.505860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.509656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.559030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:38.567539 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a9291314-4739-4b30-9af5-88aaefa82b8a tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.347139 Sep 25 01:02:38.581910 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 244/504] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:38 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:38.592354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:38.592926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:38.599922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.600414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.600856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.601618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.602073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.602502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.760556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6972a2c7-267c-4632-8e76-38beac63abd9 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1614 microversion: 2.1 time: 0.312420 Sep 25 01:02:38.769457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 261/505] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:38 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1614 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:38.781463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-853779d7-5d0b-4832-8d28-f4fc4470d7ce tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf000eca0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:38.826427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:38.833588 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-853779d7-5d0b-4832-8d28-f4fc4470d7ce tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/5c81859e-0fad-47a0-811f-99bc207974ae" status: 200 len: 661 microversion: 2.1 time: 0.071340 Sep 25 01:02:38.834171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 262/506] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:38 2022] GET /compute/v2.1/images/5c81859e-0fad-47a0-811f-99bc207974ae => generated 661 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:38.843526 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f277bd11-4888-411a-9c1c-4f55034ece26 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.254030 Sep 25 01:02:38.843526 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 245/507] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:38 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:38.846378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:38.847005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:38.851109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5919edef-410c-4278-88e5-3188604e899d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0028a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:38.858636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.859081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.860277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.861220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:38.862024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:38.862497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.903873 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5919edef-410c-4278-88e5-3188604e899d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/5c81859e-0fad-47a0-811f-99bc207974ae" status: 200 len: 661 microversion: 2.1 time: 0.058594 Sep 25 01:02:38.904570 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 263/508] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:38 2022] GET /compute/v2.1/images/5c81859e-0fad-47a0-811f-99bc207974ae => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:38.979622 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] HTTP exception thrown: Cannot 'migrate' instance 115fce23-5f1d-4023-86e4-1d8abbafbfef while it is in vm_state suspended Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Request method failure captured: Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef/action HTTP/1.1 Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 15 Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6h20k-c5ahThM3FTCJO_O2q2pqa3JL2oAHnDiYrlmRsyINrtkHJDw653dDmGeG91hmy39stbMSDtt79G71PO1NqnW3HnwAgdWxekeuX8Zgm717Z_mNYacdrk06FKLqBtFJCAnajLVepe0p38Z7hWsBDDKcEU8GP48Ogu6TaygL8pgk Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:02:38.981865 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7222c94675e14a4381e48c17b360a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7222c94675e14a4381e48c17b360a351"}]}] Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e860f05decda4dd9a319ea6efba0a1ca Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: {"migrate": {}} Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:02:38.984605 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'migrate' instance 115fce23-5f1d-4023-86e4-1d8abbafbfef while it is in vm_state suspended Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '115fce23-5f1d-4023-86e4-1d8abbafbfef', 'body': {'migrate': {}}} Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef in vm_state suspended. Cannot resize while the instance is in this state. Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:38.986975 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 115fce23-5f1d-4023-86e4-1d8abbafbfef while it is in vm_state suspended Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:38.989560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 115fce23-5f1d-4023-86e4-1d8abbafbfef while it is in vm_state suspended Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Returning 409 to user: Cannot 'migrate' instance 115fce23-5f1d-4023-86e4-1d8abbafbfef while it is in vm_state suspended {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c262380-e6c2-441a-8862-ccb82c2388ff tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef/action" status: 409 len: 148 microversion: 2.1 time: 0.143798 Sep 25 01:02:38.994017 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 246/509] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:38 2022] POST /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef/action => generated 148 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:02:39.000873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88f0a182-950a-4924-a67f-8a3afdbbbd3e tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88f0a182-950a-4924-a67f-8a3afdbbbd3e tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Request method failure captured: Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6/action HTTP/1.1 Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 39 Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6h20k-c5ahThM3FTCJO_O2q2pqa3JL2oAHnDiYrlmRsyINrtkHJDw653dDmGeG91hmy39stbMSDtt79G71PO1NqnW3HnwAgdWxekeuX8Zgm717Z_mNYacdrk06FKLqBtFJCAnajLVepe0p38Z7hWsBDDKcEU8GP48Ogu6TaygL8pgk Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:39.007315 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7222c94675e14a4381e48c17b360a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7222c94675e14a4381e48c17b360a351"}]}] Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: e860f05decda4dd9a319ea6efba0a1ca Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: {"os-resetState": {"state": "invalid"}} Sep 25 01:02:39.008677 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'c9146f07-eb2d-4aa7-b34f-6fee344aa4b6', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'invalid' Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:39.009375 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:02:39.010638 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 25 01:02:39.011708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.011708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88f0a182-950a-4924-a67f-8a3afdbbbd3e tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:39.011708 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88f0a182-950a-4924-a67f-8a3afdbbbd3e tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6/action" status: 400 len: 144 microversion: 2.1 time: 0.013560 Sep 25 01:02:39.011708 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 264/510] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:38 2022] POST /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6/action => generated 144 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:02:39.023108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d86ca24-2a29-4816-b29e-39fce619d5c7 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d86ca24-2a29-4816-b29e-39fce619d5c7 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Request method failure captured: Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6/action HTTP/1.1 Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 31 Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6h20k-c5ahThM3FTCJO_O2q2pqa3JL2oAHnDiYrlmRsyINrtkHJDw653dDmGeG91hmy39stbMSDtt79G71PO1NqnW3HnwAgdWxekeuX8Zgm717Z_mNYacdrk06FKLqBtFJCAnajLVepe0p38Z7hWsBDDKcEU8GP48Ogu6TaygL8pgk Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:02:39.037298 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7222c94675e14a4381e48c17b360a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7222c94675e14a4381e48c17b360a351"}]}] Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e860f05decda4dd9a319ea6efba0a1ca Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: {"os-resetState": {"state": 1}} Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:02:39.038685 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'c9146f07-eb2d-4aa7-b34f-6fee344aa4b6', 'body': {'os-resetState': {'state': 1}}} Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 1 Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:39.039512 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 25 01:02:39.042773 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.043920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d86ca24-2a29-4816-b29e-39fce619d5c7 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:39.044368 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d86ca24-2a29-4816-b29e-39fce619d5c7 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6/action" status: 400 len: 120 microversion: 2.1 time: 0.028181 Sep 25 01:02:39.046070 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 247/511] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:39 2022] POST /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:02:39.054716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92eae8e7-15fa-456c-83f7-f59b70294dd2 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:39.056972 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92eae8e7-15fa-456c-83f7-f59b70294dd2 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Failed to fetch instance by id 999 {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:02:39.057521 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-92eae8e7-15fa-456c-83f7-f59b70294dd2 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92eae8e7-15fa-456c-83f7-f59b70294dd2 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Request method failure captured: Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 37 Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6h20k-c5ahThM3FTCJO_O2q2pqa3JL2oAHnDiYrlmRsyINrtkHJDw653dDmGeG91hmy39stbMSDtt79G71PO1NqnW3HnwAgdWxekeuX8Zgm717Z_mNYacdrk06FKLqBtFJCAnajLVepe0p38Z7hWsBDDKcEU8GP48Ogu6TaygL8pgk Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:39.059241 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7222c94675e14a4381e48c17b360a351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7222c94675e14a4381e48c17b360a351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7222c94675e14a4381e48c17b360a351"}]}] Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 7222c94675e14a4381e48c17b360a351 Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-989009694 Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: e860f05decda4dd9a319ea6efba0a1ca Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-989009694-project-admin Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: {"os-resetState": {"state": "error"}} Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:39.060589 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 999 could not be found. Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:39.061814 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92eae8e7-15fa-456c-83f7-f59b70294dd2 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:39.063378 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92eae8e7-15fa-456c-83f7-f59b70294dd2 tempest-ServersAdminNegativeTestJSON-989009694 tempest-ServersAdminNegativeTestJSON-989009694-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010248 Sep 25 01:02:39.064295 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 265/512] 10.222.0.16 () {60 vars in 1179 bytes} [Sun Sep 25 01:02:39 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:02:39.071766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.072778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.086095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.091836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.092298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.093038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.093534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.093970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.131224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:02:39.150471 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:39.182941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.182941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.199275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.200408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.200863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.201621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.202386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.203909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.243693 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a364c93-595a-4aca-afdf-9e696ec30628 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "DELETE /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 204 len: 0 microversion: 2.1 time: 0.176737 Sep 25 01:02:39.244337 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 248/513] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:02:39 2022] DELETE /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:02:39.266107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.268145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.282408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.282913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.283568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.284450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.285186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.286584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.481923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:39.491599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6a799a6-4913-4c92-b014-111062b6659c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.319323 Sep 25 01:02:39.494973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 266/514] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:39.505603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.507233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.511537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:39.512438 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:39.519152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.520644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.521311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.521565 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8140ecf0-fcb2-469a-8645-e5804b1cc49d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.273458 Sep 25 01:02:39.522595 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 249/515] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:39.522752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.523261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.523761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.595747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.596369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.612819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.613319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.613882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.615092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.615550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.615976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.717802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:39.727895 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a792b48-f706-4db0-93f7-b6a653b890bd tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1469 microversion: 2.1 time: 0.231490 Sep 25 01:02:39.728757 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 267/516] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:39.832176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:39.842585 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1db2814e-b321-408c-ac3b-da39c62f23c3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.250648 Sep 25 01:02:39.843882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 250/517] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:39.868141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.869325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.876100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.876593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.877214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.877982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.878429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.879380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.037437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.047122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45bfdb75-f5b6-4745-b655-8db55539a7a2 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.184145 Sep 25 01:02:40.048037 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 251/518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:40.065807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d376aaf6-60ed-47b5-bc7f-a4bd9566d91a tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Calling method '.version_select at 0x7f7bf04c8820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.068555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d376aaf6-60ed-47b5-bc7f-a4bd9566d91a tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b20ae0370d8e4246a1d8a66da0fd70c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e048ceb3b94914b1c30609b2ef3b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d376aaf6-60ed-47b5-bc7f-a4bd9566d91a tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Request method failure captured: Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iuAKza85BUd5QxNf3qkTq-WEQxiYEhy3U_LKgxpWWLu0QBy3Mj2ipMT9G8TTfdtX_tm6mx7nxM7AmzG0fglGGQ5WubAKHO0lG5fR-klOKS9g_YSsKaHVNf_brEkUUnViw0Hg9i544XFcQXoam5nEF2IXqdRyAGSaHxnQZOr32bv_0 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:02:40.070670 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79e048ceb3b94914b1c30609b2ef3b59"}]}] Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b20ae0370d8e4246a1d8a66da0fd70c9 Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:02:40.072692 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:40.074081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 25 01:02:40.075392 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.076952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d376aaf6-60ed-47b5-bc7f-a4bd9566d91a tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.076952 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d376aaf6-60ed-47b5-bc7f-a4bd9566d91a tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.342618 Sep 25 01:02:40.080457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 268/519] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.085222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33902785-7e2c-4eaf-9add-3c084f630b96 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Calling method '.version_select at 0x7f7bf02b7040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.087167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-33902785-7e2c-4eaf-9add-3c084f630b96 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b20ae0370d8e4246a1d8a66da0fd70c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e048ceb3b94914b1c30609b2ef3b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33902785-7e2c-4eaf-9add-3c084f630b96 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Request method failure captured: Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iuAKza85BUd5QxNf3qkTq-WEQxiYEhy3U_LKgxpWWLu0QBy3Mj2ipMT9G8TTfdtX_tm6mx7nxM7AmzG0fglGGQ5WubAKHO0lG5fR-klOKS9g_YSsKaHVNf_brEkUUnViw0Hg9i544XFcQXoam5nEF2IXqdRyAGSaHxnQZOr32bv_0 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:02:40.089266 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79e048ceb3b94914b1c30609b2ef3b59"}]}] Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b20ae0370d8e4246a1d8a66da0fd70c9 Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: action_args: {} Sep 25 01:02:40.090732 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:40.091467 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 25 01:02:40.092615 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.094675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33902785-7e2c-4eaf-9add-3c084f630b96 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.095520 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33902785-7e2c-4eaf-9add-3c084f630b96 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015046 Sep 25 01:02:40.096087 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 252/520] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:02:40.105799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bdbd287f-491f-43d1-a294-7818b2eda58f tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Calling method '.version_select at 0x7f7bf017cb80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.107631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bdbd287f-491f-43d1-a294-7818b2eda58f tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b20ae0370d8e4246a1d8a66da0fd70c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e048ceb3b94914b1c30609b2ef3b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bdbd287f-491f-43d1-a294-7818b2eda58f tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Request method failure captured: Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iuAKza85BUd5QxNf3qkTq-WEQxiYEhy3U_LKgxpWWLu0QBy3Mj2ipMT9G8TTfdtX_tm6mx7nxM7AmzG0fglGGQ5WubAKHO0lG5fR-klOKS9g_YSsKaHVNf_brEkUUnViw0Hg9i544XFcQXoam5nEF2IXqdRyAGSaHxnQZOr32bv_0 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:02:40.109182 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79e048ceb3b94914b1c30609b2ef3b59"}]}] Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b20ae0370d8e4246a1d8a66da0fd70c9 Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:02:40.110597 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:40.111359 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 25 01:02:40.117939 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.119687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bdbd287f-491f-43d1-a294-7818b2eda58f tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.119687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bdbd287f-491f-43d1-a294-7818b2eda58f tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009314 Sep 25 01:02:40.119687 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 269/521] 10.222.0.16 () {58 vars in 1179 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.266789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Calling method '.version_select at 0x7f7bf02090d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.269184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.269696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.271049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.292763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.292763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.293075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.306708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.307627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.308074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.314973 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5655b2fb-c157-4d33-8026-22baaa220629 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.196338 Sep 25 01:02:40.315929 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 253/522] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:40.329765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a2c7fd8-83e5-47ac-91ec-be6d5abdd96d tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Calling method '.version_select at 0x7f7bf017c1f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.333389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a2c7fd8-83e5-47ac-91ec-be6d5abdd96d tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b20ae0370d8e4246a1d8a66da0fd70c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e048ceb3b94914b1c30609b2ef3b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a2c7fd8-83e5-47ac-91ec-be6d5abdd96d tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Request method failure captured: Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iuAKza85BUd5QxNf3qkTq-WEQxiYEhy3U_LKgxpWWLu0QBy3Mj2ipMT9G8TTfdtX_tm6mx7nxM7AmzG0fglGGQ5WubAKHO0lG5fR-klOKS9g_YSsKaHVNf_brEkUUnViw0Hg9i544XFcQXoam5nEF2IXqdRyAGSaHxnQZOr32bv_0 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:02:40.336089 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79e048ceb3b94914b1c30609b2ef3b59"}]}] Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b20ae0370d8e4246a1d8a66da0fd70c9 Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1'} Sep 25 01:02:40.337779 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:40.338677 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 25 01:02:40.339936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.341246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a2c7fd8-83e5-47ac-91ec-be6d5abdd96d tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.341246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a2c7fd8-83e5-47ac-91ec-be6d5abdd96d tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015094 Sep 25 01:02:40.341246 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 270/523] 10.222.0.16 () {58 vars in 1173 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.352102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4682c7cc-e178-464d-b504-e12190757a3e tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Calling method '.version_select at 0x7f7bf02eef70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.353994 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4682c7cc-e178-464d-b504-e12190757a3e tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] HTTP exception thrown: Hypervisor with ID 'ba0079ff-7477-47b8-8fa8-c41e1501dc85' could not be found. Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4682c7cc-e178-464d-b504-e12190757a3e tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Request method failure captured: Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hypervisors/ba0079ff-7477-47b8-8fa8-c41e1501dc85/uptime HTTP/1.1 Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6ivrjGDMhwWls91nUHqyS1Mz_Djy7oz-8xDGuLU1dapIsNkWwHFvjW8_iE-r5eiu4MOaklGFRvv5BAsRsa-stOj1sX-LmlGxovGUnopUqpLpy5yjC1no5BjXXDgfvDUi-dtX_7y0XFAXUP9IJa24MCEdKMzXS9YfVB9eXMN2fOBRAM Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 28ec6c075ebb4622888dac66ae31b7a5 Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-374331845 Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:02:40.363174 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28ec6c075ebb4622888dac66ae31b7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28ec6c075ebb4622888dac66ae31b7a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28ec6c075ebb4622888dac66ae31b7a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28ec6c075ebb4622888dac66ae31b7a5"}]}] Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-374331845 Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 28ec6c075ebb4622888dac66ae31b7a5 Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-374331845 Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 272f6348db5a4e48b676a28fb4a269e3 Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: exception: Hypervisor with ID 'ba0079ff-7477-47b8-8fa8-c41e1501dc85' could not be found. Sep 25 01:02:40.365090 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ba0079ff-7477-47b8-8fa8-c41e1501dc85'} Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ba0079ff-7477-47b8-8fa8-c41e1501dc85' Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 25 01:02:40.366349 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ba0079ff-7477-47b8-8fa8-c41e1501dc85' could not be found. Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.368002 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ba0079ff-7477-47b8-8fa8-c41e1501dc85' could not be found. Sep 25 01:02:40.370025 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.371371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4682c7cc-e178-464d-b504-e12190757a3e tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Returning 404 to user: Hypervisor with ID 'ba0079ff-7477-47b8-8fa8-c41e1501dc85' could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.372434 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4682c7cc-e178-464d-b504-e12190757a3e tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/ba0079ff-7477-47b8-8fa8-c41e1501dc85/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025850 Sep 25 01:02:40.377304 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 254/524] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors/ba0079ff-7477-47b8-8fa8-c41e1501dc85/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.383333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Calling method '.version_select at 0x7f7bf00563a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.392920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.393617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.394065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.409894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.410403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.411051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.430835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.431460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.431972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.446808 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-36b7a99f-edf7-4884-97d4-62cdac59c15f tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.068124 Sep 25 01:02:40.447849 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 271/525] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:40.459963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d15976b-2cba-47a5-8990-8bc14577f677 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Calling method '.version_select at 0x7f7bf0209ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.462454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d15976b-2cba-47a5-8990-8bc14577f677 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b20ae0370d8e4246a1d8a66da0fd70c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e048ceb3b94914b1c30609b2ef3b59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d15976b-2cba-47a5-8990-8bc14577f677 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Request method failure captured: Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iuAKza85BUd5QxNf3qkTq-WEQxiYEhy3U_LKgxpWWLu0QBy3Mj2ipMT9G8TTfdtX_tm6mx7nxM7AmzG0fglGGQ5WubAKHO0lG5fR-klOKS9g_YSsKaHVNf_brEkUUnViw0Hg9i544XFcQXoam5nEF2IXqdRyAGSaHxnQZOr32bv_0 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:02:40.464506 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79e048ceb3b94914b1c30609b2ef3b59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79e048ceb3b94914b1c30609b2ef3b59"}]}] Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 79e048ceb3b94914b1c30609b2ef3b59 Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756938153 Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b20ae0370d8e4246a1d8a66da0fd70c9 Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756938153-project Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1'} Sep 25 01:02:40.466099 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:02:40.467010 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 25 01:02:40.468335 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.471273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d15976b-2cba-47a5-8990-8bc14577f677 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.471273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d15976b-2cba-47a5-8990-8bc14577f677 tempest-HypervisorAdminNegativeTestJSON-756938153 tempest-HypervisorAdminNegativeTestJSON-756938153-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010658 Sep 25 01:02:40.471273 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 255/526] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.479050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76c0a92a-6990-40e8-8652-26d9b7e4d7a5 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Calling method '.version_select at 0x7f7bf02bb700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.480720 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-76c0a92a-6990-40e8-8652-26d9b7e4d7a5 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] HTTP exception thrown: Hypervisor with ID 'd318cae7-2091-4fdb-8d99-861ecb96b195' could not be found. Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76c0a92a-6990-40e8-8652-26d9b7e4d7a5 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Request method failure captured: Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/d318cae7-2091-4fdb-8d99-861ecb96b195 HTTP/1.1 Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ivrjGDMhwWls91nUHqyS1Mz_Djy7oz-8xDGuLU1dapIsNkWwHFvjW8_iE-r5eiu4MOaklGFRvv5BAsRsa-stOj1sX-LmlGxovGUnopUqpLpy5yjC1no5BjXXDgfvDUi-dtX_7y0XFAXUP9IJa24MCEdKMzXS9YfVB9eXMN2fOBRAM Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 28ec6c075ebb4622888dac66ae31b7a5 Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-374331845 Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:40.483368 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28ec6c075ebb4622888dac66ae31b7a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28ec6c075ebb4622888dac66ae31b7a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28ec6c075ebb4622888dac66ae31b7a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28ec6c075ebb4622888dac66ae31b7a5"}]}] Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-374331845 Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 28ec6c075ebb4622888dac66ae31b7a5 Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-374331845 Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 272f6348db5a4e48b676a28fb4a269e3 Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: exception: Hypervisor with ID 'd318cae7-2091-4fdb-8d99-861ecb96b195' could not be found. Sep 25 01:02:40.484826 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'd318cae7-2091-4fdb-8d99-861ecb96b195'} Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd318cae7-2091-4fdb-8d99-861ecb96b195' Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 25 01:02:40.485743 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:02:40.487434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd318cae7-2091-4fdb-8d99-861ecb96b195' could not be found. Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd318cae7-2091-4fdb-8d99-861ecb96b195' could not be found. Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76c0a92a-6990-40e8-8652-26d9b7e4d7a5 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] Returning 404 to user: Hypervisor with ID 'd318cae7-2091-4fdb-8d99-861ecb96b195' could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76c0a92a-6990-40e8-8652-26d9b7e4d7a5 tempest-HypervisorAdminNegativeTestJSON-374331845 tempest-HypervisorAdminNegativeTestJSON-374331845-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/d318cae7-2091-4fdb-8d99-861ecb96b195" status: 404 len: 123 microversion: 2.1 time: 0.010018 Sep 25 01:02:40.491044 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 272/527] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/os-hypervisors/d318cae7-2091-4fdb-8d99-861ecb96b195 => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:40.519710 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.521223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:40.534924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.538033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.538607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.539977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.541930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.542962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.546050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.546865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:40.560641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.561145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.561617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.562321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.562772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.563193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.917552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.920084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.929180 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7cad212d-e419-4e7d-9c07-da9aa05452c5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.415123 Sep 25 01:02:40.931677 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64a95110-01f7-4e0e-a529-0dc71034bef9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.389753 Sep 25 01:02:40.932203 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 256/528] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:40.932558 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 273/529] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:40.952774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f8bd266-98f9-45f6-ba0c-fddbc6e7e2da tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0209280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.953887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.954611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:40.966006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.966852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.967619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.969362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.970071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.971499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:41.033452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f8bd266-98f9-45f6-ba0c-fddbc6e7e2da tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/1b7d683a-177e-4a87-95d4-65cd01d18d0c" status: 200 len: 661 microversion: 2.1 time: 0.086424 Sep 25 01:02:41.038730 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 257/530] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/images/1b7d683a-177e-4a87-95d4-65cd01d18d0c => generated 661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:41.043996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:41.050313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:41.062616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:41.063349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:41.064198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:41.065301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:41.065793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:41.066226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:41.170599 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=16 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:41.508153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:41.522236 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1fb42fc8-6e26-4c87-aae0-090a38dc6bd2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1469 microversion: 2.1 time: 0.588354 Sep 25 01:02:41.523777 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 274/531] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:41.533438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2c3e581-dd54-47dc-9f45-5560d8d568cf tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0028ee0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:41.600262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2c3e581-dd54-47dc-9f45-5560d8d568cf tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/1b7d683a-177e-4a87-95d4-65cd01d18d0c" status: 200 len: 661 microversion: 2.1 time: 0.074517 Sep 25 01:02:41.601866 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 275/532] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:41 2022] GET /compute/v2.1/images/1b7d683a-177e-4a87-95d4-65cd01d18d0c => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:41.641844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:41.654666 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56dd92ca-b751-4907-bc31-0b79d7e9f7ca tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.611506 Sep 25 01:02:41.655412 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 258/533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:41 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:41.667514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:41.668541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:41.686182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:41.687690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:41.688217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:41.689028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:41.691422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:41.693194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:41.936316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c654b8c-16bb-4375-a22c-f274ecdd836e tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] Calling method '.version_select at 0x7f7bf0072af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:41.975181 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c654b8c-16bb-4375-a22c-f274ecdd836e tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.371525 Sep 25 01:02:41.976348 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 276/534] 10.222.0.16 () {60 vars in 1226 bytes} [Sun Sep 25 01:02:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:41.986938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:41.987573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:42.002769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.003629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.004313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.005260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.007180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.007821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.442281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:42.464916 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6911d939-1a41-40dd-8f55-379b18ce8069 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.806995 Sep 25 01:02:42.466048 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 259/535] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:41 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:42.472699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:42.472984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:42.474044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:42.482445 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-beee0548-21aa-486c-9356-2c5e739b5a3d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.504556 Sep 25 01:02:42.483084 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 277/536] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:41 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:42.500264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48ff05d5-96b9-4cd1-93a4-29c6bc25fd13 tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf00285e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:42.500857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.504007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.505729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.507750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.508237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.508683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.690996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:42.701077 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4b99a88-bba3-4e5b-9ad0-14b031f9fbb1 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1472 microversion: 2.1 time: 0.233625 Sep 25 01:02:42.701716 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 260/537] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:42 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:42.711458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e5867e77-fe4f-4329-8156-bce7fef95ed1 req-cd1e9745-3930-4c4b-83f1-4039c1a3a0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115fce23-5f1d-4023-86e4-1d8abbafbfef", "name": "network-vif-deleted", "tag": "a3afbcda-b0bb-4b2a-8d0f-e8467ca2f1c4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:42.722372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5867e77-fe4f-4329-8156-bce7fef95ed1 req-cd1e9745-3930-4c4b-83f1-4039c1a3a0bf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.723658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5867e77-fe4f-4329-8156-bce7fef95ed1 req-cd1e9745-3930-4c4b-83f1-4039c1a3a0bf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.724195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5867e77-fe4f-4329-8156-bce7fef95ed1 req-cd1e9745-3930-4c4b-83f1-4039c1a3a0bf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.744891 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e5867e77-fe4f-4329-8156-bce7fef95ed1 req-cd1e9745-3930-4c4b-83f1-4039c1a3a0bf service nova] Creating event network-vif-deleted:a3afbcda-b0bb-4b2a-8d0f-e8467ca2f1c4 for instance 115fce23-5f1d-4023-86e4-1d8abbafbfef on n-h1-master-1 Sep 25 01:02:42.770411 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e5867e77-fe4f-4329-8156-bce7fef95ed1 req-cd1e9745-3930-4c4b-83f1-4039c1a3a0bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065477 Sep 25 01:02:42.772340 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 261/538] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:42.780766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c95d0cbf-0271-45da-b6a2-2774c7ac2b6b req-0558fc51-d81c-4b09-b29f-0f32d2b49677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ee4a8d-4967-43af-9593-6c2313fbfa31", "name": "network-vif-plugged", "status": "completed", "tag": "3501c234-a011-456a-af52-2fa317ef4f4e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:42.794103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c95d0cbf-0271-45da-b6a2-2774c7ac2b6b req-0558fc51-d81c-4b09-b29f-0f32d2b49677 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.794779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c95d0cbf-0271-45da-b6a2-2774c7ac2b6b req-0558fc51-d81c-4b09-b29f-0f32d2b49677 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.795386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c95d0cbf-0271-45da-b6a2-2774c7ac2b6b req-0558fc51-d81c-4b09-b29f-0f32d2b49677 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.815708 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c95d0cbf-0271-45da-b6a2-2774c7ac2b6b req-0558fc51-d81c-4b09-b29f-0f32d2b49677 service nova] Creating event network-vif-plugged:3501c234-a011-456a-af52-2fa317ef4f4e for instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 on n-h2-master-1 Sep 25 01:02:42.830153 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48ff05d5-96b9-4cd1-93a4-29c6bc25fd13 tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.341298 Sep 25 01:02:42.834534 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 278/539] 10.222.0.16 () {62 vars in 1247 bytes} [Sun Sep 25 01:02:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:42.838572 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c95d0cbf-0271-45da-b6a2-2774c7ac2b6b req-0558fc51-d81c-4b09-b29f-0f32d2b49677 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062040 Sep 25 01:02:42.839318 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 262/540] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:42.867521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:42.870781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:42.870966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:42.871604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:42.880426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.880670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.881817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.882215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.882374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.883025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.883473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.883955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.884360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.886000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.886757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.887397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.893311 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:42.940518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.943080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.943552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.944035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lazy-loading 'fault' on Instance uuid 115fce23-5f1d-4023-86e4-1d8abbafbfef {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:43.026633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:43.038572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11d1f509-3a7a-4bca-b888-a12290ed86f8 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 200 len: 1312 microversion: 2.1 time: 0.201150 Sep 25 01:02:43.039430 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 279/541] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:42 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:43.050554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da64a4da-4d99-43c9-8910-9d3afe16904f tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] Calling method '.version_select at 0x7f7bf02bb040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:43.068118 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da64a4da-4d99-43c9-8910-9d3afe16904f tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027198 Sep 25 01:02:43.069156 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 280/542] 10.222.0.16 () {60 vars in 1226 bytes} [Sun Sep 25 01:02:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:43.090490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e71a229-5386-4531-b9b5-35016b398c6a tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] Action: 'update', calling method: .version_select at 0x7f7bebfe4430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:43.095917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:43.106919 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75162d0b-a5be-474a-811c-4667e70f64e4 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.264979 Sep 25 01:02:43.107925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 263/543] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:42 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:43.209095 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e71a229-5386-4531-b9b5-35016b398c6a tempest-QuotaClassesAdmin257Test-706939036 tempest-QuotaClassesAdmin257Test-706939036-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.129338 Sep 25 01:02:43.209906 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 281/544] 10.222.0.16 () {62 vars in 1247 bytes} [Sun Sep 25 01:02:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:43.489296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:43.490866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:43.508622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:43.509623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:43.514108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.516926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.517722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.521852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.523773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.524366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.525019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.527003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.527739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.531900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.533088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.533998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.446673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:44.465839 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c377ffa5-0e3a-41eb-baa3-0664906c5b98 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.980475 Sep 25 01:02:44.467508 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 264/545] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:43 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:44.482141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.483726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:44.497566 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=18 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:44.500989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:44.503143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:44.504293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.505917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:44.506970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:44.507954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.520509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:44.531214 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-adcd323c-0caf-4a8f-9849-107333acc293 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 1.027620 Sep 25 01:02:44.532534 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 282/546] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:43 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:44.539106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4ad8f11-332b-485e-a225-9a1347486a0f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf023e430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.591765 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4ad8f11-332b-485e-a225-9a1347486a0f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/4784d6ba-285c-4bfa-92e4-2f9354b6c0bf" status: 200 len: 661 microversion: 2.1 time: 0.057875 Sep 25 01:02:44.592346 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 283/547] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:44 2022] GET /compute/v2.1/images/4784d6ba-285c-4bfa-92e4-2f9354b6c0bf => generated 661 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:44.598165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.599118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: 115fce23-5f1d-4023-86e4-1d8abbafbfef] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:44.606769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:44.607372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:44.608080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.609578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:44.610140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:44.610843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.628835 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] HTTP exception thrown: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef could not be found. Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Request method failure captured: Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef HTTP/1.1 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hyCSA0M5tna1xrPQR-dNR4DqvIbh6UPr8Uq9sfwZlMZaH_M2Y7RsfiDc4yRkPm63fr5t1T8MzPuoyj_sg22rXaB2eVbMVDPNGX7aiWri5b-wY1qLuWoFpL_eh5cEL3Bnidc1VfNJOmk5kqR8ReGO5m94UdQuaXJI_Bbm4R3jE1dH4 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 4ea70b1c1150462fb7ad97fa83ef8060 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2146595438 Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:02:44.631760 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ea70b1c1150462fb7ad97fa83ef8060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ea70b1c1150462fb7ad97fa83ef8060"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ea70b1c1150462fb7ad97fa83ef8060"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ea70b1c1150462fb7ad97fa83ef8060"}]}] Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2146595438 Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 4ea70b1c1150462fb7ad97fa83ef8060 Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2146595438 Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-2146595438-project Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 54541ffbbb8d4f24a054d1d7a80f7152 Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2146595438-project Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef could not be found. Sep 25 01:02:44.633344 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '115fce23-5f1d-4023-86e4-1d8abbafbfef'} Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef could not be found. Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:44.634226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef could not be found. Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef could not be found. Sep 25 01:02:44.635669 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:44.638237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Returning 404 to user: Instance 115fce23-5f1d-4023-86e4-1d8abbafbfef could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:44.639307 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ada3a77-ac3b-4786-b263-cc1e0961818e tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef" status: 404 len: 111 microversion: 2.1 time: 0.045337 Sep 25 01:02:44.640629 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 284/548] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:44 2022] GET /compute/v2.1/servers/115fce23-5f1d-4023-86e4-1d8abbafbfef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:44.650059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.651304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:44.666022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:44.666748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:44.667765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.670093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:44.670625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:44.671033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:44.897523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:44.906631 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e699d1c6-3d9c-45a6-a69b-ffd244ca721e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1478 microversion: 2.1 time: 0.436462 Sep 25 01:02:44.913498 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 265/549] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:44 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1478 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:44.917568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7c4e8322-a390-4228-8852-df44f926dafc tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf005e9d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.959355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:44.965356 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7c4e8322-a390-4228-8852-df44f926dafc tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/4784d6ba-285c-4bfa-92e4-2f9354b6c0bf" status: 200 len: 661 microversion: 2.1 time: 0.056522 Sep 25 01:02:44.965984 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 266/550] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:02:44 2022] GET /compute/v2.1/images/4784d6ba-285c-4bfa-92e4-2f9354b6c0bf => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:44.970705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef361ed0-a36c-4679-9e62-d2df708006ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.328568 Sep 25 01:02:44.971892 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 285/551] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:44 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:44.988486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.989198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:44.998444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ea67f4ad-c236-47ef-9553-96c07988b195 req-70c81974-fbd7-44a2-8660-014ff6e960db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d94cc9-60f6-42c6-8695-c70085ead5a2", "name": "network-vif-plugged", "status": "completed", "tag": "59c280ab-2924-4e4f-91a8-15d67cc1947f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:45.026573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea67f4ad-c236-47ef-9553-96c07988b195 req-70c81974-fbd7-44a2-8660-014ff6e960db service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.027225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.027410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea67f4ad-c236-47ef-9553-96c07988b195 req-70c81974-fbd7-44a2-8660-014ff6e960db service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.027975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea67f4ad-c236-47ef-9553-96c07988b195 req-70c81974-fbd7-44a2-8660-014ff6e960db service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.029006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.029699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.033330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.036540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.049888 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ea67f4ad-c236-47ef-9553-96c07988b195 req-70c81974-fbd7-44a2-8660-014ff6e960db service nova] Creating event network-vif-plugged:59c280ab-2924-4e4f-91a8-15d67cc1947f for instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 on n-h1-master-1 Sep 25 01:02:45.058435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ea67f4ad-c236-47ef-9553-96c07988b195 req-70c81974-fbd7-44a2-8660-014ff6e960db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085080 Sep 25 01:02:45.059727 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 286/552] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:45.061595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.128081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:02:45.216783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1262115788", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:45.346842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:45.373952 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18f7e870-c0d4-4ef4-ac82-eb6fa28e1b81 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 204 len: 0 microversion: 2.1 time: 0.395540 Sep 25 01:02:45.375071 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 267/553] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:02:44 2022] DELETE /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:02:45.387637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:45.388813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:45.397978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.399301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.399928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.401340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.402003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.402602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.705896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:45.706482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:45.706991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:45.708647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:45.709247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:45.722301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.723064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.724111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.725271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.726029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.726560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.744624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Getting quotas for project 298a602ff055472e9ac0f14f846f8160. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:45.750027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Getting quotas for user 5bfdfd44cd064a3f88e8a5c2a3b09307 and project 298a602ff055472e9ac0f14f846f8160. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:45.751455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:45.758145 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:45.765928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:45.766896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dcbbf5ed-46bf-4ac0-9bf2-a3660999a52a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1477 microversion: 2.1 time: 0.385321 Sep 25 01:02:45.767772 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 268/554] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:45 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:45.773565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:45.782499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:45.783474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:45.792952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.794061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.794768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.796067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.796728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.797356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.818563 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2549d0df-1c5f-441a-8caf-7266830328a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616495 Sep 25 01:02:45.819202 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 287/555] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:45.824264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:45.825073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:45.838827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.839249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.839981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.840891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.841595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.842323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.064243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:46.072988 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e8245e3-c31a-4009-9444-fed58bdb2f34 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.297549 Sep 25 01:02:46.089488 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 269/556] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:45 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:46.095301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:46.096131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:46.103982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.104715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.105902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.106825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.107448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.108037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.111689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:46.139901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ea3f2689-2ac7-4a6a-b4b4-75eca0a79eb2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 0.316231 Sep 25 01:02:46.149644 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 288/557] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:45 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:46.152054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1579417426", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:46.171463 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=14,nova_api:INSERT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:46.252467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:46.424053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:46.435352 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a238555-b415-4849-b1ab-74d17e19656e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1478 microversion: 2.1 time: 0.344427 Sep 25 01:02:46.437094 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 270/558] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:46 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1478 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:46.454348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:46.455268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:46.464377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.465082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.465739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.466888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.467419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.468064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.236991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:47.237600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:47.237892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:47.239109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:47.239462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:47.262083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.262572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.263006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.263841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.264295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.265018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.302590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Getting quotas for project 298a602ff055472e9ac0f14f846f8160. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:47.305873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:47.308867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Getting quotas for user 5bfdfd44cd064a3f88e8a5c2a3b09307 and project 298a602ff055472e9ac0f14f846f8160. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:47.321963 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3465215-be88-4b80-93ce-7de4677ad69b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1318 microversion: 2.1 time: 0.882891 Sep 25 01:02:47.322721 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 271/559] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:46 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:47.327777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:47.331454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:47.333164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:47.333993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:47.345758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.350703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.354037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.355563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.358261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.359421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.440671 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f05d19fb-9d60-42c7-9f59-365030afd6e5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298640 Sep 25 01:02:47.441859 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 289/560] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:47.446566 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a2d984fa-687b-4fbe-a9d4-a6281721b1dd req-599f328b-2435-439f-a0e7-66e473397fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b", "name": "network-vif-plugged", "status": "completed", "tag": "9aca0ece-499a-498f-b1c4-04c09afa2a9c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:47.468606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a2d984fa-687b-4fbe-a9d4-a6281721b1dd req-599f328b-2435-439f-a0e7-66e473397fbe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.469310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a2d984fa-687b-4fbe-a9d4-a6281721b1dd req-599f328b-2435-439f-a0e7-66e473397fbe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.469868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a2d984fa-687b-4fbe-a9d4-a6281721b1dd req-599f328b-2435-439f-a0e7-66e473397fbe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.505237 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a2d984fa-687b-4fbe-a9d4-a6281721b1dd req-599f328b-2435-439f-a0e7-66e473397fbe service nova] Creating event network-vif-plugged:9aca0ece-499a-498f-b1c4-04c09afa2a9c for instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b on n-h2-master-1 Sep 25 01:02:47.512123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a2d984fa-687b-4fbe-a9d4-a6281721b1dd req-599f328b-2435-439f-a0e7-66e473397fbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068661 Sep 25 01:02:47.515378 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 290/561] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:47.526863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:47.527590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:47.549071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.549903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.550547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.551513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.552152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.552598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.140510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:48.165809 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3413e143-aec7-40c4-8972-897b7ed8128a tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1477 microversion: 2.1 time: 0.840852 Sep 25 01:02:48.166537 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 272/562] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:47 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1477 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:48.192982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:48.193879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:48.207370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.209351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.210035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.210797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.221738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.222377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.318222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:48.327494 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8daa9753-2822-48b6-81b1-ae1a02f57ae5 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.804906 Sep 25 01:02:48.328936 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 291/563] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:47 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:48.334873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:48.335494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:48.345935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.346977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.348064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.349057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.350070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.350681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.060768 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:49.074114 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fa79d9d2-1964-41a9-9978-f185ca870afd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1222 microversion: 2.1 time: 0.743495 Sep 25 01:02:49.082774 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 292/564] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:48 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1222 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:49.104375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:49.104774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:49.119275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:49.120374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:49.121923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.124222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:49.124942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:49.127230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.534191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:49.554308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-600a9068-ef9b-40f0-ae51-9f4fa4f8175a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1311 microversion: 2.1 time: 1.382775 Sep 25 01:02:49.556057 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 273/565] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:48 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1311 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:49.561270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:49.562226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:49.578718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:49.579048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:49.579496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.580255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:49.580726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:49.581155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.882920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:49.907917 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c5bf77d-1eb5-4026-91ad-f5d4730fa006 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1478 microversion: 2.1 time: 0.821762 Sep 25 01:02:49.934403 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 293/566] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:49 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1478 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:50.192610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:50.206970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4216acc0-7e4b-453f-98ec-1af4fd72b212 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1468 microversion: 2.1 time: 0.648224 Sep 25 01:02:50.209097 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 274/567] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:49 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1468 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:50.219224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:50.224632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:50.239867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.244537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.245324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.246382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.247102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.247868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.333141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.334205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.335504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.338538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lazy-loading 'fault' on Instance uuid c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:50.455224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf0056ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:50.581827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.582838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.583355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.584282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.584813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.585319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.649754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54541ffbbb8d4f24a054d1d7a80f7152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea70b1c1150462fb7ad97fa83ef8060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:50.663551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-985e244a-4e72-4178-9ae0-07b8fb4e53b2 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 200 len: 1311 microversion: 2.1 time: 0.447635 Sep 25 01:02:50.664803 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 275/568] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:50 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:50.674416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:50.675053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:50.698912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.699410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.699857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.700584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.701047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.701536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.721031 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b481b297-599f-404f-9bf0-ef01109e5ba7 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69" status: 200 len: 240 microversion: 2.36 time: 0.784679 Sep 25 01:02:50.722505 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 294/569] 10.222.0.16 () {62 vars in 1303 bytes} [Sun Sep 25 01:02:49 2022] PUT /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69 => generated 240 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:50.728340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2faf44f3-de14-4349-b4c5-a9294c7a3879 req-7e5e42f1-f97a-49a1-8f04-ac68cb57d9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9146f07-eb2d-4aa7-b34f-6fee344aa4b6", "name": "network-vif-deleted", "tag": "861cf8e4-f251-4647-a4f9-f68bf01ccc26"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:50.743128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2faf44f3-de14-4349-b4c5-a9294c7a3879 req-7e5e42f1-f97a-49a1-8f04-ac68cb57d9f4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.743636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2faf44f3-de14-4349-b4c5-a9294c7a3879 req-7e5e42f1-f97a-49a1-8f04-ac68cb57d9f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.744047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2faf44f3-de14-4349-b4c5-a9294c7a3879 req-7e5e42f1-f97a-49a1-8f04-ac68cb57d9f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.772710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2faf44f3-de14-4349-b4c5-a9294c7a3879 req-7e5e42f1-f97a-49a1-8f04-ac68cb57d9f4 service nova] Creating event network-vif-deleted:861cf8e4-f251-4647-a4f9-f68bf01ccc26 for instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 on n-h1-master-1 Sep 25 01:02:50.778515 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2faf44f3-de14-4349-b4c5-a9294c7a3879 req-7e5e42f1-f97a-49a1-8f04-ac68cb57d9f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053751 Sep 25 01:02:50.779210 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 295/570] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:50.784815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d7b4a975-f042-44af-b3a6-a2ac421adadc req-221f68eb-a534-4440-972b-6e81686404df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "name": "network-vif-unplugged", "status": "completed", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:50.797376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7b4a975-f042-44af-b3a6-a2ac421adadc req-221f68eb-a534-4440-972b-6e81686404df service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.797967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7b4a975-f042-44af-b3a6-a2ac421adadc req-221f68eb-a534-4440-972b-6e81686404df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.798485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7b4a975-f042-44af-b3a6-a2ac421adadc req-221f68eb-a534-4440-972b-6e81686404df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.824220 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d7b4a975-f042-44af-b3a6-a2ac421adadc req-221f68eb-a534-4440-972b-6e81686404df service nova] Creating event network-vif-unplugged:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:02:50.837553 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d7b4a975-f042-44af-b3a6-a2ac421adadc req-221f68eb-a534-4440-972b-6e81686404df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055769 Sep 25 01:02:50.840126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 296/571] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:50.854187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:50.854975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:50.883661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.887560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.888162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.889102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.890909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.891468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.327920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:51.336913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-582ab9ce-f1c8-48a7-9da9-5c3fa9952f0b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1276 microversion: 2.1 time: 0.491802 Sep 25 01:02:51.337835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 297/572] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:50 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1276 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:51.343217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:51.344025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:51.351263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.351999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.352635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.353620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.354228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.354792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.384560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lazy-loading 'flavor' on Instance uuid b8d94cc9-60f6-42c6-8695-c70085ead5a2 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:51.471608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:51.489667 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5d51942-850f-4f7e-bef6-55b1dbaf18e3 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1389 microversion: 2.1 time: 0.822345 Sep 25 01:02:51.490790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 276/573] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:50 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1389 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:51.499005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:51.500635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:51.510975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.511985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.512726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.514129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c400d8a3-962f-4a64-8527-e2be27be273c tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2/action" status: 202 len: 0 microversion: 2.1 time: 0.171789 Sep 25 01:02:51.514817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.515510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.516201 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 298/574] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:51 2022] POST /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:02:51.516659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.528478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Calling method '.version_select at 0x7f7bebf9a550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:51.656896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.657554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.658181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.659101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.659736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.664053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.697396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-81ad8234-a1a4-4faa-88b0-baad97f8ec1d tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69/detail" status: 200 len: 672 microversion: 2.36 time: 0.178827 Sep 25 01:02:51.698540 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 299/575] 10.222.0.16 () {60 vars in 1304 bytes} [Sun Sep 25 01:02:51 2022] GET /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69/detail => generated 672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:51.705114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:51.706555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:51.732558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.733091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.733612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.736929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.737434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.737888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.965612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:51.974815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b25cf950-9bba-4181-866a-5e5be1c67269 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1492 microversion: 2.1 time: 0.482157 Sep 25 01:02:51.975385 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 277/576] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:51 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1492 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:51.980960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:51.981960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:51.996425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.999963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.001502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.007286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.008459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.009946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.204342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:52.238714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54c163ec-5021-43d9-8783-f94a7697eddc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1478 microversion: 2.1 time: 0.538162 Sep 25 01:02:52.247223 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 300/577] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:51 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1478 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:52.261115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:52.262065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] [instance: c9146f07-eb2d-4aa7-b34f-6fee344aa4b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:52.287236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.291543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.292402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.293445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.294743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.295294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.312436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] HTTP exception thrown: Instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 could not be found. Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Request method failure captured: Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 HTTP/1.1 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hyCSA0M5tna1xrPQR-dNR4DqvIbh6UPr8Uq9sfwZlMZaH_M2Y7RsfiDc4yRkPm63fr5t1T8MzPuoyj_sg22rXaB2eVbMVDPNGX7aiWri5b-wY1qLuWoFpL_eh5cEL3Bnidc1VfNJOmk5kqR8ReGO5m94UdQuaXJI_Bbm4R3jE1dH4 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 4ea70b1c1150462fb7ad97fa83ef8060 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2146595438 Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:02:52.314624 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4ea70b1c1150462fb7ad97fa83ef8060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ea70b1c1150462fb7ad97fa83ef8060"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4ea70b1c1150462fb7ad97fa83ef8060"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4ea70b1c1150462fb7ad97fa83ef8060"}]}] Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2146595438 Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 4ea70b1c1150462fb7ad97fa83ef8060 Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2146595438 Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-2146595438-project Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 54541ffbbb8d4f24a054d1d7a80f7152 Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2146595438-project Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: exception: Instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 could not be found. Sep 25 01:02:52.316016 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'c9146f07-eb2d-4aa7-b34f-6fee344aa4b6'} Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 could not be found. Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:52.318234 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 could not be found. Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 could not be found. Sep 25 01:02:52.319483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:52.322567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] Returning 404 to user: Instance c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:52.323653 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-163a37e7-14c0-4345-b52f-3c823bbd4fc3 tempest-ServersAdminNegativeTestJSON-2146595438 tempest-ServersAdminNegativeTestJSON-2146595438-project] 10.222.0.16 "GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6" status: 404 len: 111 microversion: 2.1 time: 0.073852 Sep 25 01:02:52.324770 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 301/578] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:52 2022] GET /compute/v2.1/servers/c9146f07-eb2d-4aa7-b34f-6fee344aa4b6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:52.345215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Action: 'update', calling method: .version_select at 0x7f7bebf9aa60>, body: {"quota_set": {"ram": "2048"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:52.443397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:52.458121 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b466321-1273-4339-af33-89fa7672f4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1476 microversion: 2.1 time: 0.476458 Sep 25 01:02:52.481586 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 278/579] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:51 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1476 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:52.487189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.487646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.488080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.489077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.489693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.490117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.595139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.595657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.596092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.597006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.597778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.598551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.756435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5c5da247-011c-4828-9bad-e219074890a5 tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69?user_id=0eb51a1967fa40c899f2551c8e3ff31b" status: 200 len: 240 microversion: 2.36 time: 0.430261 Sep 25 01:02:52.763968 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 302/580] 10.222.0.16 () {62 vars in 1384 bytes} [Sun Sep 25 01:02:52 2022] PUT /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69?user_id=0eb51a1967fa40c899f2551c8e3ff31b => generated 240 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:52.770372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1e362d3c-3c88-4cab-8e2a-138ebc8a7019 req-f75b5644-d71d-4c3a-abca-7d8a775490ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:52.799162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1e362d3c-3c88-4cab-8e2a-138ebc8a7019 req-f75b5644-d71d-4c3a-abca-7d8a775490ae service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.799733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1e362d3c-3c88-4cab-8e2a-138ebc8a7019 req-f75b5644-d71d-4c3a-abca-7d8a775490ae service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.800191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1e362d3c-3c88-4cab-8e2a-138ebc8a7019 req-f75b5644-d71d-4c3a-abca-7d8a775490ae service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.825886 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1e362d3c-3c88-4cab-8e2a-138ebc8a7019 req-f75b5644-d71d-4c3a-abca-7d8a775490ae service nova] Creating event network-changed:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:02:52.838240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:52.839029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:52.843938 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1e362d3c-3c88-4cab-8e2a-138ebc8a7019 req-f75b5644-d71d-4c3a-abca-7d8a775490ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077779 Sep 25 01:02:52.844887 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 303/581] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:52.856015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:52.856730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:52.874021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.874515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.874660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.876683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.877616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.878583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.879347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.883187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.883375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.883823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.885508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.887436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.888508 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:53.318816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:53.333910 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-75e88c7e-7680-4ec0-a1fe-e1216022234f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.483538 Sep 25 01:02:53.334576 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 304/582] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:52 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:53.343563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:53.353495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:53.359245 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22b49471-3a28-4485-bf8d-d1e0aa512b65 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1643 microversion: 2.1 time: 0.876587 Sep 25 01:02:53.360916 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 279/583] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:52 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1643 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:53.366525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b7bc737-c467-4b64-9aa9-dc03b323139c tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] Calling method '.version_select at 0x7f7bf01399d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:53.384246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.397493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.406249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.422680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.424294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.426330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.764702 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b7bc737-c467-4b64-9aa9-dc03b323139c tempest-QuotasAdminTestV236-1824787501 tempest-QuotasAdminTestV236-1824787501-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69?user_id=0eb51a1967fa40c899f2551c8e3ff31b" status: 200 len: 282 microversion: 2.36 time: 0.401985 Sep 25 01:02:53.765936 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 280/584] 10.222.0.16 () {60 vars in 1364 bytes} [Sun Sep 25 01:02:53 2022] GET /compute/v2.1/os-quota-sets/0a54f644625b4ca5bb1f6b39a051fe69?user_id=0eb51a1967fa40c899f2551c8e3ff31b => generated 282 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:53.774142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-805d932c-17f8-48f9-aa89-b3a17f17d23a req-dcecc919-c4a1-4c05-92e2-4f1fc349c980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "name": "network-vif-plugged", "status": "completed", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:53.787059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-805d932c-17f8-48f9-aa89-b3a17f17d23a req-dcecc919-c4a1-4c05-92e2-4f1fc349c980 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.787929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-805d932c-17f8-48f9-aa89-b3a17f17d23a req-dcecc919-c4a1-4c05-92e2-4f1fc349c980 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.788440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-805d932c-17f8-48f9-aa89-b3a17f17d23a req-dcecc919-c4a1-4c05-92e2-4f1fc349c980 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.806213 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-805d932c-17f8-48f9-aa89-b3a17f17d23a req-dcecc919-c4a1-4c05-92e2-4f1fc349c980 service nova] Creating event network-vif-plugged:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:02:53.813592 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-805d932c-17f8-48f9-aa89-b3a17f17d23a req-dcecc919-c4a1-4c05-92e2-4f1fc349c980 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044772 Sep 25 01:02:53.814866 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 281/585] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:53.824207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:53.825014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:53.832950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.834294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.834829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.835750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.836377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.836885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.887085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:53.901755 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3cbc49aa-934b-4278-8c0f-178a38f52029 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1587 microversion: 2.1 time: 0.565547 Sep 25 01:02:53.906809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 305/586] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:53 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1587 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:53.926778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:53.927709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:53.939554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.940440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.942611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.944417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.945093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.946452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.249736 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4f3c0ac-149c-447a-a628-4d84cf6e3440 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1643 microversion: 2.1 time: 0.338124 Sep 25 01:02:54.253144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 306/587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:53 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1643 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:54.271190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:54.282539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.283176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.284963 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84a97770-2580-4d78-8457-6900ffeb10a3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1464 microversion: 2.1 time: 0.467765 Sep 25 01:02:54.287142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 282/588] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:53 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1464 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:54.294668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.295454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.303146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.303367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.303871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.304188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.304876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.306085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.309608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.310822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.311629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.312276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.313632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.321958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.649539 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2a38687-4f2f-428d-89b3-f80521d375fb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.359042 Sep 25 01:02:54.651167 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 283/589] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b/os-interface => generated 285 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:54.664388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.668715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.669830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.673154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.674298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.674977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.675635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.721853 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:54.747726 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15b7756a-7b20-4170-8696-b42379855f11 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095056 Sep 25 01:02:54.749164 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 284/590] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:54.754925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.757860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.774479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.778212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.778975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.780032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.780711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.783528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.806588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:54.816081 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a376ee37-4a1f-4d38-87ac-e9844b0971ec tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1459 microversion: 2.1 time: 0.560884 Sep 25 01:02:54.820062 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 307/591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1459 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:54.836509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.839710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.855658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.858144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.858801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.859617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.863725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.865858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.270908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:55.280596 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-816236db-a2b6-4e36-a5af-583db46a34e9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1464 microversion: 2.1 time: 0.530109 Sep 25 01:02:55.281257 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 285/592] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1464 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:55.287049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:55.289433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:55.295590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:55.296393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:55.297683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.299213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:55.300115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:55.301335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.390261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:55.402025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a742e24-985b-47b1-bb5f-f361c0d1a9c4 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.571676 Sep 25 01:02:55.404090 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 308/593] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:55.409380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lazy-loading 'flavor' on Instance uuid 90ee4a8d-4967-43af-9593-6c2313fbfa31 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:55.413229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:55.415583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:55.437322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:55.442678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:55.443447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.444945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:55.445698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:55.447585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.513204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Going to try to live migrate instance to n-h1-master-1 {{(pid=122384) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:02:55.611167 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:56.650339 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a09e4480-2d60-4d74-ad7b-21e72c2d1022 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1610 microversion: 2.1 time: 1.244781 Sep 25 01:02:56.652562 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 309/594] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:55 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1610 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:56.687061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:56.693304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:56.701569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:56.702127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:56.702715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:56.703505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:56.704012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:56.704621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:56.848941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:56.850166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:56.850944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:56.851566 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:56.852146 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:56.969693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:56.983225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:56.986541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:56.987036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:56.989483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:56.990156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:56.994338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.068741 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d098a4b-f90e-4d6f-b0cc-f54a0295a5da tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 1068 microversion: 2.1 time: 0.403593 Sep 25 01:02:57.087191 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 310/595] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:56 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 1068 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 25 01:02:57.094689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-222a47a8-21bc-4b1e-aed8-9c3370910e31 req-f140c403-7fe3-402e-8487-19423f89b206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd08d518-6437-4fe3-9f18-80806e39a499", "tag": "fa5e21a1-b778-4eb1-8da8-eb1d745d41de"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:57.127843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-222a47a8-21bc-4b1e-aed8-9c3370910e31 req-f140c403-7fe3-402e-8487-19423f89b206 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.131046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-222a47a8-21bc-4b1e-aed8-9c3370910e31 req-f140c403-7fe3-402e-8487-19423f89b206 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.131834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-222a47a8-21bc-4b1e-aed8-9c3370910e31 req-f140c403-7fe3-402e-8487-19423f89b206 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.174191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-222a47a8-21bc-4b1e-aed8-9c3370910e31 req-f140c403-7fe3-402e-8487-19423f89b206 service nova] Creating event network-changed:fa5e21a1-b778-4eb1-8da8-eb1d745d41de for instance bd08d518-6437-4fe3-9f18-80806e39a499 on n-h1-master-1 Sep 25 01:02:57.189820 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-222a47a8-21bc-4b1e-aed8-9c3370910e31 req-f140c403-7fe3-402e-8487-19423f89b206 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100674 Sep 25 01:02:57.210841 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 311/596] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:57.233249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:57.234054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:57.246406 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:57.295344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.296354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.298956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.304275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.308083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.309347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.699375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:57.716691 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-721fc08e-77c7-43a0-b426-58ce9e5f892d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.502706 Sep 25 01:02:57.721269 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 312/597] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:57 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:57.733260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:57.752151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.755828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.756365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.757197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.757699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.758130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.813098 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a50f26ab-c90e-43eb-8959-a7bf676afc5b tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086564 Sep 25 01:02:57.817614 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 313/598] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:02:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:57.835019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:57.835649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:57.853251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.853788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.861662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.862804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.864155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.864595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.370529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:58.379760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8437b5cf-bb85-4b3b-b5ad-4e1b92ac2968 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.560362 Sep 25 01:02:58.385873 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 314/599] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:57 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:58.398280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:58.401382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:58.423330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.424434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.425048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.426291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.432689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.433394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.468529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Lazy-loading 'flavor' on Instance uuid b8d94cc9-60f6-42c6-8695-c70085ead5a2 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:58.495264 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 while it is in vm_state suspended Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Request method failure captured: Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2/action HTTP/1.1 Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 97 Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iA4lUxsSXFylT1VWIfL9PlFF4Hty7q4nQ0y8qWLu9Z9lygOrxO_krX5Oq5SA_Dzx0H0AT_vU2lHbz2kLL4AfNlOFsoYWO3ukjCA_RnO1h-GZLTvo0t23l7YMwQIl9RspZHWq6fHi6UVuiTLYAizDL8luByUp3ONZfBHBQfP8UWL90 Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 07de72db09664c1fa135a784f54b3cab Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-LiveMigrationNegativeTest-1653006975 Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:02:58.497881 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07de72db09664c1fa135a784f54b3cab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07de72db09664c1fa135a784f54b3cab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07de72db09664c1fa135a784f54b3cab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07de72db09664c1fa135a784f54b3cab"}]}] Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-LiveMigrationNegativeTest-1653006975 Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 07de72db09664c1fa135a784f54b3cab Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1653006975 Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-LiveMigrationNegativeTest-1653006975-project-admin Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 09a8ec918453488f85edc4a79af2b11d Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-LiveMigrationNegativeTest-1653006975-project-admin Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Sep 25 01:02:58.499165 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'os-migrateLive' instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 while it is in vm_state suspended Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b8d94cc9-60f6-42c6-8695-c70085ead5a2', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 25 01:02:58.499878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:58.500951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 while it is in vm_state suspended Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 while it is in vm_state suspended Sep 25 01:02:58.502132 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:02:58.506083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 while it is in vm_state suspended {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:58.507587 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ea9aae5-0acd-42f1-bbb8-68485db642b3 tempest-LiveMigrationNegativeTest-1653006975 tempest-LiveMigrationNegativeTest-1653006975-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2/action" status: 409 len: 155 microversion: 2.1 time: 0.120335 Sep 25 01:02:58.518820 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 315/600] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:58 2022] POST /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:02:58.524394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:58.530540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:58.540482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.541392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.542190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.543178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.544005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.544660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.583433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:02:58.754556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80647e1e-8e1c-45c5-b7e1-481955ad47e3 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 204 len: 0 microversion: 2.1 time: 0.232606 Sep 25 01:02:58.760365 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 316/601] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:02:58 2022] DELETE /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:02:58.792242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:58.793684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:58.809381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.813112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.814838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.817165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.818383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.819421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.144991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:59.164123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6504f566-60a8-4079-b04f-4c97a20d6b53 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.401582 Sep 25 01:02:59.178764 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 317/602] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:58 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:59.195567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:59.196921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:59.205633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.207459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.208932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.210073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.210727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.211748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.250183 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:59.485963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:59.497551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21f76acb-e75f-4184-97fd-42d96afdb24b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1465 microversion: 2.1 time: 0.317104 Sep 25 01:02:59.498412 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 318/603] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:59 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1465 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:59.618869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:59.622702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.623198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.623625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.624364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.624817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.625242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.676145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7bdc2d6c-0c5a-44c0-970f-970c60d0e335 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.163434 Sep 25 01:02:59.684340 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 319/604] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:02:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:59.684548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:59.686432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:59.695355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.695951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.698916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.699740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.700222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.700653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.030113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:00.046119 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-75f7ee26-dbe7-4385-8f81-e885cb7b77f6 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1587 microversion: 2.1 time: 0.367928 Sep 25 01:03:00.049303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 320/605] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:59 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1587 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:00.060317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cc214837-e80c-4136-8f95-9a8b5ad1a84c req-df6ef363-ffa8-40bf-b319-f7286340cb60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b", "tag": "9aca0ece-499a-498f-b1c4-04c09afa2a9c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:00.088140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cc214837-e80c-4136-8f95-9a8b5ad1a84c req-df6ef363-ffa8-40bf-b319-f7286340cb60 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.089647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cc214837-e80c-4136-8f95-9a8b5ad1a84c req-df6ef363-ffa8-40bf-b319-f7286340cb60 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.094035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cc214837-e80c-4136-8f95-9a8b5ad1a84c req-df6ef363-ffa8-40bf-b319-f7286340cb60 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.112970 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cc214837-e80c-4136-8f95-9a8b5ad1a84c req-df6ef363-ffa8-40bf-b319-f7286340cb60 service nova] Creating event network-changed:9aca0ece-499a-498f-b1c4-04c09afa2a9c for instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b on n-h2-master-1 Sep 25 01:03:00.131263 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cc214837-e80c-4136-8f95-9a8b5ad1a84c req-df6ef363-ffa8-40bf-b319-f7286340cb60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079126 Sep 25 01:03:00.136698 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 321/606] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:00.142780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:00.149382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:00.178843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.181162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.181954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.183079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.184080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.184775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.505984 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a13420b-493b-4ec5-94b6-9063c9256014 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31/action" status: 202 len: 0 microversion: 2.1 time: 5.223060 Sep 25 01:03:00.507808 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 286/607] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:55 2022] POST /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31/action => generated 0 bytes in 5225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:03:00.513496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:00.518353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.526896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.527774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.530165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.530950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.532835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.651337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-978209b5-f53b-42c2-bc1a-7425305355c2 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.136559 Sep 25 01:03:00.652756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 287/608] 10.222.0.16 () {58 vars in 1172 bytes} [Sun Sep 25 01:03:00 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:00.662859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:00.668698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:00.688104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.688749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.689460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.690421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.692894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.693626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.075606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:01.091820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc5db3d5-c867-45d5-b18c-f573cdca6a27 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.433545 Sep 25 01:03:01.112185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:01.126942 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b82df6e4-2437-4fa7-90f5-c28c69fd5c74 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.988590 Sep 25 01:03:01.128801 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 288/609] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:00 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.152610 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 322/610] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:00 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.163765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.164396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:01.170387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.171084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:01.197017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.197460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.208335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.209304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.210125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.210605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.213974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.215216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.215721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.218977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.224956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.227041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.537238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:01.546699 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc182a20-ae84-42b7-8455-dfb07e968c7b tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 200 len: 1423 microversion: 2.1 time: 0.389129 Sep 25 01:03:01.552696 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 323/611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 1423 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.563063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.567033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.567511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.574326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.579916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.580631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.581261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.649014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3650fa65-c92a-492d-bd54-bd6082ee92fc tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095010 Sep 25 01:03:01.656443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 324/612] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:01.670105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b41d776d-ff20-4d20-ac86-467d1b1a7dbb req-b588fc40-0828-4c21-b610-2930c9fe9126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "name": "network-vif-plugged", "status": "completed", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:01.713251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b41d776d-ff20-4d20-ac86-467d1b1a7dbb req-b588fc40-0828-4c21-b610-2930c9fe9126 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.714209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b41d776d-ff20-4d20-ac86-467d1b1a7dbb req-b588fc40-0828-4c21-b610-2930c9fe9126 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.715075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b41d776d-ff20-4d20-ac86-467d1b1a7dbb req-b588fc40-0828-4c21-b610-2930c9fe9126 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.828370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:01.842949 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22fde6cc-1bfb-42af-9525-4c09e21307d6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.712756 Sep 25 01:03:01.843556 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 289/613] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.886505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.903521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.904437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.905117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.906195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.907858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.910154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.961850 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ebebf1dd-9d79-4d10-94f2-6d456521a7e8 tempest-ServicesAdminTestJSON-1089458511 tempest-ServicesAdminTestJSON-1089458511-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.095181 Sep 25 01:03:01.963806 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 290/614] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/os-services => generated 944 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:02.121676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:02.122701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:02.138184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.142061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.143570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.146030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.146958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.147653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.150733 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b41d776d-ff20-4d20-ac86-467d1b1a7dbb req-b588fc40-0828-4c21-b610-2930c9fe9126 service nova] Creating event network-vif-plugged:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:03:02.167225 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b41d776d-ff20-4d20-ac86-467d1b1a7dbb req-b588fc40-0828-4c21-b610-2930c9fe9126 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503268 Sep 25 01:03:02.169753 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 325/615] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:02.175468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:02.188138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:02.209887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.211315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.214146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.215093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.215719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.222185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.740787 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=73,nova_cell0:UPDATE=7 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:02.760607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:02.772338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b13ffe66-2590-4b09-86ef-ab1d57647999 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.601022 Sep 25 01:03:02.777677 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 326/616] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:02 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:02.800426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-40c49c90-a74b-45b5-bae5-ef1c9fd192c6 req-ee4e9266-ccae-4971-96a6-70fee1978cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d94cc9-60f6-42c6-8695-c70085ead5a2", "name": "network-vif-deleted", "tag": "59c280ab-2924-4e4f-91a8-15d67cc1947f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:02.816541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:02.839175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5bb043be-1601-4abf-b0f7-dd98d6460f62 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.721833 Sep 25 01:03:02.844238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-40c49c90-a74b-45b5-bae5-ef1c9fd192c6 req-ee4e9266-ccae-4971-96a6-70fee1978cd2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.849660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-40c49c90-a74b-45b5-bae5-ef1c9fd192c6 req-ee4e9266-ccae-4971-96a6-70fee1978cd2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.850340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-40c49c90-a74b-45b5-bae5-ef1c9fd192c6 req-ee4e9266-ccae-4971-96a6-70fee1978cd2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.857681 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 291/617] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:02 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:02.882952 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-40c49c90-a74b-45b5-bae5-ef1c9fd192c6 req-ee4e9266-ccae-4971-96a6-70fee1978cd2 service nova] Creating event network-vif-deleted:59c280ab-2924-4e4f-91a8-15d67cc1947f for instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 on n-h1-master-1 Sep 25 01:03:02.886385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:02.887067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: b8d94cc9-60f6-42c6-8695-c70085ead5a2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:02.918986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.919705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-40c49c90-a74b-45b5-bae5-ef1c9fd192c6 req-ee4e9266-ccae-4971-96a6-70fee1978cd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136887 Sep 25 01:03:02.919941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.920523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.921546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.922153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.922797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.926902 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 327/618] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:02.963189 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] HTTP exception thrown: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 could not be found. Sep 25 01:03:02.966825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:02.968325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Request method failure captured: Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 HTTP/1.1 Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6h9XbmE-rGY1nAFV_irBavyNzYYMSQet-FFfyr3rwIjmx6tJ7PQHrMHFr_Dmx9UyAPPKSYSSV65Vphpsur2ul8Id1JFCw9rLtdY7eNHO7LTl6Iiu257UXOyx9TlAn7KW7AH8hA_TRZ9xvrynvJnbVgK9jHkRi5MqHiPpXUG2NMEq8Q Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 065df012fefb435e9a3329b6b1b51b4a Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-LiveMigrationNegativeTest-852272140 Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:02.969609 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/065df012fefb435e9a3329b6b1b51b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/065df012fefb435e9a3329b6b1b51b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/065df012fefb435e9a3329b6b1b51b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_065df012fefb435e9a3329b6b1b51b4a"}]}] Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-LiveMigrationNegativeTest-852272140 Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 065df012fefb435e9a3329b6b1b51b4a Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-852272140 Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-LiveMigrationNegativeTest-852272140-project Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f8c135c37b804252a8275d28972d8c31 Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-LiveMigrationNegativeTest-852272140-project Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: exception: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 could not be found. Sep 25 01:03:02.971200 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b8d94cc9-60f6-42c6-8695-c70085ead5a2'} Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 could not be found. Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:02.972096 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 could not be found. Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 could not be found. Sep 25 01:03:02.973662 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:02.976904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Returning 404 to user: Instance b8d94cc9-60f6-42c6-8695-c70085ead5a2 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:02.978950 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10568d81-fcd4-457e-9527-775d46e8bb80 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2" status: 404 len: 111 microversion: 2.1 time: 0.119808 Sep 25 01:03:02.984360 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 292/619] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:02 2022] GET /compute/v2.1/servers/b8d94cc9-60f6-42c6-8695-c70085ead5a2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:02.990170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.992497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.992963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.994917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.995915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.996512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.997377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:03.002340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:03.023048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.025765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.026479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.028783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.029512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.030185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.094374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:03:03.297234 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25844e78-3808-4bd6-a64c-6c8d20f10978 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 204 len: 0 microversion: 2.1 time: 0.301074 Sep 25 01:03:03.299594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 293/620] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:03:02 2022] DELETE /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:03:03.315378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:03.317845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:03.333167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.334316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.335396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.337997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.340143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.341308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.361087 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:03.376003 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e04bb506-1a10-4946-9367-a4df437c8704 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.441387 Sep 25 01:03:03.379732 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 328/621] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:02 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:03.752985 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:03.826072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:03.845065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61967519-ebfd-4978-a445-aa7305a23b26 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1474 microversion: 2.1 time: 0.538365 Sep 25 01:03:03.850771 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 294/622] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:03 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1474 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:03.877940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:03.882820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:03.916437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.919370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.921787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.926863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.929655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.930791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.013098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1856565158", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:04.134644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:03:04.545097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:04.595323 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ee9de25-c891-4277-8d80-4a40dcb7d3c9 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.740151 Sep 25 01:03:04.597773 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 295/623] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:03 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:04.610956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:04.612322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:04.633716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.634603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.636934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.638041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.638709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.640030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.594172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:03:05.595000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:03:05.595215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:03:05.595810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:03:05.596398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:03:05.603116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:05.614154 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-197993b4-8f2e-46c8-b215-5f2fc1b2596e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 1.013603 Sep 25 01:03:05.614754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 296/624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:04 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:05.623523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:05.624686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.632570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.633528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.637452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.643241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.645020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.645719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.646174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.648047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.648813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.650813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.653959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.655262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.705275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:05.716684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:05.756703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:03:05.765208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:05.877043 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9038a22d-f25e-4fac-a477-aa4ed3d1d0f0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.304096 Sep 25 01:03:05.885437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 329/625] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:03:05.890881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bcde8613-f8de-4616-9aaf-0dce30707e16 req-b2d466f8-6775-4426-93c6-4e9bf762f011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd08d518-6437-4fe3-9f18-80806e39a499", "name": "network-vif-plugged", "status": "completed", "tag": "fa5e21a1-b778-4eb1-8da8-eb1d745d41de"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:05.918005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bcde8613-f8de-4616-9aaf-0dce30707e16 req-b2d466f8-6775-4426-93c6-4e9bf762f011 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.918500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bcde8613-f8de-4616-9aaf-0dce30707e16 req-b2d466f8-6775-4426-93c6-4e9bf762f011 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.918943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bcde8613-f8de-4616-9aaf-0dce30707e16 req-b2d466f8-6775-4426-93c6-4e9bf762f011 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.943318 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bcde8613-f8de-4616-9aaf-0dce30707e16 req-b2d466f8-6775-4426-93c6-4e9bf762f011 service nova] Creating event network-vif-plugged:fa5e21a1-b778-4eb1-8da8-eb1d745d41de for instance bd08d518-6437-4fe3-9f18-80806e39a499 on n-h1-master-1 Sep 25 01:03:05.959801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bcde8613-f8de-4616-9aaf-0dce30707e16 req-b2d466f8-6775-4426-93c6-4e9bf762f011 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072877 Sep 25 01:03:05.960827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 330/626] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:05.976569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:05.978039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.998640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.999617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.000966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.003280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:06.005040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.005865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.545838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:06.563600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ffea9632-45e4-465d-ac76-bd543f981260 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.947203 Sep 25 01:03:06.565585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 297/627] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:05 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:06.587276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ee4a8d-4967-43af-9593-6c2313fbfa31", "name": "network-vif-unplugged", "status": "completed", "tag": "3501c234-a011-456a-af52-2fa317ef4f4e"}, {"name": "network-changed", "server_uuid": "90ee4a8d-4967-43af-9593-6c2313fbfa31", "tag": "3501c234-a011-456a-af52-2fa317ef4f4e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:06.616619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:06.617915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.618672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.663858 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] Creating event network-vif-unplugged:3501c234-a011-456a-af52-2fa317ef4f4e for instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 on n-h2-master-1 Sep 25 01:03:06.664764 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] Creating event network-changed:3501c234-a011-456a-af52-2fa317ef4f4e for instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 on n-h2-master-1 Sep 25 01:03:06.671473 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e6a7fd68-37bf-4ab7-9bb8-b4e651b73e6c req-07c926e5-d11a-4f4d-bb63-e8338973956c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.102577 Sep 25 01:03:06.673719 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 298/628] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:06.707878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:06.709447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:06.741652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:06.742520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.744354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.751553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:06.752848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.754416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.896419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:06.906632 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83c630f7-3052-4ed6-afb7-abe143bc52c2 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1474 microversion: 2.1 time: 0.944498 Sep 25 01:03:06.907359 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 331/629] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:05 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1474 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:06.916643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-631c94d9-9878-447f-95f4-e7f59e72ebb5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:06.917509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-631c94d9-9878-447f-95f4-e7f59e72ebb5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:07.152272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-631c94d9-9878-447f-95f4-e7f59e72ebb5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:07.176164 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-631c94d9-9878-447f-95f4-e7f59e72ebb5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1217 microversion: 2.1 time: 0.264335 Sep 25 01:03:07.179985 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 332/630] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:06 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:07.195833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:07.197257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:07.208273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.209054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.209682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.210663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.211555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.212346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.988691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:07.998165 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-829e1719-5810-4329-b896-359a66310eb6 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1318 microversion: 2.1 time: 0.815064 Sep 25 01:03:08.010081 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 333/631] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:07 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:08.022446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:08.023409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:08.030048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.030889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.031557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.032529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.033237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.033935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.048905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:08.084198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f1b5196-d0be-4f86-9dae-50da0d1789ed tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 1.400647 Sep 25 01:03:08.085647 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 299/632] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:06 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:08.095988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:08.096898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:08.127122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.127877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.131090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.132276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.133563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.134017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.725063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:08.739828 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-291e6779-2901-4144-9afc-8e4ffd153bcb tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1474 microversion: 2.1 time: 0.652887 Sep 25 01:03:08.740434 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 300/633] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:08 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1474 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:08.748817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:08.752915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:08.753145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:08.768656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f71b5454-5426-4586-9b0d-9d0bd211a993 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.756759 Sep 25 01:03:08.771584 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 334/634] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:08 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:08.785223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.785765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.786436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.787379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.788051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.788692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.916996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:08.930554 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c733e80e-f01e-4320-a113-3c820e6e5246 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1269 microversion: 2.1 time: 0.188407 Sep 25 01:03:08.932325 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 301/635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:08 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:09.026536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:09.027554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:09.031876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:09.036745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.037566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.038184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.038309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.038639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.039264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.039503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.040016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.040447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.041055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.041762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.042411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.083663 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1b09d6a-ca55-48d2-828b-415d399cec60 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.296866 Sep 25 01:03:09.084317 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 335/636] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:03:08 2022] GET /compute/v2.1/os-services => generated 944 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:09.096699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:09.100974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.101662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.102117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.103168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.103671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.104082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.150092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-42e6d2b8-440f-4364-81f5-915bd74dc17e tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.056886 Sep 25 01:03:09.151491 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 336/637] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:03:09 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:09.159337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:09.160432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:09.169391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.169924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.170360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.171068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.171526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.172007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.913043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:09.938407 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f3af1ad-cea1-4e70-868a-b95594873b6d tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1467 microversion: 2.1 time: 0.917586 Sep 25 01:03:09.943447 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 302/638] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:09 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1467 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:09.961834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:09.967740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.968584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.968691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.969855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.970503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.970936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.004721 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb02f89c-ddea-42e2-88af-4cd601b827d2 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.058468 Sep 25 01:03:10.013353 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 303/639] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:03:09 2022] GET /compute/v2.1/os-services => generated 944 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:10.021380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7ad26aef-4a7d-491b-b242-838fd342aa63 req-ce9124c9-232e-4b69-bce9-ca0814c198ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5ac0ec-3af1-4bbe-b344-63a288ec6344", "name": "network-vif-deleted", "tag": "b38c1410-4bb1-4aba-9f89-06cbac454855"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:10.023357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.032123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1422adf-c90f-4c90-8f8c-62641e479b61 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.878968 Sep 25 01:03:10.033722 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 337/640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:09 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:10.034326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7ad26aef-4a7d-491b-b242-838fd342aa63 req-ce9124c9-232e-4b69-bce9-ca0814c198ab service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.034891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7ad26aef-4a7d-491b-b242-838fd342aa63 req-ce9124c9-232e-4b69-bce9-ca0814c198ab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.035480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7ad26aef-4a7d-491b-b242-838fd342aa63 req-ce9124c9-232e-4b69-bce9-ca0814c198ab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.039428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.039984 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:10.040450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:10.046813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.047574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.048188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.049069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.049738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.050865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.051925 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7ad26aef-4a7d-491b-b242-838fd342aa63 req-ce9124c9-232e-4b69-bce9-ca0814c198ab service nova] Creating event network-vif-deleted:b38c1410-4bb1-4aba-9f89-06cbac454855 for instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 on n-h2-master-1 Sep 25 01:03:10.057793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7ad26aef-4a7d-491b-b242-838fd342aa63 req-ce9124c9-232e-4b69-bce9-ca0814c198ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041749 Sep 25 01:03:10.058408 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 304/641] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:10.064409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.065367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:10.074466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.075542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.076153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.077170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.077822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.078413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.086152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.086914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.087507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.088128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lazy-loading 'fault' on Instance uuid 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:10.164691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8c135c37b804252a8275d28972d8c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065df012fefb435e9a3329b6b1b51b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.174368 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f56190a8-9854-4fd1-9c0f-8eaa8fd12946 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 200 len: 1308 microversion: 2.1 time: 0.138824 Sep 25 01:03:10.175911 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 338/642] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:10.181952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.182929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:10.197921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.199767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.200448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.201725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.202374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.203000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.420712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.430665 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fbeb72da-939d-4759-b563-f656fa8871e4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.370848 Sep 25 01:03:10.436488 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 305/643] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:10.436699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.437384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:10.449773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.450367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.451490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.452449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.453057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.453704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.524646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.534421 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9b85c975-6e08-4c03-8bea-4424e4f12890 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.357220 Sep 25 01:03:10.536831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 339/644] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:10.541842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.549491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.551536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.552250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.553056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.553738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.554171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.591818 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a691954-13fa-437e-aa21-c20dff447710 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.055142 Sep 25 01:03:10.617196 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 340/645] 10.222.0.16 () {58 vars in 1194 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:03:10.622208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.632426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.633595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.634308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.635587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.636514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.637300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.672233 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9d4c1b02-7f61-4a76-9e38-44fd03a906c6 tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053590 Sep 25 01:03:10.673235 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 341/646] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:10.688367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.694218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.695880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.696764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.698450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.699917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.700605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.730144 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:10.738425 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f8c107e-c6fb-4a53-b181-cabc3c67342f tempest-ServicesAdminNegativeTestJSON-1009363137 tempest-ServicesAdminNegativeTestJSON-1009363137-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.054789 Sep 25 01:03:10.740227 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 342/647] 10.222.0.16 () {58 vars in 1198 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:03:10.805862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.819860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-acaafc6b-e85b-4050-88c6-9a94486f52a2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 1467 microversion: 2.1 time: 0.386472 Sep 25 01:03:10.835117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 306/648] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 1467 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:10.848003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-675862499"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:10.850960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:10.859738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.860492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.861175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.862103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.864208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.865427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.891556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a367bc60-3f3f-4f99-84f7-3572e4c3c25f tempest-ServicesAdminNegativeTestJSON-2099149042 tempest-ServicesAdminNegativeTestJSON-2099149042-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.895805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a367bc60-3f3f-4f99-84f7-3572e4c3c25f tempest-ServicesAdminNegativeTestJSON-2099149042 tempest-ServicesAdminNegativeTestJSON-2099149042-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'cc879316f009409190f3614673fcc637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61aec289e69e4ec6b580caddfd559c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a367bc60-3f3f-4f99-84f7-3572e4c3c25f tempest-ServicesAdminNegativeTestJSON-2099149042 tempest-ServicesAdminNegativeTestJSON-2099149042-project] Request method failure captured: Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jLtze11a3znpUogqcFvNfqzYaAq3jmbbDKdIFH0KHqkuuzBebc5-owMma78qKokgls_jgepk4FhN15He1Yey99cdB_LbE9kQcqxcnjdt64YyDvrAKRQRHEPkAZm3N0dun6npCd0BOPB1_N5fAPmzkR8rLnojO1GHEvg3Um_ABRBaY Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 61aec289e69e4ec6b580caddfd559c66 Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2099149042 Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:03:10.897787 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/61aec289e69e4ec6b580caddfd559c66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61aec289e69e4ec6b580caddfd559c66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/61aec289e69e4ec6b580caddfd559c66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_61aec289e69e4ec6b580caddfd559c66"}]}] Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2099149042 Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 61aec289e69e4ec6b580caddfd559c66 Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2099149042 Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServicesAdminNegativeTestJSON-2099149042-project Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: cc879316f009409190f3614673fcc637 Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2099149042-project Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 25 01:03:10.899547 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:03:10.900388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 25 01:03:10.901854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:10.903243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a367bc60-3f3f-4f99-84f7-3572e4c3c25f tempest-ServicesAdminNegativeTestJSON-2099149042 tempest-ServicesAdminNegativeTestJSON-2099149042-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:10.904122 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a367bc60-3f3f-4f99-84f7-3572e4c3c25f tempest-ServicesAdminNegativeTestJSON-2099149042 tempest-ServicesAdminNegativeTestJSON-2099149042-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.155097 Sep 25 01:03:10.909857 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 343/649] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/os-services => generated 112 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:11.056985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:11.057639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:11.067980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.069679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.070131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.070864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.071326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.076993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.188732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ca549b8-c05a-4361-89c8-6edc806c6aef tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "POST /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1/action" status: 202 len: 0 microversion: 2.1 time: 0.344174 Sep 25 01:03:11.196869 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 307/650] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:10 2022] POST /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:03:11.210289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:11.212843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] [instance: 5b5ac0ec-3af1-4bbe-b344-63a288ec6344] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:11.227482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.228343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.228809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.233173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.234839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.236838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.281348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] HTTP exception thrown: Instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 could not be found. Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Request method failure captured: Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 HTTP/1.1 Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6h9XbmE-rGY1nAFV_irBavyNzYYMSQet-FFfyr3rwIjmx6tJ7PQHrMHFr_Dmx9UyAPPKSYSSV65Vphpsur2ul8Id1JFCw9rLtdY7eNHO7LTl6Iiu257UXOyx9TlAn7KW7AH8hA_TRZ9xvrynvJnbVgK9jHkRi5MqHiPpXUG2NMEq8Q Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 065df012fefb435e9a3329b6b1b51b4a Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-LiveMigrationNegativeTest-852272140 Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:11.283616 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/065df012fefb435e9a3329b6b1b51b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/065df012fefb435e9a3329b6b1b51b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/065df012fefb435e9a3329b6b1b51b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_065df012fefb435e9a3329b6b1b51b4a"}]}] Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-LiveMigrationNegativeTest-852272140 Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 065df012fefb435e9a3329b6b1b51b4a Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-852272140 Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-LiveMigrationNegativeTest-852272140-project Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f8c135c37b804252a8275d28972d8c31 Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-LiveMigrationNegativeTest-852272140-project Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 could not be found. Sep 25 01:03:11.285711 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5b5ac0ec-3af1-4bbe-b344-63a288ec6344'} Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 could not be found. Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:11.286696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 could not be found. Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 could not be found. Sep 25 01:03:11.288124 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:11.290712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] Returning 404 to user: Instance 5b5ac0ec-3af1-4bbe-b344-63a288ec6344 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:11.291989 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48993c21-e295-4e8c-b533-b32dd78ba4b8 tempest-LiveMigrationNegativeTest-852272140 tempest-LiveMigrationNegativeTest-852272140-project] 10.222.0.16 "GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344" status: 404 len: 111 microversion: 2.1 time: 0.093211 Sep 25 01:03:11.293037 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 308/651] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:11 2022] GET /compute/v2.1/servers/5b5ac0ec-3af1-4bbe-b344-63a288ec6344 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:11.314719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ba533e4-fa04-4dac-ba9c-77dbb7709045 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf03670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:11.399004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ba533e4-fa04-4dac-ba9c-77dbb7709045 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.103729 Sep 25 01:03:11.399814 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 309/652] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:11 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:11.474556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:11.475932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:11.479582 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:11.483158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:11.499399 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a0868a7-6bdf-42e6-b3b8-77d286985e5d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.446286 Sep 25 01:03:11.499990 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 344/653] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:11 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:11.504666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.507812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.508470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.510818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.511728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.513284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.559903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:11.560805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:11.574134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.575322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.576008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.577025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.577879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.578647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.919806 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:11.934300 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f5b57e79-4d87-4afa-888d-0e28a224ee56 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.466778 Sep 25 01:03:11.935102 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 310/654] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:11 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:12.083784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:12.121153 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-662ac1a5-71c5-484f-9075-01f1bb098631 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.564440 Sep 25 01:03:12.138872 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 345/655] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:11 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:12.425170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9050ca6-e906-4082-9dc8-2886fc301a9f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf03ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:12.527825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:12.528750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:12.547447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:12.548711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:12.551501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:12.552326 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9050ca6-e906-4082-9dc8-2886fc301a9f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.139474 Sep 25 01:03:12.554904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:12.555664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:12.556095 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 311/656] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:12 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:12.559811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:12.858484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5bebe870-888f-46c8-8800-d496a68911e3 req-ae4ffbff-63c3-457e-acd4-53046bde0b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91", "tag": "a069a87f-5afa-40d1-aace-7bb3cbecd763"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:12.890095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5bebe870-888f-46c8-8800-d496a68911e3 req-ae4ffbff-63c3-457e-acd4-53046bde0b3b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:12.890912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5bebe870-888f-46c8-8800-d496a68911e3 req-ae4ffbff-63c3-457e-acd4-53046bde0b3b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:12.891545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5bebe870-888f-46c8-8800-d496a68911e3 req-ae4ffbff-63c3-457e-acd4-53046bde0b3b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:12.902051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:12.907284 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5bebe870-888f-46c8-8800-d496a68911e3 req-ae4ffbff-63c3-457e-acd4-53046bde0b3b service nova] Creating event network-changed:a069a87f-5afa-40d1-aace-7bb3cbecd763 for instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 on n-h2-master-1 Sep 25 01:03:12.917444 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29b38218-c019-4260-b5f9-efcf0f32e21b tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.395217 Sep 25 01:03:12.918512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 346/657] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:12 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:12.921702 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5bebe870-888f-46c8-8800-d496a68911e3 req-ae4ffbff-63c3-457e-acd4-53046bde0b3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067065 Sep 25 01:03:12.922869 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 312/658] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:12.961702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:12.962547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:12.974104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:12.988916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:12.992433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:12.996886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:12.999056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.000732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:13.151971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:13.152685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:13.168154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:13.168656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.169096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:13.170080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:13.170740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.171340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:13.422834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:13.439494 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7fffac2c-8cff-4a0f-936e-157f60cc481a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.482967 Sep 25 01:03:13.440113 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 347/659] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:12 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:13.546543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:13.568422 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0bd3ff2c-05e8-4c14-bcc3-1927c27f0f56 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.419369 Sep 25 01:03:13.569070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49c2fd29-7492-45b0-acb1-4ff0c741a7eb tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf000e8b0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:13.579766 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 313/660] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:13 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:13.650670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49c2fd29-7492-45b0-acb1-4ff0c741a7eb tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.085591 Sep 25 01:03:13.653990 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 348/661] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:13 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:13.945747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:13.946676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:13.955097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:13.955886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.956557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:13.957467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:13.958087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.958674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:14.268062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:14.333882 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21f64521-4101-4ce7-96ee-1b6262e83564 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.385484 Sep 25 01:03:14.341094 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 314/662] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:13 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:14.467191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:14.467812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:14.477773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:14.478816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:14.479769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:14.480754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:14.482224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:14.482882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:14.593183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:14.594224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:14.620300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:14.620794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:14.623940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:14.624768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:14.625254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:14.639947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:14.915086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:14.927964 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8b85e57c-440f-4858-b685-085653494ef0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1502 microversion: 2.1 time: 0.462549 Sep 25 01:03:14.928576 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 349/663] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:14 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1502 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:14.957061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dec266ef-ad82-467a-ae93-4943007982ed tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0017670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:15.046977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dec266ef-ad82-467a-ae93-4943007982ed tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.113697 Sep 25 01:03:15.058333 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 350/664] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:14 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:15.070515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:15.080218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-652daf6d-b299-4864-8c69-ecae53d2a879 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.491143 Sep 25 01:03:15.081020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 315/665] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:14 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:15.374999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:15.376263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:15.392730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:15.393246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:15.395781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:15.398081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:15.399193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:15.402484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:15.631832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:15.643832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-99f0f453-bb4a-491d-8b06-9c0b14fe9da8 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.282699 Sep 25 01:03:15.645831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 351/666] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:15 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:15.956159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:15.958092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:15.971513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:15.972414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:15.974264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:15.977184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:15.978286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:15.979726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:16.068041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf93606e-3db5-494a-b95c-76f57ab13c97 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0072820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:16.187124 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf93606e-3db5-494a-b95c-76f57ab13c97 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.127492 Sep 25 01:03:16.188021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 352/667] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:16 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:16.213800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:16.214812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:16.252708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:16.253679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:16.254613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:16.255730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:16.256357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:16.256935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:16.827751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:16.837947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f3e3b83-9c95-4965-8dd0-8981671b8e1e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.648005 Sep 25 01:03:16.842858 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 353/668] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:16 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:16.853650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:16.858683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:16.885579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:16.886451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:16.888233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:16.890819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:16.891694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:16.892437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:17.160557 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:17.277127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:17.293452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:17.300218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5304990-fb72-41a6-b85f-2b5a3c67c344 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1492 microversion: 2.1 time: 1.348144 Sep 25 01:03:17.314105 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 316/669] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:15 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1492 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:17.317711 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4cd7a6eb-c67d-4da3-a576-ab350782b705 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.468863 Sep 25 01:03:17.319379 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 354/670] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:16 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:17.338495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23a90dc2-8038-485e-b875-02510b4277ac tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf03bf3a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:17.457177 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23a90dc2-8038-485e-b875-02510b4277ac tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.134638 Sep 25 01:03:17.463799 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 355/671] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:17 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:17.489984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67a4082a-993e-4e66-827e-ca0b4e6a887d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '.version_select at 0x7f7bebf1c700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:17.507873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67a4082a-993e-4e66-827e-ca0b4e6a887d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:17.508473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67a4082a-993e-4e66-827e-ca0b4e6a887d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:17.508944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67a4082a-993e-4e66-827e-ca0b4e6a887d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:17.558197 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67a4082a-993e-4e66-827e-ca0b4e6a887d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.093076 Sep 25 01:03:17.558830 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 356/672] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:03:17 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:17.601161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:17.612095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:17.646825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:17.647327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:17.647771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:17.648490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:17.648951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:17.649379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:17.984890 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f427430-2280-4f81-9ba8-bf3b8f4107d0 tempest-TenantUsagesNegativeTestJSON-337938442 tempest-TenantUsagesNegativeTestJSON-337938442-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-24T01%3A03%3A17.137057&end=2022-09-26T01%3A03%3A17.137057" status: 404 len: 112 microversion: - time: 0.669589 Sep 25 01:03:17.985722 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 317/673] 10.222.0.16 () {58 vars in 1316 bytes} [Sun Sep 25 01:03:17 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-24T01%3A03%3A17.137057&end=2022-09-26T01%3A03%3A17.137057 => generated 112 bytes in 671 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:03:17.995289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:17.996136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:18.019722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:18.022998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:18.023699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:18.024642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:18.026294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:18.028917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:18.203130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e228e372-194c-4f7e-898e-bd8968c277f0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1643 microversion: 2.1 time: 0.618210 Sep 25 01:03:18.208327 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 357/674] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:17 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1643 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:18.440257 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:18.458249 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae375283-863e-4fad-8f56-ccf0b00eb108 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.470720 Sep 25 01:03:18.476020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1857304967", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "defca061-1fc0-4eb4-a3fe-f0e809a541e4"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:18.482419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 318/675] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:17 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:18.489890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-234fd167-4976-4be7-bbe9-708ff9741cab tempest-TenantUsagesNegativeTestJSON-337938442 tempest-TenantUsagesNegativeTestJSON-337938442-project-admin] Calling method '.version_select at 0x7f7bf000a550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:18.506437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-234fd167-4976-4be7-bbe9-708ff9741cab tempest-TenantUsagesNegativeTestJSON-337938442 tempest-TenantUsagesNegativeTestJSON-337938442-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-234fd167-4976-4be7-bbe9-708ff9741cab tempest-TenantUsagesNegativeTestJSON-337938442 tempest-TenantUsagesNegativeTestJSON-337938442-project-admin] Request method failure captured: Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-simple-tenant-usage/cec290298c294206965c9569bb3bd700?start=2022-09-26T01%3A03%3A17.137057&end=2022-09-24T01%3A03%3A17.137057 HTTP/1.1 Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jUobX7oXvVjy7P-0uttwsfa2y0sNm9JU_2hyrqHhFDbAjxY-EAr0j2OBfVh3SOYtwRux0fqAr85MUk4ns_wFCwAK-TsnEwsx4K6k3y3noqDXebtFblozdLhzg1EnKxtANRgzIVNBR-yNTxPnlA_cniSRrJe0-ZwkswbdhR5emR54U Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: a05cc20a4d8c4ffda8cb3b45e3f674e4 Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-337938442 Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:03:18.511014 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05cc20a4d8c4ffda8cb3b45e3f674e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05cc20a4d8c4ffda8cb3b45e3f674e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05cc20a4d8c4ffda8cb3b45e3f674e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05cc20a4d8c4ffda8cb3b45e3f674e4"}]}] Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-337938442 Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: a05cc20a4d8c4ffda8cb3b45e3f674e4 Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-337938442 Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TenantUsagesNegativeTestJSON-337938442-project-admin Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ee80493926ae46939c357bc01592818a Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-337938442-project-admin Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid start time. The start time cannot occur after the end time. Sep 25 01:03:18.512762 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'cec290298c294206965c9569bb3bd700'} Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 25 01:03:18.513748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 25 01:03:18.515558 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:18.518425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-234fd167-4976-4be7-bbe9-708ff9741cab tempest-TenantUsagesNegativeTestJSON-337938442 tempest-TenantUsagesNegativeTestJSON-337938442-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:18.520968 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-234fd167-4976-4be7-bbe9-708ff9741cab tempest-TenantUsagesNegativeTestJSON-337938442 tempest-TenantUsagesNegativeTestJSON-337938442-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/cec290298c294206965c9569bb3bd700?start=2022-09-26T01%3A03%3A17.137057&end=2022-09-24T01%3A03%3A17.137057" status: 400 len: 111 microversion: 2.1 time: 0.036992 Sep 25 01:03:18.521680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 319/676] 10.222.0.16 () {58 vars in 1412 bytes} [Sun Sep 25 01:03:18 2022] GET /compute/v2.1/os-simple-tenant-usage/cec290298c294206965c9569bb3bd700?start=2022-09-26T01%3A03%3A17.137057&end=2022-09-24T01%3A03%3A17.137057 => generated 111 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:03:18.537868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:18.542192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:18.557261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:18.558298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:18.559004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:18.559972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:18.560658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:18.561511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:18.605273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] validate_networks() for [('defca061-1fc0-4eb4-a3fe-f0e809a541e4', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:03:18.971682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:18.981571 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-611ce6ed-76ea-44b3-b5ce-40ee9f93382e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.457895 Sep 25 01:03:18.986540 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 320/677] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:18 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:19.001332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4c2676f-ae73-4bf4-b7be-f02ac7437401 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf04abc10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:19.092567 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4c2676f-ae73-4bf4-b7be-f02ac7437401 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.103378 Sep 25 01:03:19.104566 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 321/678] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:18 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:19.109807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2059969500", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4f8a553d-e325-4d96-bf39-28985d951e27"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:19.271124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] validate_networks() for [('4f8a553d-e325-4d96-bf39-28985d951e27', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:03:19.977761 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:20.297995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:03:20.298512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:03:20.299035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:03:20.299453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:03:20.300466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:03:20.321775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.324531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.328183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.329397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.330187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.336311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.359955 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=32 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:20.377528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:20.387175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for user 545456a4a4e540be9138c47b0df77bbf and project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:20.413226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:03:20.416185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:20.524166 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-beeed3c4-f5ee-4026-a941-db30d44bea2f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.311949 Sep 25 01:03:20.532188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 358/679] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:03:20.742835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6576e46c-83a3-489d-b8b3-427092743746 tempest-TenantUsagesNegativeTestJSON-193296535 tempest-TenantUsagesNegativeTestJSON-193296535-project] Calling method '.version_select at 0x7f7bf0017670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:20.748550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6576e46c-83a3-489d-b8b3-427092743746 tempest-TenantUsagesNegativeTestJSON-193296535 tempest-TenantUsagesNegativeTestJSON-193296535-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f8ac5a9bf1fc4483b198984f18930e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec290298c294206965c9569bb3bd700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6576e46c-83a3-489d-b8b3-427092743746 tempest-TenantUsagesNegativeTestJSON-193296535 tempest-TenantUsagesNegativeTestJSON-193296535-project] Request method failure captured: Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-24T01%3A03%3A17.137057&end=2022-09-26T01%3A03%3A17.137057&detailed=1 HTTP/1.1 Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jTH6h7k7CHfFAqc9sstDtBxm_Eyv-NNBB3Ntgo2Y0FysACEZ09faKU1MIpxpVIt55kdk2zdw4SQUs1Jrkv1wkrLDrjmwDCXe3j1V8d8PXtVG9Z54GnYteJOrByH_f_aYEwKYxtVZbWL86bSLInSRPu45a8Ug_WtQfuTlQOPh9bVks Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: cec290298c294206965c9569bb3bd700 Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-193296535 Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:03:20.752792 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cec290298c294206965c9569bb3bd700"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cec290298c294206965c9569bb3bd700"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cec290298c294206965c9569bb3bd700"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cec290298c294206965c9569bb3bd700"}]}] Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-193296535 Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: cec290298c294206965c9569bb3bd700 Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-193296535 Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TenantUsagesNegativeTestJSON-193296535-project Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f8ac5a9bf1fc4483b198984f18930e42 Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-193296535-project Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:03:20.755490 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:03:20.756624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:03:20.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:03:20.760634 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 25 01:03:20.760634 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:20.762062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6576e46c-83a3-489d-b8b3-427092743746 tempest-TenantUsagesNegativeTestJSON-193296535 tempest-TenantUsagesNegativeTestJSON-193296535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:20.763231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6576e46c-83a3-489d-b8b3-427092743746 tempest-TenantUsagesNegativeTestJSON-193296535 tempest-TenantUsagesNegativeTestJSON-193296535-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-24T01%3A03%3A17.137057&end=2022-09-26T01%3A03%3A17.137057&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.229493 Sep 25 01:03:20.764289 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 359/680] 10.222.0.16 () {58 vars in 1335 bytes} [Sun Sep 25 01:03:20 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-24T01%3A03%3A17.137057&end=2022-09-26T01%3A03%3A17.137057&detailed=1 => generated 123 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:20.799393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-58c40d78-60d8-4c70-b235-84eeb83f98c3 req-70e30661-9c46-44d9-af2b-7dd369ba5f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "name": "network-vif-plugged", "status": "completed", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:20.833009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-58c40d78-60d8-4c70-b235-84eeb83f98c3 req-70e30661-9c46-44d9-af2b-7dd369ba5f56 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.834364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-58c40d78-60d8-4c70-b235-84eeb83f98c3 req-70e30661-9c46-44d9-af2b-7dd369ba5f56 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.835321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-58c40d78-60d8-4c70-b235-84eeb83f98c3 req-70e30661-9c46-44d9-af2b-7dd369ba5f56 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.869211 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-58c40d78-60d8-4c70-b235-84eeb83f98c3 req-70e30661-9c46-44d9-af2b-7dd369ba5f56 service nova] Creating event network-vif-plugged:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:03:20.884186 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-58c40d78-60d8-4c70-b235-84eeb83f98c3 req-70e30661-9c46-44d9-af2b-7dd369ba5f56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115056 Sep 25 01:03:20.889465 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 360/681] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:20.900326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:20.906848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:20.922657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.927510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.928180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.930138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.930633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.931093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.041117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:03:21.041866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:03:21.042462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:03:21.043120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:03:21.043650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:03:21.077887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:21.078886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:21.079452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.080452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:21.081024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:21.082426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.166267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:21.193952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for user fe77600029ff40f8b738c097bf184495 and project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:21.241434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:03:21.253587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:21.432353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c24288dd-e5ee-4335-a375-02e775c92e5f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.326428 Sep 25 01:03:21.434586 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 322/682] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:03:21.444249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:21.456834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:21.458514 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a850297-a1bd-4c4c-a06c-3293ed90718f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.562799 Sep 25 01:03:21.458650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:21.472328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:21.476624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:21.477078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.478802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:21.479271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:21.479704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.479972 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 361/683] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:20 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:21.497784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27edd414-71cc-4004-81f8-d944f8cbf23e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf023ed30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:21.619046 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27edd414-71cc-4004-81f8-d944f8cbf23e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.137812 Sep 25 01:03:21.634619 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 362/684] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:21 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:21.663841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-335be460-d34d-4223-a081-e98dc1463bbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:21.664506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-335be460-d34d-4223-a081-e98dc1463bbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:21.929540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-335be460-d34d-4223-a081-e98dc1463bbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:21.943741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-335be460-d34d-4223-a081-e98dc1463bbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:21.948289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-335be460-d34d-4223-a081-e98dc1463bbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:21.950856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-335be460-d34d-4223-a081-e98dc1463bbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1262 microversion: 2.25 time: 0.314851 Sep 25 01:03:21.955073 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 363/685] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:21 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1262 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:21.982231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8893f2f-38f6-44e9-b0d4-c5db8abf6b6d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:21.983238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c8893f2f-38f6-44e9-b0d4-c5db8abf6b6d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:22.123739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:22.141768 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23c116ee-3585-4a31-8517-435d75d8fa16 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 0.697261 Sep 25 01:03:22.142683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 323/686] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:21 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:22.148334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8893f2f-38f6-44e9-b0d4-c5db8abf6b6d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:22.161595 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8893f2f-38f6-44e9-b0d4-c5db8abf6b6d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1211 microversion: 2.1 time: 0.204192 Sep 25 01:03:22.162139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 364/687] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:21 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1211 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:22.494408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:22.495023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:22.521602 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:22.526102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.527202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.527904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.530311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.532594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.540234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.650956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca1fe56b-f65f-4b46-b89f-aab6821beecf tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf02bb550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:22.824358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca1fe56b-f65f-4b46-b89f-aab6821beecf tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.177127 Sep 25 01:03:22.825462 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 365/688] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:22 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:22.984423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:22.985054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:23.018637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.020394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.029121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.033772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.035507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.037112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.061296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.089564 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4a1fabb-74bd-4d92-8b4a-9e7c65da5469 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.598179 Sep 25 01:03:23.090448 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 324/689] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:22 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:23.170032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:23.171427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:23.184536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.185343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.186011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.186933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.189040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.190459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.268452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.330350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.335754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.343423 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-406cc413-1f37-4fb9-9a40-82e8040a3a05 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1314 microversion: 2.25 time: 0.365548 Sep 25 01:03:23.363352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 366/690] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:22 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:23.377379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:23.379463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:23.406578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.410926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.422766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.424326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.425064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.426611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.806127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.818689 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1dbaa51a-d747-4fd4-8432-a086d55972ce tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1207 microversion: 2.1 time: 0.454128 Sep 25 01:03:23.819277 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 367/691] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:23 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1207 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:23.842500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d48a427e-4c40-48df-a2f0-e2e605e54a14 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf1cc10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:23.942737 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d48a427e-4c40-48df-a2f0-e2e605e54a14 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.105546 Sep 25 01:03:23.945824 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 368/692] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:23 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:23.959772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c209f9d3-25a2-4877-89f6-6080fb25940f req-fcfc216a-b879-41f8-ba68-c4d1b6be3dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91", "name": "network-vif-plugged", "status": "completed", "tag": "a069a87f-5afa-40d1-aace-7bb3cbecd763"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:23.989466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c209f9d3-25a2-4877-89f6-6080fb25940f req-fcfc216a-b879-41f8-ba68-c4d1b6be3dc4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.003509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c209f9d3-25a2-4877-89f6-6080fb25940f req-fcfc216a-b879-41f8-ba68-c4d1b6be3dc4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.009953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c209f9d3-25a2-4877-89f6-6080fb25940f req-fcfc216a-b879-41f8-ba68-c4d1b6be3dc4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.077309 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c209f9d3-25a2-4877-89f6-6080fb25940f req-fcfc216a-b879-41f8-ba68-c4d1b6be3dc4 service nova] Creating event network-vif-plugged:a069a87f-5afa-40d1-aace-7bb3cbecd763 for instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 on n-h2-master-1 Sep 25 01:03:24.093551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c209f9d3-25a2-4877-89f6-6080fb25940f req-fcfc216a-b879-41f8-ba68-c4d1b6be3dc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143352 Sep 25 01:03:24.094908 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 369/693] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:24.114160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:24.118222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:24.137205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.137827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.138489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.141172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.141869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.144159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.270467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:24.304588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f990b8d4-73bc-463f-bf42-812c587d547d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1473 microversion: 2.1 time: 1.132579 Sep 25 01:03:24.306583 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 325/694] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:23 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1473 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:24.377017 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:24.377904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:24.389109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.394246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.395521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.396997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.398851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.400763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.703746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:24.750352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:24.874889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:24.886482 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75259a4e-5e5e-4337-a709-489e9890379a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1320 microversion: 2.25 time: 0.513732 Sep 25 01:03:24.888287 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 326/695] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:24 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:24.947708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:24.948333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:24.964241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.968070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.969343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.973350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.974148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.974915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.991730 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:25.087123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:25.109360 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0d39247-defe-4ff4-8b97-2ba9d166bc82 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.999656 Sep 25 01:03:25.129593 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 370/696] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:24 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:25.144585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7df6747a-f5ab-4781-90b0-1892545ec0a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf02ac5e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:25.254541 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7df6747a-f5ab-4781-90b0-1892545ec0a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.123532 Sep 25 01:03:25.268751 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 371/697] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:25 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:25.314683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:25.335258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:25.340547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:25.346303 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c55658e-1fbe-44c9-827b-773048457b8d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1271 microversion: 2.1 time: 0.454424 Sep 25 01:03:25.353812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.354186 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 327/698] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:24 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1271 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:25.359709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.360693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.362621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.366240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.366946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.832921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:25.844218 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-96ac8e7d-6bbe-4a0f-a83a-cb3ae9406bdc tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1479 microversion: 2.1 time: 0.514989 Sep 25 01:03:25.864635 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 372/699] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:25 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1479 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:25.938936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:25.939677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:25.951445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.955788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.957667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.967559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.968056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.968504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.088084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:26.103333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:26.105167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:26.107756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-273ebb27-4ea1-4cf2-b25e-8ad176908a29 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1320 microversion: 2.25 time: 0.175403 Sep 25 01:03:26.108943 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 328/700] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:25 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:26.140446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:26.142185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:26.150776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.152185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.152821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.153821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.154451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.155053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.277313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7efe6cab-2f52-4603-9f43-d975dbce34f8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0139af0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:26.371004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7efe6cab-2f52-4603-9f43-d975dbce34f8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.103353 Sep 25 01:03:26.372271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 329/701] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:26 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:26.391497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:26.392423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:26.400953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.412163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.412861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.414307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.414937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.415524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.908389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:26.928800 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b934eb1c-0ba0-45f1-8412-0a58c88a2cf3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1269 microversion: 2.1 time: 0.541552 Sep 25 01:03:26.942687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 330/702] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:26 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1269 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:26.969897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:26.971497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:26.986052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.988553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.989941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.992515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.994384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.995748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:27.064202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:27.074410 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11867c04-772d-43df-8934-99169db10b0c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.941506 Sep 25 01:03:27.081916 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 373/703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:26 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:27.138013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:27.138907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:27.149036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:27.154600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:27.155373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:27.156314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:27.156960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:27.158570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.061745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.074559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.086363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.089861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5bba8511-3841-47c0-b0c2-567a254d56f4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.955799 Sep 25 01:03:28.093007 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 374/704] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:27 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:03:28.191838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.212373 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-896cf2b3-acaa-401b-98db-a73c35b84069 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1479 microversion: 2.1 time: 1.267574 Sep 25 01:03:28.213806 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 331/705] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:26 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1479 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:28.236122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6999a918-6b03-4fac-8a3c-490a23a824dd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf03d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.309656 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6999a918-6b03-4fac-8a3c-490a23a824dd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.093700 Sep 25 01:03:28.310568 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 332/706] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:28.316407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.317931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:28.326911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.328427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.329122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.330127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.330853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.332209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.410463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-afe42771-a6db-441e-817d-d6d3f42cd474 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Calling method '.version_select at 0x7f7bf0017430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.443280 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-afe42771-a6db-441e-817d-d6d3f42cd474 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] HTTP exception thrown: Image not found. Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-afe42771-a6db-441e-817d-d6d3f42cd474 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Request method failure captured: Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/images/63f9cba5-360e-4625-b853-6eb8528eec46/metadata/os_distro HTTP/1.1 Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jeZSUXLveSxi3WLrl1U_l8ddfJgGfoRrfuowg_S1-mcQ4pe0JLsWFYSZOylXxZ5v6O9ZKd_AQxwegjBQkUrXZpwTkTKA-dMSpGs2_6uV6l5J5GkWrS05JQ3vrEkFbYToAexWnE3fPOrdi7ifkXgR3twuUAettGskjTn4LLtkWHPKM Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:03:28.452144 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f7afc63d70434b138d1b64efaa8b6b1c"}]}] Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a98f5be7a70e487c9b394093cfd6deca Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: action_args: {'image_id': '63f9cba5-360e-4625-b853-6eb8528eec46', 'id': 'os_distro'} Sep 25 01:03:28.453567 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:28.454388 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63f9cba5-360e-4625-b853-6eb8528eec46 Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:28.455439 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63f9cba5-360e-4625-b853-6eb8528eec46 could not be found. Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:28.457244 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:03:28.458601 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.462293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-afe42771-a6db-441e-817d-d6d3f42cd474 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:28.463497 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-afe42771-a6db-441e-817d-d6d3f42cd474 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] 10.222.0.16 "DELETE /compute/v2.1/images/63f9cba5-360e-4625-b853-6eb8528eec46/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.369216 Sep 25 01:03:28.468726 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 375/707] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:03:28 2022] DELETE /compute/v2.1/images/63f9cba5-360e-4625-b853-6eb8528eec46/metadata/os_distro => generated 62 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:03:28.477271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.478553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:28.488958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.490069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.490748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.494947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.495834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.496507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.502739 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:28.798041 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.816400 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6087599a-547b-4577-9cd3-d05a9c5aaee2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.502016 Sep 25 01:03:28.817460 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 333/708] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:28.829820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d48ab808-99a3-4988-a214-fa196a728f01 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Calling method '.version_select at 0x7f7bf05015e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.875726 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d48ab808-99a3-4988-a214-fa196a728f01 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] HTTP exception thrown: Image not found. Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d48ab808-99a3-4988-a214-fa196a728f01 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Request method failure captured: Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/images/1668e7f9-b560-4ab1-94dd-6907bc8f10dc/metadata/os_version HTTP/1.1 Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jeZSUXLveSxi3WLrl1U_l8ddfJgGfoRrfuowg_S1-mcQ4pe0JLsWFYSZOylXxZ5v6O9ZKd_AQxwegjBQkUrXZpwTkTKA-dMSpGs2_6uV6l5J5GkWrS05JQ3vrEkFbYToAexWnE3fPOrdi7ifkXgR3twuUAettGskjTn4LLtkWHPKM Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:28.882553 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f7afc63d70434b138d1b64efaa8b6b1c"}]}] Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a98f5be7a70e487c9b394093cfd6deca Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: action_args: {'image_id': '1668e7f9-b560-4ab1-94dd-6907bc8f10dc', 'id': 'os_version'} Sep 25 01:03:28.883923 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:28.884731 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1668e7f9-b560-4ab1-94dd-6907bc8f10dc Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:28.885826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1668e7f9-b560-4ab1-94dd-6907bc8f10dc could not be found. Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:28.887228 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:03:28.890543 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.897552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d48ab808-99a3-4988-a214-fa196a728f01 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:28.898877 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d48ab808-99a3-4988-a214-fa196a728f01 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] 10.222.0.16 "GET /compute/v2.1/images/1668e7f9-b560-4ab1-94dd-6907bc8f10dc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.079331 Sep 25 01:03:28.900081 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 334/709] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/images/1668e7f9-b560-4ab1-94dd-6907bc8f10dc/metadata/os_version => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:03:28.911113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd83470d-8568-4a3e-ac5e-da7472247664 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Calling method '.version_select at 0x7f7bebf63820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.940293 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-fd83470d-8568-4a3e-ac5e-da7472247664 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] HTTP exception thrown: Image not found. Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd83470d-8568-4a3e-ac5e-da7472247664 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Request method failure captured: Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/images/b91fb071-41da-49a0-8d29-2658846e9391/metadata HTTP/1.1 Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jeZSUXLveSxi3WLrl1U_l8ddfJgGfoRrfuowg_S1-mcQ4pe0JLsWFYSZOylXxZ5v6O9ZKd_AQxwegjBQkUrXZpwTkTKA-dMSpGs2_6uV6l5J5GkWrS05JQ3vrEkFbYToAexWnE3fPOrdi7ifkXgR3twuUAettGskjTn4LLtkWHPKM Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:28.942930 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f7afc63d70434b138d1b64efaa8b6b1c"}]}] Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a98f5be7a70e487c9b394093cfd6deca Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: action_args: {'image_id': 'b91fb071-41da-49a0-8d29-2658846e9391'} Sep 25 01:03:28.944294 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:28.945095 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b91fb071-41da-49a0-8d29-2658846e9391 Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:28.947742 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b91fb071-41da-49a0-8d29-2658846e9391 could not be found. Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:28.948939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:03:28.950098 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:28.957637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd83470d-8568-4a3e-ac5e-da7472247664 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:28.958844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd83470d-8568-4a3e-ac5e-da7472247664 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] 10.222.0.16 "GET /compute/v2.1/images/b91fb071-41da-49a0-8d29-2658846e9391/metadata" status: 404 len: 62 microversion: 2.1 time: 0.053592 Sep 25 01:03:28.959995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 335/710] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/images/b91fb071-41da-49a0-8d29-2658846e9391/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:03:28.978165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-534abfb8-e460-4152-8174-5397bed03ccf tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Action: 'update_all', calling method: .version_select at 0x7f7bf075d940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:29.005653 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-534abfb8-e460-4152-8174-5397bed03ccf tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] HTTP exception thrown: Image not found. Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-534abfb8-e460-4152-8174-5397bed03ccf tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Request method failure captured: Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/images/d2867aa6-70f8-4ef3-b69b-90a1f0dc7f97/metadata HTTP/1.1 Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 57 Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jeZSUXLveSxi3WLrl1U_l8ddfJgGfoRrfuowg_S1-mcQ4pe0JLsWFYSZOylXxZ5v6O9ZKd_AQxwegjBQkUrXZpwTkTKA-dMSpGs2_6uV6l5J5GkWrS05JQ3vrEkFbYToAexWnE3fPOrdi7ifkXgR3twuUAettGskjTn4LLtkWHPKM Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:29.008342 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f7afc63d70434b138d1b64efaa8b6b1c"}]}] Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a98f5be7a70e487c9b394093cfd6deca Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:03:29.010077 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: action_args: {'image_id': 'd2867aa6-70f8-4ef3-b69b-90a1f0dc7f97', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:29.011005 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d2867aa6-70f8-4ef3-b69b-90a1f0dc7f97 Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:29.012564 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d2867aa6-70f8-4ef3-b69b-90a1f0dc7f97 could not be found. Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:29.013946 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:03:29.015560 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.020018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-534abfb8-e460-4152-8174-5397bed03ccf tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:29.021062 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-534abfb8-e460-4152-8174-5397bed03ccf tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] 10.222.0.16 "PUT /compute/v2.1/images/d2867aa6-70f8-4ef3-b69b-90a1f0dc7f97/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048923 Sep 25 01:03:29.022227 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 336/711] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:03:28 2022] PUT /compute/v2.1/images/d2867aa6-70f8-4ef3-b69b-90a1f0dc7f97/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:03:29.022482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:29.037690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3447501c-1969-4340-8d12-ef8ab17794d9 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Action: 'update', calling method: .version_select at 0x7f7bf016f160>, body: {"meta": {"os_distro": "alt"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:29.042268 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9d225e1-c5a9-4ebf-b000-05cb02e0e7c8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1317 microversion: 2.1 time: 0.571591 Sep 25 01:03:29.058033 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 376/712] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:29.074551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3447501c-1969-4340-8d12-ef8ab17794d9 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] HTTP exception thrown: Image not found. Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3447501c-1969-4340-8d12-ef8ab17794d9 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Request method failure captured: Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/images/bfe018cc-3363-495c-a04f-a7cceff3d2f3/metadata/os_distro HTTP/1.1 Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 30 Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jeZSUXLveSxi3WLrl1U_l8ddfJgGfoRrfuowg_S1-mcQ4pe0JLsWFYSZOylXxZ5v6O9ZKd_AQxwegjBQkUrXZpwTkTKA-dMSpGs2_6uV6l5J5GkWrS05JQ3vrEkFbYToAexWnE3fPOrdi7ifkXgR3twuUAettGskjTn4LLtkWHPKM Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:29.078065 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f7afc63d70434b138d1b64efaa8b6b1c"}]}] Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a98f5be7a70e487c9b394093cfd6deca Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: {"meta": {"os_distro": "alt"}} Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:03:29.079541 n-d-master-1 devstack@n-api.service[122384]: action_args: {'image_id': 'bfe018cc-3363-495c-a04f-a7cceff3d2f3', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:29.080445 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bfe018cc-3363-495c-a04f-a7cceff3d2f3 Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:29.082226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfe018cc-3363-495c-a04f-a7cceff3d2f3 could not be found. Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:29.084412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:03:29.086561 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.090249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3447501c-1969-4340-8d12-ef8ab17794d9 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:29.091339 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3447501c-1969-4340-8d12-ef8ab17794d9 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] 10.222.0.16 "PUT /compute/v2.1/images/bfe018cc-3363-495c-a04f-a7cceff3d2f3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.061557 Sep 25 01:03:29.093160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 337/713] 10.222.0.16 () {60 vars in 1310 bytes} [Sun Sep 25 01:03:29 2022] PUT /compute/v2.1/images/bfe018cc-3363-495c-a04f-a7cceff3d2f3/metadata/os_distro => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:03:29.104911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3739be8a-d6ea-4f3d-a8d9-dfd5d6e39a39 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Action: 'create', calling method: .version_select at 0x7f7bf00173a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:29.119339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:29.119956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:29.138447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.140131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.145196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.146332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.147057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.149962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.154885 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-3739be8a-d6ea-4f3d-a8d9-dfd5d6e39a39 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] HTTP exception thrown: Image not found. Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3739be8a-d6ea-4f3d-a8d9-dfd5d6e39a39 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Request method failure captured: Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/images/e84da417-b73b-4a9a-a5b2-0f1792772eb8/metadata HTTP/1.1 Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 57 Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jeZSUXLveSxi3WLrl1U_l8ddfJgGfoRrfuowg_S1-mcQ4pe0JLsWFYSZOylXxZ5v6O9ZKd_AQxwegjBQkUrXZpwTkTKA-dMSpGs2_6uV6l5J5GkWrS05JQ3vrEkFbYToAexWnE3fPOrdi7ifkXgR3twuUAettGskjTn4LLtkWHPKM Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:03:29.157143 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f7afc63d70434b138d1b64efaa8b6b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f7afc63d70434b138d1b64efaa8b6b1c"}]}] Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: f7afc63d70434b138d1b64efaa8b6b1c Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490 Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a98f5be7a70e487c9b394093cfd6deca Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091888490-project Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:03:29.158579 n-d-master-1 devstack@n-api.service[122385]: action_args: {'image_id': 'e84da417-b73b-4a9a-a5b2-0f1792772eb8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:29.159511 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e84da417-b73b-4a9a-a5b2-0f1792772eb8 Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:03:29.160578 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e84da417-b73b-4a9a-a5b2-0f1792772eb8 could not be found. Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:29.161735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:03:29.162868 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:29.167968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3739be8a-d6ea-4f3d-a8d9-dfd5d6e39a39 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:29.167968 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3739be8a-d6ea-4f3d-a8d9-dfd5d6e39a39 tempest-ImagesMetadataNegativeTestJSON-1091888490 tempest-ImagesMetadataNegativeTestJSON-1091888490-project] 10.222.0.16 "POST /compute/v2.1/images/e84da417-b73b-4a9a-a5b2-0f1792772eb8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066490 Sep 25 01:03:29.167968 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 377/714] 10.222.0.16 () {60 vars in 1281 bytes} [Sun Sep 25 01:03:29 2022] POST /compute/v2.1/images/e84da417-b73b-4a9a-a5b2-0f1792772eb8/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:03:29.236142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:29.237842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:29.250242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.253323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.255952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.257792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.262051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.262510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.778332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:29.793810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:29.814871 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:29.816647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a323ebb-14ee-42d7-a8de-7b4f9b32f2d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.701384 Sep 25 01:03:29.834465 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 338/715] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:29 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:29.845141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b978a74-4083-408c-883c-1267f3edd445 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0139940>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:30.005103 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b978a74-4083-408c-883c-1267f3edd445 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.168906 Sep 25 01:03:30.010948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 339/716] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:29 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:30.052118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:30.059094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:30.097367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.102812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.103288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.104056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.111225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.111686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.365795 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:30.370184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:30.393127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d0b5b1a-fb3a-426e-80bd-e3742d3eb507 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1479 microversion: 2.1 time: 1.151145 Sep 25 01:03:30.394809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 378/717] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:29 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1479 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:30.422109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-97378830-d3ab-47f6-8d55-b77c2f3b4783 req-3c6bf888-7a3c-46b7-bb7f-43654c36235e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "name": "network-vif-unplugged", "status": "completed", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:30.481095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97378830-d3ab-47f6-8d55-b77c2f3b4783 req-3c6bf888-7a3c-46b7-bb7f-43654c36235e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.481724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97378830-d3ab-47f6-8d55-b77c2f3b4783 req-3c6bf888-7a3c-46b7-bb7f-43654c36235e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.482187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97378830-d3ab-47f6-8d55-b77c2f3b4783 req-3c6bf888-7a3c-46b7-bb7f-43654c36235e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.540994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-97378830-d3ab-47f6-8d55-b77c2f3b4783 req-3c6bf888-7a3c-46b7-bb7f-43654c36235e service nova] Creating event network-vif-unplugged:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:03:30.553489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-97378830-d3ab-47f6-8d55-b77c2f3b4783 req-3c6bf888-7a3c-46b7-bb7f-43654c36235e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155627 Sep 25 01:03:30.558662 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 379/718] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:30.575174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4907f1dd-2311-4901-b88f-b7202c5eaa70 req-03c58e0e-0a8c-4349-98e7-316dbf0b372d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "286adbb8-ab65-4c43-bd6c-d73ae0f11a6c", "tag": "250f468b-3568-4cf8-9c11-e739f9bd20cf"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:30.598286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4907f1dd-2311-4901-b88f-b7202c5eaa70 req-03c58e0e-0a8c-4349-98e7-316dbf0b372d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.601176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4907f1dd-2311-4901-b88f-b7202c5eaa70 req-03c58e0e-0a8c-4349-98e7-316dbf0b372d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.602945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4907f1dd-2311-4901-b88f-b7202c5eaa70 req-03c58e0e-0a8c-4349-98e7-316dbf0b372d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.632957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4907f1dd-2311-4901-b88f-b7202c5eaa70 req-03c58e0e-0a8c-4349-98e7-316dbf0b372d service nova] Creating event network-changed:250f468b-3568-4cf8-9c11-e739f9bd20cf for instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c on n-h1-master-1 Sep 25 01:03:30.651194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4907f1dd-2311-4901-b88f-b7202c5eaa70 req-03c58e0e-0a8c-4349-98e7-316dbf0b372d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089582 Sep 25 01:03:30.653769 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 380/719] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:30.664843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:30.670634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:30.684589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.689015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.689884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.691095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.694009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.694910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.831898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:30.849141 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02a27e09-04b8-4bcc-a173-a00a0f5c8e6c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.834411 Sep 25 01:03:30.872160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 340/720] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:30 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:30.887526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:30.888334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:30.903191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.903885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.904675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.906329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.911730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.926984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:31.115379 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:31.181379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:31.191440 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5851bbb8-f404-4f40-84e7-1e9e6772ca65 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1467 microversion: 2.1 time: 0.535315 Sep 25 01:03:31.207287 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 381/721] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:30 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1467 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:31.221268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-800e786d-35a1-4b9a-91a5-6fbda62b3d07 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0780940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:31.227065 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:31.337951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-800e786d-35a1-4b9a-91a5-6fbda62b3d07 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.123781 Sep 25 01:03:31.338933 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 382/722] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:31 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:31.468124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:31.490757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:31.492657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:31.495561 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59962558-430b-4da0-805e-d6d025f5ee87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.622084 Sep 25 01:03:31.498448 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 341/723] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:30 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:31.523399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:31.535571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:31.570944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:31.574815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:31.575333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:31.576099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:31.576598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:31.577009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:31.873659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:31.874516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:31.888759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:31.889642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:31.892199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:31.894736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:31.895986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:31.896854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:32.152889 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:32.173329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:32.215082 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61a4d790-6b37-4c82-a120-9fe36cbf735c tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1479 microversion: 2.1 time: 0.710349 Sep 25 01:03:32.216151 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 342/724] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:31 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1479 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:32.239749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:32.244463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:32.266740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:32.267635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:32.269909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:32.271575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:32.272643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:32.273964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:32.862624 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e2b58eb-1ffd-4719-b0c8-85a5f07ed629 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1618 microversion: 2.1 time: 1.519842 Sep 25 01:03:32.881188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 383/725] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:31 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1618 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:32.895742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db468a8c-27b8-4459-b104-62e2a62320f5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0766a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:32.957294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:32.983439 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-641c0018-66e3-41c5-bd05-39a352bc55a0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.759347 Sep 25 01:03:32.997653 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 343/726] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:32 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:32.999379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db468a8c-27b8-4459-b104-62e2a62320f5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.116934 Sep 25 01:03:32.999973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 384/727] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:32 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:33.007500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-982faa02-11e9-40f0-94a1-fda1388fa445 req-a9c8441d-b2c0-4eac-a6b4-cdcea4e8eac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59518b5d-19aa-4c65-bb04-07ee70ef436b", "tag": "3c2d629b-52bf-4176-be1b-5bed48860c09"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:33.014248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:33.021475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:33.027973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-982faa02-11e9-40f0-94a1-fda1388fa445 req-a9c8441d-b2c0-4eac-a6b4-cdcea4e8eac5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.028464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-982faa02-11e9-40f0-94a1-fda1388fa445 req-a9c8441d-b2c0-4eac-a6b4-cdcea4e8eac5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.028959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-982faa02-11e9-40f0-94a1-fda1388fa445 req-a9c8441d-b2c0-4eac-a6b4-cdcea4e8eac5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.030751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.031602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.032067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.035311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.037002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.037845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.054723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-982faa02-11e9-40f0-94a1-fda1388fa445 req-a9c8441d-b2c0-4eac-a6b4-cdcea4e8eac5 service nova] Creating event network-changed:3c2d629b-52bf-4176-be1b-5bed48860c09 for instance 59518b5d-19aa-4c65-bb04-07ee70ef436b on n-h1-master-1 Sep 25 01:03:33.071353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-982faa02-11e9-40f0-94a1-fda1388fa445 req-a9c8441d-b2c0-4eac-a6b4-cdcea4e8eac5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069340 Sep 25 01:03:33.072433 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 385/728] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:33.078718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d0ebc5f-f5e6-4771-8a4f-571f745fc0d4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: .version_select at 0x7f7bf06d4820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1053454821", "policies": ["affinity"]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:33.123628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7d0ebc5f-f5e6-4771-8a4f-571f745fc0d4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:33.136938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7d0ebc5f-f5e6-4771-8a4f-571f745fc0d4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:33.258961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7d0ebc5f-f5e6-4771-8a4f-571f745fc0d4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:33.272511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7d0ebc5f-f5e6-4771-8a4f-571f745fc0d4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:33.279384 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:33.302284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d0ebc5f-f5e6-4771-8a4f-571f745fc0d4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.228450 Sep 25 01:03:33.303702 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 386/729] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:03:33 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:33.351718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:33.375087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:33.377916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:33.380175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc8f79e6-a6ad-4232-8932-e174ba897b71 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.379934 Sep 25 01:03:33.397104 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 344/730] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:32 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:33.450169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:33.451105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:33.469288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.469840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.470288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.471152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.471694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.472114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.842208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:33.859488 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-548ba126-963a-474f-8655-a138c4573d14 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1464 microversion: 2.1 time: 0.457774 Sep 25 01:03:33.860864 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 345/731] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:33 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1464 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:33.882875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1898697951", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0f0b4f56-756f-4d89-b413-02f07b5e36f8"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:33.939544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a231e8e1-7a1d-4042-9c85-c060caca6280 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Calling method '.version_select at 0x7f7bf04d69d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:34.012574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:03:34.447456 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a231e8e1-7a1d-4042-9c85-c060caca6280 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.142010 Sep 25 01:03:34.449948 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 387/732] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:03:33 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:03:34.469628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:34.485070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:34.526630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.527682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.529479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.530586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.533882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.537309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.775565 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b3e254f-306f-4004-8885-896cc8f6b12c tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 0 microversion: 2.1 time: 0.322160 Sep 25 01:03:34.776796 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 388/733] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:34 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:03:34.791687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:34.792612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:34.812036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.813721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.814598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.815966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.820760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.821996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.894719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:03:34.895286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:03:34.895808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:03:34.896255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:03:34.896683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:03:34.983466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.986199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.988449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.990236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.991970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.992622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.019079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:35.026157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:35.044594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Going to run 2 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:03:35.047513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:35.130873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122384) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 25 01:03:35.134352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:35.151209 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62992136-c710-4de7-91ce-9feb292c6f54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.372131 Sep 25 01:03:35.155282 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 389/734] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:34 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:35.164416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb66d9c6-ef3d-49c5-8a02-1914d383a6c5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0072550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:35.202587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:35.209250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:35.253731 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb66d9c6-ef3d-49c5-8a02-1914d383a6c5 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.092221 Sep 25 01:03:35.254602 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 390/735] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:35 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:35.267838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:35.276469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:35.286646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:35.290270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.292008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.292460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.293196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.293697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.294980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.300990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:35.320788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=ce85d75a-6d29-4271-8442-77904ee95690,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:35.399156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:35.408726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:35.483582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:35.512270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:35.567404 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:35.629781 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23fba5c3-119a-4bce-b252-b8d9432433af tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.763067 Sep 25 01:03:35.634293 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 346/736] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:03:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 1768 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:03:35.646697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ba633b1-f3f9-4919-8b9a-77234b7412f4 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Action: 'create', calling method: .version_select at 0x7f7bebf63ca0>, body: {"pool": "non_exist_pool"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:35.733834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:35.760351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:35.769319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:35.775278 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0466ad2-ebd8-48a8-aae8-b3fca184b107 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.508790 Sep 25 01:03:35.799440 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 391/737] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:35 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:35.803988 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8ba633b1-f3f9-4919-8b9a-77234b7412f4 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] HTTP exception thrown: Floating IP pool not found. Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ba633b1-f3f9-4919-8b9a-77234b7412f4 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Request method failure captured: Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 26 Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jkpI9N0IfBzDJycKvKwREEuJcu_Bzty3C_yktZDs9GA2AUY0WthFNCp_7bHMP3J3nGOjISBgpliXSoHz5lxsJY4aqdZVYppJ4sNsiH8mXLgPqYNgWUb_luwvuJapARRcAxofg-yXzqfCfzUmyHs7f37s2Cb4NsR0lNqBgL6WhIe-A Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: a97a70a2a1744376a7f8a6b5120470e7 Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1282567216 Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:03:35.805731 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a97a70a2a1744376a7f8a6b5120470e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97a70a2a1744376a7f8a6b5120470e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97a70a2a1744376a7f8a6b5120470e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a97a70a2a1744376a7f8a6b5120470e7"}]}] Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1282567216 Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: a97a70a2a1744376a7f8a6b5120470e7 Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1282567216 Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsNegativeTestJSON-1282567216-project Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3260d086db0846e6b305d9cccfdbf976 Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1282567216-project Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: {"pool": "non_exist_pool"} Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: exception: Floating IP pool not found. Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 25 01:03:35.807191 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:35.808160 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ba633b1-f3f9-4919-8b9a-77234b7412f4 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Returning 404 to user: Floating IP pool not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:35.810183 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ba633b1-f3f9-4919-8b9a-77234b7412f4 tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.172475 Sep 25 01:03:35.813680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 347/738] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:03:35 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:03:35.817919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:35.818551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:35.828394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:35.840802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:35.844038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Searching by: {'deleted': False, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:03:35.861347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.862235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.876610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.884498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.886275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.886689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.887142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.889787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.893272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.893862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.896756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.897513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.998438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.999212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:36.000489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:36.001445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lazy-loading 'fault' on Instance uuid d0a01236-83f5-4729-abc0-e5ea5216c149 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:36.160094 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af1ba4d9-5c2a-4efe-995c-0805df403724 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1598 microversion: 2.1 time: 0.350147 Sep 25 01:03:36.162240 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 392/739] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:35 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1598 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:36.168328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62218963-b752-4f91-ac46-1f09cf47c5ce tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Calling method '.version_select at 0x7f7bf098c700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:36.199725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:03:36.241347 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-62218963-b752-4f91-ac46-1f09cf47c5ce tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1d978e72-118d-4720-828d-b651620cd1b0 could not be found", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:03:36.242323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-62218963-b752-4f91-ac46-1f09cf47c5ce tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] HTTP exception thrown: Floating IP not found for ID 1d978e72-118d-4720-828d-b651620cd1b0 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62218963-b752-4f91-ac46-1f09cf47c5ce tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Request method failure captured: Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-floating-ips/1d978e72-118d-4720-828d-b651620cd1b0 HTTP/1.1 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jkpI9N0IfBzDJycKvKwREEuJcu_Bzty3C_yktZDs9GA2AUY0WthFNCp_7bHMP3J3nGOjISBgpliXSoHz5lxsJY4aqdZVYppJ4sNsiH8mXLgPqYNgWUb_luwvuJapARRcAxofg-yXzqfCfzUmyHs7f37s2Cb4NsR0lNqBgL6WhIe-A Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: a97a70a2a1744376a7f8a6b5120470e7 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1282567216 Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:03:36.247023 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a97a70a2a1744376a7f8a6b5120470e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97a70a2a1744376a7f8a6b5120470e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97a70a2a1744376a7f8a6b5120470e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a97a70a2a1744376a7f8a6b5120470e7"}]}] Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1282567216 Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: a97a70a2a1744376a7f8a6b5120470e7 Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1282567216 Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPsNegativeTestJSON-1282567216-project Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3260d086db0846e6b305d9cccfdbf976 Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1282567216-project Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: exception: Floating IP not found for ID 1d978e72-118d-4720-828d-b651620cd1b0 Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1d978e72-118d-4720-828d-b651620cd1b0'} Sep 25 01:03:36.248647 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:03:36.249613 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1d978e72-118d-4720-828d-b651620cd1b0 could not be found Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9d239e1-b0b2-4608-bb67-32949f8c33ad'] Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1d978e72-118d-4720-828d-b651620cd1b0. Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:36.250964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1d978e72-118d-4720-828d-b651620cd1b0 Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:36.252857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:36.255569 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1d978e72-118d-4720-828d-b651620cd1b0 Sep 25 01:03:36.255569 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:36.256715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62218963-b752-4f91-ac46-1f09cf47c5ce tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] Returning 404 to user: Floating IP not found for ID 1d978e72-118d-4720-828d-b651620cd1b0 {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:36.257977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62218963-b752-4f91-ac46-1f09cf47c5ce tempest-FloatingIPsNegativeTestJSON-1282567216 tempest-FloatingIPsNegativeTestJSON-1282567216-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1d978e72-118d-4720-828d-b651620cd1b0" status: 404 len: 111 microversion: 2.1 time: 0.094366 Sep 25 01:03:36.259891 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 393/740] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:03:36 2022] DELETE /compute/v2.1/os-floating-ips/1d978e72-118d-4720-828d-b651620cd1b0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:36.276205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:36.290973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:36.358148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:36.362461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:36.369269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:36.375419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:36.376736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:36.379590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:36.462023 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2629481-a900-4087-8f9f-b3b9dec52005 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.626613 Sep 25 01:03:36.472303 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 348/741] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:03:35 2022] GET /compute/v2.1/servers => generated 1004 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:36.483787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:36.486079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:36.574771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:36.575810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:36.577094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:36.587718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:36.589011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:36.589877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:37.162540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:37.176276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2f0b7f9-c35f-449b-971e-f74d994fbf90 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.912144 Sep 25 01:03:37.179541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 394/742] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:36 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:37.203797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d92f6eb-7728-495b-b68d-dd12aaef1dee tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf03bf3a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:37.385523 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d92f6eb-7728-495b-b68d-dd12aaef1dee tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.204393 Sep 25 01:03:37.392278 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 395/743] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:37 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:37.408498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6011b4c2-a2a3-48ac-be9a-52c85b3efc18 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:37.410592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6011b4c2-a2a3-48ac-be9a-52c85b3efc18 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:37.446277 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c529ae3-8681-4e98-9f0c-5b469b4443f4 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action" status: 202 len: 0 microversion: 2.1 time: 0.973135 Sep 25 01:03:37.451487 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 349/744] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:36 2022] POST /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:03:37.467528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:37.468827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:37.502355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:37.505369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:37.505997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:37.507480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:37.508419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:37.509132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:37.758698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6011b4c2-a2a3-48ac-be9a-52c85b3efc18 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:37.772600 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6011b4c2-a2a3-48ac-be9a-52c85b3efc18 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1219 microversion: 2.1 time: 0.385095 Sep 25 01:03:37.773210 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 396/745] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:37 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1219 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:37.778139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ef569c0d-6ea6-499d-b86a-6f2fc0d4ce7e req-e75da21a-7cd9-4714-a077-40db7fade012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "name": "network-vif-plugged", "status": "completed", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:37.810455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ef569c0d-6ea6-499d-b86a-6f2fc0d4ce7e req-e75da21a-7cd9-4714-a077-40db7fade012 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:37.811415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ef569c0d-6ea6-499d-b86a-6f2fc0d4ce7e req-e75da21a-7cd9-4714-a077-40db7fade012 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:37.812042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ef569c0d-6ea6-499d-b86a-6f2fc0d4ce7e req-e75da21a-7cd9-4714-a077-40db7fade012 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:37.835843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ef569c0d-6ea6-499d-b86a-6f2fc0d4ce7e req-e75da21a-7cd9-4714-a077-40db7fade012 service nova] Creating event network-vif-plugged:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:03:37.854509 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ef569c0d-6ea6-499d-b86a-6f2fc0d4ce7e req-e75da21a-7cd9-4714-a077-40db7fade012 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079792 Sep 25 01:03:37.856265 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 397/746] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:37.867749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:37.868728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:37.897082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:37.897981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:37.898610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:37.899581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:37.900235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:37.902047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:38.153355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:38.156021 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:38.204728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:38.222978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:38.225890 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c044c961-ae09-42fe-b7da-8cfba9c0b6db tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.768861 Sep 25 01:03:38.238749 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 350/747] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:37 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:38.270825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:38.274313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:38.323104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:38.327497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:38.341088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:38.342896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:38.343391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:38.343836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:38.774431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e99437c7-006c-47e3-b79b-eac41945ad84 tempest-ServersAdminTestJSON-1460572438 tempest-ServersAdminTestJSON-1460572438-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1615 microversion: 2.1 time: 0.916401 Sep 25 01:03:38.776139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 398/748] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:37 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1615 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:38.781100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e23a052e-9bd6-400e-90aa-ce81ff0f0136 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf1c160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:38.863977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e23a052e-9bd6-400e-90aa-ce81ff0f0136 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.086488 Sep 25 01:03:38.864732 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 399/749] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:38 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:38.879266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:38.880281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:38.895963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:38.896887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:38.897644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:38.899278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:38.909727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:38.912092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:38.944624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:38.957748 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92d20c12-5bbb-4d4c-af7d-bbef26af4f4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.717273 Sep 25 01:03:38.959348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 351/750] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:38 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:38.964766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:38.965667 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:38.973066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:38.973869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:38.974479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:38.975383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:38.976004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:38.976581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.008023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:03:39.132087 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aadd2a4b-3e7b-4aa6-b8f6-5fc064cd06cd tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 204 len: 0 microversion: 2.1 time: 0.168899 Sep 25 01:03:39.138218 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 352/751] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:03:38 2022] DELETE /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:03:39.162043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:39.169131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:39.188548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.189795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.193671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.194754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.196795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.200038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.355184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.366791 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4dda8586-13bf-478f-a111-46c5eeb1bb95 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1215 microversion: 2.1 time: 0.500869 Sep 25 01:03:39.370137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 400/752] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:38 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1215 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:39.380628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:39.381848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:39.403627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.405742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.406637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.407959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.409159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.410420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.658066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.674763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce32d5b2-7d0b-4667-bca1-25ac8f24390d tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1468 microversion: 2.1 time: 0.528766 Sep 25 01:03:39.676996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 353/753] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:39 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1468 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:39.795428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.812042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.813896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.816139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1545a52-da6d-4bca-9efa-fac169320c5a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.442480 Sep 25 01:03:39.819852 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 401/754] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:39 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:39.888121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33806682-ab19-4447-9ae7-90dea89b1359 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf002cdc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:39.970409 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33806682-ab19-4447-9ae7-90dea89b1359 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.089772 Sep 25 01:03:39.974666 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 354/755] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:39 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:39.991802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:39.992898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:40.007400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.008491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.009196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.010161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.010935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.011589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.293596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:40.305979 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a7026691-faeb-4c28-932a-9657d611d5f1 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 0.318704 Sep 25 01:03:40.324240 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 402/756] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:39 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:40.396014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:40.397018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:40.430736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.431024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.431964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.433723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.443212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.444302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.610910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:40.634011 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73a3a94c-e0cf-4441-ad5a-0b727621a320 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1271 microversion: 2.1 time: 0.241961 Sep 25 01:03:40.635361 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 355/757] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:40 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:40.701388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:40.702230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:40.713743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.718215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.722393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.723518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.724173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.724806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.845230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:40.845870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:40.858799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.859319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.859767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.865195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.866244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.870921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.092044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:42.107663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:42.110878 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:42.120270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:42.123440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:42.141538 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e58b62a-0acd-436f-aa43-7c7f8f2c99ef tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 1.300617 Sep 25 01:03:42.146881 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 356/758] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:40 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:42.162852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48817c8f-5ae1-472d-94a3-b75c229fcfff tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf1daf0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:42.193858 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5448d75b-e413-43b0-838f-18442860d3eb tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1468 microversion: 2.1 time: 1.496174 Sep 25 01:03:42.220387 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 403/759] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:40 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1468 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:42.252606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:42.253267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:42.363362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.364484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.365191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.366501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.367228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.385138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.436463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48817c8f-5ae1-472d-94a3-b75c229fcfff tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1454 microversion: 2.1 time: 0.284768 Sep 25 01:03:42.449259 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 357/760] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:42 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1454 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:42.484746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-08d78429-5f99-4dd0-b88a-5a4bd28e333b req-6efc94d5-5d8d-4bf5-b8fa-2dc916a119c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59518b5d-19aa-4c65-bb04-07ee70ef436b", "name": "network-vif-plugged", "status": "completed", "tag": "3c2d629b-52bf-4176-be1b-5bed48860c09"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:42.542438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08d78429-5f99-4dd0-b88a-5a4bd28e333b req-6efc94d5-5d8d-4bf5-b8fa-2dc916a119c5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.544345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08d78429-5f99-4dd0-b88a-5a4bd28e333b req-6efc94d5-5d8d-4bf5-b8fa-2dc916a119c5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.545369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08d78429-5f99-4dd0-b88a-5a4bd28e333b req-6efc94d5-5d8d-4bf5-b8fa-2dc916a119c5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.620902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-08d78429-5f99-4dd0-b88a-5a4bd28e333b req-6efc94d5-5d8d-4bf5-b8fa-2dc916a119c5 service nova] Creating event network-vif-plugged:3c2d629b-52bf-4176-be1b-5bed48860c09 for instance 59518b5d-19aa-4c65-bb04-07ee70ef436b on n-h1-master-1 Sep 25 01:03:42.649592 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-08d78429-5f99-4dd0-b88a-5a4bd28e333b req-6efc94d5-5d8d-4bf5-b8fa-2dc916a119c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196577 Sep 25 01:03:42.662191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 358/761] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:42.702889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:42.710556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:42.736343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.736979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.738352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.739389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.745881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.746869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.351683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:43.395647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa2e2d22-ee5d-41e7-b714-0fd18192d641 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1277 microversion: 2.1 time: 0.728713 Sep 25 01:03:43.397826 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 359/762] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:42 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1277 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:43.413047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:43.414175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:43.428135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.432469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.433661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.435880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.437753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.438483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.903720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:43.919523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:43.924365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:43.927683 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe37ea06-87cd-4121-b83e-3cd3bba7e23d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 0.528463 Sep 25 01:03:43.933660 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 360/763] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:43 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:43.952562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:43.953313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:43.986448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.987371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.988489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.989632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.990402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.991071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.027664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:44.079379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-70d0db95-92a6-41bc-9cae-02bbee38f7ac tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1311 microversion: 2.1 time: 1.855745 Sep 25 01:03:44.081540 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 404/764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:42 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1311 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:44.101865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee15b269-59f2-4b6e-8f94-2c6d7ad4310c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf4aa60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:44.171809 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ee15b269-59f2-4b6e-8f94-2c6d7ad4310c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1463 microversion: 2.1 time: 0.086934 Sep 25 01:03:44.176660 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 405/765] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:44 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1463 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:44.202548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1c8a2b7-0e1e-4f8e-98af-809a50e8717a tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf1c700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:44.267871 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1c8a2b7-0e1e-4f8e-98af-809a50e8717a tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 200 len: 1463 microversion: 2.1 time: 0.069217 Sep 25 01:03:44.269851 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 406/766] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:44 2022] GET /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 1463 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:44.297179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:44.298618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:44.310581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.312829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.319538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.321566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.323641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.325063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.307464 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:45.324547 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-87e070d2-c213-4ebe-8ed9-00559bd4176c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 1480 microversion: 2.1 time: 1.035708 Sep 25 01:03:45.326543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 407/767] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:44 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 1480 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:45.336020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:45.336953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:45.344488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.345278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.345945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.348893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.349720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.350352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.391906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:45.404088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a4190cb-e394-4fb9-86a7-66e0af538878 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1468 microversion: 2.1 time: 1.469043 Sep 25 01:03:45.404680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 361/768] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:43 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1468 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:45.413384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-55009e76-d2b5-44d4-b714-20af01060c8e req-2f32f732-9781-4bb3-83af-6b3ebd136b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286adbb8-ab65-4c43-bd6c-d73ae0f11a6c", "name": "network-vif-plugged", "status": "completed", "tag": "250f468b-3568-4cf8-9c11-e739f9bd20cf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:45.491041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55009e76-d2b5-44d4-b714-20af01060c8e req-2f32f732-9781-4bb3-83af-6b3ebd136b51 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.509642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55009e76-d2b5-44d4-b714-20af01060c8e req-2f32f732-9781-4bb3-83af-6b3ebd136b51 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.510729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55009e76-d2b5-44d4-b714-20af01060c8e req-2f32f732-9781-4bb3-83af-6b3ebd136b51 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.590300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:45.592642 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-55009e76-d2b5-44d4-b714-20af01060c8e req-2f32f732-9781-4bb3-83af-6b3ebd136b51 service nova] Creating event network-vif-plugged:250f468b-3568-4cf8-9c11-e739f9bd20cf for instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c on n-h1-master-1 Sep 25 01:03:45.600452 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-45106481-928f-43c2-9527-55006fd3e066 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1277 microversion: 2.1 time: 0.271478 Sep 25 01:03:45.614975 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 408/769] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:45 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:45.628725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:45.632247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:45.634810 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-55009e76-d2b5-44d4-b714-20af01060c8e req-2f32f732-9781-4bb3-83af-6b3ebd136b51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227496 Sep 25 01:03:45.641338 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 362/770] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:45.666658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.670719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:45.670932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.672007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:45.674361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.675427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.678901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.679759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.695254 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=22 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:45.729822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.731391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.733352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.734930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.735996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.737671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.043377 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:46.690745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.735236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.741268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.751781 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ffba45c6-43f1-451a-8d34-7341ea7d0c4e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1362 microversion: 2.25 time: 1.135021 Sep 25 01:03:46.757106 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 409/771] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:45 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1362 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:46.771219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.801138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:46.803942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:46.817913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a433f40c-ff05-4826-bb3c-f9563c13eade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1493 microversion: 2.1 time: 1.167214 Sep 25 01:03:46.822559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 363/772] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:45 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1493 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:46.835611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.839713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.840527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.841899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.844648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d9ec47eb-11e1-4114-addf-0eb482d01e40 req-2a4a03ef-73c2-45c4-9445-013cee1911dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa95a264-1a20-4603-afec-9a327196920a", "name": "network-vif-deleted", "tag": "49af7cda-f46e-41cb-8981-c2ce676ada7d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:46.849689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.851950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.927366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d9ec47eb-11e1-4114-addf-0eb482d01e40 req-2a4a03ef-73c2-45c4-9445-013cee1911dd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.935434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d9ec47eb-11e1-4114-addf-0eb482d01e40 req-2a4a03ef-73c2-45c4-9445-013cee1911dd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.942437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d9ec47eb-11e1-4114-addf-0eb482d01e40 req-2a4a03ef-73c2-45c4-9445-013cee1911dd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.984307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d9ec47eb-11e1-4114-addf-0eb482d01e40 req-2a4a03ef-73c2-45c4-9445-013cee1911dd service nova] Creating event network-vif-deleted:49af7cda-f46e-41cb-8981-c2ce676ada7d for instance aa95a264-1a20-4603-afec-9a327196920a on n-h2-master-1 Sep 25 01:03:47.004896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d9ec47eb-11e1-4114-addf-0eb482d01e40 req-2a4a03ef-73c2-45c4-9445-013cee1911dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178101 Sep 25 01:03:47.007120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 364/773] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:47.025093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:47.027324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:47.050142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.051002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.051781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.053065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.059240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.060477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.125207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.126210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.127270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.128790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lazy-loading 'fault' on Instance uuid aa95a264-1a20-4603-afec-9a327196920a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:47.517371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:47.530864 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-139f78bd-182f-485b-be62-9c8eb1f03392 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 200 len: 1303 microversion: 2.1 time: 0.520191 Sep 25 01:03:47.531759 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 365/774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:47 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 1303 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:47.550504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:47.551592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:47.560758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.562935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.564547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.566184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.567396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.568009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.772316 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:48.006186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:48.021761 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8835df5d-058b-4882-9740-3f00b8810f7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 1467 microversion: 2.1 time: 1.261406 Sep 25 01:03:48.034499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 410/775] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:46 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 1467 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:48.039930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:48.041008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:48.052949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.053946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.054732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.055730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.056445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.058075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.717472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:48.758188 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34b9f546-21f5-4dc2-8420-81d590d7f2cb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 1.214371 Sep 25 01:03:48.759837 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 366/776] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:47 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:48.773648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:48.787204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:48.823028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.823658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.824306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.839083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.840067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.840970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.178622 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17567ca0-32e1-4988-8c7a-7cc4b3b1f61c tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1644 microversion: 2.1 time: 1.141300 Sep 25 01:03:49.202409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 411/777] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:48 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1644 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:49.214894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-802216960"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:49.224664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:49.241104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.245499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.246181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.246945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.247411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.247841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.718797 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-06476607-56e0-4e8a-96b4-4ef872753d7e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "POST /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499/action" status: 202 len: 0 microversion: 2.1 time: 0.514973 Sep 25 01:03:49.727068 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 412/778] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:49 2022] POST /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:03:49.743570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:49.746646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: aa95a264-1a20-4603-afec-9a327196920a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:49.756249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.757090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.757920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.773058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.773931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.774587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.816825 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] HTTP exception thrown: Instance aa95a264-1a20-4603-afec-9a327196920a could not be found. Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Request method failure captured: Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a HTTP/1.1 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hUuf9yYt70rzPhyFZgVmLUPnsY1Rflfeglhn-E4h8BNjbMO1IbH880RbSmOKKZSSFbGlapZ6QhnsypmUy8lNT1Mac_ZtnmPYD3-Vy60Zle2AhJjeN2eJhBtgHLcl9GEu-ZuT7AK10bYh0BgvRHX6OMP7pYQeSqp3F4AIo23TYG2p0 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 66b3353b3fbc4f97a0387a6c40e4fb15 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:03:49.820083 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66b3353b3fbc4f97a0387a6c40e4fb15"}]}] Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 66b3353b3fbc4f97a0387a6c40e4fb15 Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminTestJSON-2112613801-project Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2eddf0cd4fb54de2ab7f26843380a1be Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminTestJSON-2112613801-project Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: exception: Instance aa95a264-1a20-4603-afec-9a327196920a could not be found. Sep 25 01:03:49.821908 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'aa95a264-1a20-4603-afec-9a327196920a'} Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa95a264-1a20-4603-afec-9a327196920a could not be found. Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:49.822854 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa95a264-1a20-4603-afec-9a327196920a could not be found. Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa95a264-1a20-4603-afec-9a327196920a could not be found. Sep 25 01:03:49.824574 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:03:49.826023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Returning 404 to user: Instance aa95a264-1a20-4603-afec-9a327196920a could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:49.826023 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5e1ee178-4a47-49a0-bb5d-3e408ee34539 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a" status: 404 len: 111 microversion: 2.1 time: 0.094672 Sep 25 01:03:49.826023 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 413/779] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:49 2022] GET /compute/v2.1/servers/aa95a264-1a20-4603-afec-9a327196920a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:03:49.834210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-340ec59e-a10f-4bd5-8d35-5d4c655ceb45 req-1cb07d89-b01f-4eab-b3cc-7fd836e91475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "name": "network-vif-unplugged", "status": "completed", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:49.855710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-340ec59e-a10f-4bd5-8d35-5d4c655ceb45 req-1cb07d89-b01f-4eab-b3cc-7fd836e91475 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.856727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-340ec59e-a10f-4bd5-8d35-5d4c655ceb45 req-1cb07d89-b01f-4eab-b3cc-7fd836e91475 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.857888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-340ec59e-a10f-4bd5-8d35-5d4c655ceb45 req-1cb07d89-b01f-4eab-b3cc-7fd836e91475 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.878323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-340ec59e-a10f-4bd5-8d35-5d4c655ceb45 req-1cb07d89-b01f-4eab-b3cc-7fd836e91475 service nova] Creating event network-vif-unplugged:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:03:49.884600 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-340ec59e-a10f-4bd5-8d35-5d4c655ceb45 req-1cb07d89-b01f-4eab-b3cc-7fd836e91475 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057207 Sep 25 01:03:49.885293 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 414/780] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:49.895852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:49.896977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:49.905422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.906208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.906818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.908189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.909768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.910459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.913108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:49.927028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:49.929598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:49.938095 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21cbe7d3-a7de-410c-b060-ef456dca59dd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1558 microversion: 2.25 time: 1.175994 Sep 25 01:03:49.939268 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 367/781] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:48 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1558 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:49.944410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9c978d0f-95ef-4c24-b0c3-568a091a6151 req-fd7b4d52-dbc6-400c-9dfc-a04dd3a1c645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce85d75a-6d29-4271-8442-77904ee95690", "tag": "25f4c89c-6759-43ba-9e62-c6d960aa2e50"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:49.969454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9c978d0f-95ef-4c24-b0c3-568a091a6151 req-fd7b4d52-dbc6-400c-9dfc-a04dd3a1c645 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.969830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9c978d0f-95ef-4c24-b0c3-568a091a6151 req-fd7b4d52-dbc6-400c-9dfc-a04dd3a1c645 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.976690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9c978d0f-95ef-4c24-b0c3-568a091a6151 req-fd7b4d52-dbc6-400c-9dfc-a04dd3a1c645 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.024160 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9c978d0f-95ef-4c24-b0c3-568a091a6151 req-fd7b4d52-dbc6-400c-9dfc-a04dd3a1c645 service nova] Creating event network-changed:25f4c89c-6759-43ba-9e62-c6d960aa2e50 for instance ce85d75a-6d29-4271-8442-77904ee95690 on n-h2-master-1 Sep 25 01:03:50.042530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9c978d0f-95ef-4c24-b0c3-568a091a6151 req-fd7b4d52-dbc6-400c-9dfc-a04dd3a1c645 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100766 Sep 25 01:03:50.043424 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 368/782] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:50.057919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dcf2d64-f1f6-4edf-a2c1-2a970aa3ca5f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf02691f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:50.208335 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4dcf2d64-f1f6-4edf-a2c1-2a970aa3ca5f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.163017 Sep 25 01:03:50.210396 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 369/783] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:50 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:50.225665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:50.237873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:50.255867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.257196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.258346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.261028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.263147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.264641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.001686 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23973f66-0276-485e-b850-c17645bf4e5a tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1644 microversion: 2.1 time: 1.112360 Sep 25 01:03:51.004148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 415/784] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:49 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1644 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:51.009877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.010788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:51.018867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.019746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.020297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.021113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.021735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.022248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.058218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:03:51.146675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:51.169370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c00b10e0-5a8f-445f-af72-e7745b1b6f7e tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 204 len: 0 microversion: 2.1 time: 0.163038 Sep 25 01:03:51.175293 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 416/785] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:03:51 2022] DELETE /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:03:51.177796 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-264322fe-db96-49fc-904d-79c6415bcd8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 0.965077 Sep 25 01:03:51.178891 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 370/786] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:50 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:51.212212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.223255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.224680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.232063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.235302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.236489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.238184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.249269 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:51.326503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2594e795-c9e7-4d46-aabc-26a091c9f046 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.146103 Sep 25 01:03:51.327722 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 371/787] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:03:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:51.335345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.336342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:51.347306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.348301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.348984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.350610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.351905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.352732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.818830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.820329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:51.835634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.836537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.837714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.841492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.843063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.843790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.849065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:51.863479 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d157f841-79fb-4e40-b0a1-ad4c5cc62f00 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1468 microversion: 2.1 time: 0.533389 Sep 25 01:03:51.864055 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 372/788] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:51 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:51.878225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f20fe51b-6187-42de-a788-a997d2173bd3 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0269c10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.972479 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f20fe51b-6187-42de-a788-a997d2173bd3 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.104544 Sep 25 01:03:51.979116 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 373/789] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:51 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:51.990825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:51.991545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:52.015219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.015895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.016400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.017353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.024524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.025295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.153808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4857de2-3f69-4ce6-abfc-c9b7aab480b0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b/action" status: 202 len: 0 microversion: 2.1 time: 0.171858 Sep 25 01:03:52.155332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 374/790] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:51 2022] POST /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:03:52.167389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d7c7a56b-81db-4651-94d5-7098e4d68243 req-f6001f0a-6e55-4383-9b26-146ce699540b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a79880d-75b5-4e5c-b9f4-64aa404ea459", "tag": "6f216d4b-e2d8-41eb-95e5-189b7bf41410"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:52.187885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d7c7a56b-81db-4651-94d5-7098e4d68243 req-f6001f0a-6e55-4383-9b26-146ce699540b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.189344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d7c7a56b-81db-4651-94d5-7098e4d68243 req-f6001f0a-6e55-4383-9b26-146ce699540b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.191800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d7c7a56b-81db-4651-94d5-7098e4d68243 req-f6001f0a-6e55-4383-9b26-146ce699540b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.221488 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d7c7a56b-81db-4651-94d5-7098e4d68243 req-f6001f0a-6e55-4383-9b26-146ce699540b service nova] Creating event network-changed:6f216d4b-e2d8-41eb-95e5-189b7bf41410 for instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 on n-h2-master-1 Sep 25 01:03:52.231026 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d7c7a56b-81db-4651-94d5-7098e4d68243 req-f6001f0a-6e55-4383-9b26-146ce699540b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072706 Sep 25 01:03:52.232662 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 375/791] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:52.244054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:52.246102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:52.260891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.265817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.267182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.269177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.271495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.272695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.654720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:52.715896 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-694b6535-689d-47d2-acbe-087d0ce3c71b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 2051 microversion: 2.25 time: 1.539085 Sep 25 01:03:52.716675 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 417/792] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:51 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 2051 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:52.722911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:52.723803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:52.730916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.731758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.732519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.733563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.734246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.735290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.050720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b3e6bd53-c742-4e4c-804b-71dfab6aed9b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1649 microversion: 2.1 time: 0.815551 Sep 25 01:03:53.068236 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 376/793] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:52 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1649 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:53.088189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:53.090737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:53.110057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.112431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.114478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.116594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.118182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.119396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.310306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:53.325290 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b47a453e-b84f-4f3a-9ba6-5eb2b6e03835 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 0.607068 Sep 25 01:03:53.338148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 418/794] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:52 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:53.348218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:53.349112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:53.359167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.360022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.360683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.362258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.363266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.364061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.548268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:53.633582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bdb347e3-4008-4fc1-8cd2-b5c6b8b95d59 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 2051 microversion: 2.25 time: 0.553270 Sep 25 01:03:53.634680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 377/795] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:53 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 2051 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:53.641083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d1665638-a19b-492d-a6b5-e0543d1dd4a8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebfba550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:53.704313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:53.725081 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d1665638-a19b-492d-a6b5-e0543d1dd4a8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.089096 Sep 25 01:03:53.727905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fa3d36e1-4557-43a7-bfa6-0422c71b2954 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1468 microversion: 2.1 time: 0.388193 Sep 25 01:03:53.732856 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 378/796] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:53 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:53.745168 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 419/797] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:53 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1468 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:53.746912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:53.751073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.753513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.754285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.755138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.755778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.756472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.835459 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5654088e-257f-4fb8-8459-3410e1a3c54e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.101153 Sep 25 01:03:53.836941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 379/798] 10.222.0.16 () {60 vars in 1217 bytes} [Sun Sep 25 01:03:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:03:53.851689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:53.855304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:53.863769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.864268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.865044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.866022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.866825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.867735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.898807 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:53.913736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'flavor' on Instance uuid 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:53.930747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Going to try to live migrate instance to n-h2-master-1 {{(pid=122385) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:03:54.097587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:54.098550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:54.106568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.107676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.108359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.109359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.110425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.112649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.343294 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8c508b1-0f79-479e-89c3-40487aa23e1d tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1629 microversion: 2.1 time: 0.254918 Sep 25 01:03:54.348102 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 380/799] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:54 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1629 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:54.360860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:54.362322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:54.376490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.377925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.378724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.380686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.381336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.381952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.945372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:54.968596 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0dfbcc2a-4163-470f-9675-b3a64ab80ac1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 0.605788 Sep 25 01:03:54.969869 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 381/800] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:54 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:54.975590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:54.978950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:55.004073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.006175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.009849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.012300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.013153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.014748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.094004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lazy-loading 'flavor' on Instance uuid 59518b5d-19aa-4c65-bb04-07ee70ef436b {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:55.122678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Going to try to live migrate instance to n-h2-master-1 {{(pid=122384) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:03:58.263848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-edffbaef-8985-45d5-ad23-9e2a5dba49fc tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c/action" status: 202 len: 0 microversion: 2.25 time: 4.417523 Sep 25 01:03:58.267971 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 420/801] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:03:53 2022] POST /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c/action => generated 0 bytes in 4420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:03:58.271380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5bfd81c6-5e94-4805-9877-d3579a7b9903 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebdd3310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:58.420625 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5bfd81c6-5e94-4805-9877-d3579a7b9903 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.153630 Sep 25 01:03:58.422837 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 421/802] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:03:58 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:58.440903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:58.442101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:58.453077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.454211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.455993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.458680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.459395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.459991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.638537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:59.673343 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a298cb3-ebf4-493b-9e4c-5951b4cb9bf3 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1468 microversion: 2.1 time: 1.238571 Sep 25 01:03:59.702554 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 422/803] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:58 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1468 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:59.726368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:59.729433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:59.778418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:59.780664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:59.782102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.787439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:59.796141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:59.801966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.353033 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff24359b-13f0-489a-a247-5c099eb829df tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b/action" status: 202 len: 0 microversion: 2.1 time: 5.381483 Sep 25 01:04:00.353787 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 382/804] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:54 2022] POST /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b/action => generated 0 bytes in 5383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:00.358421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5d353569-5bab-4da2-9f1b-690909ff2634 req-bd629112-8697-4dd7-9a2d-fc272e8b3bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd08d518-6437-4fe3-9f18-80806e39a499", "name": "network-vif-plugged", "status": "completed", "tag": "fa5e21a1-b778-4eb1-8da8-eb1d745d41de"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:00.410620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5d353569-5bab-4da2-9f1b-690909ff2634 req-bd629112-8697-4dd7-9a2d-fc272e8b3bfa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.431098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5d353569-5bab-4da2-9f1b-690909ff2634 req-bd629112-8697-4dd7-9a2d-fc272e8b3bfa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.432030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5d353569-5bab-4da2-9f1b-690909ff2634 req-bd629112-8697-4dd7-9a2d-fc272e8b3bfa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.453815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:00.466763 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca1c4d82-2d6d-4e52-8a92-3f711feb2f73 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 0.762066 Sep 25 01:04:00.467791 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 423/805] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:59 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:00.486578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:00.487956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:00.497825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.498730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.499592 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5d353569-5bab-4da2-9f1b-690909ff2634 req-bd629112-8697-4dd7-9a2d-fc272e8b3bfa service nova] Creating event network-vif-plugged:fa5e21a1-b778-4eb1-8da8-eb1d745d41de for instance bd08d518-6437-4fe3-9f18-80806e39a499 on n-h1-master-1 Sep 25 01:04:00.499942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.501147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.502822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.504781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.511538 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5d353569-5bab-4da2-9f1b-690909ff2634 req-bd629112-8697-4dd7-9a2d-fc272e8b3bfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156585 Sep 25 01:04:00.512156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 383/806] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:00.525374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ca5898e-5312-472f-8306-a70dcfc3224f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebfb5040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:00.616133 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ca5898e-5312-472f-8306-a70dcfc3224f tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.100555 Sep 25 01:04:00.616761 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 384/807] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:00 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:00.641051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9a0d8fca-3cdb-4bc0-a095-ef8021886e66 req-8051b638-5a76-4570-8c91-5fd6eacb8d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e946773-1b66-480a-9649-0d43d11b5bec", "name": "network-vif-deleted", "tag": "39a86b01-b486-4428-aaa6-72b27f4471a8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:00.656919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9a0d8fca-3cdb-4bc0-a095-ef8021886e66 req-8051b638-5a76-4570-8c91-5fd6eacb8d3d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.657421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9a0d8fca-3cdb-4bc0-a095-ef8021886e66 req-8051b638-5a76-4570-8c91-5fd6eacb8d3d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.657862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9a0d8fca-3cdb-4bc0-a095-ef8021886e66 req-8051b638-5a76-4570-8c91-5fd6eacb8d3d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.683983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9a0d8fca-3cdb-4bc0-a095-ef8021886e66 req-8051b638-5a76-4570-8c91-5fd6eacb8d3d service nova] Creating event network-vif-deleted:39a86b01-b486-4428-aaa6-72b27f4471a8 for instance 4e946773-1b66-480a-9649-0d43d11b5bec on n-h2-master-1 Sep 25 01:04:00.695196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9a0d8fca-3cdb-4bc0-a095-ef8021886e66 req-8051b638-5a76-4570-8c91-5fd6eacb8d3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077187 Sep 25 01:04:00.695813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 385/808] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:00.708691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:00.709473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:00.722199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.722893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.723490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.724355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.725037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.725643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.291480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.310830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.318955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.324457 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5354d033-612d-4fce-a099-e3d805573daf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 0.850868 Sep 25 01:04:01.348618 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 424/809] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:00 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:01.364562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:01.367638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:01.400298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.402345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.402996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.403934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.404642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.405660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.709979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.733092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8fb55d50-9fb3-451e-b8fa-768835e9a9f6 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 200 len: 1426 microversion: 2.1 time: 0.382714 Sep 25 01:04:01.759664 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 425/810] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:01 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 1426 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:01.803352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:01.804555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:01.832332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.837000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.837671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.845348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.846193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.856996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.946829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.958164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d2c3909-209e-451f-898b-bdfffb02954c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 1.258896 Sep 25 01:04:01.958813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 386/811] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:00 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:01.964447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73f9a6c2-dbc9-4953-8e36-07bdecaadcc2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf016f430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:02.061329 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73f9a6c2-dbc9-4953-8e36-07bdecaadcc2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.100039 Sep 25 01:04:02.063194 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 387/812] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:01 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:02.356277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:02.356909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:02.366811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.373713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.374178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.375604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.378879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.380422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.522984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:03.537620 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0593b8d4-478f-41a2-a0bd-dd91c6cf367d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 1.776235 Sep 25 01:04:03.538601 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 426/813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:01 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:03.545429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3a1ed273-236e-4b1b-9d10-d8111a12106f req-44506376-3d30-49d5-b1b8-d7a20ea72cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce85d75a-6d29-4271-8442-77904ee95690", "name": "network-vif-plugged", "status": "completed", "tag": "25f4c89c-6759-43ba-9e62-c6d960aa2e50"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:03.554278 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:03.561068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3a1ed273-236e-4b1b-9d10-d8111a12106f req-44506376-3d30-49d5-b1b8-d7a20ea72cc4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.565750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3a1ed273-236e-4b1b-9d10-d8111a12106f req-44506376-3d30-49d5-b1b8-d7a20ea72cc4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.582160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3a1ed273-236e-4b1b-9d10-d8111a12106f req-44506376-3d30-49d5-b1b8-d7a20ea72cc4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.610018 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3a1ed273-236e-4b1b-9d10-d8111a12106f req-44506376-3d30-49d5-b1b8-d7a20ea72cc4 service nova] Creating event network-vif-plugged:25f4c89c-6759-43ba-9e62-c6d960aa2e50 for instance ce85d75a-6d29-4271-8442-77904ee95690 on n-h2-master-1 Sep 25 01:04:03.617474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3a1ed273-236e-4b1b-9d10-d8111a12106f req-44506376-3d30-49d5-b1b8-d7a20ea72cc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077431 Sep 25 01:04:03.629018 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 427/814] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:03.640397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:03.641430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: 4e946773-1b66-480a-9649-0d43d11b5bec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:03.674588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.675409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.676045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.677537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.678300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.679240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.743919 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] HTTP exception thrown: Instance 4e946773-1b66-480a-9649-0d43d11b5bec could not be found. Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Request method failure captured: Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec HTTP/1.1 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hUuf9yYt70rzPhyFZgVmLUPnsY1Rflfeglhn-E4h8BNjbMO1IbH880RbSmOKKZSSFbGlapZ6QhnsypmUy8lNT1Mac_ZtnmPYD3-Vy60Zle2AhJjeN2eJhBtgHLcl9GEu-ZuT7AK10bYh0BgvRHX6OMP7pYQeSqp3F4AIo23TYG2p0 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 66b3353b3fbc4f97a0387a6c40e4fb15 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:04:03.745701 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66b3353b3fbc4f97a0387a6c40e4fb15"}]}] Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 66b3353b3fbc4f97a0387a6c40e4fb15 Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminTestJSON-2112613801-project Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2eddf0cd4fb54de2ab7f26843380a1be Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminTestJSON-2112613801-project Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4e946773-1b66-480a-9649-0d43d11b5bec could not be found. Sep 25 01:04:03.747325 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4e946773-1b66-480a-9649-0d43d11b5bec'} Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e946773-1b66-480a-9649-0d43d11b5bec could not be found. Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:03.751213 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e946773-1b66-480a-9649-0d43d11b5bec could not be found. Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e946773-1b66-480a-9649-0d43d11b5bec could not be found. Sep 25 01:04:03.753238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:03.754625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Returning 404 to user: Instance 4e946773-1b66-480a-9649-0d43d11b5bec could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:03.754625 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e45ef107-1298-45a2-bf4f-5a686e0e7014 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec" status: 404 len: 111 microversion: 2.1 time: 0.116452 Sep 25 01:04:03.754625 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 428/815] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:03 2022] GET /compute/v2.1/servers/4e946773-1b66-480a-9649-0d43d11b5bec => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:03.761126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:03.761804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:03.784770 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:03.803935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.818130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.823257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.827075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.830169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.832650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.029118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.067202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.069103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.083256 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b21abca4-cad6-4b4a-b8c9-7c61208ad973 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 2.729378 Sep 25 01:04:05.086560 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 388/816] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:02 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:05.093259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-52b0cc2b-e95e-4200-ae0b-76e3972c0dcb tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebdf98b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:05.139377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.154760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eea58c07-a338-40e1-8696-910a5e1cba52 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 1.401787 Sep 25 01:04:05.162111 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 429/817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:03 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:05.178191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:05.181899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:05.204208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.204960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.205962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.206966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.207613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.208575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.210588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-52b0cc2b-e95e-4200-ae0b-76e3972c0dcb tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.122595 Sep 25 01:04:05.211184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 389/818] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:05 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:05.233667 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:05.239019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:05.259718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.260263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.260724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.266151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.266369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.266775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.294504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:04:05.517389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5e82b05-d717-4b7f-8e13-3f56ec1d188a tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 204 len: 0 microversion: 2.1 time: 0.345784 Sep 25 01:04:05.524900 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 430/819] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:04:05 2022] DELETE /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:04:05.547260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:05.550943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:05.576004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.577197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.578925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.580000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.583283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.583979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.464342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:06.480494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:06.493701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62bb799a-86ab-413d-a0f4-5844c0a3bb8c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 1.280541 Sep 25 01:04:06.496703 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 390/820] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:05 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:06.501241 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d74aad1-40a3-430a-bfa1-91d9f349d086 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1470 microversion: 2.1 time: 0.971434 Sep 25 01:04:06.506294 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 431/821] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:05 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1470 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:06.513789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:06.514660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:06.533194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:06.533389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:06.535551 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:06.542544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:06.543373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:06.543918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.549983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:06.550946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:06.551701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.563750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:06.569076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:06.569747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.571674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:06.574454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:06.574937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.193271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.203044 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cebad513-4916-4640-82e3-53006827bc54 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.694793 Sep 25 01:04:07.203714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 432/822] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:06 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:07.216457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-316d2dcd-1481-4f9e-8b1b-40b5190ab2e2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf03bf3a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:07.316765 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-316d2dcd-1481-4f9e-8b1b-40b5190ab2e2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.105793 Sep 25 01:04:07.318662 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 433/823] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:07 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:07.477054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.488797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.495415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.503754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0425c25-815e-46f7-8611-c206a33a020c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 0.980368 Sep 25 01:04:07.521386 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 391/824] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:06 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:07.528766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:07.530799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:07.535535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:07.536165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:07.548938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.554759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.555349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.555804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.556492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.556684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.557012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.557467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.559009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.563690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.565499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.569672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.241776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:08.259086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:08.268720 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:08.271776 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12136c6a-a575-48f5-9ebe-b57989890afb tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 0.754827 Sep 25 01:04:08.272464 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 434/825] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:07 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:08.275179 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b8ae0ac-ce4b-4b06-a034-b702b7de5cba tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1470 microversion: 2.1 time: 0.743585 Sep 25 01:04:08.276326 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 392/826] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:07 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1470 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:08.288957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:08.289986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:08.309480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.311191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.319566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.320896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.321589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.322334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.336791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67762efe-58c3-400f-bb38-c5a60018fdb8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebdd1a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:08.549851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67762efe-58c3-400f-bb38-c5a60018fdb8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1454 microversion: 2.1 time: 0.219967 Sep 25 01:04:08.552155 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 435/827] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:08 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:08.566419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4eb6144f-d924-4c81-8a64-f14229cb272f req-0813d6f0-e7ad-456b-896b-ef83d406302e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a79880d-75b5-4e5c-b9f4-64aa404ea459", "name": "network-vif-plugged", "status": "completed", "tag": "6f216d4b-e2d8-41eb-95e5-189b7bf41410"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:08.586220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4eb6144f-d924-4c81-8a64-f14229cb272f req-0813d6f0-e7ad-456b-896b-ef83d406302e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.587044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4eb6144f-d924-4c81-8a64-f14229cb272f req-0813d6f0-e7ad-456b-896b-ef83d406302e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.588558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4eb6144f-d924-4c81-8a64-f14229cb272f req-0813d6f0-e7ad-456b-896b-ef83d406302e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.604047 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4eb6144f-d924-4c81-8a64-f14229cb272f req-0813d6f0-e7ad-456b-896b-ef83d406302e service nova] Creating event network-vif-plugged:6f216d4b-e2d8-41eb-95e5-189b7bf41410 for instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 on n-h2-master-1 Sep 25 01:04:08.610260 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4eb6144f-d924-4c81-8a64-f14229cb272f req-0813d6f0-e7ad-456b-896b-ef83d406302e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056361 Sep 25 01:04:08.612637 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 436/828] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:08.622027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:08.625219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:08.646129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.646892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.650998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.652099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.652790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.653963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:09.863923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:09.898177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:09.901467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:09.903793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50528858-2976-4a10-a040-7808f45c3015 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 1.288988 Sep 25 01:04:09.907220 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 437/829] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:08 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:09.930240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:09.931894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:09.950698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:09.954500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:09.958024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:09.965183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:09.966542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:09.967818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.069790 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:10.290466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.312184 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfc194da-0eca-4f51-902f-e7c98f2943b8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 2.024384 Sep 25 01:04:10.317695 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 393/830] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:08 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:10.333252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:10.340786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:10.359318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.359830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.360282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.361058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.361968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.367458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.677095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.698174 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d99a6ab1-48c9-4353-b80b-7e3cec418cb7 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1319 microversion: 2.1 time: 0.784594 Sep 25 01:04:10.702243 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 438/831] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:09 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1319 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:10.709436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49d5f753-118a-487e-9e9e-0dd3b38ad8a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0a21af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:10.911957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eddf0cd4fb54de2ab7f26843380a1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66b3353b3fbc4f97a0387a6c40e4fb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.942979 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b01ad3d5-20f6-401e-a765-02f96af6e806 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 200 len: 1470 microversion: 2.1 time: 0.623320 Sep 25 01:04:10.947265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 394/832] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:10 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:10.962635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:10.972308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:10.996082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.996874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.997565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.998484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.999239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.999835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:11.715217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.741234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.754910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.763010 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cb11a960-a4dc-497b-89ab-d28fa1d0399a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 0.809334 Sep 25 01:04:11.767102 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 395/833] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:10 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:11.784476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:11.806635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:11.843135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:11.846886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:11.864011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:11.869570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:11.870064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:11.874724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:12.486906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:12.498310 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c26f1d23-982e-4fcc-b1a7-a6266e0ec6b9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.729053 Sep 25 01:04:12.514357 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 396/834] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:11 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:12.514357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fc904ea1-58ed-48db-b9dc-b43e931abea0 req-66dde664-97a9-476c-8d2f-c1699b441750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286adbb8-ab65-4c43-bd6c-d73ae0f11a6c", "name": "network-vif-unplugged", "status": "completed", "tag": "250f468b-3568-4cf8-9c11-e739f9bd20cf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:12.525050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fc904ea1-58ed-48db-b9dc-b43e931abea0 req-66dde664-97a9-476c-8d2f-c1699b441750 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:12.525592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fc904ea1-58ed-48db-b9dc-b43e931abea0 req-66dde664-97a9-476c-8d2f-c1699b441750 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:12.526029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fc904ea1-58ed-48db-b9dc-b43e931abea0 req-66dde664-97a9-476c-8d2f-c1699b441750 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:12.563477 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fc904ea1-58ed-48db-b9dc-b43e931abea0 req-66dde664-97a9-476c-8d2f-c1699b441750 service nova] Creating event network-vif-unplugged:250f468b-3568-4cf8-9c11-e739f9bd20cf for instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c on n-h1-master-1 Sep 25 01:04:12.584458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fc904ea1-58ed-48db-b9dc-b43e931abea0 req-66dde664-97a9-476c-8d2f-c1699b441750 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079547 Sep 25 01:04:12.597659 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 397/835] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:12.609811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:12.610565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:12.634143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:12.635210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:12.635669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:12.638723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:12.639219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:12.639662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.310159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.333321 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c12c11b7-9381-4545-84fe-84c20446b500 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1468 microversion: 2.1 time: 0.732731 Sep 25 01:04:13.333983 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 398/836] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:12 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1468 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:13.348343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:13.349818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] [instance: d0a01236-83f5-4729-abc0-e5ea5216c149] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:13.364183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.366403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.367669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.373244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.374039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.377242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.414641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] HTTP exception thrown: Instance d0a01236-83f5-4729-abc0-e5ea5216c149 could not be found. Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Request method failure captured: Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 HTTP/1.1 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hUuf9yYt70rzPhyFZgVmLUPnsY1Rflfeglhn-E4h8BNjbMO1IbH880RbSmOKKZSSFbGlapZ6QhnsypmUy8lNT1Mac_ZtnmPYD3-Vy60Zle2AhJjeN2eJhBtgHLcl9GEu-ZuT7AK10bYh0BgvRHX6OMP7pYQeSqp3F4AIo23TYG2p0 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 66b3353b3fbc4f97a0387a6c40e4fb15 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:13.419726 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66b3353b3fbc4f97a0387a6c40e4fb15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66b3353b3fbc4f97a0387a6c40e4fb15"}]}] Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 66b3353b3fbc4f97a0387a6c40e4fb15 Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersAdminTestJSON-2112613801 Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersAdminTestJSON-2112613801-project Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 2eddf0cd4fb54de2ab7f26843380a1be Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersAdminTestJSON-2112613801-project Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: exception: Instance d0a01236-83f5-4729-abc0-e5ea5216c149 could not be found. Sep 25 01:04:13.421484 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'd0a01236-83f5-4729-abc0-e5ea5216c149'} Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a01236-83f5-4729-abc0-e5ea5216c149 could not be found. Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:13.422486 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a01236-83f5-4729-abc0-e5ea5216c149 could not be found. Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a01236-83f5-4729-abc0-e5ea5216c149 could not be found. Sep 25 01:04:13.424135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:13.432896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] Returning 404 to user: Instance d0a01236-83f5-4729-abc0-e5ea5216c149 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:13.433810 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f9b351b-e8c3-40e5-9956-b33cc7389298 tempest-ServersAdminTestJSON-2112613801 tempest-ServersAdminTestJSON-2112613801-project] 10.222.0.16 "GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149" status: 404 len: 111 microversion: 2.1 time: 0.097923 Sep 25 01:04:13.441925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 399/837] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:13 2022] GET /compute/v2.1/servers/d0a01236-83f5-4729-abc0-e5ea5216c149 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:13.446545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:13.447263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:13.464239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.464735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.465175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.466345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.466807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.467239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.846682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.864548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.869734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.873434 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e60e2006-65dc-4eac-80c4-369e8a420829 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 0.433078 Sep 25 01:04:13.876375 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 400/838] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:13 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:13.889739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:13.891052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:13.911404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.912016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.913543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.917031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.918798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.920518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.338803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:14.374379 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86298958-9986-4715-87a4-b6f14bd7d150 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 200 len: 1469 microversion: 2.1 time: 0.478814 Sep 25 01:04:14.376813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 401/839] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:13 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:14.386126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:14.399387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:14.424809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.431081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.433558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.435998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.438747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.441133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.972055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:14.985309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02dd89f7-a322-44d7-98c4-b33a97a78724 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.605138 Sep 25 01:04:14.992596 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 402/840] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:14 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:14.998078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:15.008170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:15.009580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Searching by: {'reservation_id': 'r-7sislo6n', 'deleted': False, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:04:15.028184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.028645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.029296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.030499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.031226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.031989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.231647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:04:15.485485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:15.500109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.501214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.502751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.925342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-870f0887-f4b8-4d52-b113-f666e7c39fab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-7sislo6n" status: 200 len: 2930 microversion: 2.1 time: 0.931379 Sep 25 01:04:15.926022 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 403/841] 10.222.0.16 () {58 vars in 1197 bytes} [Sun Sep 25 01:04:14 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7sislo6n => generated 2930 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:15.932352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a01236-83f5-4729-abc0-e5ea5216c149", "name": "network-vif-deleted", "tag": "e206c3b6-9c60-4ad7-a75d-fbab32498809"}, {"name": "network-changed", "server_uuid": "286adbb8-ab65-4c43-bd6c-d73ae0f11a6c", "tag": "250f468b-3568-4cf8-9c11-e739f9bd20cf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:15.993589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.998606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.999324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:16.040881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] Creating event network-vif-deleted:e206c3b6-9c60-4ad7-a75d-fbab32498809 for instance d0a01236-83f5-4729-abc0-e5ea5216c149 on n-h2-master-1 Sep 25 01:04:16.041570 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] Creating event network-changed:250f468b-3568-4cf8-9c11-e739f9bd20cf for instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c on n-h1-master-1 Sep 25 01:04:16.066139 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-db54162e-f0a1-4e3e-bd1b-f086f7b76fe7 req-c3c58ee9-a8ed-4304-9a58-9be5f34cab04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.138210 Sep 25 01:04:16.074285 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 404/842] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:16.086089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:16.087613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:16.112701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.113602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.114251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:16.115193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.118070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.118732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:16.555354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:16.582524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:16.592370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:16.602651 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6dc6faf2-928b-4080-a3f7-5f4968ec6989 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 0.521572 Sep 25 01:04:16.606850 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 405/843] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:16 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:16.626269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56ce96f1-ac65-49ed-a6af-24828ad283dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:16.697629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.server_groups [None req-56ce96f1-ac65-49ed-a6af-24828ad283dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Querying cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) for 2 instances {{(pid=122384) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 25 01:04:16.701359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56ce96f1-ac65-49ed-a6af-24828ad283dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.702289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56ce96f1-ac65-49ed-a6af-24828ad283dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.702413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56ce96f1-ac65-49ed-a6af-24828ad283dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:16.793894 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56ce96f1-ac65-49ed-a6af-24828ad283dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/0f0b4f56-756f-4d89-b413-02f07b5e36f8" status: 200 len: 266 microversion: 2.1 time: 0.185031 Sep 25 01:04:16.806738 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 406/844] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:04:16 2022] GET /compute/v2.1/os-server-groups/0f0b4f56-756f-4d89-b413-02f07b5e36f8 => generated 266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:16.818748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:16.819377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:16.837869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.838375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.838817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:16.848098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.848726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.849180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:17.069039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:17.081662 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9057e674-0ec0-4bc8-95fa-af382da00cc2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.272065 Sep 25 01:04:17.082511 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 407/845] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:16 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:17.087490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:17.091546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:17.101851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:17.102753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:17.104583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:17.106269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:17.106939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:17.107674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:17.417977 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d313a93-e763-434d-af95-6f07449126ac tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 200 len: 1619 microversion: 2.1 time: 0.333418 Sep 25 01:04:17.421222 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 408/846] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:17 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 1619 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:17.989370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b945e64-cbe9-4e13-a858-c4a3ac691d09 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Action: 'create', calling method: .version_select at 0x7f7bebdd9280>, body: {"pool": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:19.950576 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:20.258330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b945e64-cbe9-4e13-a858-c4a3ac691d09 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.835775 Sep 25 01:04:20.259065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 409/847] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:04:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:20.264748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:20.265954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:20.279897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.283816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.288478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.289561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.290461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.291070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.562149 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5614490a-6e92-4a99-bf9b-068797c96de6 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 200 len: 1620 microversion: 2.1 time: 0.301863 Sep 25 01:04:20.563610 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 410/848] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:20 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 1620 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:20.569159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:20.569985 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:20.577251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.577951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.578535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.579469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.580823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.591472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.698147 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:20.817113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:20.843827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:20.847263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:20.848566 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d52f182d-afac-462a-aeee-efa2ad5b9ecf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1568 microversion: 2.25 time: 0.283213 Sep 25 01:04:20.850476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 411/849] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:20 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:20.854818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:20.858344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:20.864499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.864995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.865457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.866457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.867208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.867651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.872172 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:21.123841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:21.143461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-118063a7-0b59-44b7-bee9-4d7c2e83ee2c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.291497 Sep 25 01:04:21.163788 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 412/850] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:20 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:21.198319 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49d5f753-118a-487e-9e9e-0dd3b38ad8a0 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1463 microversion: 2.1 time: 10.493628 Sep 25 01:04:21.199258 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 439/851] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:10 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1463 bytes in 10496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:21.207522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67c52516-6ab0-4dd2-a709-11b8ce8392ad tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Action: 'create', calling method: .version_select at 0x7f7bebdd38b0>, body: {"pool": null} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:21.362346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f50d09bb-9404-4381-a3e0-3a85d67717cd tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:21.376853 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f50d09bb-9404-4381-a3e0-3a85d67717cd tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.211336 Sep 25 01:04:21.377899 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 413/852] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:21.385522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a60c32c8-b221-4524-add7-fb098e7c50a8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: .version_select at 0x7f7bebdf98b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1643018391", "policies": ["anti-affinity"]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:21.424001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a60c32c8-b221-4524-add7-fb098e7c50a8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:21.431387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a60c32c8-b221-4524-add7-fb098e7c50a8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:21.511538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a60c32c8-b221-4524-add7-fb098e7c50a8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:21.517184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a60c32c8-b221-4524-add7-fb098e7c50a8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:21.538442 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a60c32c8-b221-4524-add7-fb098e7c50a8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.158894 Sep 25 01:04:21.540142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 414/853] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:04:21 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:21.544963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ffaef90-fd37-4a1b-97a0-7f937888b09a tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf05d9d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:21.686070 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ffaef90-fd37-4a1b-97a0-7f937888b09a tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 200 len: 1463 microversion: 2.1 time: 0.144669 Sep 25 01:04:21.686976 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 415/854] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:21 2022] GET /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:21.703197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfb11a29-2c27-4aba-85f5-d552da79665a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:21.747184 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfb11a29-2c27-4aba-85f5-d552da79665a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3077 microversion: 2.1 time: 0.059123 Sep 25 01:04:21.754718 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 416/855] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:04:21 2022] GET /compute/v2.1/flavors => generated 3077 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:21.760023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:21.760759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:21.775112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:21.775687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:21.776202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:21.777032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:21.777485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:21.777914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:22.421859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:22.435071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b365f58-b5fe-4fb9-b838-3477de7e91fa tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1467 microversion: 2.1 time: 0.678514 Sep 25 01:04:22.436361 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 417/856] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:21 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1467 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:22.448170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ad3a997-fb81-4b57-b469-07c57c015754 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:22.471571 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ad3a997-fb81-4b57-b469-07c57c015754 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028588 Sep 25 01:04:22.472901 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 418/857] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:22.481077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-427680943", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "09263558-8be0-4f2e-815e-94ffecf58828"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:22.560712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:04:23.215128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:04:23.215663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:04:23.216253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:04:23.216762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:04:23.217460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:04:23.234406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.235035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.235597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.236990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.237666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.238199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.260882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:23.270141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:23.285206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Going to run 2 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:04:23.288054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:04:23.333939 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:23.351826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:23.357300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:23.395421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:23.400357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:23.416109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=e79be9a3-4950-4b44-9458-276628f72902,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:04:23.482042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:23.489463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:23.545032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:23.554151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:23.604002 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad276a02-57ba-4c50-9900-1d007999c4ad tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.129383 Sep 25 01:04:23.605827 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 419/858] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:04:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1132 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:04:23.623011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:23.626263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:23.633824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.634501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.634956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.635681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.636785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.637251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.974480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.990332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.992102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.994617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95e90935-a779-4c51-9cb4-3f98cc41afd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1558 microversion: 2.25 time: 0.387424 Sep 25 01:04:24.001849 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 420/859] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:23 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1558 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:24.007805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.008759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:24.033427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.034032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.036179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.038324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.039827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.040284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.192705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67c52516-6ab0-4dd2-a709-11b8ce8392ad tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.991573 Sep 25 01:04:24.197713 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 440/860] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:04:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:24.214945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1141091074"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:24.217648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:24.230268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.230268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.230268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.230268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.230862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.230862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.246210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:24.256790 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4023b5eb-c391-4c84-800e-5885c2520154 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.259015 Sep 25 01:04:24.257513 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 421/861] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:23 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:24.275559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b8304a2d-4ef0-4c8d-b8cd-702dbabc8cd6 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.285735 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b8304a2d-4ef0-4c8d-b8cd-702dbabc8cd6 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026635 Sep 25 01:04:24.286329 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 422/862] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:24.293721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.296471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:24.297147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Searching by: {'deleted': False, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:04:24.315638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.316130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.316571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.317303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.317781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.318399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.351957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:04:24.384297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b3bed57-5243-4373-b390-457de06dd44d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.096859 Sep 25 01:04:24.384910 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 423/863] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/servers => generated 1664 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:24.393228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c44a21b-75ad-42ab-bf35-cb73a21b02be tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '.version_select at 0x7f7bf000a550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.394265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c44a21b-75ad-42ab-bf35-cb73a21b02be tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.394747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c44a21b-75ad-42ab-bf35-cb73a21b02be tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.395186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c44a21b-75ad-42ab-bf35-cb73a21b02be tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.415231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c44a21b-75ad-42ab-bf35-cb73a21b02be tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1763 microversion: 2.25 time: 0.028817 Sep 25 01:04:24.416193 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 424/864] 10.222.0.16 () {60 vars in 1184 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/os-migrations => generated 1763 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:24.422028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af871a38-1495-4310-b087-a73ec0541a0e tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Action: 'create', calling method: .version_select at 0x7f7bebdf44c0>, body: {"pool": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:24.580233 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6eb6464-cc96-44dc-af2f-3158a3c3050c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "POST /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1/action" status: 202 len: 0 microversion: 2.1 time: 0.372299 Sep 25 01:04:24.582077 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 441/865] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:04:24 2022] POST /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:04:24.588410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db2586b8-dad8-4466-b68c-d9f4237b8cf2 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.625515 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db2586b8-dad8-4466-b68c-d9f4237b8cf2 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.041780 Sep 25 01:04:24.627293 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 442/866] 10.222.0.16 () {58 vars in 1165 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:24.632430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15301a6c-cd35-439e-a922-94c4383a46d0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.633635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15301a6c-cd35-439e-a922-94c4383a46d0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:24.766349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15301a6c-cd35-439e-a922-94c4383a46d0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:24.796034 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15301a6c-cd35-439e-a922-94c4383a46d0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1218 microversion: 2.1 time: 0.147970 Sep 25 01:04:24.796034 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 443/867] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:24.796034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.796034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:24.815108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.815635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.816089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.816833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.817309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.833874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.216179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:04:25.254051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae298eff-3a50-4e4d-ac95-413fa790c370 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 2051 microversion: 2.25 time: 0.475557 Sep 25 01:04:25.254643 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 444/868] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 2051 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:25.259702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-625c8d8e-557b-4adf-a78f-6b030c2f1d81 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebfb3af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:25.347294 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-625c8d8e-557b-4adf-a78f-6b030c2f1d81 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.086611 Sep 25 01:04:25.348753 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 445/869] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:25 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:25.358067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4cd6a36e-ea60-4c8c-b71b-5141397326df tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:25.382832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4cd6a36e-ea60-4c8c-b71b-5141397326df tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028509 Sep 25 01:04:25.383791 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 446/870] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:25.389145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-444a7571-2c00-45ec-bac3-a0a1ec3235bc req-f7bb9aca-dda3-4343-bee6-0349cf50d575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd08d518-6437-4fe3-9f18-80806e39a499", "name": "network-vif-unplugged", "status": "completed", "tag": "fa5e21a1-b778-4eb1-8da8-eb1d745d41de"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:25.402544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-444a7571-2c00-45ec-bac3-a0a1ec3235bc req-f7bb9aca-dda3-4343-bee6-0349cf50d575 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:25.403044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-444a7571-2c00-45ec-bac3-a0a1ec3235bc req-f7bb9aca-dda3-4343-bee6-0349cf50d575 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:25.403487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-444a7571-2c00-45ec-bac3-a0a1ec3235bc req-f7bb9aca-dda3-4343-bee6-0349cf50d575 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.428313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-444a7571-2c00-45ec-bac3-a0a1ec3235bc req-f7bb9aca-dda3-4343-bee6-0349cf50d575 service nova] Creating event network-vif-unplugged:fa5e21a1-b778-4eb1-8da8-eb1d745d41de for instance bd08d518-6437-4fe3-9f18-80806e39a499 on n-h1-master-1 Sep 25 01:04:25.443071 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-444a7571-2c00-45ec-bac3-a0a1ec3235bc req-f7bb9aca-dda3-4343-bee6-0349cf50d575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057608 Sep 25 01:04:25.444385 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 447/871] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:25.467198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:25.468531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:25.484941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:25.485736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:25.487090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.488351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:25.489013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:25.490490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.747443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:25.765187 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41ffaa5b-975c-4cc4-a6b7-519195537659 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.307473 Sep 25 01:04:25.766518 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 448/872] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:25 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:25.772973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d08f054c-1c3e-47c7-818d-b3eb5388e07d tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:25.812029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d08f054c-1c3e-47c7-818d-b3eb5388e07d tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.042300 Sep 25 01:04:25.813440 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 449/873] 10.222.0.16 () {58 vars in 1169 bytes} [Sun Sep 25 01:04:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:25.819343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1009356401", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "defca061-1fc0-4eb4-a3fe-f0e809a541e4"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:25.890251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] validate_networks() for [('defca061-1fc0-4eb4-a3fe-f0e809a541e4', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:04:26.936434 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af871a38-1495-4310-b087-a73ec0541a0e tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.517960 Sep 25 01:04:26.938666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:04:26.940472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:04:26.941133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:04:26.941748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:04:26.942324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:04:26.950479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 425/874] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:04:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:26.955864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.956627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.957255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.957669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:26.958292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:26.958583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.959204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.959809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.965993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.966487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.966925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.967634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.968088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.968517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.981103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:26.987036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for user 545456a4a4e540be9138c47b0df77bbf and project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:27.000278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:04:27.003597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:04:27.075464 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-731ff35a-42bb-436e-b973-670d7f6fd42d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.259905 Sep 25 01:04:27.076132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 450/875] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:04:27.092096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe9fbd30-f32c-4584-8dd9-0ea366bd4d19 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:27.119696 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe9fbd30-f32c-4584-8dd9-0ea366bd4d19 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.042454 Sep 25 01:04:27.130643 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 451/876] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:04:27 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:27.135161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eba4458e-57df-4c5e-b31a-f72ea48ddf5e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebdd00d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:27.229098 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eba4458e-57df-4c5e-b31a-f72ea48ddf5e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.101247 Sep 25 01:04:27.230285 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 452/877] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:27 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:27.245444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:27.246312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:27.267702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.268450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.268928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:27.269735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.270477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.271205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:27.431757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:27.450462 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-788522ee-72f7-4ae0-acdd-e7078ddb3f08 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1270 microversion: 2.1 time: 0.498733 Sep 25 01:04:27.459738 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 426/878] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:26 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1270 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:27.474670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-50dd30ae-bda0-4eb5-a72b-63a42e01c163 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Action: 'create', calling method: .version_select at 0x7f7bf000a5e0>, body: {"pool": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:27.839217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:27.862822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-075d63cc-c71c-458d-b9ae-aa8bea06fd99 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.621582 Sep 25 01:04:27.882688 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 453/879] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:27 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:27.909961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:27.910993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:27.925196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.925806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.926602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:27.928151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.928631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.929072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:28.101169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.111784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.113693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.115576 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-708b47f8-1585-40e7-aadd-89ff4f885841 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1266 microversion: 2.25 time: 0.219944 Sep 25 01:04:28.133631 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 454/880] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:27 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:28.143671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63e63e56-b779-4ee6-a989-5939505bd690 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.157007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63e63e56-b779-4ee6-a989-5939505bd690 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021280 Sep 25 01:04:28.157715 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 455/881] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:28.179188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d44c70af-67cf-4f86-88df-8df1a5f89a9e tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.268039 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d44c70af-67cf-4f86-88df-8df1a5f89a9e tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2911 microversion: 2.1 time: 0.100450 Sep 25 01:04:28.277657 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 456/882] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2911 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:28.285912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-06f66309-9db5-48d1-90f8-aa743308934b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebfb3670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.372230 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-06f66309-9db5-48d1-90f8-aa743308934b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.101874 Sep 25 01:04:28.373725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 457/883] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:28.379822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57e514e6-6d32-4465-958d-e66b5233273a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.394054 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57e514e6-6d32-4465-958d-e66b5233273a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017686 Sep 25 01:04:28.395563 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 458/884] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:28.417167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bb1d21a-1e41-41c7-8fd3-020491fdeef1 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.458445 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9bb1d21a-1e41-41c7-8fd3-020491fdeef1 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.048059 Sep 25 01:04:28.459982 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 459/885] 10.222.0.16 () {58 vars in 1144 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:28.477506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1abe3db3-2898-4ff5-b8b8-c9fd3a6a630a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.509392 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1abe3db3-2898-4ff5-b8b8-c9fd3a6a630a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036536 Sep 25 01:04:28.515655 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 460/886] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:04:28.539396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.540976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:28.554728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:28.555000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:28.555633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:28.556383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:28.558021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:28.559455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:28.720981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.732056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6accbba2-be8d-4729-9f95-f9ee6538f00b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1276 microversion: 2.1 time: 0.213949 Sep 25 01:04:28.733670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 461/887] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:28.740546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd5922ff-b156-4991-8a6f-80d47f42abfa tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.765196 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd5922ff-b156-4991-8a6f-80d47f42abfa tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028749 Sep 25 01:04:28.777463 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 462/888] 10.222.0.16 () {58 vars in 1148 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:28.783478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-257380f3-3305-43e4-a372-4e09dd7e99a8 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.800310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-257380f3-3305-43e4-a372-4e09dd7e99a8 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020443 Sep 25 01:04:28.809659 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 463/889] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:28.815488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3531e9a7-6d8c-4e8a-9aa4-da07a8440019 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.826059 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3531e9a7-6d8c-4e8a-9aa4-da07a8440019 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014691 Sep 25 01:04:28.829978 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 464/890] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:28.841117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0185591-3f99-4421-816e-d73c76c3145a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.864922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0185591-3f99-4421-816e-d73c76c3145a tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1540 microversion: 2.1 time: 0.029133 Sep 25 01:04:28.865547 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 465/891] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors?marker=452 => generated 1540 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:28.883215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f426ee78-e1ea-4dc6-8877-36c550bcf7e7 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.990120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f426ee78-e1ea-4dc6-8877-36c550bcf7e7 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.111592 Sep 25 01:04:29.018403 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 466/892] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:29.024539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:29.027071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:29.035452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.036360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.037058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.038062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.038848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.040244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.602390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:29.618152 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c52a3961-9ab2-4717-b7a0-2d44c6d7a009 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.598134 Sep 25 01:04:29.633445 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 467/893] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:29 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:29.683024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e8e0571-f696-40c4-821d-7f85544c7315 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:29.701512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e8e0571-f696-40c4-821d-7f85544c7315 tempest-FlavorsV2TestJSON-831638888 tempest-FlavorsV2TestJSON-831638888-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061490 Sep 25 01:04:29.704030 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 468/894] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:04:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:29.719556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:29.721391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:29.755125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.755792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.756443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.758677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.760506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.761020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:30.511140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:30.538924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:30.550020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:30.552396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff23b0b5-94dd-4e8b-b695-eb3a70b48af1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1320 microversion: 2.25 time: 0.845438 Sep 25 01:04:30.558003 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 469/895] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:29 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1320 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:30.574588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-81415e22-b97c-45ef-a5ad-04c3c0d1f756 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebfb35e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:30.682596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-81415e22-b97c-45ef-a5ad-04c3c0d1f756 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.123187 Sep 25 01:04:30.692009 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 470/896] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:30 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:30.709715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:30.710826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:30.722217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:30.722995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:30.724405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:30.727543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:30.728208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:30.730575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:32.053526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:32.065305 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3290e9b2-4ec6-4ac1-973a-053548b25651 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1318 microversion: 2.1 time: 1.372077 Sep 25 01:04:32.067613 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 471/897] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:30 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1318 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:32.089717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:32.092772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:32.111576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:32.112460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:32.115236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:32.116219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:32.116856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:32.117793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:32.195722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:04:32.397106 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8623d465-2037-4e6f-96d7-88877f25e807 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 204 len: 0 microversion: 2.1 time: 0.326094 Sep 25 01:04:32.397763 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 472/898] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:04:32 2022] DELETE /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:04:32.410450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:32.411149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:32.429090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:32.430720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:32.431207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:32.431947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:32.432419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:32.432854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.324508 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-50dd30ae-bda0-4eb5-a72b-63a42e01c163 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.859137 Sep 25 01:04:33.326768 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 427/899] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:04:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:33.343026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3ce98a0d-454b-48e0-9468-6f6ccdbf5a86 req-3faa8921-4f72-4ec9-b40e-ef9be1175451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "name": "network-vif-plugged", "status": "completed", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:33.401356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:33.414105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3ce98a0d-454b-48e0-9468-6f6ccdbf5a86 req-3faa8921-4f72-4ec9-b40e-ef9be1175451 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.416893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3ce98a0d-454b-48e0-9468-6f6ccdbf5a86 req-3faa8921-4f72-4ec9-b40e-ef9be1175451 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.417665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3ce98a0d-454b-48e0-9468-6f6ccdbf5a86 req-3faa8921-4f72-4ec9-b40e-ef9be1175451 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.422537 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7121f7f5-0c39-4902-a627-cf400088b3fd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 1.023484 Sep 25 01:04:33.442582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 473/900] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:32 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:33.454850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fd88614d-2cbb-468a-b470-49e084693258 req-044fc8d7-9378-4803-b126-30f6db198b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59518b5d-19aa-4c65-bb04-07ee70ef436b", "name": "network-vif-unplugged", "status": "completed", "tag": "3c2d629b-52bf-4176-be1b-5bed48860c09"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:33.479827 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3ce98a0d-454b-48e0-9468-6f6ccdbf5a86 req-3faa8921-4f72-4ec9-b40e-ef9be1175451 service nova] Creating event network-vif-plugged:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:04:33.480965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd88614d-2cbb-468a-b470-49e084693258 req-044fc8d7-9378-4803-b126-30f6db198b33 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.483526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd88614d-2cbb-468a-b470-49e084693258 req-044fc8d7-9378-4803-b126-30f6db198b33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.486340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd88614d-2cbb-468a-b470-49e084693258 req-044fc8d7-9378-4803-b126-30f6db198b33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.504199 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3ce98a0d-454b-48e0-9468-6f6ccdbf5a86 req-3faa8921-4f72-4ec9-b40e-ef9be1175451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172235 Sep 25 01:04:33.512291 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 428/901] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:33.515884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fd88614d-2cbb-468a-b470-49e084693258 req-044fc8d7-9378-4803-b126-30f6db198b33 service nova] Creating event network-vif-unplugged:3c2d629b-52bf-4176-be1b-5bed48860c09 for instance 59518b5d-19aa-4c65-bb04-07ee70ef436b on n-h1-master-1 Sep 25 01:04:33.525644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:33.526624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:33.529237 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fd88614d-2cbb-468a-b470-49e084693258 req-044fc8d7-9378-4803-b126-30f6db198b33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083497 Sep 25 01:04:33.533474 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 474/902] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:33.546784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.549395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.550469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.552169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bf347018-1f2d-416f-8f10-40756dfe55dd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebf271f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:33.553709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.554630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.555424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.573731 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:33.681735 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bf347018-1f2d-416f-8f10-40756dfe55dd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.138852 Sep 25 01:04:33.683297 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 475/903] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:33 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:33.691512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8edaaaf4-98e1-4e17-852a-0d01a638f30f req-2b0effb4-c61c-435e-bf1f-1901bdff2ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f940cae7-5120-4682-a8a1-e640a8a37aec", "tag": "3c558a5f-1763-4e4e-ac0a-8a2fd61729d9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:33.707148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8edaaaf4-98e1-4e17-852a-0d01a638f30f req-2b0effb4-c61c-435e-bf1f-1901bdff2ccb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.707927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8edaaaf4-98e1-4e17-852a-0d01a638f30f req-2b0effb4-c61c-435e-bf1f-1901bdff2ccb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.708554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8edaaaf4-98e1-4e17-852a-0d01a638f30f req-2b0effb4-c61c-435e-bf1f-1901bdff2ccb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.722445 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8edaaaf4-98e1-4e17-852a-0d01a638f30f req-2b0effb4-c61c-435e-bf1f-1901bdff2ccb service nova] Creating event network-changed:3c558a5f-1763-4e4e-ac0a-8a2fd61729d9 for instance f940cae7-5120-4682-a8a1-e640a8a37aec on n-h1-master-1 Sep 25 01:04:33.737477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8edaaaf4-98e1-4e17-852a-0d01a638f30f req-2b0effb4-c61c-435e-bf1f-1901bdff2ccb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052010 Sep 25 01:04:33.738630 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 476/904] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:33.749163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:33.750141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:33.760723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.761645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.762628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.763582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.764235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.765087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:34.331503 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:34.376944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.410485 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:34.425773 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3512c783-9e0d-4280-9b07-0502ce7cb4e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1711 microversion: 2.1 time: 0.683917 Sep 25 01:04:34.430845 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 477/905] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:33 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1711 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:34.440441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:34.445866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:34.482805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:34.484026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:34.486126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:34.509132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:34.515136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:34.516739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:34.938013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.970600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.983174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.990555 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24f9a4d7-22e0-40fc-be77-250264d2c27a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 1.476825 Sep 25 01:04:34.997087 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 429/906] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:33 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:35.028290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62277d16-920b-4c36-b01d-5f7e46cde188 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebdd93a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:35.298751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:35.315169 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92d128d0-89f0-4031-8801-3f9f1d1cd323 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1318 microversion: 2.1 time: 0.875618 Sep 25 01:04:35.321796 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 478/907] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:34 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1318 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:35.330586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:35.331228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:35.359274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:35.359874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:35.361749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:35.362521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:35.368833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:35.369308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:35.514770 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62277d16-920b-4c36-b01d-5f7e46cde188 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/d8a6f3ab-961c-4bc6-b1b7-4a8feebcf8aa" status: 200 len: 141 microversion: 2.1 time: 0.508318 Sep 25 01:04:35.516636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 430/908] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:04:35 2022] GET /compute/v2.1/os-floating-ips/d8a6f3ab-961c-4bc6-b1b7-4a8feebcf8aa => generated 141 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:35.522286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad1b5ba5-99a4-48ae-8992-bf6d4b11cf54 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebce6d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:35.635388 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad1b5ba5-99a4-48ae-8992-bf6d4b11cf54 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.117021 Sep 25 01:04:35.645374 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 431/909] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:35 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:35.649624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:35.654104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:35.675766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:35.677017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:35.677764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:35.678709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:35.679353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:35.679968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.118288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:36.130546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3393934-1359-4c53-9e0b-428a4e053091 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1711 microversion: 2.1 time: 0.491777 Sep 25 01:04:36.132100 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 432/910] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:35 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1711 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:36.141117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdc3deb0-305c-4c0e-a1f1-8cf761ab8788 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebcdd5e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:36.160522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:36.169534 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3720df4c-0070-493e-8fd5-917fc82d80cb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.846457 Sep 25 01:04:36.170129 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 479/911] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:35 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:36.184313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8b4c191c-bbba-4670-8936-47988673b8de req-899342d7-e0a8-46e8-a994-5e07b423bd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59518b5d-19aa-4c65-bb04-07ee70ef436b", "tag": "3c2d629b-52bf-4176-be1b-5bed48860c09"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:36.210080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8b4c191c-bbba-4670-8936-47988673b8de req-899342d7-e0a8-46e8-a994-5e07b423bd76 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:36.210886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8b4c191c-bbba-4670-8936-47988673b8de req-899342d7-e0a8-46e8-a994-5e07b423bd76 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:36.215996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8b4c191c-bbba-4670-8936-47988673b8de req-899342d7-e0a8-46e8-a994-5e07b423bd76 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.243116 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8b4c191c-bbba-4670-8936-47988673b8de req-899342d7-e0a8-46e8-a994-5e07b423bd76 service nova] Creating event network-changed:3c2d629b-52bf-4176-be1b-5bed48860c09 for instance 59518b5d-19aa-4c65-bb04-07ee70ef436b on n-h1-master-1 Sep 25 01:04:36.256606 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8b4c191c-bbba-4670-8936-47988673b8de req-899342d7-e0a8-46e8-a994-5e07b423bd76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081678 Sep 25 01:04:36.257905 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 480/912] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:36.281427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cb87b065-8a0f-4b9e-9a57-b6b38fe56f8d req-fbd2bc32-325e-4abd-81c7-8e695bf06ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4569b875-6e5c-4e5c-b602-f5454f874bba", "tag": "9b02ba0e-f61b-4006-b9f3-05b72df925b3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:36.295666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cb87b065-8a0f-4b9e-9a57-b6b38fe56f8d req-fbd2bc32-325e-4abd-81c7-8e695bf06ce6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:36.296359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cb87b065-8a0f-4b9e-9a57-b6b38fe56f8d req-fbd2bc32-325e-4abd-81c7-8e695bf06ce6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:36.297040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cb87b065-8a0f-4b9e-9a57-b6b38fe56f8d req-fbd2bc32-325e-4abd-81c7-8e695bf06ce6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.325843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cb87b065-8a0f-4b9e-9a57-b6b38fe56f8d req-fbd2bc32-325e-4abd-81c7-8e695bf06ce6 service nova] Creating event network-changed:9b02ba0e-f61b-4006-b9f3-05b72df925b3 for instance 4569b875-6e5c-4e5c-b602-f5454f874bba on n-h1-master-1 Sep 25 01:04:36.333356 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cb87b065-8a0f-4b9e-9a57-b6b38fe56f8d req-fbd2bc32-325e-4abd-81c7-8e695bf06ce6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073659 Sep 25 01:04:36.334751 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 481/913] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:36.341468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:36.342558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:36.351717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:36.353542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:36.354380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.357298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:36.358366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:36.360447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.971618 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:36.995698 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:37.555333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.568501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.574740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.578810 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-876b2f56-27ae-4598-a68b-7c24c297550e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 1.241455 Sep 25 01:04:37.581924 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 482/914] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:36 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:37.593571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:37.594214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:37.610907 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:37.616160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:37.616684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:37.617139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:37.619076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:37.619561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:37.620011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:38.945396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:38.964971 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-02827b20-007d-4d1a-8313-a858d4450da4 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1318 microversion: 2.1 time: 1.381848 Sep 25 01:04:38.971036 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 483/915] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:37 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1318 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:38.980476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c595c58-c79f-4c32-ae9c-557e37da6137 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf0341940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:39.138694 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c595c58-c79f-4c32-ae9c-557e37da6137 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.165786 Sep 25 01:04:39.141438 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 484/916] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:38 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:39.154856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:39.155886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:39.187439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:39.187951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:39.188494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:39.190124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:39.190767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:39.191722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:39.552175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:39.577861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-81931f91-4c89-4f08-97f8-0c7e5a1fcc68 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1644 microversion: 2.1 time: 0.433902 Sep 25 01:04:39.582733 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 485/917] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:39 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1644 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:39.590200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:39.596546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:39.612784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:39.613956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:39.617653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:39.618678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:39.620491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:39.623168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:40.940465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:40.949278 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab6d2e89-0aa2-4bd3-9253-e427cc020ef7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 1.365190 Sep 25 01:04:40.961884 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 486/918] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:39 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:40.973565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8c65d2b3-56bf-4f8f-861e-73a88fb5f706 req-120696c7-714f-4141-a331-1ecfd13d7c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79be9a3-4950-4b44-9458-276628f72902", "tag": "0b41e14e-cf51-44b5-8f42-fd27f1dd5dcc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:40.998859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8c65d2b3-56bf-4f8f-861e-73a88fb5f706 req-120696c7-714f-4141-a331-1ecfd13d7c1a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:40.999398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8c65d2b3-56bf-4f8f-861e-73a88fb5f706 req-120696c7-714f-4141-a331-1ecfd13d7c1a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:40.999872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8c65d2b3-56bf-4f8f-861e-73a88fb5f706 req-120696c7-714f-4141-a331-1ecfd13d7c1a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.028979 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8c65d2b3-56bf-4f8f-861e-73a88fb5f706 req-120696c7-714f-4141-a331-1ecfd13d7c1a service nova] Creating event network-changed:0b41e14e-cf51-44b5-8f42-fd27f1dd5dcc for instance e79be9a3-4950-4b44-9458-276628f72902 on n-h2-master-1 Sep 25 01:04:41.049239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8c65d2b3-56bf-4f8f-861e-73a88fb5f706 req-120696c7-714f-4141-a331-1ecfd13d7c1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095754 Sep 25 01:04:41.050327 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 487/919] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:41.056107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:41.059466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:41.072302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.072827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.077070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.078159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.078664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.079217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.940217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:41.955412 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:41.959170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:41.967630 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-950499b4-628d-4d13-bed9-9eee024ce4a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 0.909284 Sep 25 01:04:41.969016 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 488/920] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:41 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:41.978467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:41.982078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:42.005502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.006242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.006785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.009691 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdc3deb0-305c-4c0e-a1f1-8cf761ab8788 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d8a6f3ab-961c-4bc6-b1b7-4a8feebcf8aa" status: 202 len: 0 microversion: 2.1 time: 5.876213 Sep 25 01:04:42.010659 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 433/921] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:04:36 2022] DELETE /compute/v2.1/os-floating-ips/d8a6f3ab-961c-4bc6-b1b7-4a8feebcf8aa => generated 0 bytes in 5878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:42.013954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.019950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7bd8d743-706b-40fe-b963-75cd89ca9d0e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcb5790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:42.024154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.024920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.107002 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7bd8d743-706b-40fe-b963-75cd89ca9d0e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.095087 Sep 25 01:04:42.121243 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 434/922] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:42 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:42.121243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:42.122164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:42.155615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.156286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.156840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.157914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.158494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.159051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.368234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ed412afded46c49d993a2749e42c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd08c233d6944199beebf1a2e1a1a23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:42.392116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f703b9ab-7b3f-420c-a9dc-dd9948ed4235 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 200 len: 1644 microversion: 2.1 time: 0.267741 Sep 25 01:04:42.395647 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 435/923] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:42 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 1644 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:42.439886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a24b5e3a-c835-4a0d-922e-f3ada9bc80fe req-d0a5ea79-1880-4aa6-b590-04834b0b30fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f940cae7-5120-4682-a8a1-e640a8a37aec", "name": "network-vif-plugged", "status": "completed", "tag": "3c558a5f-1763-4e4e-ac0a-8a2fd61729d9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:42.489091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:42.498293 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5cc6de45-4272-46b3-8f5c-936779233f4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1318 microversion: 2.1 time: 0.526398 Sep 25 01:04:42.507219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a24b5e3a-c835-4a0d-922e-f3ada9bc80fe req-d0a5ea79-1880-4aa6-b590-04834b0b30fe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.509099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a24b5e3a-c835-4a0d-922e-f3ada9bc80fe req-d0a5ea79-1880-4aa6-b590-04834b0b30fe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.509355 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 489/924] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:41 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:42.513033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a24b5e3a-c835-4a0d-922e-f3ada9bc80fe req-d0a5ea79-1880-4aa6-b590-04834b0b30fe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.520788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:42.529735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:42.548307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.550688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.551324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.553084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a24b5e3a-c835-4a0d-922e-f3ada9bc80fe req-d0a5ea79-1880-4aa6-b590-04834b0b30fe service nova] Creating event network-vif-plugged:3c558a5f-1763-4e4e-ac0a-8a2fd61729d9 for instance f940cae7-5120-4682-a8a1-e640a8a37aec on n-h1-master-1 Sep 25 01:04:42.557810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.560312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.560991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.575273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a24b5e3a-c835-4a0d-922e-f3ada9bc80fe req-d0a5ea79-1880-4aa6-b590-04834b0b30fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173670 Sep 25 01:04:42.578506 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 436/925] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:42.596028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9c5dc9f-c6e1-4c92-972c-9d3875615a79 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebcb5670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:43.817081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:43.832284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-77151cdf-d180-4717-a642-dfa2335e1976 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 1.321503 Sep 25 01:04:43.836058 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 490/926] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:42 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:43.847800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:43.848704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:43.862544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:43.870309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:43.871374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:43.872309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:43.872937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:43.873561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.068074 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9c5dc9f-c6e1-4c92-972c-9d3875615a79 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.487864 Sep 25 01:04:44.068753 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 437/927] 10.222.0.16 () {58 vars in 1164 bytes} [Sun Sep 25 01:04:42 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:04:44.079152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5037f0a-c5f3-4a37-828d-7179d0f7c866 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebc9ad30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:44.176703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5037f0a-c5f3-4a37-828d-7179d0f7c866 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.106812 Sep 25 01:04:44.178550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 438/928] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:44 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:44.201241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:44.202156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:44.228694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.234204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.234778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.235623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.236098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.236542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.294022 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b HTTP/1.1 Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:44.317254 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:44.318824 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b'} Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:44.319696 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:44.321090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:44.330143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:44.336499 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95beb474-2ff1-492a-9fee-fa33aba243e1 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 404 len: 111 microversion: 2.1 time: 0.154004 Sep 25 01:04:44.337342 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 439/929] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:44 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:44.353746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:44.372261 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:44.381504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.394709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.400705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.403844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.404816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.408494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.412227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.428747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.433881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.438252 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-539dfc5c-f977-4a4c-9ae3-e4a61a4e6407 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 0.600176 Sep 25 01:04:44.441983 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 491/930] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:43 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:44.463825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-290eb9c0-723d-4e19-b49e-0961c31c0b8a req-21d767c7-7e29-4845-b831-f824b6adb6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b", "name": "network-vif-deleted", "tag": "9aca0ece-499a-498f-b1c4-04c09afa2a9c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:44.524352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-290eb9c0-723d-4e19-b49e-0961c31c0b8a req-21d767c7-7e29-4845-b831-f824b6adb6b6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.524859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-290eb9c0-723d-4e19-b49e-0961c31c0b8a req-21d767c7-7e29-4845-b831-f824b6adb6b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.525307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-290eb9c0-723d-4e19-b49e-0961c31c0b8a req-21d767c7-7e29-4845-b831-f824b6adb6b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.558932 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-290eb9c0-723d-4e19-b49e-0961c31c0b8a req-21d767c7-7e29-4845-b831-f824b6adb6b6 service nova] Creating event network-vif-deleted:9aca0ece-499a-498f-b1c4-04c09afa2a9c for instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b on n-h2-master-1 Sep 25 01:04:44.572932 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-290eb9c0-723d-4e19-b49e-0961c31c0b8a req-21d767c7-7e29-4845-b831-f824b6adb6b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126552 Sep 25 01:04:44.576648 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 492/931] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:44.591752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5643051d-1b77-4378-8a5b-e41694a4e5c5 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebdd1700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.309521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:45.319136 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2f2120e-d01b-4fb9-ab67-0c9839fbdba1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1318 microversion: 2.1 time: 0.974529 Sep 25 01:04:45.325347 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 440/932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:44 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1318 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:45.341210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.357635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:45.382446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.393911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.397517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.401059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.407625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.413673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.460093 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 HTTP/1.1 Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:45.461931 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:45.463258 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9'} Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:45.464003 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:45.465169 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:45.466436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:45.466436 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bbf290b-253a-4178-aa9e-82268f6e570b tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 404 len: 111 microversion: 2.1 time: 0.137679 Sep 25 01:04:45.473032 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 441/933] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:04:45 2022] DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:45.478420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.479053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:45.504421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.504929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.505726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.506884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.507635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.508414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.790665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5643051d-1b77-4378-8a5b-e41694a4e5c5 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.208549 Sep 25 01:04:45.791679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 493/934] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:04:44 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:45.799011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dda2cbe8-a42a-4b9a-87db-764544155b02 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebde71f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.934468 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dda2cbe8-a42a-4b9a-87db-764544155b02 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.141265 Sep 25 01:04:45.935096 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 494/935] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:45 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:45.956127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.958293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:45.996377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:46.005154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.006072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.006725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.008533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.011168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.012330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ebc96fe-366b-43ee-b751-778378073f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1503 microversion: 2.1 time: 0.537230 Sep 25 01:04:46.013957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.037641 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 442/936] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:45 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1503 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:46.056879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:46.057792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:46.076582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.077092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.077571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.078302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.079289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.079715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.177581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 HTTP/1.1 Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:46.179077 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:46.180437 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9'} Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:46.181186 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:46.182442 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:46.183552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:46.185437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d234887-0c51-4fd1-824e-6357fbc12b90 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 404 len: 111 microversion: 2.1 time: 0.146282 Sep 25 01:04:46.186051 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 443/937] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:46 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:46.198578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36d58f04-0018-4641-b327-3093fdae98c3 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebd39dc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:46.706466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:46.730489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:46.732237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:46.733436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8135464-6b29-4969-8350-b6720806450c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 0.794632 Sep 25 01:04:46.754760 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 495/938] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:45 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:46.768579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb030838-a9c2-4985-b676-73f53ff85f5d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '.version_select at 0x7f7bebdd08b0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:46.853369 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb030838-a9c2-4985-b676-73f53ff85f5d tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102063023" status: 202 len: 0 microversion: 2.1 time: 0.092487 Sep 25 01:04:46.862100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 496/939] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102063023 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:46.891884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:46.896600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:46.934327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.934824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.944765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.954466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.955051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.960730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:47.979593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:47.992670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd5ba377-859a-4591-8cd2-699437516e7d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1468 microversion: 2.1 time: 1.128269 Sep 25 01:04:47.999594 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 497/940] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:46 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1468 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:48.008549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-817b6231-c3ad-461d-954a-4b6fd3562ea8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf098c160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:48.086400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-817b6231-c3ad-461d-954a-4b6fd3562ea8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.084327 Sep 25 01:04:48.092141 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 498/941] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:47 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:48.098249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9f2dc667-6989-4a9b-afb0-3b9f615a505c req-184ae469-df98-4c52-9e65-a3404d0f48f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79be9a3-4950-4b44-9458-276628f72902", "name": "network-vif-plugged", "status": "completed", "tag": "0b41e14e-cf51-44b5-8f42-fd27f1dd5dcc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:48.127317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9f2dc667-6989-4a9b-afb0-3b9f615a505c req-184ae469-df98-4c52-9e65-a3404d0f48f1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.127807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9f2dc667-6989-4a9b-afb0-3b9f615a505c req-184ae469-df98-4c52-9e65-a3404d0f48f1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.128244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9f2dc667-6989-4a9b-afb0-3b9f615a505c req-184ae469-df98-4c52-9e65-a3404d0f48f1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.152099 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9f2dc667-6989-4a9b-afb0-3b9f615a505c req-184ae469-df98-4c52-9e65-a3404d0f48f1 service nova] Creating event network-vif-plugged:0b41e14e-cf51-44b5-8f42-fd27f1dd5dcc for instance e79be9a3-4950-4b44-9458-276628f72902 on n-h2-master-1 Sep 25 01:04:48.171218 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9f2dc667-6989-4a9b-afb0-3b9f615a505c req-184ae469-df98-4c52-9e65-a3404d0f48f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077695 Sep 25 01:04:48.176838 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 499/942] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:48.182303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:48.197579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:48.211653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.230169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.231049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.235411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.236517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.239667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.876797 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36d58f04-0018-4641-b327-3093fdae98c3 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/b694d932-b54f-48a1-96d9-a6da09159bba" status: 202 len: 0 microversion: 2.1 time: 2.686126 Sep 25 01:04:48.878552 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 444/943] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:04:46 2022] DELETE /compute/v2.1/os-floating-ips/b694d932-b54f-48a1-96d9-a6da09159bba => generated 0 bytes in 2691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:48.885815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:48.886782 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:48.925724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:48.937325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.939512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f718cfa-c7e6-4a29-ba36-70b135f2ab49 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1478 microversion: 2.1 time: 0.761291 Sep 25 01:04:48.945284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 500/944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:48 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1478 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:48.945682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.946257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.947035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.947504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.947938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.952199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:48.953130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:48.965750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.968815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.969872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.971897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.972628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.973296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:49.604988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.645310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.648915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.651757 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-040f74ec-f956-4525-b789-057624915e9a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 0.771905 Sep 25 01:04:49.660954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.684711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 445/945] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:48 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:49.684924 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3482dc64-5bbc-4bc2-83bb-58a259ff19c0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 200 len: 1318 microversion: 2.1 time: 0.732081 Sep 25 01:04:49.684924 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 501/946] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:48 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:49.691383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-002ddde3-4ab8-4c44-83d4-cfc4a5500882 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebd39f70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:49.697049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22fe63bc-b043-4fe5-81a2-42e1b77917c0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '.version_select at 0x7f7bebd2b820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:49.725098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe63bc-b043-4fe5-81a2-42e1b77917c0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:49.734111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe63bc-b043-4fe5-81a2-42e1b77917c0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:49.734671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe63bc-b043-4fe5-81a2-42e1b77917c0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:49.778416 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22fe63bc-b043-4fe5-81a2-42e1b77917c0 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.092153 Sep 25 01:04:49.783945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 502/947] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:04:49 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:49.793757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43d06c0e-ade9-4f29-8642-cc24ea965814 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd723a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:49.896364 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43d06c0e-ade9-4f29-8642-cc24ea965814 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.111014 Sep 25 01:04:49.896995 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 503/948] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:49 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:49.919066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d21450e9-ef8b-468b-a428-05dd631accb4 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:49.984804 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d21450e9-ef8b-468b-a428-05dd631accb4 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/640328424" status: 202 len: 0 microversion: 2.1 time: 0.074466 Sep 25 01:04:49.996825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 504/949] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:04:49 2022] DELETE /compute/v2.1/flavors/640328424 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:50.015821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:50.018054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:50.031308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:50.033906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:50.038365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:50.039465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:50.040170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:50.040846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:50.080167 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:50.912264 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76edeb8d-0174-4b83-8f0d-a88bc8560227 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1629 microversion: 2.1 time: 0.916969 Sep 25 01:04:50.919100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 505/950] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:49 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1629 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:50.926462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62999661-436c-422d-86a5-0127c4056a17 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:50.973921 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62999661-436c-422d-86a5-0127c4056a17 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.052883 Sep 25 01:04:50.975060 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 506/951] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:04:50 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:50.979806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2618607c-ee66-48a3-a3e6-540e2fc607f5 req-c1cb7147-9f0e-485a-a4a4-87427f047ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4569b875-6e5c-4e5c-b602-f5454f874bba", "name": "network-vif-plugged", "status": "completed", "tag": "9b02ba0e-f61b-4006-b9f3-05b72df925b3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:50.991044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2618607c-ee66-48a3-a3e6-540e2fc607f5 req-c1cb7147-9f0e-485a-a4a4-87427f047ac4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:50.991753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2618607c-ee66-48a3-a3e6-540e2fc607f5 req-c1cb7147-9f0e-485a-a4a4-87427f047ac4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:50.992435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2618607c-ee66-48a3-a3e6-540e2fc607f5 req-c1cb7147-9f0e-485a-a4a4-87427f047ac4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.008667 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2618607c-ee66-48a3-a3e6-540e2fc607f5 req-c1cb7147-9f0e-485a-a4a4-87427f047ac4 service nova] Creating event network-vif-plugged:9b02ba0e-f61b-4006-b9f3-05b72df925b3 for instance 4569b875-6e5c-4e5c-b602-f5454f874bba on n-h1-master-1 Sep 25 01:04:51.017104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2618607c-ee66-48a3-a3e6-540e2fc607f5 req-c1cb7147-9f0e-485a-a4a4-87427f047ac4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039577 Sep 25 01:04:51.020214 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 507/952] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:51.284564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1423591677", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "424f6113-9606-4e62-8840-759afa211883"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:51.364935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] validate_networks() for [('424f6113-9606-4e62-8840-759afa211883', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:04:52.050664 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-002ddde3-4ab8-4c44-83d4-cfc4a5500882 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/7edce457-51c8-4c00-ab1b-f5178666a7b9" status: 202 len: 0 microversion: 2.1 time: 2.372583 Sep 25 01:04:52.054246 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 446/953] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:04:49 2022] DELETE /compute/v2.1/os-floating-ips/7edce457-51c8-4c00-ab1b-f5178666a7b9 => generated 0 bytes in 2375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:52.056885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:52.057855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:52.086215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.098143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.098812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.102183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.103229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.103838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.180832 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=88 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:52.556417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:04:52.557136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:04:52.557833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:04:52.558389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:04:52.558926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:04:52.563792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.604532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.619841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.622720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be5e9111-a922-4bf6-830c-455a44804bdd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1362 microversion: 2.25 time: 0.569747 Sep 25 01:04:52.624998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.625560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.626055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.628247 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 447/954] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:52 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:52.631204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.631732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.632239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.642431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:52.643077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:52.664634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.665138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.665606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.666328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.672832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.673746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.692516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Getting quotas for project d22d569cfdfb47619e63f469ad2d00bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:52.710308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Getting quotas for user f07489ff6ce74b7cab3b78a9654e4192 and project d22d569cfdfb47619e63f469ad2d00bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:52.738696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:04:52.743602 n-d-master-1 devstack@n-api.service[122385]: WARNING nova.utils [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1423591677 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-142359167 Sep 25 01:04:52.746079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:04:52.871489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3ee07c4-f7a7-4780-8073-d220b4853701 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.844956 Sep 25 01:04:52.872824 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 508/955] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:04:52.885255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c07d1fa2-1050-4c29-a501-9457f898b877 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebdd3310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:52.960386 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c07d1fa2-1050-4c29-a501-9457f898b877 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.086277 Sep 25 01:04:52.961658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 509/956] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:52 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:52.975042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9567e6c2-c0b4-40be-bf9b-f55658b373a8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Action: 'create', calling method: .version_select at 0x7f7bebd74310>, body: {"keypair": {"name": "tempest-keypair-111273034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9PG6diCappS8tFIy1FukdDBgC1Zt36vLy3sIAOyW33oip3oOUEW43tB0pShDFgrEI5cpAbc/sn2hYI7wMci6t80SIhQ/Kdx/VtIQanCsO7lRHoGbFikDDtjPRFkGeH5A=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:53.021437 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9567e6c2-c0b4-40be-bf9b-f55658b373a8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for project ce74d459ddb341569f42818c99cbfcaa. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:53.039376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9567e6c2-c0b4-40be-bf9b-f55658b373a8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for user fe77600029ff40f8b738c097bf184495 and project ce74d459ddb341569f42818c99cbfcaa. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:53.111073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9567e6c2-c0b4-40be-bf9b-f55658b373a8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146948 Sep 25 01:04:53.112905 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 510/957] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:04:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:53.123003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1aad4912-cf14-4341-a5ef-83996a211cdb tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.170270 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1aad4912-cf14-4341-a5ef-83996a211cdb tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1437912271" status: 202 len: 0 microversion: 2.1 time: 0.052738 Sep 25 01:04:53.171513 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 511/958] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:04:53 2022] DELETE /compute/v2.1/flavors/1437912271 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:53.178870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bfaa8a2-3151-4599-8815-9e1e8007f289 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] Calling method '.version_select at 0x7f7bebd44dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.229812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.242337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad0dd769-cc9b-49dd-a86b-755193944709 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 200 len: 1468 microversion: 2.1 time: 0.611783 Sep 25 01:04:53.243859 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 448/959] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:52 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 1468 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:53.259630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-596e56dd-90e6-4db9-a89d-07d1d1defeeb tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.262263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-596e56dd-90e6-4db9-a89d-07d1d1defeeb tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:53.435288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-596e56dd-90e6-4db9-a89d-07d1d1defeeb tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.450140 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-596e56dd-90e6-4db9-a89d-07d1d1defeeb tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1232 microversion: 2.1 time: 0.199744 Sep 25 01:04:53.469140 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 449/960] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:53 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1232 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:53.475162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d933a14-8031-425e-bf91-1bf8cfc845f9 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.504812 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:53.512981 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d933a14-8031-425e-bf91-1bf8cfc845f9 tempest-ServersWithSpecificFlavorTestJSON-1040417573 tempest-ServersWithSpecificFlavorTestJSON-1040417573-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041387 Sep 25 01:04:53.513876 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 450/961] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:04:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:53.544493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.551082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.552519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Searching by: {'reservation_id': 'r-mzivovyx', 'deleted': False, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:04:53.558534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.559509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.560177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:53.561156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.561857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.562512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:53.682089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:04:53.859039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.874604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.877862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.880600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.575017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ce9bcc3-50da-440f-9782-ee07c0ac9706 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-mzivovyx" status: 200 len: 2929 microversion: 2.1 time: 1.044482 Sep 25 01:04:54.601119 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 451/962] 10.222.0.16 () {58 vars in 1197 bytes} [Sun Sep 25 01:04:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mzivovyx => generated 2929 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:54.608756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:54.609592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:54.618026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.618773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.619412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.620307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.620929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.621550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.692655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b HTTP/1.1 Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:54.694304 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:54.695850 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b'} Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:54.696748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:54.698367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:54.706288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:54.715549 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e43e5c7e-31dc-4923-860b-d249830f1628 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 404 len: 111 microversion: 2.1 time: 0.104316 Sep 25 01:04:54.720267 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 452/963] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:04:54 2022] DELETE /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:54.743116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:54.746868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:54.766991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.777126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.779611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.786001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.790260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.800335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.722048 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2bfaa8a2-3151-4599-8815-9e1e8007f289 tempest-FloatingIPDetailsTestJSON-1266673353 tempest-FloatingIPDetailsTestJSON-1266673353-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/bcd8d584-c0d7-44ed-93e9-6560c74a7a19" status: 202 len: 0 microversion: 2.1 time: 2.549178 Sep 25 01:04:55.726101 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 512/964] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:04:53 2022] DELETE /compute/v2.1/os-floating-ips/bcd8d584-c0d7-44ed-93e9-6560c74a7a19 => generated 0 bytes in 2551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:55.726443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:55.729026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63682be5-eded-473c-8d39-2077ba75900c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd06f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:55.744115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:55.745626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:55.754372 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3b06aec-69e3-4511-95f0-45f01b31577b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1559 microversion: 2.25 time: 1.032950 Sep 25 01:04:55.755281 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 453/965] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:54 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1559 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:55.773596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:55.774258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:55.783769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.784388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.784843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.785639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.786085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.786521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.864921 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63682be5-eded-473c-8d39-2077ba75900c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.140785 Sep 25 01:04:55.867979 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 513/966] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:55 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:55.882072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7024b637-8db7-4e8a-b28f-65d350cf1e51 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:55.941565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:55.952607 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-606fea46-f968-4e5a-bd83-b773f80032e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1302 microversion: 2.1 time: 0.196208 Sep 25 01:04:55.955801 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 454/967] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:55 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1302 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:55.965391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:55.968615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:55.984116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.server_groups [None req-7024b637-8db7-4e8a-b28f-65d350cf1e51 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Querying cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) for 2 instances {{(pid=122385) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 25 01:04:55.985484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7024b637-8db7-4e8a-b28f-65d350cf1e51 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.986392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.986563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7024b637-8db7-4e8a-b28f-65d350cf1e51 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.986895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.987345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.987725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7024b637-8db7-4e8a-b28f-65d350cf1e51 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.988061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.988530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.988959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.032566 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b HTTP/1.1 Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:56.035460 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:56.036813 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b'} Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:56.037587 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. Sep 25 01:04:56.038831 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.040287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance 76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:56.041607 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-245ce2d6-ae93-4b4a-8ca8-19d8f096fbcb tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b" status: 404 len: 111 microversion: 2.1 time: 0.083211 Sep 25 01:04:56.042818 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 455/968] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:55 2022] GET /compute/v2.1/servers/76a5ffb4-5bb5-467c-8ee4-30dd9d604d2b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:56.053466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:56.059947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:56.073777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:56.076494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:56.076963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.080211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:56.080926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:56.081086 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7024b637-8db7-4e8a-b28f-65d350cf1e51 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/09263558-8be0-4f2e-815e-94ffecf58828" status: 200 len: 271 microversion: 2.1 time: 0.211416 Sep 25 01:04:56.084038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.085494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 514/969] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:04:55 2022] GET /compute/v2.1/os-server-groups/09263558-8be0-4f2e-815e-94ffecf58828 => generated 271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:56.109070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:56.110294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:56.117139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:56.118243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:56.118920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.119859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:56.120466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:56.121127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.142836 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 HTTP/1.1 Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:04:56.146193 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:56.147713 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9'} Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:56.148561 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:56.149856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:04:56.152423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:56.153575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-382037af-8e34-48d8-9216-c4a10d788765 tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 404 len: 111 microversion: 2.1 time: 0.066590 Sep 25 01:04:56.156600 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 515/970] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:04:56 2022] DELETE /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:56.163664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:56.164522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:56.192351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:56.192847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:56.193284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.194025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:56.197051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:56.197536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.073443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:04:57.099666 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3372dc6-7f73-4161-899d-ec8581c9de89 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 2052 microversion: 2.25 time: 1.055536 Sep 25 01:04:57.108977 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 456/971] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:56 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 2052 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:57.114577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.115207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] [instance: ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:57.147590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.148084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.148740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.151004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.152461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.156853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.223071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] HTTP exception thrown: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Request method failure captured: Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 HTTP/1.1 Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6hGQNHIkRzaJV_tpsq5aVLv9Y66IrSQBcfcgrF90VwT-cjnRmjd_xCAb4LIrkq-mZABaV6M_bu4H59EO-B57WAh2AklUFdn8lq4kNGuwM9ljcjCYW7Gfk4DSEBFD4JTFu7G1hYvSHZmQbmlGh3PaidUV7m7-fgDA67HVmAPXLbB3fU Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:04:57.236940 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fbd08c233d6944199beebf1a2e1a1a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fbd08c233d6944199beebf1a2e1a1a23"}]}] Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fbd08c233d6944199beebf1a2e1a1a23 Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686 Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 98ed412afded46c49d993a2749e42c65 Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2026580686-project Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:57.240881 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9'} Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:57.241885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. Sep 25 01:04:57.243331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:04:57.245561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] Returning 404 to user: Instance ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:57.246619 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45b99b10-d411-4977-84d5-3ee4bb4a83ef tempest-ServersWithSpecificFlavorTestJSON-2026580686 tempest-ServersWithSpecificFlavorTestJSON-2026580686-project] 10.222.0.16 "GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9" status: 404 len: 111 microversion: 2.1 time: 0.135815 Sep 25 01:04:57.247351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 457/972] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/servers/ad4c40a5-f7ae-48fd-87f5-cb9f01f19bb9 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:04:57.258477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6c1b238-e70c-4adb-88e2-af6a324faebe tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebbd6d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.341805 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6c1b238-e70c-4adb-88e2-af6a324faebe tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.093150 Sep 25 01:04:57.342089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2e44ab6-7397-48c6-8c10-f608285fa0ab tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 200 len: 1619 microversion: 2.1 time: 1.176881 Sep 25 01:04:57.346744 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 458/973] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:57.351803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.353185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:57.354904 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 516/974] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:56 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 1619 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:57.385227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.385749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.390134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.390374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.392989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:57.394013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.398392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.398913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.413286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.414240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.415683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.421927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.423429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.425027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.669260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:57.685043 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76029299-577f-47bd-b40a-3fd8d319b6c3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1290 microversion: 2.1 time: 0.336905 Sep 25 01:04:57.691657 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 459/975] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1290 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:57.707196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.710632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:57.733464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.734065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.734564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.735644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.736329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.741314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.911929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:04:57.936194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-09f3bb5f-6179-4e34-92b4-85a54c084e9b tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 2052 microversion: 2.25 time: 0.579264 Sep 25 01:04:57.937948 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 517/976] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 2052 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:57.963568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.969280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.970089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.970992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.972403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.973060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.973718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.018572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a132676-6031-410a-a5b5-93af4d7183db tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058697 Sep 25 01:04:58.020404 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 518/977] 10.222.0.16 () {60 vars in 1217 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:04:58.035207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:58.040844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:58.056168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:58.056680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:58.057132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.057898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:58.058368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:58.058803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.152728 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9fc752f-a04c-41ad-888e-4cc8f548d903 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1619 microversion: 2.1 time: 0.458431 Sep 25 01:04:58.239102 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 460/978] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1619 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:58.371381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ab98f2c-ca9f-4467-8e71-77198b75b57f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba/action" status: 202 len: 0 microversion: 2.25 time: 0.329878 Sep 25 01:04:58.372110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 519/979] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:04:58 2022] POST /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:04:58.387491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e4c5ffb2-122e-477f-9a53-1164603ec6dd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf016f790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:58.401557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:58.402308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:58.446185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:58.447847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:58.450233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.457117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:58.458968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:58.492401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.511596 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e4c5ffb2-122e-477f-9a53-1164603ec6dd tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.150628 Sep 25 01:04:58.520416 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 461/980] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:04:58 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:58.619458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-676889293", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:58.730427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:04:59.685476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:04:59.686050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:04:59.686583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:04:59.687764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:04:59.689159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:04:59.728765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:59.729397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:59.729858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:59.730589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:59.731043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:59.731466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:59.800653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:59.809005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:04:59.810995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:59.848017 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:04:59.852317 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af7a3cb3-1842-4c1f-bd1b-f5e114857139 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 2057 microversion: 2.25 time: 1.471312 Sep 25 01:04:59.853704 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 520/981] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:58 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 2057 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:59.862339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:59.868633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:59.876832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:04:59.893818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:59.896307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:59.898042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:59.901580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:59.902661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:59.903300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:00.075657 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df78f823-adfb-4867-a113-7450b6736c3a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457744 Sep 25 01:05:00.076725 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 462/982] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:05:00.085739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64278588-7c03-427d-a0c7-ffc6376cf730 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebbd60d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:00.170593 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64278588-7c03-427d-a0c7-ffc6376cf730 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1455 microversion: 2.1 time: 0.088888 Sep 25 01:05:00.180569 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 463/983] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:00 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:00.187527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b78cc83-449f-4bd5-938d-9d662503a0f8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:00.198433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b78cc83-449f-4bd5-938d-9d662503a0f8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:00.361683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:00.361856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b78cc83-449f-4bd5-938d-9d662503a0f8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:00.369617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b78cc83-449f-4bd5-938d-9d662503a0f8 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1216 microversion: 2.1 time: 0.186690 Sep 25 01:05:00.373019 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 464/984] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:00 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:00.387540 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ac23c706-23b8-4739-a660-12f23770feab tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1290 microversion: 2.1 time: 0.532463 Sep 25 01:05:00.390552 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 521/985] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:59 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1290 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:00.882498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:00.883129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:00.889620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:00.890110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:00.890565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:00.892102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:00.892562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:00.893013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.193840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45945a65-5aad-4ce9-b950-10e6932bd5f2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd37820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:01.284692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-45945a65-5aad-4ce9-b950-10e6932bd5f2 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1464 microversion: 2.1 time: 0.097671 Sep 25 01:05:01.288488 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 522/986] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:01 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:01.304162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b411bb0-c4c3-4234-88b0-acc9c813f5eb tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcf5d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:01.342641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:01.374876 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-547e8bc2-17da-4769-8a20-fb81d198ce1f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 2037 microversion: 2.25 time: 0.495830 Sep 25 01:05:01.393826 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 465/987] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:00 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 2037 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:01.401659 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b411bb0-c4c3-4234-88b0-acc9c813f5eb tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 200 len: 1464 microversion: 2.1 time: 0.103113 Sep 25 01:05:01.425149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 523/988] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:01 2022] GET /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 1464 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:01.429198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:01.432495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:01.454530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:01.456614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.457973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.458664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.459785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.460777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.461368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.467510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:01.479947 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:01.488787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.491520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.493435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.495589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.497076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.499054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.577462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'flavor' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:01.618568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Going to try to live migrate instance to n-h2-master-1 {{(pid=122385) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:05:01.692704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:01.705389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b88ca66-d99d-402f-b8d3-1a4f85252360 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1268 microversion: 2.1 time: 0.306971 Sep 25 01:05:01.706035 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 466/989] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:01 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:01.719763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:01.720611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:01.734461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.737627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.738256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.740533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.741188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.743919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:02.068836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:02.080810 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0c5c0e6-e332-4859-ba36-ec8852cf4fd4 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1332 microversion: 2.1 time: 0.371965 Sep 25 01:05:02.082572 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 467/990] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:01 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1332 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:02.090320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:02.091162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:02.101210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:02.102071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:02.102754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:02.114435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:02.114909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:02.115521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:02.752928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:02.762085 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1148c3f3-a3d9-4eea-b304-877c60c625f1 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 1467 microversion: 2.1 time: 0.675312 Sep 25 01:05:02.762703 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 468/991] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:02 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 1467 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:02.790031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-668382226", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4f8a553d-e325-4d96-bf39-28985d951e27"}], "security_groups": [{"name": "tempest-securitygroup--538886698"}], "key_name": "tempest-keypair-111273034", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:03.055089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] validate_networks() for [('4f8a553d-e325-4d96-bf39-28985d951e27', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:03.068483 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:04.411781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:04.411781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:04.411781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:04.418248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:04.419438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:04.434077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:04.434984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:04.435722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:04.436854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:04.438520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:04.439379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:04.463692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:04.471872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for user fe77600029ff40f8b738c097bf184495 and project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:04.490931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:04.493852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:04.557051 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a02147f5-df65-4032-aae9-e3c2364f81a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.780783 Sep 25 01:05:04.559679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 469/992] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:05:04.568164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:04.569709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:04.580186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:04.581114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:04.581841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:04.583207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:04.583922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:04.584612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:04.971074 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c09f2f2a-5d74-43c9-8334-8e4d17f5c59e tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba/action" status: 202 len: 0 microversion: 2.25 time: 3.542583 Sep 25 01:05:04.972089 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 524/993] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:05:01 2022] POST /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba/action => generated 0 bytes in 3546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:04.988926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9792cfb8-d578-4292-8cb5-a76a16b57a0c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd72280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:05.178632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:05.192574 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c075fafc-23b2-4d68-901e-bc9bfe06a8b5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1316 microversion: 2.1 time: 0.629400 Sep 25 01:05:05.194637 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 470/994] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:04 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:05.203967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:05.212151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:05.231091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.231669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.232184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.232982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.236141 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9792cfb8-d578-4292-8cb5-a76a16b57a0c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-09-25T01%3A02%3A42Z" status: 200 len: 1901 microversion: 2.1 time: 0.262331 Sep 25 01:05:05.236752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 525/995] 10.222.0.16 () {58 vars in 1199 bytes} [Sun Sep 25 01:05:04 2022] GET /compute/v2.1/images?changes-since=2022-09-25T01%3A02%3A42Z => generated 1901 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:05.236890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.237466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.262449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f71cf231-d850-44f6-8f21-e63feac62383 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Action: 'create', calling method: .version_select at 0x7f7bebf08e50>, body: {"keypair": {"name": "tempest-keypair-922956414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdnCajsHOFZf8Eeqbbnu0ujGJxdiqEHROOJ6xnzrhPiCxxGWvxhwqQ/K3TosmI8KgEvE4j2PYc4N3ximDWhXRlJXw+t7BBnhmOT3lTRIzr0pIl4eVdhGt7HY2+c391yRg=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:05.298715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f71cf231-d850-44f6-8f21-e63feac62383 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Getting quotas for project 624fa9637d2844fbbce4439455fbe41f. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:05.323774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f71cf231-d850-44f6-8f21-e63feac62383 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Getting quotas for user 1e62f0277cf04e87be2017098f3d6327 and project 624fa9637d2844fbbce4439455fbe41f. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:05.374129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f71cf231-d850-44f6-8f21-e63feac62383 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.129818 Sep 25 01:05:05.374820 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 526/996] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:05:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:05:05.393578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-481fa542-7760-4493-9a7f-5e7f43f3ddc1 req-637f9260-4749-460f-a809-7448afa27977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cadbb54f-1cbd-40d7-948d-a9a2f14f7a73", "tag": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:05.418723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-481fa542-7760-4493-9a7f-5e7f43f3ddc1 req-637f9260-4749-460f-a809-7448afa27977 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.420379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-481fa542-7760-4493-9a7f-5e7f43f3ddc1 req-637f9260-4749-460f-a809-7448afa27977 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.421934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-481fa542-7760-4493-9a7f-5e7f43f3ddc1 req-637f9260-4749-460f-a809-7448afa27977 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.460950 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-481fa542-7760-4493-9a7f-5e7f43f3ddc1 req-637f9260-4749-460f-a809-7448afa27977 service nova] Creating event network-changed:6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc for instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 on n-h1-master-1 Sep 25 01:05:05.475513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-481fa542-7760-4493-9a7f-5e7f43f3ddc1 req-637f9260-4749-460f-a809-7448afa27977 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098607 Sep 25 01:05:05.477264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 527/997] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:05.503931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:05.506822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:05.522699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.524371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.525331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.527159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.528773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.530499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.090611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.103889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b9276cba-5d4a-468b-9e75-b1e277ae4ee8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1237 microversion: 2.1 time: 0.619877 Sep 25 01:05:06.109162 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 528/998] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:05 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1237 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:06.148615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:06.151139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:06.162936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:06.164623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:06.165508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.167119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:06.168067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:06.168711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.370126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.376941 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:06.398760 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4df54094-afa1-4e90-9987-d21b794c946d tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1332 microversion: 2.1 time: 1.201581 Sep 25 01:05:06.399875 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 471/999] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:05 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1332 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:06.405099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09740810-8728-4c54-9710-dd393ca1d309 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebba0dc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:06.513236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09740810-8728-4c54-9710-dd393ca1d309 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-743053901" status: 200 len: 484 microversion: 2.1 time: 0.112162 Sep 25 01:05:06.523505 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 472/1000] 10.222.0.16 () {58 vars in 1229 bytes} [Sun Sep 25 01:05:06 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-743053901 => generated 484 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:06.530353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c6347789-5dcf-4725-8d03-53ed0256c293 req-edeb07ef-62fe-47cb-8cd2-de6aa05eab5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "name": "network-vif-unplugged", "status": "completed", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:06.546899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c6347789-5dcf-4725-8d03-53ed0256c293 req-edeb07ef-62fe-47cb-8cd2-de6aa05eab5e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:06.547705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c6347789-5dcf-4725-8d03-53ed0256c293 req-edeb07ef-62fe-47cb-8cd2-de6aa05eab5e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:06.548301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c6347789-5dcf-4725-8d03-53ed0256c293 req-edeb07ef-62fe-47cb-8cd2-de6aa05eab5e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.560576 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c6347789-5dcf-4725-8d03-53ed0256c293 req-edeb07ef-62fe-47cb-8cd2-de6aa05eab5e service nova] Creating event network-vif-unplugged:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:05:06.567998 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c6347789-5dcf-4725-8d03-53ed0256c293 req-edeb07ef-62fe-47cb-8cd2-de6aa05eab5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041286 Sep 25 01:05:06.569193 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 473/1001] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:06.576287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:06.576997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:06.585247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:06.586348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:06.587155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.588008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:06.588772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:06.589492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.944026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.966043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.968069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.969813 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed147561-cf90-49fd-b39d-332bc3ecd4af tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1569 microversion: 2.25 time: 0.858494 Sep 25 01:05:06.971010 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 529/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:06 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1569 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:06.977441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a4d56884-ed4a-40ef-bc00-b78671792e2b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd2be50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.101852 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a4d56884-ed4a-40ef-bc00-b78671792e2b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?server=c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 957 microversion: 2.1 time: 0.129417 Sep 25 01:05:07.113786 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 530/1003] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:05:06 2022] GET /compute/v2.1/images?server=c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 957 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:07.120360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2483b2a8-cfed-43ae-aa26-1cd6d464249a tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcfa5e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.195478 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2483b2a8-cfed-43ae-aa26-1cd6d464249a tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 484 microversion: 2.1 time: 0.079711 Sep 25 01:05:07.198717 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 531/1004] 10.222.0.16 () {58 vars in 1317 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499 => generated 484 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:07.216390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.216947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:07.231428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.234102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.236733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.239878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.240900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.243753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.401972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:07.411474 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09fad51f-7ddd-4465-bfc0-ac6e8dae8630 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1316 microversion: 2.1 time: 0.840705 Sep 25 01:05:07.412349 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 474/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:06 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1316 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:07.420159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe25d2f3-1c0e-4458-b10e-95280c765eba tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebb8d3a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.503201 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe25d2f3-1c0e-4458-b10e-95280c765eba tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 484 microversion: 2.1 time: 0.089326 Sep 25 01:05:07.504679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 475/1006] 10.222.0.16 () {58 vars in 1303 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499 => generated 484 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:07.520314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.522045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:07.531449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.533306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.534760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.536522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.537513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.538298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.748311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:07.781090 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2d6c514-2213-4091-8eb7-dab0d8a04ced tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1291 microversion: 2.1 time: 0.580970 Sep 25 01:05:07.791534 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 532/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1291 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:07.804124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b05a3c8e-ee76-4f88-8073-a5218c4fd369 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcfa8b0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.948007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b05a3c8e-ee76-4f88-8073-a5218c4fd369 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.154972 Sep 25 01:05:07.948709 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 533/1008] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:07.980701 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:08.115807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48fc301e-357d-4ee6-924a-4dde5c50e1a4 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.165636 Sep 25 01:05:08.121630 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 534/1009] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 25 01:05:07 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:05:08.128936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14395dfc-aee4-4296-99a9-ec3541d53976 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd2b1f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.200504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14395dfc-aee4-4296-99a9-ec3541d53976 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.077321 Sep 25 01:05:08.201106 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 535/1010] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:05:08 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:08.205908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.206532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:08.214107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.214609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.215056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.215782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.216247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.216679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.612992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:08.620838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-167bc5f0-a3a5-4983-a974-96630b146480 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1332 microversion: 2.1 time: 1.114265 Sep 25 01:05:08.621640 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 476/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1332 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:08.626345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbb5918b-5169-4324-98d2-64ee50842437 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Calling method '.version_select at 0x7f7bf016f040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.695245 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-cbb5918b-5169-4324-98d2-64ee50842437 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] HTTP exception thrown: Image not found. Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbb5918b-5169-4324-98d2-64ee50842437 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Request method failure captured: Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lDMmILbh3f_8-L47FzfwW2t1Hp5YF1WvBr-u1W6khM0SZy09hjOfJ8Vh_IUzTpZoMJQfCftj_8QUTBc8JvBofj70qsDE0sxQAB7ZQnb2yK-F9ccZ3SapDd_bEanTBHmW6fZDkFXqGKCnMukfqDRrOsDB5lCdOKXI6yug63s-MSOLE Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:05:08.705211 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/13257d388164408199a58e3792ea8e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_13257d388164408199a58e3792ea8e83"}]}] Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b89692a762994574ba71c634f400323e Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '-1'} Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:08.706798 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.707833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:08.709245 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:08.712155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbb5918b-5169-4324-98d2-64ee50842437 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:08.714705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cbb5918b-5169-4324-98d2-64ee50842437 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.090937 Sep 25 01:05:08.721485 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 477/1012] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:05:08 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:05:08.721772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3015dd51-4b68-4f2d-b33b-c459fe6ed72b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebb8db80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.811899 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3015dd51-4b68-4f2d-b33b-c459fe6ed72b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.095936 Sep 25 01:05:08.812842 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 478/1013] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:05:08 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:08.826679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.827311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:08.833545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.834035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.834472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.835185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.835639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.836122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.997905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.007057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.008723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.010439 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a8c2052-b6ef-468e-a0da-0697315ac082 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1569 microversion: 2.25 time: 0.808368 Sep 25 01:05:09.011179 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 536/1014] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:08 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1569 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:09.016606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21dd107f-41d9-42d6-a0d3-9544fc6c0a94 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Calling method '.version_select at 0x7f7bebcfa160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.042676 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-21dd107f-41d9-42d6-a0d3-9544fc6c0a94 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] HTTP exception thrown: Image not found. Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21dd107f-41d9-42d6-a0d3-9544fc6c0a94 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Request method failure captured: Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/images/ca4afe9f-8b62-4d79-b27f-32521b6cef6j HTTP/1.1 Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lDMmILbh3f_8-L47FzfwW2t1Hp5YF1WvBr-u1W6khM0SZy09hjOfJ8Vh_IUzTpZoMJQfCftj_8QUTBc8JvBofj70qsDE0sxQAB7ZQnb2yK-F9ccZ3SapDd_bEanTBHmW6fZDkFXqGKCnMukfqDRrOsDB5lCdOKXI6yug63s-MSOLE Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:09.045095 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/13257d388164408199a58e3792ea8e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_13257d388164408199a58e3792ea8e83"}]}] Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b89692a762994574ba71c634f400323e Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ca4afe9f-8b62-4d79-b27f-32521b6cef6j'} Sep 25 01:05:09.046517 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ca4afe9f-8b62-4d79-b27f-32521b6cef6j to delete Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.048608 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca4afe9f-8b62-4d79-b27f-32521b6cef6j could not be found. Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:09.050368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21dd107f-41d9-42d6-a0d3-9544fc6c0a94 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:09.051683 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21dd107f-41d9-42d6-a0d3-9544fc6c0a94 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] 10.222.0.16 "DELETE /compute/v2.1/images/ca4afe9f-8b62-4d79-b27f-32521b6cef6j" status: 404 len: 62 microversion: 2.1 time: 0.034506 Sep 25 01:05:09.052739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 537/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:09 2022] DELETE /compute/v2.1/images/ca4afe9f-8b62-4d79-b27f-32521b6cef6j => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:05:09.056590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.057317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:09.065888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.066673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.067470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.068170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.068725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.069217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.074183 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:09.264010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.273502 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43be7ef7-9e9d-4f90-ab28-fcf1d85935e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1291 microversion: 2.1 time: 0.223796 Sep 25 01:05:09.274478 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 538/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1291 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:09.279218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6d003ab-173c-47b5-a3e8-dd49b01beb95 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcfa820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.409863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6d003ab-173c-47b5-a3e8-dd49b01beb95 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-09-25T01%3A02%3A36Z" status: 200 len: 6331 microversion: 2.1 time: 0.134006 Sep 25 01:05:09.410819 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 539/1017] 10.222.0.16 () {58 vars in 1220 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-25T01%3A02%3A36Z => generated 6331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:09.418672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b836445-610a-45d4-a1b5-dd3e0763c791 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Calling method '.version_select at 0x7f7bf08603a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.439714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5b836445-610a-45d4-a1b5-dd3e0763c791 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] HTTP exception thrown: Image not found. Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b836445-610a-45d4-a1b5-dd3e0763c791 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Request method failure captured: Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/images/d5f80fbe-6a5f-48b6-aae3-20f4a68fa3251 HTTP/1.1 Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lDMmILbh3f_8-L47FzfwW2t1Hp5YF1WvBr-u1W6khM0SZy09hjOfJ8Vh_IUzTpZoMJQfCftj_8QUTBc8JvBofj70qsDE0sxQAB7ZQnb2yK-F9ccZ3SapDd_bEanTBHmW6fZDkFXqGKCnMukfqDRrOsDB5lCdOKXI6yug63s-MSOLE Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:09.442054 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/13257d388164408199a58e3792ea8e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_13257d388164408199a58e3792ea8e83"}]}] Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b89692a762994574ba71c634f400323e Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'd5f80fbe-6a5f-48b6-aae3-20f4a68fa3251'} Sep 25 01:05:09.443471 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d5f80fbe-6a5f-48b6-aae3-20f4a68fa3251 to delete Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.444262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d5f80fbe-6a5f-48b6-aae3-20f4a68fa3251 could not be found. Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:09.445434 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:05:09.448724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.452110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b836445-610a-45d4-a1b5-dd3e0763c791 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:09.453868 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b836445-610a-45d4-a1b5-dd3e0763c791 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] 10.222.0.16 "DELETE /compute/v2.1/images/d5f80fbe-6a5f-48b6-aae3-20f4a68fa3251" status: 404 len: 62 microversion: 2.1 time: 0.041389 Sep 25 01:05:09.454705 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 540/1018] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:05:09 2022] DELETE /compute/v2.1/images/d5f80fbe-6a5f-48b6-aae3-20f4a68fa3251 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:05:09.462175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5281132b-e7d6-406b-8daa-8b4e9c6b1513 req-d5f89800-02fc-427f-9d2b-f5dc87d71af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadbb54f-1cbd-40d7-948d-a9a2f14f7a73", "name": "network-vif-plugged", "status": "completed", "tag": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:09.473161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5281132b-e7d6-406b-8daa-8b4e9c6b1513 req-d5f89800-02fc-427f-9d2b-f5dc87d71af2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.473778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5281132b-e7d6-406b-8daa-8b4e9c6b1513 req-d5f89800-02fc-427f-9d2b-f5dc87d71af2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.474285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5281132b-e7d6-406b-8daa-8b4e9c6b1513 req-d5f89800-02fc-427f-9d2b-f5dc87d71af2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.486776 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5281132b-e7d6-406b-8daa-8b4e9c6b1513 req-d5f89800-02fc-427f-9d2b-f5dc87d71af2 service nova] Creating event network-vif-plugged:6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc for instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 on n-h1-master-1 Sep 25 01:05:09.492076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5281132b-e7d6-406b-8daa-8b4e9c6b1513 req-d5f89800-02fc-427f-9d2b-f5dc87d71af2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Sep 25 01:05:09.493328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 541/1019] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:09.499978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2beeed94-9596-4ded-9889-a9a09cdcd900 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd44dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.520068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.529523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1ae960f-d7c5-4e4a-9004-5b35b22b3445 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1316 microversion: 2.1 time: 0.706497 Sep 25 01:05:09.530380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 479/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:08 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:09.535896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e42561-428a-42e9-9a16-d010f77251c6 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Calling method '.version_select at 0x7f7bebbd6820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.559511 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2beeed94-9596-4ded-9889-a9a09cdcd900 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-743053901" status: 200 len: 664 microversion: 2.1 time: 0.064804 Sep 25 01:05:09.560260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 542/1021] 10.222.0.16 () {58 vars in 1250 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-743053901 => generated 664 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:09.577045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24952569-dc2b-463d-9a2b-418a92bef668 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd378b0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.583994 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e9e42561-428a-42e9-9a16-d010f77251c6 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] HTTP exception thrown: Image not found. Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e42561-428a-42e9-9a16-d010f77251c6 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Request method failure captured: Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/tempest-invalid-1711257492 HTTP/1.1 Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lDMmILbh3f_8-L47FzfwW2t1Hp5YF1WvBr-u1W6khM0SZy09hjOfJ8Vh_IUzTpZoMJQfCftj_8QUTBc8JvBofj70qsDE0sxQAB7ZQnb2yK-F9ccZ3SapDd_bEanTBHmW6fZDkFXqGKCnMukfqDRrOsDB5lCdOKXI6yug63s-MSOLE Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:05:09.585803 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/13257d388164408199a58e3792ea8e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_13257d388164408199a58e3792ea8e83"}]}] Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b89692a762994574ba71c634f400323e Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'tempest-invalid-1711257492'} Sep 25 01:05:09.587415 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1711257492 to delete Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.588395 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1711257492 could not be found. Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:09.589791 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:05:09.591301 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.597300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e42561-428a-42e9-9a16-d010f77251c6 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:09.598188 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9e42561-428a-42e9-9a16-d010f77251c6 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-1711257492" status: 404 len: 62 microversion: 2.1 time: 0.066713 Sep 25 01:05:09.598754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 480/1022] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:05:09 2022] DELETE /compute/v2.1/images/tempest-invalid-1711257492 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:05:09.607712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-deeebc57-506f-44eb-8c09-389ec59f05f1 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Calling method '.version_select at 0x7f7bebcb3670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.641025 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-deeebc57-506f-44eb-8c09-389ec59f05f1 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] HTTP exception thrown: Image not found. Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-deeebc57-506f-44eb-8c09-389ec59f05f1 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Request method failure captured: Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/8ce2b242-63ab-4c69-9e6e-b48f47f49d48 HTTP/1.1 Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lDMmILbh3f_8-L47FzfwW2t1Hp5YF1WvBr-u1W6khM0SZy09hjOfJ8Vh_IUzTpZoMJQfCftj_8QUTBc8JvBofj70qsDE0sxQAB7ZQnb2yK-F9ccZ3SapDd_bEanTBHmW6fZDkFXqGKCnMukfqDRrOsDB5lCdOKXI6yug63s-MSOLE Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:05:09.643322 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/13257d388164408199a58e3792ea8e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13257d388164408199a58e3792ea8e83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_13257d388164408199a58e3792ea8e83"}]}] Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 13257d388164408199a58e3792ea8e83 Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-176238782 Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b89692a762994574ba71c634f400323e Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-176238782-project Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8ce2b242-63ab-4c69-9e6e-b48f47f49d48'} Sep 25 01:05:09.644838 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8ce2b242-63ab-4c69-9e6e-b48f47f49d48 to delete Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.649588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ce2b242-63ab-4c69-9e6e-b48f47f49d48 could not be found. Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:09.651035 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-deeebc57-506f-44eb-8c09-389ec59f05f1 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:09.652928 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-deeebc57-506f-44eb-8c09-389ec59f05f1 tempest-ImagesDeleteNegativeTestJSON-176238782 tempest-ImagesDeleteNegativeTestJSON-176238782-project] 10.222.0.16 "DELETE /compute/v2.1/images/8ce2b242-63ab-4c69-9e6e-b48f47f49d48" status: 404 len: 62 microversion: 2.1 time: 0.040899 Sep 25 01:05:09.654105 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 481/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:09 2022] DELETE /compute/v2.1/images/8ce2b242-63ab-4c69-9e6e-b48f47f49d48 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:05:09.654214 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24952569-dc2b-463d-9a2b-418a92bef668 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1466 microversion: 2.1 time: 0.076594 Sep 25 01:05:09.661618 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 543/1024] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499 => generated 1466 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:09.663172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.663836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:09.669445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9e15f2f1-973e-456f-91c3-a78065da8255 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bf000e550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.671093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.671914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.673129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.673880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.674497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.674934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.736921 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9e15f2f1-973e-456f-91c3-a78065da8255 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1466 microversion: 2.1 time: 0.074197 Sep 25 01:05:09.748752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 544/1025] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fbd08d518-6437-4fe3-9f18-80806e39a499 => generated 1466 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:09.754427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e17d6a70-099a-4eff-a21d-ead5b5fd18ae tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcfa790>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.853264 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e17d6a70-099a-4eff-a21d-ead5b5fd18ae tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.103075 Sep 25 01:05:09.868981 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 545/1026] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:09.878510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97a474ba-1440-481f-bf73-bf7be4dd8032 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd72c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.961382 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97a474ba-1440-481f-bf73-bf7be4dd8032 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.089502 Sep 25 01:05:09.962082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 546/1027] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:09.980707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48b1c75e-72bd-45dc-9bbb-e26050dc3f5b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebd74310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:10.102413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48b1c75e-72bd-45dc-9bbb-e26050dc3f5b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/a3c714ab-6173-44d8-8a52-bcbf97934f05" status: 200 len: 784 microversion: 2.1 time: 0.126404 Sep 25 01:05:10.103389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 547/1028] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/images/a3c714ab-6173-44d8-8a52-bcbf97934f05 => generated 784 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:10.119803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:10.121991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:10.132995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.133839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.134552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.135695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.136692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.138059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.508419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:10.520722 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-12f07441-23c5-47ca-af9e-7b65d72d6eb2 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1332 microversion: 2.1 time: 0.874048 Sep 25 01:05:10.522412 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 482/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1332 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:10.529028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d6614ba-44fc-41bd-aca6-59384108113e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebb8d8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:10.628008 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d6614ba-44fc-41bd-aca6-59384108113e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.103838 Sep 25 01:05:10.633085 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 483/1030] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:05:10 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:10.646154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:10.646851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:10.653788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.654697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.655363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.657171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.659033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.659771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.115705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.132641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b33e1e69-18cb-4c5c-b8c6-7db5346ae1b7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1291 microversion: 2.1 time: 0.494111 Sep 25 01:05:11.133687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 484/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:10 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1291 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:11.160851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7f53c4f2-17fa-451a-bd4e-5247a369b2cf req-f0afa1a5-23a4-453a-880b-d3551a50539f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6231ebb-d141-4aa8-89f5-86e652654348", "tag": "c00996ac-5e21-4b68-abba-37e06fe2e878"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:11.199129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f53c4f2-17fa-451a-bd4e-5247a369b2cf req-f0afa1a5-23a4-453a-880b-d3551a50539f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.201540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f53c4f2-17fa-451a-bd4e-5247a369b2cf req-f0afa1a5-23a4-453a-880b-d3551a50539f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.203014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f53c4f2-17fa-451a-bd4e-5247a369b2cf req-f0afa1a5-23a4-453a-880b-d3551a50539f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.227194 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7f53c4f2-17fa-451a-bd4e-5247a369b2cf req-f0afa1a5-23a4-453a-880b-d3551a50539f service nova] Creating event network-changed:c00996ac-5e21-4b68-abba-37e06fe2e878 for instance a6231ebb-d141-4aa8-89f5-86e652654348 on n-h1-master-1 Sep 25 01:05:11.233002 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7f53c4f2-17fa-451a-bd4e-5247a369b2cf req-f0afa1a5-23a4-453a-880b-d3551a50539f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097750 Sep 25 01:05:11.234456 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 485/1032] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:11.237109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.244984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:11.246093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:11.249152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.254347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.255086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.255711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.256807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.257697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.258424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.259638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.262443 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec66393b-b9c3-43c1-a5f9-22f5eb06260d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1569 microversion: 2.25 time: 1.149214 Sep 25 01:05:11.263121 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 548/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:10 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1569 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:11.278085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f840324-8aa5-431c-b162-a18f5d4c9172 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebdd0550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:11.733210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.749902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25bbd178-6e96-4cef-b63a-8866157d3170 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1316 microversion: 2.1 time: 0.513287 Sep 25 01:05:11.751031 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 486/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:11 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:11.764039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:11.764964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:11.779635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.780140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.780584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.781868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.782339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.783160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:12.258123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f840324-8aa5-431c-b162-a18f5d4c9172 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e" status: 204 len: 0 microversion: 2.1 time: 0.993881 Sep 25 01:05:12.259804 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 549/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:11 2022] DELETE /compute/v2.1/images/7643167b-b3cd-4839-83dc-94db115e5e3e => generated 0 bytes in 996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:12.268551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:12.270600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:12.278874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:12.279647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:12.280454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:12.282215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:12.283700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:12.284533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:12.585766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:12.594856 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1b4929a6-05da-4b5d-8450-8ce23baba834 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1535 microversion: 2.1 time: 0.841491 Sep 25 01:05:12.611270 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 487/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:11 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1535 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:12.618067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05ac9567-9c4c-459c-87e5-f61153a3b1a3 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebcb35e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:12.941930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:12.962507 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a478c24d-2a1b-469f-aebd-27461066d512 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1358 microversion: 2.1 time: 0.700573 Sep 25 01:05:12.963118 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 550/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:12 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1358 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:12.969041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:12.969691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:12.979159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:12.979900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:12.981264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:12.983464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:12.984250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:12.985741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:13.452767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.490759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.492307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.506159 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-546c29c8-f6aa-400b-b662-84ef3a55fb97 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1569 microversion: 2.25 time: 0.541785 Sep 25 01:05:13.521631 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 551/1038] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:12 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1569 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:13.540433 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05ac9567-9c4c-459c-87e5-f61153a3b1a3 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222" status: 204 len: 0 microversion: 2.1 time: 0.927507 Sep 25 01:05:13.541583 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 488/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:12 2022] DELETE /compute/v2.1/images/110c46a4-0580-4d22-8d91-ec386c329222 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:13.552487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-27b87264-ffe3-4280-951a-a35acb749678 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'create', calling method: .version_select at 0x7f7bebb8de50>, body: {"pool": "d05724ff-ac3f-4b3f-b1a7-77b9bfdac608"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:13.821635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1264203269", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:13.900680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:14.453521 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:14.471339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:14.472471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:14.473331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:14.473957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:14.474590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:14.482794 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=18 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:14.510895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.513306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.514109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.515368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.517925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.518676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.562725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Getting quotas for project e3b524092c484ec3b22d1ce29930fa58. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:14.571108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Getting quotas for user 46ba0c28dade4f7abf4e3ef3dcafa957 and project e3b524092c484ec3b22d1ce29930fa58. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:14.592351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:14.596166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:14.654801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43151e37-8e51-4a08-8574-c20a1d8504a8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131225 Sep 25 01:05:14.656823 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 552/1040] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:05:14.669998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:14.671210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:14.689817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.690376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.690825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.691790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.692256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.692684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:15.928055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:15.966292 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-024946ce-3788-4092-b713-ab426dc811f1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1316 microversion: 2.1 time: 1.306978 Sep 25 01:05:15.968253 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 553/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:14 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1316 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:15.989976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2084985819", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "415df827-dc16-4f16-8d6e-8ae2e1f48ea7"}, {"port": "50fadfa3-bf92-4aac-bdc9-8a535261d330", "tag": "port-1"}, {"port": "2510f7a3-c33d-4ac7-9c28-177187a8049e", "tag": "port-2"}, {"uuid": "86f925eb-4452-409b-b2af-07741dea3018", "tag": "net-1"}, {"uuid": "86f925eb-4452-409b-b2af-07741dea3018"}, {"uuid": "365f064c-f795-443d-9a9d-26acf4614dd5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "365f064c-f795-443d-9a9d-26acf4614dd5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ae9acf07-5800-4220-ac86-63fa8e732f9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ed2305af-f518-4c84-bc9e-b3fd15dcaaa0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9232313e-bbaf-475f-944e-9f43a757868e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--28313375"}], "key_name": "tempest-keypair-922956414", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:16.648709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] validate_networks() for [('415df827-dc16-4f16-8d6e-8ae2e1f48ea7', None, None, None, None, None), (None, None, '50fadfa3-bf92-4aac-bdc9-8a535261d330', None, None, None), (None, None, '2510f7a3-c33d-4ac7-9c28-177187a8049e', None, None, None), ('86f925eb-4452-409b-b2af-07741dea3018', None, None, None, None, None), ('86f925eb-4452-409b-b2af-07741dea3018', None, None, None, None, None), ('365f064c-f795-443d-9a9d-26acf4614dd5', '10.2.2.100', None, None, None, None), ('365f064c-f795-443d-9a9d-26acf4614dd5', '10.2.2.200', None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:17.949127 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-27b87264-ffe3-4280-951a-a35acb749678 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.406065 Sep 25 01:05:17.958083 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 489/1042] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:05:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:17.958083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4569b875-6e5c-4e5c-b602-f5454f874bba", "name": "network-vif-unplugged", "status": "completed", "tag": "9b02ba0e-f61b-4006-b9f3-05b72df925b3"}, {"name": "network-changed", "server_uuid": "4569b875-6e5c-4e5c-b602-f5454f874bba", "tag": "9b02ba0e-f61b-4006-b9f3-05b72df925b3"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:17.968633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:17.969218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:17.969698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:17.980732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] Creating event network-vif-unplugged:9b02ba0e-f61b-4006-b9f3-05b72df925b3 for instance 4569b875-6e5c-4e5c-b602-f5454f874bba on n-h1-master-1 Sep 25 01:05:17.981257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] Creating event network-changed:9b02ba0e-f61b-4006-b9f3-05b72df925b3 for instance 4569b875-6e5c-4e5c-b602-f5454f874bba on n-h1-master-1 Sep 25 01:05:17.986620 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-29d0e666-a743-4141-9102-ea46cb85ab23 req-bec08c01-546d-47f7-b740-dda28a0b156e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035517 Sep 25 01:05:17.987237 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 490/1043] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:17.992533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-546c454a-767c-417a-86fd-0be7c0c67994 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebbd6280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:18.749256 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-546c454a-767c-417a-86fd-0be7c0c67994 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c" status: 204 len: 0 microversion: 2.1 time: 0.760663 Sep 25 01:05:18.750308 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 491/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:17 2022] DELETE /compute/v2.1/images/7f40c443-186f-44ba-9613-10195a57d57c => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:18.756896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:18.758244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:18.766322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:18.766322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:18.766636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:18.767377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:18.768016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:18.768442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.403763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.413625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb8b5cda-74f0-4a7f-af95-102e4cb78f40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1358 microversion: 2.1 time: 0.661435 Sep 25 01:05:19.414214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 492/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:18 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1358 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:19.419673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:19.420577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:19.434802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.435652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.436349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.447198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.448007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.448651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.685584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.696089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.697579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.698769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-58abfb8c-7d1b-4bec-9db1-2d959aebc739 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1569 microversion: 2.25 time: 0.282978 Sep 25 01:05:19.699332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 493/1046] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:19 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:19.705084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:19.705941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:19.714716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.715243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.715686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.716431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.716922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.717355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.795695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.805449 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ecbdc75e-cbd4-47bc-a001-d0452854c5b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1275 microversion: 2.1 time: 0.104798 Sep 25 01:05:19.806446 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 494/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:19 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:19.816297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:19.816915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:19.830515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.831396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.832152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.834182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.835031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.835767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.076827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:20.084596 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9e32f1a-b178-4ff4-934d-a3934ff5a3a1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1316 microversion: 2.1 time: 0.274031 Sep 25 01:05:20.085178 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 495/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:19 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:20.090453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c7585f70-ea51-4965-a4e9-5b41fb4581e3 req-17fa1f2b-a47f-4d5c-b2c0-55f07c7b9b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6231ebb-d141-4aa8-89f5-86e652654348", "name": "network-vif-plugged", "status": "completed", "tag": "c00996ac-5e21-4b68-abba-37e06fe2e878"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:20.096657 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:20.102496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c7585f70-ea51-4965-a4e9-5b41fb4581e3 req-17fa1f2b-a47f-4d5c-b2c0-55f07c7b9b33 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.102980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c7585f70-ea51-4965-a4e9-5b41fb4581e3 req-17fa1f2b-a47f-4d5c-b2c0-55f07c7b9b33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.103416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c7585f70-ea51-4965-a4e9-5b41fb4581e3 req-17fa1f2b-a47f-4d5c-b2c0-55f07c7b9b33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.117900 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c7585f70-ea51-4965-a4e9-5b41fb4581e3 req-17fa1f2b-a47f-4d5c-b2c0-55f07c7b9b33 service nova] Creating event network-vif-plugged:c00996ac-5e21-4b68-abba-37e06fe2e878 for instance a6231ebb-d141-4aa8-89f5-86e652654348 on n-h1-master-1 Sep 25 01:05:20.122994 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c7585f70-ea51-4965-a4e9-5b41fb4581e3 req-17fa1f2b-a47f-4d5c-b2c0-55f07c7b9b33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 Sep 25 01:05:20.123594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 496/1049] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:20.130887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'action', calling method: .version_select at 0x7f7bf23d49d0>, body: {"addFloatingIp": {"address": "172.35.6.54"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:20.133454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:20.139657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.140145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.140592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.141589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.142041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.142464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.214340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:05:20.214747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquired lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:05:21.432490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:21.433022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:21.433389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:21.433837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:21.434267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:21.443523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:21.444012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:21.444462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:21.445201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:21.445684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:21.446115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:21.465824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Getting quotas for project 624fa9637d2844fbbce4439455fbe41f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:21.471817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Getting quotas for user 1e62f0277cf04e87be2017098f3d6327 and project 624fa9637d2844fbbce4439455fbe41f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:21.672402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:21.676770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ae9acf07-5800-4220-ac86-63fa8e732f9c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ed2305af-f518-4c84-bc9e-b3fd15dcaaa0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9232313e-bbaf-475f-944e-9f43a757868e',volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:22.082004 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48f9f042-5443-4c05-9675-526cbc51dcec tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 6.110096 Sep 25 01:05:22.082578 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 554/1050] 10.222.0.16 () {62 vars in 1189 bytes} [Sun Sep 25 01:05:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 6114 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:05:22.087578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:22.088139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:22.095253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:22.096149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:22.096660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:22.097483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:22.098181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:22.098813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:22.138332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:05:22.247360 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83b914a0-3419-42f2-81f2-07e935eb0082 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 204 len: 0 microversion: 2.1 time: 0.162559 Sep 25 01:05:22.248761 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 555/1051] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:05:22 2022] DELETE /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:22.410413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1053838115", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:22.472403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:23.218287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:23.219304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:23.219855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:23.220342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:23.220979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:23.230851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.231338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.231786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.232523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.233085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.233719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.253714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Getting quotas for project 829ed353f9104a14b276d36b480b850f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:23.259586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Getting quotas for user 10739e6066e3468b98e14168ff2df181 and project 829ed353f9104a14b276d36b480b850f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:23.286695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:23.290758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:23.355726 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27422b16-c7ee-4db2-950d-ce4fdbe31b1c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104558 Sep 25 01:05:23.356706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 556/1052] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:05:23.368239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Building network info cache for instance {{(pid=122384) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:05:23.400476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-521bee14-5992-47b4-84ae-6aa5f9d0f11e req-7ca818c9-51e8-4e93-956b-9cf3c937d201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d848e47a-66a6-4630-ad21-d24380ffc726", "tag": "960fd715-aae2-47ef-8376-ebb1c085dc62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:23.428301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-521bee14-5992-47b4-84ae-6aa5f9d0f11e req-7ca818c9-51e8-4e93-956b-9cf3c937d201 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.428780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-521bee14-5992-47b4-84ae-6aa5f9d0f11e req-7ca818c9-51e8-4e93-956b-9cf3c937d201 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.429572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-521bee14-5992-47b4-84ae-6aa5f9d0f11e req-7ca818c9-51e8-4e93-956b-9cf3c937d201 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.448917 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-521bee14-5992-47b4-84ae-6aa5f9d0f11e req-7ca818c9-51e8-4e93-956b-9cf3c937d201 service nova] Creating event network-changed:960fd715-aae2-47ef-8376-ebb1c085dc62 for instance d848e47a-66a6-4630-ad21-d24380ffc726 on n-h2-master-1 Sep 25 01:05:23.456358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-521bee14-5992-47b4-84ae-6aa5f9d0f11e req-7ca818c9-51e8-4e93-956b-9cf3c937d201 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059132 Sep 25 01:05:23.457504 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 557/1053] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:23.465702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:23.470304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:23.482184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.482742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.484735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.485504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.486271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.486717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.032139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.047629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-44adb023-1966-4527-bafe-035ab0fdea75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1358 microversion: 2.1 time: 0.585603 Sep 25 01:05:24.064554 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 558/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:23 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1358 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:24.079543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:24.081321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:24.098429 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:24.105550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.106168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.106643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.107394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.107850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.108279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.699401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.711814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.713968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.718248 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f16bfbaa-cc82-4492-93f6-87845dacdaf7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1569 microversion: 2.25 time: 0.648271 Sep 25 01:05:24.719276 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 559/1055] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:24 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1569 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:24.743717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:24.744428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:24.752273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.752834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.753574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.754513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.755209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.755856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:25.809914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:25.820017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07507839-fa4a-4f56-9f68-b49cd98ed6bf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 1.088315 Sep 25 01:05:25.833886 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 560/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:24 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:25.841720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:25.842552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:25.850661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:25.851753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:25.852343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:25.853643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:25.854250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:25.854821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.366439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Updating instance_info_cache with network_info: [{"id": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc", "address": "fa:16:3e:b4:f9:01", "network": {"id": "424f6113-9606-4e62-8840-759afa211883", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-614242377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d22d569cfdfb47619e63f469ad2d00bd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6e0d4b6a-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:05:26.382685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Releasing lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:05:26.393199 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2f4dd3f-daad-4748-a8ae-25367bc2b361 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action" status: 202 len: 0 microversion: 2.1 time: 6.266354 Sep 25 01:05:26.394417 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 497/1057] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:20 2022] POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action => generated 0 bytes in 6270 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:05:26.400094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:26.401114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:26.407037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.409526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.410149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.410937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.418843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.419562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.420279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.428536 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-177d22df-c832-4e58-aba3-74fcd2b3b4df tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1466 microversion: 2.1 time: 0.593132 Sep 25 01:05:26.431008 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 561/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:25 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1466 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:26.454985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:26.457148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:26.473013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.475045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.475556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.476275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.476735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.479158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.754946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.770928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.772727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.774003 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9658bca1-95a3-412a-8186-0d40381893ea tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1593 microversion: 2.42 time: 0.378471 Sep 25 01:05:26.774793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 498/1059] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:26 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1593 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:26.792645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:26.795057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:26.805532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.806420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.807408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.808692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.809619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.810276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.812919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.831403 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-638ec3f2-37c7-4f9a-8771-d11c1d24044c tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 200 len: 1431 microversion: 2.1 time: 0.399000 Sep 25 01:05:26.847987 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 562/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:26 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 1431 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:26.853650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:26.854473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:26.865556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.866346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.872019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.873044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.874005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.875263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.525784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:27.537362 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6301d00a-5b71-4ecf-80b5-dfcf3ec5e107 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1320 microversion: 2.1 time: 0.750710 Sep 25 01:05:27.545434 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 499/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:26 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:27.555185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-10a69073-d6fd-4b46-90b9-5ebf7f69ee7a req-1b44dfd2-97b9-4bc6-808d-2c397ba5781f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848e47a-66a6-4630-ad21-d24380ffc726", "name": "network-vif-plugged", "status": "completed", "tag": "960fd715-aae2-47ef-8376-ebb1c085dc62"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:27.568728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-10a69073-d6fd-4b46-90b9-5ebf7f69ee7a req-1b44dfd2-97b9-4bc6-808d-2c397ba5781f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.569930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-10a69073-d6fd-4b46-90b9-5ebf7f69ee7a req-1b44dfd2-97b9-4bc6-808d-2c397ba5781f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.571079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-10a69073-d6fd-4b46-90b9-5ebf7f69ee7a req-1b44dfd2-97b9-4bc6-808d-2c397ba5781f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.586844 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:27.589308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-10a69073-d6fd-4b46-90b9-5ebf7f69ee7a req-1b44dfd2-97b9-4bc6-808d-2c397ba5781f service nova] Creating event network-vif-plugged:960fd715-aae2-47ef-8376-ebb1c085dc62 for instance d848e47a-66a6-4630-ad21-d24380ffc726 on n-h2-master-1 Sep 25 01:05:27.597940 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-10a69073-d6fd-4b46-90b9-5ebf7f69ee7a req-1b44dfd2-97b9-4bc6-808d-2c397ba5781f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049214 Sep 25 01:05:27.599301 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 500/1062] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:27.612387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d0d81382-9e99-4a3c-8e62-4db5b0e30fe6 req-38a65d4f-7c47-4617-991c-ec94e9b1a584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cadbb54f-1cbd-40d7-948d-a9a2f14f7a73", "tag": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:27.626920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d0d81382-9e99-4a3c-8e62-4db5b0e30fe6 req-38a65d4f-7c47-4617-991c-ec94e9b1a584 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.627389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d0d81382-9e99-4a3c-8e62-4db5b0e30fe6 req-38a65d4f-7c47-4617-991c-ec94e9b1a584 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.627882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d0d81382-9e99-4a3c-8e62-4db5b0e30fe6 req-38a65d4f-7c47-4617-991c-ec94e9b1a584 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.654637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:27.662009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d0d81382-9e99-4a3c-8e62-4db5b0e30fe6 req-38a65d4f-7c47-4617-991c-ec94e9b1a584 service nova] Creating event network-changed:6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc for instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 on n-h1-master-1 Sep 25 01:05:27.669667 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1618b08e-57c0-4831-97d3-9028c770b5ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1358 microversion: 2.1 time: 0.818772 Sep 25 01:05:27.670272 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 563/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:26 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1358 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:27.679353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d0d81382-9e99-4a3c-8e62-4db5b0e30fe6 req-38a65d4f-7c47-4617-991c-ec94e9b1a584 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066234 Sep 25 01:05:27.680026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 501/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:27.683758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:27.684647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:27.685606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdc27059-2f3e-4033-85dd-265c8d24435c tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'create', calling method: .version_select at 0x7f7bebbd6d30>, body: {"pool": "d05724ff-ac3f-4b3f-b1a7-77b9bfdac608"} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:27.708918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.712027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.712663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.717178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.717940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.720820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:28.497324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.521069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.522687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.524885 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5384f7de-8ca5-4557-b70d-2f1cfe9d5276 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1544 microversion: 2.25 time: 0.853656 Sep 25 01:05:28.526012 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 564/1065] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:27 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1544 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:28.531322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:28.532432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:28.539902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:28.540516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:28.542821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:28.554672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:28.557629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:28.558391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:28.595968 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:29.000066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f3555eb-2982-488e-8fc3-03859d0fec4e tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1617 microversion: 2.1 time: 0.472187 Sep 25 01:05:29.000830 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 565/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:28 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1617 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:29.016434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:29.018189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:29.060862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:29.061375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:29.061850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:29.066073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:29.066810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:29.067516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:29.389379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:29.399552 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-959d11a0-bb2b-4466-a513-d4ae808177d6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 0.388816 Sep 25 01:05:29.400258 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 566/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:29 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:29.409995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:29.410781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:29.417312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:29.417923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:29.418497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:29.419206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:29.419758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:29.420440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.263744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.275293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.277139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.278745 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a0aa254-669f-42ab-8bc2-307d0121706e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1659 microversion: 2.42 time: 0.877234 Sep 25 01:05:30.279675 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 567/1068] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:29 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1659 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:30.287419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:30.288286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: bd08d518-6437-4fe3-9f18-80806e39a499] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:30.295002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.295889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.296841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.297892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.299386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.300066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.317274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] HTTP exception thrown: Instance bd08d518-6437-4fe3-9f18-80806e39a499 could not be found. Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Request method failure captured: Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 HTTP/1.1 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6irxrNhcISdeHqY5UvukU2tHWT0ltwvi3GeQTdPVQxwSZZXDEm8MUVz8Ey5FVSkHe_HWJfZKR8bS0CUtjGknIFZ7Kj3iuLSiNQF-4m34QP4NbpfCeNjpIUJse07vQy20uFhsYAFYIYAcU46qIR1u3ZghyvNlNQ-W7ehDSr3hr8kY_o Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 298a602ff055472e9ac0f14f846f8160 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ListImageFiltersTestJSON-1001830576 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/298a602ff055472e9ac0f14f846f8160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/298a602ff055472e9ac0f14f846f8160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/298a602ff055472e9ac0f14f846f8160"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_298a602ff055472e9ac0f14f846f8160"}]}] Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ListImageFiltersTestJSON-1001830576 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 298a602ff055472e9ac0f14f846f8160 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1001830576 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ListImageFiltersTestJSON-1001830576-project Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 5bfdfd44cd064a3f88e8a5c2a3b09307 Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ListImageFiltersTestJSON-1001830576-project Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: exception: Instance bd08d518-6437-4fe3-9f18-80806e39a499 could not be found. Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'bd08d518-6437-4fe3-9f18-80806e39a499'} Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd08d518-6437-4fe3-9f18-80806e39a499 could not be found. Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd08d518-6437-4fe3-9f18-80806e39a499 could not be found. Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:30.320190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd08d518-6437-4fe3-9f18-80806e39a499 could not be found. Sep 25 01:05:30.324451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:30.326511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Returning 404 to user: Instance bd08d518-6437-4fe3-9f18-80806e39a499 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:30.328358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d715895a-cba9-442d-b66d-b365ffb1d131 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499" status: 404 len: 111 microversion: 2.1 time: 0.046848 Sep 25 01:05:30.329170 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 568/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:30 2022] GET /compute/v2.1/servers/bd08d518-6437-4fe3-9f18-80806e39a499 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:30.334227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3b4210a2-8d87-4457-99cd-01c56a67be16 req-1891db33-27e4-4e2b-9b6a-8703f8760296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d2f0eb-1f9b-4fd7-ab64-370a440914bf", "tag": "ff7a8655-deb7-4ec6-9655-8f4f4de5fef6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:30.349274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3b4210a2-8d87-4457-99cd-01c56a67be16 req-1891db33-27e4-4e2b-9b6a-8703f8760296 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.350330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3b4210a2-8d87-4457-99cd-01c56a67be16 req-1891db33-27e4-4e2b-9b6a-8703f8760296 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.350993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3b4210a2-8d87-4457-99cd-01c56a67be16 req-1891db33-27e4-4e2b-9b6a-8703f8760296 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.365204 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3b4210a2-8d87-4457-99cd-01c56a67be16 req-1891db33-27e4-4e2b-9b6a-8703f8760296 service nova] Creating event network-changed:ff7a8655-deb7-4ec6-9655-8f4f4de5fef6 for instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf on n-h1-master-1 Sep 25 01:05:30.373224 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3b4210a2-8d87-4457-99cd-01c56a67be16 req-1891db33-27e4-4e2b-9b6a-8703f8760296 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042178 Sep 25 01:05:30.374025 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 569/1070] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:30.380434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bdd14107-223a-48a0-acd0-a0a04abf929c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '.version_select at 0x7f7bebbd4ca0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:30.383776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd14107-223a-48a0-acd0-a0a04abf929c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.385198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd14107-223a-48a0-acd0-a0a04abf929c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.386362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd14107-223a-48a0-acd0-a0a04abf929c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.398757 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bdd14107-223a-48a0-acd0-a0a04abf929c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.023564 Sep 25 01:05:30.399436 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 570/1071] 10.222.0.16 () {60 vars in 1184 bytes} [Sun Sep 25 01:05:30 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:30.404277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:30.405223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:30.413329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.414882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.415340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.417525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.418293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.418750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.913513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.938906 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0992ccbf-5eeb-4c8b-90be-c839d790a7f3 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1320 microversion: 2.1 time: 0.535269 Sep 25 01:05:30.940856 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 571/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:30 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:30.949600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:30.952430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:30.966550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.967111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.967737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.969039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.969706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.970296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.403732 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:31.413976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e6ff9b80-7546-4e0a-8353-c96733840738 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1539 microversion: 2.1 time: 0.471691 Sep 25 01:05:31.414554 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 572/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:30 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1539 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:31.422601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-427306441", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91"]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:31.488467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:31.843866 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdc27059-2f3e-4033-85dd-265c8d24435c tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.161757 Sep 25 01:05:31.845062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 502/1074] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:05:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:31.849775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd08d518-6437-4fe3-9f18-80806e39a499", "name": "network-vif-deleted", "tag": "fa5e21a1-b778-4eb1-8da8-eb1d745d41de"}, {"name": "network-changed", "server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:31.866040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.866642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.867084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.881883 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] Creating event network-vif-deleted:fa5e21a1-b778-4eb1-8da8-eb1d745d41de for instance bd08d518-6437-4fe3-9f18-80806e39a499 on n-h1-master-1 Sep 25 01:05:31.882349 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] Creating event network-changed:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:05:31.891957 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-66100d8c-c57b-4f78-ae53-a0de1f4b42f6 req-4d51dac8-f7d2-418e-beff-a0354a826141 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045624 Sep 25 01:05:31.892561 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 503/1075] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:31.897788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:31.898371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:31.905182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.906582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.907265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.907986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.908446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.908875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.938134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:05:31.950945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:31.951370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:31.951927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:31.952422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:31.955059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:31.964019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.964809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.965282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.966492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.967024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.967465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.988784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:31.993947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:32.008551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:32.011112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:32.027635 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ec8ad63-6a23-4630-bf89-688e7315fbec tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 204 len: 0 microversion: 2.1 time: 0.133522 Sep 25 01:05:32.028410 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 504/1076] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:05:31 2022] DELETE /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:32.034533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:32.035341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:32.041267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.041915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.042444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.043249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.043785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.044270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.062521 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-070eada3-fcc5-46ae-96c0-5aef3936fb12 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644989 Sep 25 01:05:32.063964 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 573/1077] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:05:32.068720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:32.069541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:32.076784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.078225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.079341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.080135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.080669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.081167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.267120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:32.278295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:32.284448 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbb87fb0-8290-4fbb-8e2f-348e0fc9ebe7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 2037 microversion: 2.25 time: 0.254362 Sep 25 01:05:32.286164 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 505/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:32 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 2037 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:32.287119 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9af00780-c79d-488a-b810-498e2346e08c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 0.222085 Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.301437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.302472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.303066 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 574/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:32 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:32.319117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:32.319673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:32.326866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.327448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.328606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.330079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.330628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.331229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.458343 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9eacc250-6c1f-4c76-93c3-d0d908748b40 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153449 Sep 25 01:05:32.458934 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 575/1080] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:05:32 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:32.473967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'action', calling method: .version_select at 0x7f7bf194d670>, body: {"addFloatingIp": {"address": "172.35.6.245"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:32.477096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:32.485855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.486284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.486776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.487729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.488369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.488795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.545728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:32.558385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:32.560222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:32.561714 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3624e7a-e467-4fa4-bff7-75030e09d65e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1704 microversion: 2.42 time: 0.274395 Sep 25 01:05:32.569688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:05:32.570191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquired lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:05:32.578403 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 506/1081] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:32 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1704 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:32.586716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:32.587340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:32.594138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.594627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.595061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.595759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.596217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.596644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.304820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:33.314035 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b79f28d6-2ed0-4d95-a811-0891fa886176 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1320 microversion: 2.1 time: 0.734421 Sep 25 01:05:33.314996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 507/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:32 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1320 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:33.320136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:33.321093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:33.329975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.330866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.331606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.332549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.333005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.333449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.699852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:33.709947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbcba3bd-c4e3-4030-8076-6806a46c2be7 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 1473 microversion: 2.1 time: 0.393584 Sep 25 01:05:33.710905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 508/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:33 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:33.715896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:33.716846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:33.726212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.727105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.727981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.729346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.730123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.731048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.750128 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608.", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:05:33.752556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Releasing lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:05:33.755144 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] HTTP exception thrown: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.755144 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Request method failure captured: Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action HTTP/1.1 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 46 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ky1SDasxMV9PwGWi-3X2jpOJKHOe-aq04KVvQhcmFZLQ_gC2d_IsSEpOzZEm4HWggU3kV7-QVb4knh9wKtYot5BuKdKEME6vYa3Y1uykx4Pzyf3BUV06ha2ezqBZqw5qaWkNp-u3Q2N5TXMdJP0z5hx4ag9mQBUitothpS_8dthF4 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22d569cfdfb47619e63f469ad2d00bd"}]}] Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f07489ff6ce74b7cab3b78a9654e4192 Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: {"addFloatingIp": {"address": "172.35.6.245"}} Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'cadbb54f-1cbd-40d7-948d-a9a2f14f7a73', 'body': {'addFloatingIp': {'address': '172.35.6.245'}}} Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:05:33.760501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] Sep 25 01:05:33.772587 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:33.786202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Returning 400 to user: Cannot associate floating IP 172.35.6.245 (fcfd8372-674e-4b5a-a8b2-095549c067dc) with port 6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network d05724ff-ac3f-4b3f-b1a7-77b9bfdac608. Sep 25 01:05:33.786202 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-82f3fd3a-ecd0-40ff-9d7d-03ecf5ea92b6'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:33.786799 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c6f5e6d-367e-4012-9a61-82cc241de9d8 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action" status: 400 len: 381 microversion: 2.1 time: 1.314315 Sep 25 01:05:33.791450 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 576/1084] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:32 2022] POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action => generated 381 bytes in 1329 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:05:33.795301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa4f5e2f-7668-4348-a5e7-18b2c96d4f1f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Action: 'create', calling method: .version_select at 0x7f7bebcfac10>, body: {"keypair": {"name": "tempest-keypair-1480425643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjti8ucbRYmaMFzquu2m1aDgh0QueL6IskhuoUf2q9Mp1Fu4MEaFBJsIis3Fm2PaGCP6ByaIxe685nFG1GROO/1rk8UjLOc5tFvS1Ooeov2FCsf74a2hqRLSWNVpjEwNA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:33.815028 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=29 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:33.817676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-aa4f5e2f-7668-4348-a5e7-18b2c96d4f1f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for project 868947b52a1d48d6be6e81a2b8718441. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:33.824710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-aa4f5e2f-7668-4348-a5e7-18b2c96d4f1f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for user 545456a4a4e540be9138c47b0df77bbf and project 868947b52a1d48d6be6e81a2b8718441. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:33.860941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa4f5e2f-7668-4348-a5e7-18b2c96d4f1f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.070650 Sep 25 01:05:33.865257 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:33.869321 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 577/1085] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:05:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:05:33.874167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:33.875540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:33.878959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8d8d7d4-12a8-400a-8bd0-b76155d91f01 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1220 microversion: 2.1 time: 0.166634 Sep 25 01:05:33.880272 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 509/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:33 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:33.884293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.885157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.885869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.886657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:33.887288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.887410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:33.888216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.889003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.902601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.904061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.904835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.907151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.907956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.908555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.764810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:34.774093 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b47016a1-0cfa-41c4-98ce-1ab1147aca34 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 0.903769 Sep 25 01:05:34.775431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 578/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:33 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:34.781251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e133af61-62f1-4239-bd93-c195e2dce751 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '.version_select at 0x7f7bebbd41f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:34.821459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:34.834160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:34.835701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:34.836932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ae051ff-395d-44bf-9264-cd8b41b33ed3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1704 microversion: 2.42 time: 0.954635 Sep 25 01:05:34.837599 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 510/1088] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:33 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1704 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:34.843020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-129bbff7-c237-4a67-8cfd-6f2205d866ff req-f9a3108d-01d1-4b9c-a451-ffffb9863c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d2f0eb-1f9b-4fd7-ab64-370a440914bf", "name": "network-vif-plugged", "status": "completed", "tag": "ff7a8655-deb7-4ec6-9655-8f4f4de5fef6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:34.854360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-129bbff7-c237-4a67-8cfd-6f2205d866ff req-f9a3108d-01d1-4b9c-a451-ffffb9863c44 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.854932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-129bbff7-c237-4a67-8cfd-6f2205d866ff req-f9a3108d-01d1-4b9c-a451-ffffb9863c44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.855424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-129bbff7-c237-4a67-8cfd-6f2205d866ff req-f9a3108d-01d1-4b9c-a451-ffffb9863c44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.871681 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-129bbff7-c237-4a67-8cfd-6f2205d866ff req-f9a3108d-01d1-4b9c-a451-ffffb9863c44 service nova] Creating event network-vif-plugged:ff7a8655-deb7-4ec6-9655-8f4f4de5fef6 for instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf on n-h1-master-1 Sep 25 01:05:34.877844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-129bbff7-c237-4a67-8cfd-6f2205d866ff req-f9a3108d-01d1-4b9c-a451-ffffb9863c44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038293 Sep 25 01:05:34.878832 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 511/1089] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:34.883850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:34.884556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:34.892372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.892865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.893535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.894259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.894880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.895464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:35.948417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:35.965591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b64ce4c-9481-42d9-bc38-afe606513866 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1320 microversion: 2.1 time: 1.085665 Sep 25 01:05:35.966780 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 512/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:34 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1320 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:35.974228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:35.975175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:35.986882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:35.988175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:35.989883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:35.992642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:35.993519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:35.994766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.647300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bfdfd44cd064a3f88e8a5c2a3b09307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298a602ff055472e9ac0f14f846f8160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:36.657608 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc5c6f1f-e671-4e57-8ad1-53f3a0482da8 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 200 len: 1473 microversion: 2.1 time: 0.688841 Sep 25 01:05:36.677969 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 513/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:35 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 1473 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:36.685828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:36.692926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:36.706451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.718460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.719526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.720559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.721281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.722102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.956641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:36.976151 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5996d1e-502d-4186-93fc-0cf20bddac8b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1274 microversion: 2.1 time: 0.296674 Sep 25 01:05:36.977443 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 514/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:36 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1274 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:36.982649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:36.983626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:37.001818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:37.002747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:37.003414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:37.004639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:37.005328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:37.007111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:37.847307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:37.862065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa121d42-33ca-4d37-8d98-e68ad395bbc6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 0.877544 Sep 25 01:05:37.863283 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 515/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:36 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:37.869042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:37.869698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:37.924014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:37.926374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:37.927221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:37.929452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:37.930330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:37.932497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.406473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:38.426386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:38.427886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:38.434307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba791e18-2195-4e82-b6ff-82c98e8ffa28 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1749 microversion: 2.42 time: 0.569710 Sep 25 01:05:38.435574 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 516/1094] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:37 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1749 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:38.446467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:38.447093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:38.464338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.464845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.466011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.466763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.467229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.467663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.602870 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e133af61-62f1-4239-bd93-c195e2dce751 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/fcfd8372-674e-4b5a-a8b2-095549c067dc" status: 202 len: 0 microversion: 2.1 time: 3.826064 Sep 25 01:05:38.604024 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 579/1095] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:05:34 2022] DELETE /compute/v2.1/os-floating-ips/fcfd8372-674e-4b5a-a8b2-095549c067dc => generated 0 bytes in 3827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:05:38.609456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c235dd52-a720-4a17-b150-c5c3acdc0e06 req-febc1385-6477-4e26-bcd4-245a33e852f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d848e47a-66a6-4630-ad21-d24380ffc726", "tag": "960fd715-aae2-47ef-8376-ebb1c085dc62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:38.642795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c235dd52-a720-4a17-b150-c5c3acdc0e06 req-febc1385-6477-4e26-bcd4-245a33e852f2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.645561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c235dd52-a720-4a17-b150-c5c3acdc0e06 req-febc1385-6477-4e26-bcd4-245a33e852f2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.646997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c235dd52-a720-4a17-b150-c5c3acdc0e06 req-febc1385-6477-4e26-bcd4-245a33e852f2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.698636 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c235dd52-a720-4a17-b150-c5c3acdc0e06 req-febc1385-6477-4e26-bcd4-245a33e852f2 service nova] Creating event network-changed:960fd715-aae2-47ef-8376-ebb1c085dc62 for instance d848e47a-66a6-4630-ad21-d24380ffc726 on n-h2-master-1 Sep 25 01:05:38.721102 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c235dd52-a720-4a17-b150-c5c3acdc0e06 req-febc1385-6477-4e26-bcd4-245a33e852f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115626 Sep 25 01:05:38.727068 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 580/1096] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:38.750420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:38.751419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] [instance: c6481325-caf4-4ae4-ba40-51557ae152c1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:38.768413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.769814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.771843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.772706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.774656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.775614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.808871 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] HTTP exception thrown: Instance c6481325-caf4-4ae4-ba40-51557ae152c1 could not be found. Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Request method failure captured: Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 HTTP/1.1 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6irxrNhcISdeHqY5UvukU2tHWT0ltwvi3GeQTdPVQxwSZZXDEm8MUVz8Ey5FVSkHe_HWJfZKR8bS0CUtjGknIFZ7Kj3iuLSiNQF-4m34QP4NbpfCeNjpIUJse07vQy20uFhsYAFYIYAcU46qIR1u3ZghyvNlNQ-W7ehDSr3hr8kY_o Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 298a602ff055472e9ac0f14f846f8160 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ListImageFiltersTestJSON-1001830576 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/298a602ff055472e9ac0f14f846f8160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/298a602ff055472e9ac0f14f846f8160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/298a602ff055472e9ac0f14f846f8160"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_298a602ff055472e9ac0f14f846f8160"}]}] Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ListImageFiltersTestJSON-1001830576 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 298a602ff055472e9ac0f14f846f8160 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1001830576 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ListImageFiltersTestJSON-1001830576-project Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 5bfdfd44cd064a3f88e8a5c2a3b09307 Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ListImageFiltersTestJSON-1001830576-project Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: exception: Instance c6481325-caf4-4ae4-ba40-51557ae152c1 could not be found. Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'c6481325-caf4-4ae4-ba40-51557ae152c1'} Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6481325-caf4-4ae4-ba40-51557ae152c1 could not be found. Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6481325-caf4-4ae4-ba40-51557ae152c1 could not be found. Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:38.813111 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6481325-caf4-4ae4-ba40-51557ae152c1 could not be found. Sep 25 01:05:38.817442 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:38.828892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Returning 404 to user: Instance c6481325-caf4-4ae4-ba40-51557ae152c1 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:38.830956 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ea2f7d2c-0d2c-49d9-b13c-04296e576146 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1" status: 404 len: 111 microversion: 2.1 time: 0.097067 Sep 25 01:05:38.832122 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 581/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:38 2022] GET /compute/v2.1/servers/c6481325-caf4-4ae4-ba40-51557ae152c1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:38.837379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1427752343", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "defca061-1fc0-4eb4-a3fe-f0e809a541e4"}], "security_groups": [{"name": "tempest-securitygroup--1903533512"}], "key_name": "tempest-keypair-1480425643", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:39.100859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] validate_networks() for [('defca061-1fc0-4eb4-a3fe-f0e809a541e4', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:39.696369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:39.713674 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1170fa41-29d3-4574-867e-42db069b3648 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1470 microversion: 2.1 time: 1.276828 Sep 25 01:05:39.732552 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 517/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:38 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1470 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:39.743602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:39.744141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:39.760911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.763963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.764474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.767367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.769738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.770679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.814969 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:40.214690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:40.223836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8a85a20-9fa6-4592-9d67-343d2b040623 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1316 microversion: 2.1 time: 0.490095 Sep 25 01:05:40.224902 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 518/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:39 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:40.230112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'action', calling method: .version_select at 0x7f7bf23d4820>, body: {"removeFloatingIp": {"address": "172.35.6.54"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:40.592716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:40.600273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.601156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.601784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.602780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.603512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.605056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.966790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:40.967608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:40.967744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:40.968436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:40.969086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:40.978449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.978936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.979578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.980319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.980770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.981196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.990019 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=9 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:41.003065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:41.008447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for user 545456a4a4e540be9138c47b0df77bbf and project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:41.026161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:41.028499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:41.082504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6bbd407e-a403-4643-989e-22ff7412b3c9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.248973 Sep 25 01:05:41.083916 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 582/1100] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:05:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:05:41.088879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3be47ea2-ab63-46ab-a5e2-7c05baabde94 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebb869d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:41.127173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:05:41.128338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquired lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:05:41.563855 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3be47ea2-ab63-46ab-a5e2-7c05baabde94 tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/images/4784d6ba-285c-4bfa-92e4-2f9354b6c0bf" status: 204 len: 0 microversion: 2.1 time: 0.478583 Sep 25 01:05:41.564464 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 583/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:41 2022] DELETE /compute/v2.1/images/4784d6ba-285c-4bfa-92e4-2f9354b6c0bf => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:41.573879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:41.574886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:41.603478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:41.604607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:41.606312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:41.610423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:41.612809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:41.614411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:42.050557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:42.085575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-26d054e7-4014-409c-97b4-7110910fccb5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 0.518731 Sep 25 01:05:42.086910 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 584/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:41 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:42.120383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a82f5005-b922-44d3-94c1-bd7940194e05 req-2e87e5a6-5efc-40e0-9890-4629e04797e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa", "tag": "61bf0aef-be4f-4819-a60d-60b39c85f8bb"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:42.134076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a82f5005-b922-44d3-94c1-bd7940194e05 req-2e87e5a6-5efc-40e0-9890-4629e04797e7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:42.134677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a82f5005-b922-44d3-94c1-bd7940194e05 req-2e87e5a6-5efc-40e0-9890-4629e04797e7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:42.135276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a82f5005-b922-44d3-94c1-bd7940194e05 req-2e87e5a6-5efc-40e0-9890-4629e04797e7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:42.153963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a82f5005-b922-44d3-94c1-bd7940194e05 req-2e87e5a6-5efc-40e0-9890-4629e04797e7 service nova] Creating event network-changed:61bf0aef-be4f-4819-a60d-60b39c85f8bb for instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa on n-h1-master-1 Sep 25 01:05:42.160252 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a82f5005-b922-44d3-94c1-bd7940194e05 req-2e87e5a6-5efc-40e0-9890-4629e04797e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070225 Sep 25 01:05:42.165881 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 585/1103] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:42.174721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:42.175626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:42.182552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:42.183227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:42.183862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:42.184719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:42.185967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:42.186473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.286537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.295855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.298209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.299562 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-52eacf30-5c80-4035-bdfb-9b6ee6bcc6a2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1839 microversion: 2.42 time: 1.132006 Sep 25 01:05:43.313867 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 586/1104] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:42 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1839 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:43.431680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.432200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.449923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.452761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.454678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.456383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.457099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.457800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.494951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:05:43.580040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Building network info cache for instance {{(pid=122384) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:05:43.662241 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13cbe44a-7cd2-49f5-b66f-adb5392a3601 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 204 len: 0 microversion: 2.1 time: 0.346909 Sep 25 01:05:43.663080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 587/1105] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:05:43 2022] DELETE /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:43.677009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-986db68c-4b54-4a2f-b16a-fbbfac0d01b4 req-8955e6de-0bc6-4a0b-ad07-46c2344ff58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6481325-caf4-4ae4-ba40-51557ae152c1", "name": "network-vif-deleted", "tag": "28dddea0-0f95-4eaa-a480-7c500b4a3346"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:43.698937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-986db68c-4b54-4a2f-b16a-fbbfac0d01b4 req-8955e6de-0bc6-4a0b-ad07-46c2344ff58a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.701562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-986db68c-4b54-4a2f-b16a-fbbfac0d01b4 req-8955e6de-0bc6-4a0b-ad07-46c2344ff58a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.704056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-986db68c-4b54-4a2f-b16a-fbbfac0d01b4 req-8955e6de-0bc6-4a0b-ad07-46c2344ff58a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.744737 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-986db68c-4b54-4a2f-b16a-fbbfac0d01b4 req-8955e6de-0bc6-4a0b-ad07-46c2344ff58a service nova] Creating event network-vif-deleted:28dddea0-0f95-4eaa-a480-7c500b4a3346 for instance c6481325-caf4-4ae4-ba40-51557ae152c1 on n-h1-master-1 Sep 25 01:05:43.750787 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-986db68c-4b54-4a2f-b16a-fbbfac0d01b4 req-8955e6de-0bc6-4a0b-ad07-46c2344ff58a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084117 Sep 25 01:05:43.751944 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 588/1106] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:43.757846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.758803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.763199 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:43.771759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.772509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.773174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.774139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.774775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.775406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.878628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.893853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.895693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.896936 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8b5a683f-3b28-4e02-8810-fbc6363f3842 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1344 microversion: 2.25 time: 0.143688 Sep 25 01:05:43.898048 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 589/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:43 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:43.906031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.907030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.922842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.923394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.924636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.925735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.926217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.926651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.931721 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:44.295469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:44.309840 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2084daa-60f0-486f-8926-7ee8a5fe7967 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1316 microversion: 2.1 time: 0.410007 Sep 25 01:05:44.311078 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 590/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:43 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:44.319326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5496b187-c2bd-4a3e-ad98-271377256f9b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebb38c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:44.615642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5496b187-c2bd-4a3e-ad98-271377256f9b tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/images/1b7d683a-177e-4a87-95d4-65cd01d18d0c" status: 204 len: 0 microversion: 2.1 time: 0.303267 Sep 25 01:05:44.616238 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 591/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:44 2022] DELETE /compute/v2.1/images/1b7d683a-177e-4a87-95d4-65cd01d18d0c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:44.623363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-dcedea20-5ceb-47d0-a14d-0ffd0b56f46f req-30beeba7-f631-402e-89b8-283dcfd64ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "name": "network-vif-plugged", "status": "completed", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:44.639130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dcedea20-5ceb-47d0-a14d-0ffd0b56f46f req-30beeba7-f631-402e-89b8-283dcfd64ac8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.640489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dcedea20-5ceb-47d0-a14d-0ffd0b56f46f req-30beeba7-f631-402e-89b8-283dcfd64ac8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.641374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dcedea20-5ceb-47d0-a14d-0ffd0b56f46f req-30beeba7-f631-402e-89b8-283dcfd64ac8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.672336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Updating instance_info_cache with network_info: [{"id": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc", "address": "fa:16:3e:b4:f9:01", "network": {"id": "424f6113-9606-4e62-8840-759afa211883", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-614242377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d22d569cfdfb47619e63f469ad2d00bd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6e0d4b6a-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:05:44.698311 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-dcedea20-5ceb-47d0-a14d-0ffd0b56f46f req-30beeba7-f631-402e-89b8-283dcfd64ac8 service nova] Creating event network-vif-plugged:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:05:44.719924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Releasing lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:05:44.721251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc1a8246-8b37-4c1d-a32e-fe77ceeda2ba tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action" status: 202 len: 0 microversion: 2.1 time: 4.494905 Sep 25 01:05:44.722710 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 519/1110] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:40 2022] POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action => generated 0 bytes in 4497 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:05:44.729576 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-dcedea20-5ceb-47d0-a14d-0ffd0b56f46f req-30beeba7-f631-402e-89b8-283dcfd64ac8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111866 Sep 25 01:05:44.730232 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 592/1111] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:44.735102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:44.735993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:44.746186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.747621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.748310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.748427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:44.753654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.754290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:44.754449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.755678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.761591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.762094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.762533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.763410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.775508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.780922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:45.053335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:45.065889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76d7bcf7-19a0-403f-a4ab-cc149975a6b7 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1317 microversion: 2.1 time: 0.340206 Sep 25 01:05:45.067334 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 520/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:44 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:45.091118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:45.094554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:45.118605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:45.119291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:45.120498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:45.121390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:45.125022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:45.125767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:45.377206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:45.401353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-587563c3-6b0f-4f57-b392-88da7b0fc4bb tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1476 microversion: 2.1 time: 0.665293 Sep 25 01:05:45.437064 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 593/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:44 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1476 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:45.444290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-324a93e4-449b-4272-8f73-2e4b67fb9b8e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] Calling method '.version_select at 0x7f7bebb38280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:45.671842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:45.683500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:45.693201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:45.696354 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba4013e1-0433-4fd9-bb47-d9d877606beb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1839 microversion: 2.42 time: 0.609602 Sep 25 01:05:45.699493 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 521/1114] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:45 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1839 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:45.721268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15e13ea5-b889-412a-8788-4029a5de18d9 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '.version_select at 0x7f7bebb388b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:45.872092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-324a93e4-449b-4272-8f73-2e4b67fb9b8e tempest-ListImageFiltersTestJSON-1001830576 tempest-ListImageFiltersTestJSON-1001830576-project] 10.222.0.16 "DELETE /compute/v2.1/images/5c81859e-0fad-47a0-811f-99bc207974ae" status: 204 len: 0 microversion: 2.1 time: 0.431940 Sep 25 01:05:45.873746 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 594/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:45 2022] DELETE /compute/v2.1/images/5c81859e-0fad-47a0-811f-99bc207974ae => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:45.891878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:45.894285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:45.910101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:45.915131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:45.916960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:45.919115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:45.919891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:45.923548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.670580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:46.707486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:46.712721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:46.714312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95b2ba9e-7883-451a-8cb9-c76e3f9ec2a2 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1412 microversion: 2.25 time: 0.838754 Sep 25 01:05:46.726874 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 595/1116] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:45 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1412 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:46.738609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:46.739525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:46.758981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.759304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.759719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.760422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.761113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.761392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.748200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:47.764341 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e798700f-33ea-4988-83e7-04b7cfc8c607 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1316 microversion: 2.1 time: 1.035976 Sep 25 01:05:47.764986 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 596/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:46 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:47.769909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cadbb54f-1cbd-40d7-948d-a9a2f14f7a73", "tag": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc"}, {"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "f3f44f7c-343a-41d4-9458-4367d49b3d8c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:47.793174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.804896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.805701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.820757 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] Creating event network-changed:6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc for instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 on n-h1-master-1 Sep 25 01:05:47.821266 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] Creating event network-changed:f3f44f7c-343a-41d4-9458-4367d49b3d8c for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:05:47.846643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3d57b16f-de08-4046-9bd0-089110607755 req-d447e48e-9cc4-42a4-af5f-cdda5ca7bad8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.080281 Sep 25 01:05:47.847252 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 597/1118] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:47.859608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:47.860322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:47.882639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.883521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.888594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.889877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.891556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.892338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.546439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:48.556130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a52a71e7-d634-4836-a58e-2785305bf8f8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1467 microversion: 2.1 time: 0.705383 Sep 25 01:05:48.556798 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 598/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:47 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1467 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:48.561293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:48.562486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:48.568410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.569110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.569856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.570787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.571431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.572075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.728750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:48.736695 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-633e8a92-c880-450a-9406-7d8477ff8f48 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1434 microversion: 2.1 time: 0.178886 Sep 25 01:05:48.737288 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 599/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:48 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1434 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:48.742410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:48.743021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:48.749548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.750174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.750484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.751160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.751792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.752224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.274947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.287333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15e13ea5-b889-412a-8788-4029a5de18d9 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/39a67116-4276-4d63-aa0a-7c79935999f2" status: 202 len: 0 microversion: 2.1 time: 3.586468 Sep 25 01:05:49.293555 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 522/1121] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:05:45 2022] DELETE /compute/v2.1/os-floating-ips/39a67116-4276-4d63-aa0a-7c79935999f2 => generated 0 bytes in 3593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:05:49.302131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f6166a10-e6cd-4ab2-bdad-1bc6db679d73 req-22bc7ec1-d290-4222-9cca-a04864195ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa", "name": "network-vif-plugged", "status": "completed", "tag": "61bf0aef-be4f-4819-a60d-60b39c85f8bb"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:49.307811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.311701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.317473 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca96171f-bbc5-45f1-b62a-f65edc7d68c7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1848 microversion: 2.42 time: 0.579080 Sep 25 01:05:49.319339 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 600/1122] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:48 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1848 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:49.349689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4115124b-7d4c-480a-b8a8-d1ad6d625128 req-5d7c6735-3150-431e-a709-56b323c4c557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606c6b18-fed9-4c35-a893-073e837e900e", "tag": "064c9227-3e67-4e2b-93a2-32adff32ffbc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:49.355336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f6166a10-e6cd-4ab2-bdad-1bc6db679d73 req-22bc7ec1-d290-4222-9cca-a04864195ac3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.362833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4115124b-7d4c-480a-b8a8-d1ad6d625128 req-5d7c6735-3150-431e-a709-56b323c4c557 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.363629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4115124b-7d4c-480a-b8a8-d1ad6d625128 req-5d7c6735-3150-431e-a709-56b323c4c557 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.364304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4115124b-7d4c-480a-b8a8-d1ad6d625128 req-5d7c6735-3150-431e-a709-56b323c4c557 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.373443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f6166a10-e6cd-4ab2-bdad-1bc6db679d73 req-22bc7ec1-d290-4222-9cca-a04864195ac3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.374657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f6166a10-e6cd-4ab2-bdad-1bc6db679d73 req-22bc7ec1-d290-4222-9cca-a04864195ac3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.377745 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4115124b-7d4c-480a-b8a8-d1ad6d625128 req-5d7c6735-3150-431e-a709-56b323c4c557 service nova] Creating event network-changed:064c9227-3e67-4e2b-93a2-32adff32ffbc for instance 606c6b18-fed9-4c35-a893-073e837e900e on n-h1-master-1 Sep 25 01:05:49.384002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4115124b-7d4c-480a-b8a8-d1ad6d625128 req-5d7c6735-3150-431e-a709-56b323c4c557 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063199 Sep 25 01:05:49.384945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 601/1123] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:49.392060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:49.394394 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f6166a10-e6cd-4ab2-bdad-1bc6db679d73 req-22bc7ec1-d290-4222-9cca-a04864195ac3 service nova] Creating event network-vif-plugged:61bf0aef-be4f-4819-a60d-60b39c85f8bb for instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa on n-h1-master-1 Sep 25 01:05:49.394558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:49.401487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.402141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.402747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.403547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.404200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.404574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.413270 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f6166a10-e6cd-4ab2-bdad-1bc6db679d73 req-22bc7ec1-d290-4222-9cca-a04864195ac3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118088 Sep 25 01:05:49.413987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 523/1124] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:49.600847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a403c654-4075-4240-bd22-394c866de002 tempest-ListImagesTestJSON-788721492 tempest-ListImagesTestJSON-788721492-project] Calling method '.version_select at 0x7f7bebba0820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:49.678711 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a403c654-4075-4240-bd22-394c866de002 tempest-ListImagesTestJSON-788721492 tempest-ListImagesTestJSON-788721492-project] 10.222.0.16 "GET /compute/v2.1/images/a3c714ab-6173-44d8-8a52-bcbf97934f05" status: 200 len: 784 microversion: 2.1 time: 0.263218 Sep 25 01:05:49.679304 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 524/1125] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:49 2022] GET /compute/v2.1/images/a3c714ab-6173-44d8-8a52-bcbf97934f05 => generated 784 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:49.689325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1724579519", "metadata": {"image_type": "test"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:49.692829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:49.701553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.702953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.703409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.704129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.704617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.705506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.751245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Getting quotas for project e3b524092c484ec3b22d1ce29930fa58. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:49.757969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Getting quotas for user 46ba0c28dade4f7abf4e3ef3dcafa957 and project e3b524092c484ec3b22d1ce29930fa58. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:49.817007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.828654 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.830583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.831901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10e0de2a-3419-4008-8942-6661ede24356 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1412 microversion: 2.25 time: 0.445520 Sep 25 01:05:49.845872 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 602/1126] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:49 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1412 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:49.855476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:49.856109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:49.867283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.867751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.868491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.869211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.875819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.876347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.013972 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3283800e-a203-4ef7-96b0-d8ad9d3e3796 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "POST /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257/action" status: 202 len: 0 microversion: 2.1 time: 0.324173 Sep 25 01:05:50.023402 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 525/1127] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:49 2022] POST /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:05:50.034380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34b90ee8-6577-403c-b99e-4474a4d3f54f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34b90ee8-6577-403c-b99e-4474a4d3f54f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Request method failure captured: Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action HTTP/1.1 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 34 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6ky1SDasxMV9PwGWi-3X2jpOJKHOe-aq04KVvQhcmFZLQ_gC2d_IsSEpOzZEm4HWggU3kV7-QVb4knh9wKtYot5BuKdKEME6vYa3Y1uykx4Pzyf3BUV06ha2ezqBZqw5qaWkNp-u3Q2N5TXMdJP0z5hx4ag9mQBUitothpS_8dthF4 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22d569cfdfb47619e63f469ad2d00bd"}]}] Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f07489ff6ce74b7cab3b78a9654e4192 Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: {"addFloatingIp": {"address": ""}} Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'cadbb54f-1cbd-40d7-948d-a9a2f14f7a73', 'body': {'addFloatingIp': {'address': ''}}} Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '' Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:05:50.038940 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 25 01:05:50.043060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:50.045683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34b90ee8-6577-403c-b99e-4474a4d3f54f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:50.046824 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34b90ee8-6577-403c-b99e-4474a4d3f54f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action" status: 400 len: 142 microversion: 2.1 time: 0.019996 Sep 25 01:05:50.048279 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 526/1128] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:50 2022] POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:05:50.057742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d51b3f5-46c8-49b9-baf1-c8c66159a06a tempest-ListImagesTestJSON-788721492 tempest-ListImagesTestJSON-788721492-project] Calling method '.version_select at 0x7f7bebb38940>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:50.122710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d51b3f5-46c8-49b9-baf1-c8c66159a06a tempest-ListImagesTestJSON-788721492 tempest-ListImagesTestJSON-788721492-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.073019 Sep 25 01:05:50.125723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 527/1129] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:05:50 2022] GET /compute/v2.1/images => generated 445 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:50.130378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:50.136888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:50.137669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:50.144598 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:50.146497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.147084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.147554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.148269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.148723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.149148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.150614 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa16990b-de43-4639-9de6-25539d9d62dd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1316 microversion: 2.1 time: 0.311047 Sep 25 01:05:50.170639 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 603/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:49 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:50.179882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d2f0eb-1f9b-4fd7-ab64-370a440914bf", "name": "network-vif-deleted", "tag": "ff7a8655-deb7-4ec6-9655-8f4f4de5fef6"}, {"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "50fadfa3-bf92-4aac-bdc9-8a535261d330"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:50.185700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.186193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.187221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.187690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lazy-loading 'fault' on Instance uuid 77d2f0eb-1f9b-4fd7-ab64-370a440914bf {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:50.209550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.210515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.211224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.225662 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] Creating event network-vif-deleted:ff7a8655-deb7-4ec6-9655-8f4f4de5fef6 for instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf on n-h1-master-1 Sep 25 01:05:50.233768 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] Creating event network-changed:50fadfa3-bf92-4aac-bdc9-8a535261d330 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:05:50.243497 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6e59d47c-1d0e-4634-94cf-578f3f08417f req-624cbc9b-1326-48ec-a0d3-e1c47fa073f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071288 Sep 25 01:05:50.244917 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 604/1131] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:50.251018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfed4fec-60b4-4c45-8e0c-82e34afb66c0 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebc11a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:50.292580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:50.301388 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c64a7ed-9f0f-41fc-8852-cfef9d22c0df tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 200 len: 1310 microversion: 2.1 time: 0.177091 Sep 25 01:05:50.302186 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 528/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:50 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 1310 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:50.305111 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfed4fec-60b4-4c45-8e0c-82e34afb66c0 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.058730 Sep 25 01:05:50.312966 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 605/1133] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:50 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:50.315025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:50.317767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:50.321147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-adf270c8-fb0e-4bd5-bf2e-7567470cdee5 tempest-ListImagesTestJSON-788721492 tempest-ListImagesTestJSON-788721492-project] Calling method '.version_select at 0x7f7bebacc550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:50.324555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.325452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.326466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.326917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.328098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.328779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.357836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:05:50.358233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquired lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:05:50.379006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-adf270c8-fb0e-4bd5-bf2e-7567470cdee5 tempest-ListImagesTestJSON-788721492 tempest-ListImagesTestJSON-788721492-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.071890 Sep 25 01:05:50.379918 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 606/1134] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:05:50 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:50.384778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:50.385722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:50.393493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.394204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.394842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.395973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.396964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.397430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.001331 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:51.016018 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=9 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:51.064353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Releasing lock "refresh_cache-cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:05:51.066692 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] HTTP exception thrown: floating IP not found Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Request method failure captured: Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action HTTP/1.1 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 41 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6ky1SDasxMV9PwGWi-3X2jpOJKHOe-aq04KVvQhcmFZLQ_gC2d_IsSEpOzZEm4HWggU3kV7-QVb4knh9wKtYot5BuKdKEME6vYa3Y1uykx4Pzyf3BUV06ha2ezqBZqw5qaWkNp-u3Q2N5TXMdJP0z5hx4ag9mQBUitothpS_8dthF4 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22d569cfdfb47619e63f469ad2d00bd"}]}] Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f07489ff6ce74b7cab3b78a9654e4192 Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: exception: floating IP not found Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'cadbb54f-1cbd-40d7-948d-a9a2f14f7a73', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 25 01:05:51.070690 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Returning 404 to user: floating IP not found {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6613959-e67b-4a3f-a78b-82ee4c79f6df tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action" status: 404 len: 67 microversion: 2.1 time: 0.769296 Sep 25 01:05:51.074811 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 529/1135] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:50 2022] POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action => generated 67 bytes in 772 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:05:51.085912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.086538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.104945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.106052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.106520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.107250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.112307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.112307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.402626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.413046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.414540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.415719 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e864db45-d1d1-4e59-8930-bafac893ac64 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.034598 Sep 25 01:05:51.424585 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 607/1136] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:50 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:51.432075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c877c440-6ffe-4c22-a7c1-7a7d195c33e3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Action: 'action', calling method: .version_select at 0x7f7bf23e6790>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:51.585793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c877c440-6ffe-4c22-a7c1-7a7d195c33e3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c877c440-6ffe-4c22-a7c1-7a7d195c33e3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Request method failure captured: Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action HTTP/1.1 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 44 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ky1SDasxMV9PwGWi-3X2jpOJKHOe-aq04KVvQhcmFZLQ_gC2d_IsSEpOzZEm4HWggU3kV7-QVb4knh9wKtYot5BuKdKEME6vYa3Y1uykx4Pzyf3BUV06ha2ezqBZqw5qaWkNp-u3Q2N5TXMdJP0z5hx4ag9mQBUitothpS_8dthF4 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22d569cfdfb47619e63f469ad2d00bd"}]}] Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f07489ff6ce74b7cab3b78a9654e4192 Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: exception: Floating IP not found for address 0.0.0.0. Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'cadbb54f-1cbd-40d7-948d-a9a2f14f7a73', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 25 01:05:51.587589 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c877c440-6ffe-4c22-a7c1-7a7d195c33e3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c877c440-6ffe-4c22-a7c1-7a7d195c33e3 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action" status: 404 len: 88 microversion: 2.1 time: 0.163487 Sep 25 01:05:51.594195 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 608/1137] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:51 2022] POST /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73/action => generated 88 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:05:51.596943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.596943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.601629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.603189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.603808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.604239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.605328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.605818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.606251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.621659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.625240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.627670 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-685fc2c3-777b-4d3c-9f36-a0af55de5066 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1412 microversion: 2.25 time: 0.551901 Sep 25 01:05:51.641585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 530/1138] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1412 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:51.641585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc1a2b14-41bb-4d57-8d00-b7d8bb239e33 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebba03a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.707155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc1a2b14-41bb-4d57-8d00-b7d8bb239e33 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.071689 Sep 25 01:05:51.707766 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 531/1139] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:51.714766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.715869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.728932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.729668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.730362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.731318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.731867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.732393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.750160 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] HTTP exception thrown: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Request method failure captured: Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf HTTP/1.1 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lPq3d80hu-uMKRhDMdwICtRFYKhCa25EdEyb7cJWoy_1e5CR4KyHjOdXhKe2UFrKNDs-UCLtSn_ozx4tjuPJ0BlVQiafNUHAF91wfmHsQSq806g1treQeB_3E_skVgfUvStruh97G0jocYUp6ZrOKqwgZz1yIf_7LpwaZF5BP4RNc Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/829ed353f9104a14b276d36b480b850f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_829ed353f9104a14b276d36b480b850f"}]}] Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 10739e6066e3468b98e14168ff2df181 Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '77d2f0eb-1f9b-4fd7-ab64-370a440914bf'} Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.751799 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Returning 404 to user: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d604fe7a-b7db-4f49-9d8a-4d29b28253f8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 404 len: 111 microversion: 2.1 time: 0.044353 Sep 25 01:05:51.759452 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 532/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:51.761011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.761011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.770065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.770800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.771311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.773221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.773856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.774383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.816353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:05:51.935518 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5ab8fa5-bf56-465f-bdff-2da5cb61c5db tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 204 len: 0 microversion: 2.1 time: 0.179501 Sep 25 01:05:51.942884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 533/1141] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:05:51 2022] DELETE /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:51.950201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.951296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.961000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.961750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.962301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.963428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.963979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.964517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.998343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:52.008025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f38b2ef1-0944-447a-9b7e-669f3ef56522 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1464 microversion: 2.1 time: 0.417537 Sep 25 01:05:52.012594 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 609/1142] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1464 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:52.026984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1355103169", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:52.108899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:52.354824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:52.363453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7153ce23-d480-42fe-aef7-9efac58cd264 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1541 microversion: 2.1 time: 0.418433 Sep 25 01:05:52.375528 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 534/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1541 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:52.386321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:52.387323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:52.396650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.397152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.397666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.398417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.398883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.399581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.594851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:52.595886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:52.596627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:52.597609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:52.598259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:52.614526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.616434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.617149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.627405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.628038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.628812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.652438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Getting quotas for project 829ed353f9104a14b276d36b480b850f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:52.664825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Getting quotas for user 10739e6066e3468b98e14168ff2df181 and project 829ed353f9104a14b276d36b480b850f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:52.704324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:52.709420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:52.713790 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d353d90-6130-46bf-bc61-f202087de4b4 tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1615 microversion: 2.1 time: 0.334648 Sep 25 01:05:52.716392 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 535/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:52 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1615 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:52.732567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b0484de3-edee-4af3-befd-e637f273a264 req-57502c0b-f9c5-40f3-a921-323f9c20697c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606c6b18-fed9-4c35-a893-073e837e900e", "name": "network-vif-plugged", "status": "completed", "tag": "064c9227-3e67-4e2b-93a2-32adff32ffbc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:52.764977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b0484de3-edee-4af3-befd-e637f273a264 req-57502c0b-f9c5-40f3-a921-323f9c20697c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.765633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b0484de3-edee-4af3-befd-e637f273a264 req-57502c0b-f9c5-40f3-a921-323f9c20697c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.766520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b0484de3-edee-4af3-befd-e637f273a264 req-57502c0b-f9c5-40f3-a921-323f9c20697c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.793519 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b0484de3-edee-4af3-befd-e637f273a264 req-57502c0b-f9c5-40f3-a921-323f9c20697c service nova] Creating event network-vif-plugged:064c9227-3e67-4e2b-93a2-32adff32ffbc for instance 606c6b18-fed9-4c35-a893-073e837e900e on n-h1-master-1 Sep 25 01:05:52.807235 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b0484de3-edee-4af3-befd-e637f273a264 req-57502c0b-f9c5-40f3-a921-323f9c20697c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086943 Sep 25 01:05:52.807868 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 536/1145] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:52.823476 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de12492c-9324-49bc-ad7a-3a9cb295b990 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801387 Sep 25 01:05:52.824771 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 610/1146] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:05:52.840608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:52.841274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:52.856892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.857783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.860075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.863272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.866840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.868553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.096267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c79df8b8-1400-45ae-9c8e-582e8003357a req-26c1836c-dc4a-4111-8fbb-c145bbbb5fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "2510f7a3-c33d-4ac7-9c28-177187a8049e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:53.108107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c79df8b8-1400-45ae-9c8e-582e8003357a req-26c1836c-dc4a-4111-8fbb-c145bbbb5fe9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.109564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c79df8b8-1400-45ae-9c8e-582e8003357a req-26c1836c-dc4a-4111-8fbb-c145bbbb5fe9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.110348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c79df8b8-1400-45ae-9c8e-582e8003357a req-26c1836c-dc4a-4111-8fbb-c145bbbb5fe9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.127511 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c79df8b8-1400-45ae-9c8e-582e8003357a req-26c1836c-dc4a-4111-8fbb-c145bbbb5fe9 service nova] Creating event network-changed:2510f7a3-c33d-4ac7-9c28-177187a8049e for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:05:53.143627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c79df8b8-1400-45ae-9c8e-582e8003357a req-26c1836c-dc4a-4111-8fbb-c145bbbb5fe9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325389 Sep 25 01:05:53.150824 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 537/1147] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:53.173930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:53.175671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:53.195596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.198453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.198958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.204454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.206285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.209563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.271444 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:53.328769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.353441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.356518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.358076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8d6e55a7-2150-4995-ab70-0e17491332ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.531864 Sep 25 01:05:53.395126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 611/1148] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:52 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:53.400099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a538b4c-6b10-4099-a97e-6c552b9fef27 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebd74310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:53.484807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a538b4c-6b10-4099-a97e-6c552b9fef27 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.088361 Sep 25 01:05:53.486057 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 612/1149] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:53 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:53.505394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8386cd31-02c9-46c7-8543-7438c49cb122 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:53.506053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8386cd31-02c9-46c7-8543-7438c49cb122 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:53.663755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8386cd31-02c9-46c7-8543-7438c49cb122 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.692938 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8386cd31-02c9-46c7-8543-7438c49cb122 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1220 microversion: 2.1 time: 0.191987 Sep 25 01:05:53.695826 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 613/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:53 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1220 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:53.711617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-522329589", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:53.839990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:53.918901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.947564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.950414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.953297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8cd11bdb-e333-4ed9-a7b4-8074dc570025 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1412 microversion: 2.25 time: 0.801119 Sep 25 01:05:53.965438 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 538/1151] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:53 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1412 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:53.965438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:53.965438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:53.969474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.969859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.970489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.971385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.971941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.972366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.511056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:54.521690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-93d31df1-ea4a-41bb-9b73-e7cb670bc2e1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1541 microversion: 2.1 time: 0.565676 Sep 25 01:05:54.541201 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 539/1152] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:53 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1541 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:54.555434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.556630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:54.571688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.572188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.572688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.573928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.574539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.574976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.619526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:54.623272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:54.624521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:54.624911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:54.625338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:54.651905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.652567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.653105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.654235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.655716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.657287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.686139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:54.698385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Getting quotas for user 687667b3aadf4dd591e1335678be938d and project 31eef923c6104d6ea7bb63db20f13dc3. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:54.729489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:54.736163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:54.870724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-908dcdf9-4e3c-48e0-96e3-5a3b58d6a70b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171118 Sep 25 01:05:54.871737 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 614/1153] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:05:54.882707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-050900c9-0306-4062-9563-840a38e3ce0c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb74dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.965575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-050900c9-0306-4062-9563-840a38e3ce0c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.087306 Sep 25 01:05:54.966822 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 615/1154] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:54.972448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.979719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:54.993719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.994233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.994672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.995393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.995849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.996278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.379343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.399968 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a06ae06-0e3b-4280-9f35-985c1dcfd096 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1272 microversion: 2.1 time: 0.431447 Sep 25 01:05:55.402574 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 616/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:55.417651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b7f6189-22c9-45b2-9422-329dd19ab475 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:55.421454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b7f6189-22c9-45b2-9422-329dd19ab475 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:55.468241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.492741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.496956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.503371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67741cf2-08d4-45b2-8a3e-ed3dcf5a2084 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.956938 Sep 25 01:05:55.506136 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 540/1156] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:55.522053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:55.526817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:55.546628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.554060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.558103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.561796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.562464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.565256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.207694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b7f6189-22c9-45b2-9422-329dd19ab475 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.228441 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b7f6189-22c9-45b2-9422-329dd19ab475 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1216 microversion: 2.1 time: 0.822184 Sep 25 01:05:56.229668 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 617/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:55 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1216 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:56.238441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-eb8889a2-9d02-4522-bb95-b15c794d8067 req-7a2a6bff-0772-46fe-92d8-c67b69392bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "55805ffb-c11c-4ab6-8106-f78fa29b3f69"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:56.250945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-eb8889a2-9d02-4522-bb95-b15c794d8067 req-7a2a6bff-0772-46fe-92d8-c67b69392bf9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.251433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-eb8889a2-9d02-4522-bb95-b15c794d8067 req-7a2a6bff-0772-46fe-92d8-c67b69392bf9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.251870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-eb8889a2-9d02-4522-bb95-b15c794d8067 req-7a2a6bff-0772-46fe-92d8-c67b69392bf9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.275436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-eb8889a2-9d02-4522-bb95-b15c794d8067 req-7a2a6bff-0772-46fe-92d8-c67b69392bf9 service nova] Creating event network-changed:55805ffb-c11c-4ab6-8106-f78fa29b3f69 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:05:56.288287 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-eb8889a2-9d02-4522-bb95-b15c794d8067 req-7a2a6bff-0772-46fe-92d8-c67b69392bf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057083 Sep 25 01:05:56.289516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 618/1158] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:56.294768 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2ec30605-ba40-44f6-9c90-dc69c44f1a67 req-4fda5b93-e465-4d51-84f0-55285c4994e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadbb54f-1cbd-40d7-948d-a9a2f14f7a73", "name": "network-vif-deleted", "tag": "6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:56.308687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2ec30605-ba40-44f6-9c90-dc69c44f1a67 req-4fda5b93-e465-4d51-84f0-55285c4994e8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.309657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2ec30605-ba40-44f6-9c90-dc69c44f1a67 req-4fda5b93-e465-4d51-84f0-55285c4994e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.310265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2ec30605-ba40-44f6-9c90-dc69c44f1a67 req-4fda5b93-e465-4d51-84f0-55285c4994e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.342586 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2ec30605-ba40-44f6-9c90-dc69c44f1a67 req-4fda5b93-e465-4d51-84f0-55285c4994e8 service nova] Creating event network-vif-deleted:6e0d4b6a-7299-4832-8cb5-c63bd89b9ecc for instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 on n-h1-master-1 Sep 25 01:05:56.352692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2ec30605-ba40-44f6-9c90-dc69c44f1a67 req-4fda5b93-e465-4d51-84f0-55285c4994e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061435 Sep 25 01:05:56.354110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 619/1159] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:56.363884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:56.366044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:56.376504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.377991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.378687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.397097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.397835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.400337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.474076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.475004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.476195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.476983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lazy-loading 'fault' on Instance uuid cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:56.630624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.641636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07489ff6ce74b7cab3b78a9654e4192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22d569cfdfb47619e63f469ad2d00bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.642753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.645054 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:56.652520 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e41e3d28-22c1-472d-b468-2f4ca98ecb8f tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 200 len: 1322 microversion: 2.1 time: 0.296686 Sep 25 01:05:56.653328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 620/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:56 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:56.655148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.656506 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83c3f921-da3d-4fe4-b0b7-b69d326d3506 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1609 microversion: 2.25 time: 1.149067 Sep 25 01:05:56.669758 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 541/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:55 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1609 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:56.669758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:56.669758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:56.682827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eeaf9176-b999-4959-8b34-16e02f082e97 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb01af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:56.683490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.683986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.684424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.685140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.709277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.710563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.786431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eeaf9176-b999-4959-8b34-16e02f082e97 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.131814 Sep 25 01:05:56.787357 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 621/1162] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:56 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:56.802828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:56.803907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:56.857255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.857719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.858326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.872545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.873157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.886503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.987232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.998563 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5795139c-7190-4543-bcee-7ff48aebd846 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1278 microversion: 2.1 time: 0.339008 Sep 25 01:05:57.005894 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 542/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:56 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:57.011633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.017078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:57.033042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.037460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.038073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.039018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.039749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.040433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.292371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1fc90dc0-3fe0-464b-a1e1-bfac0ea479c0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.284508 Sep 25 01:05:57.295277 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 543/1164] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:05:57.312198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.317572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:57.353107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.360779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.367399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.371899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.377577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.378359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.504648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:57.550592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:57.558094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:57.559713 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0099cb6-5dcc-4f76-9942-970057a3277c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1268 microversion: 2.1 time: 0.260969 Sep 25 01:05:57.565437 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 544/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1268 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:57.577743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2f948479-c8c4-4ec7-b7bf-7f267877f814 req-840244ec-cdc2-42b8-b859-e2076de2226e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "name": "network-vif-plugged", "status": "completed", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:57.578472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:57.579701 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3de6511e-4779-4a81-b48d-3acaa4a8ac5c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.791259 Sep 25 01:05:57.582731 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 622/1166] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:56 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:57.593794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2f948479-c8c4-4ec7-b7bf-7f267877f814 req-840244ec-cdc2-42b8-b859-e2076de2226e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.594274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2f948479-c8c4-4ec7-b7bf-7f267877f814 req-840244ec-cdc2-42b8-b859-e2076de2226e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.602111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2f948479-c8c4-4ec7-b7bf-7f267877f814 req-840244ec-cdc2-42b8-b859-e2076de2226e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.626974 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2f948479-c8c4-4ec7-b7bf-7f267877f814 req-840244ec-cdc2-42b8-b859-e2076de2226e service nova] Creating event network-vif-plugged:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:05:57.656253 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2f948479-c8c4-4ec7-b7bf-7f267877f814 req-840244ec-cdc2-42b8-b859-e2076de2226e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070510 Sep 25 01:05:57.658074 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 545/1167] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:57.676495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.677196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] [instance: cadbb54f-1cbd-40d7-948d-a9a2f14f7a73] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:57.692429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.692937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.693381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.694117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.694569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.698815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.757051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] HTTP exception thrown: Instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 could not be found. Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Request method failure captured: Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 HTTP/1.1 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ky1SDasxMV9PwGWi-3X2jpOJKHOe-aq04KVvQhcmFZLQ_gC2d_IsSEpOzZEm4HWggU3kV7-QVb4knh9wKtYot5BuKdKEME6vYa3Y1uykx4Pzyf3BUV06ha2ezqBZqw5qaWkNp-u3Q2N5TXMdJP0z5hx4ag9mQBUitothpS_8dthF4 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d22d569cfdfb47619e63f469ad2d00bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d22d569cfdfb47619e63f469ad2d00bd"}]}] Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: d22d569cfdfb47619e63f469ad2d00bd Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f07489ff6ce74b7cab3b78a9654e4192 Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: exception: Instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 could not be found. Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'cadbb54f-1cbd-40d7-948d-a9a2f14f7a73'} Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 could not be found. Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 could not be found. Sep 25 01:05:57.762842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 could not be found. Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] Returning 404 to user: Instance cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:57.768465 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-940eb8bf-3bee-4b64-9db1-18de0b49b0a1 tempest-FloatingIPsAssociationNegativeTestJSON-606980222 tempest-FloatingIPsAssociationNegativeTestJSON-606980222-project] 10.222.0.16 "GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73" status: 404 len: 111 microversion: 2.1 time: 0.092047 Sep 25 01:05:57.774814 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 623/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/servers/cadbb54f-1cbd-40d7-948d-a9a2f14f7a73 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:05:57.803514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a94c66b-291c-4680-9da9-a9a87a37d29b tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebce64c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.871761 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a94c66b-291c-4680-9da9-a9a87a37d29b tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.072789 Sep 25 01:05:57.882474 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 546/1169] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:58.027015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:58.027914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:58.039731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.040692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.041621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.043310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.044518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.045450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.213434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:58.226341 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-037e5cb6-b1b0-4138-a964-1f5b0e03f14b tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1278 microversion: 2.1 time: 0.203094 Sep 25 01:05:58.227261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 624/1170] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:58 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:58.361437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-442ea9fe-9698-40e5-82f2-fda8e8d3cf9c req-de05a224-b76e-404a-ada4-a75e1804f9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:58.389297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-442ea9fe-9698-40e5-82f2-fda8e8d3cf9c req-de05a224-b76e-404a-ada4-a75e1804f9b7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.390814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-442ea9fe-9698-40e5-82f2-fda8e8d3cf9c req-de05a224-b76e-404a-ada4-a75e1804f9b7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.392030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-442ea9fe-9698-40e5-82f2-fda8e8d3cf9c req-de05a224-b76e-404a-ada4-a75e1804f9b7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.418097 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-442ea9fe-9698-40e5-82f2-fda8e8d3cf9c req-de05a224-b76e-404a-ada4-a75e1804f9b7 service nova] Creating event network-changed:13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:05:58.431225 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-442ea9fe-9698-40e5-82f2-fda8e8d3cf9c req-de05a224-b76e-404a-ada4-a75e1804f9b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072561 Sep 25 01:05:58.434060 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 547/1171] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:58.605367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:58.607125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:58.607286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:58.608221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:58.621089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.621494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.622020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.622567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.623145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.623586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.627197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.628299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.629596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.630302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.634183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.634708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.882284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:58.903657 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb38b921-9f6a-45cd-a571-df6e05055aba tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1274 microversion: 2.1 time: 0.316757 Sep 25 01:05:58.907248 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 625/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:58 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:58.913206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b565fed-67e0-4096-a0cb-c9a3ce3a0c3a tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb381f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:58.985769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b565fed-67e0-4096-a0cb-c9a3ce3a0c3a tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.077118 Sep 25 01:05:58.993809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 626/1173] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:05:58 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:59.253265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:59.253899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:59.273107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.274112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.275622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:59.278203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.279109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.279770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:59.930048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:59.956627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:59.963370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:59.966525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45a4c24d-29f7-4906-89b7-4050440ce2fd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.363474 Sep 25 01:05:59.981444 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 548/1174] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:58 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:59.981444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:59.981444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:59.984595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.985309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.989365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:59.990805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.991451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.993816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:00.298775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:00.308681 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60722523-53ae-4a77-bb3a-0d403c00a1d1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1274 microversion: 2.1 time: 0.339149 Sep 25 01:06:00.310065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 549/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:59 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1274 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:00.353431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43b1feff-f86c-4348-9ac3-ee015deff324 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebba04c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:00.476041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43b1feff-f86c-4348-9ac3-ee015deff324 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.162538 Sep 25 01:06:00.477117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 550/1176] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:00 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:00.489604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:00.506550 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de90df93-c198-4769-9fab-cf8cbe6fe01c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1320 microversion: 2.1 time: 1.257437 Sep 25 01:06:00.507647 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 627/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:59 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1320 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:00.598832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-df693634-9919-4d41-8b23-c68330f9ed51 req-ba7c7dff-0f86-45d5-bc79-f0d148eea5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606c6b18-fed9-4c35-a893-073e837e900e", "tag": "064c9227-3e67-4e2b-93a2-32adff32ffbc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:00.619124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-df693634-9919-4d41-8b23-c68330f9ed51 req-ba7c7dff-0f86-45d5-bc79-f0d148eea5a4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:00.619931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-df693634-9919-4d41-8b23-c68330f9ed51 req-ba7c7dff-0f86-45d5-bc79-f0d148eea5a4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:00.621178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-df693634-9919-4d41-8b23-c68330f9ed51 req-ba7c7dff-0f86-45d5-bc79-f0d148eea5a4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:00.642729 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-df693634-9919-4d41-8b23-c68330f9ed51 req-ba7c7dff-0f86-45d5-bc79-f0d148eea5a4 service nova] Creating event network-changed:064c9227-3e67-4e2b-93a2-32adff32ffbc for instance 606c6b18-fed9-4c35-a893-073e837e900e on n-h1-master-1 Sep 25 01:06:00.656480 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-df693634-9919-4d41-8b23-c68330f9ed51 req-ba7c7dff-0f86-45d5-bc79-f0d148eea5a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064845 Sep 25 01:06:00.662289 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 551/1178] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:00.992556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:00.993175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:01.002401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:01.004729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:01.014182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:01.015737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:01.016463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:01.016901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:01.334161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:01.334876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:01.351632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:01.352184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:01.352644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:01.353417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:01.354343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:01.355479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.139131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:02.159716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:02.174457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:02.176007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29a3768a-51ca-42b4-b486-ab853087024d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.187310 Sep 25 01:06:02.177092 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 628/1179] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:00 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:02.184134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-254c6a6d-a982-4d4c-bfce-625d05953658 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb74dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:02.301128 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-254c6a6d-a982-4d4c-bfce-625d05953658 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.121149 Sep 25 01:06:02.301758 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 629/1180] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:02 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:02.322983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:02.323603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:02.357659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.358213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.363532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.368690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.369220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.370454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.436277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:02.452870 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cad4cd8-aec3-4661-9ead-81c0cac3dd84 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 1.119324 Sep 25 01:06:02.456705 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 552/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:01 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:02.524391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5f229d39-53b7-44fa-a698-1433c1edaee5 req-96125a0c-e912-4fb0-ab57-052777ccf3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "e7447597-17d3-4b71-a80e-dccd38a636f5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:02.541801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5f229d39-53b7-44fa-a698-1433c1edaee5 req-96125a0c-e912-4fb0-ab57-052777ccf3c9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.542329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5f229d39-53b7-44fa-a698-1433c1edaee5 req-96125a0c-e912-4fb0-ab57-052777ccf3c9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.542772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5f229d39-53b7-44fa-a698-1433c1edaee5 req-96125a0c-e912-4fb0-ab57-052777ccf3c9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.578502 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5f229d39-53b7-44fa-a698-1433c1edaee5 req-96125a0c-e912-4fb0-ab57-052777ccf3c9 service nova] Creating event network-changed:e7447597-17d3-4b71-a80e-dccd38a636f5 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:06:02.607681 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5f229d39-53b7-44fa-a698-1433c1edaee5 req-96125a0c-e912-4fb0-ab57-052777ccf3c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088949 Sep 25 01:06:02.610213 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 553/1182] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:02.927493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-20706e34-5b21-486a-b95e-2b0f1e34ea67 req-7a460532-6fb7-406d-bafe-8bc18a1a06b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969f5f99-9db4-4dde-8677-0efb61e51b23", "tag": "6e54e6d2-e16b-404a-aa03-c701d7e26e41"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:02.944352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-20706e34-5b21-486a-b95e-2b0f1e34ea67 req-7a460532-6fb7-406d-bafe-8bc18a1a06b3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.945387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-20706e34-5b21-486a-b95e-2b0f1e34ea67 req-7a460532-6fb7-406d-bafe-8bc18a1a06b3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.946179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-20706e34-5b21-486a-b95e-2b0f1e34ea67 req-7a460532-6fb7-406d-bafe-8bc18a1a06b3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.959425 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-20706e34-5b21-486a-b95e-2b0f1e34ea67 req-7a460532-6fb7-406d-bafe-8bc18a1a06b3 service nova] Creating event network-changed:6e54e6d2-e16b-404a-aa03-c701d7e26e41 for instance 969f5f99-9db4-4dde-8677-0efb61e51b23 on n-h1-master-1 Sep 25 01:06:02.966977 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-20706e34-5b21-486a-b95e-2b0f1e34ea67 req-7a460532-6fb7-406d-bafe-8bc18a1a06b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044490 Sep 25 01:06:02.969317 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 554/1183] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:03.208738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:03.210091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:03.225450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:03.226277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:03.227029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:03.227914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:03.228559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:03.229134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.041824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:04.052389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-987fb738-9881-4ed9-af71-12b6d27f291c tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1320 microversion: 2.1 time: 1.733780 Sep 25 01:06:04.056308 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 630/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:02 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1320 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:04.069881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dcfa6a02-96de-4475-bfc6-589535ab57e2 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebaf6af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:04.149389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dcfa6a02-96de-4475-bfc6-589535ab57e2 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.090191 Sep 25 01:06:04.159110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 631/1185] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:04 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:04.167926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:04.171985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:04.185070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:04.185937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:04.187492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.191707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:04.192359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:04.192935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.666658 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:05.324751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:05.342397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:05.349144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:05.350684 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9878834a-1e7d-4ab2-a2e2-39dc818f97c3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 2.147793 Sep 25 01:06:05.355561 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 555/1186] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:03 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:05.375525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:05.376442 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:05.392011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:05.393802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:05.394652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:05.395753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:05.396562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:05.397242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:05.483374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:05.500300 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1406b8c8-3e23-4fdd-99f4-c5773a9c2b69 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 1.343101 Sep 25 01:06:05.501240 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 632/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:04 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:05.513348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-397770ed-6648-4914-8c6d-3fa3e4bb10d4 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebc705e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:05.572945 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-397770ed-6648-4914-8c6d-3fa3e4bb10d4 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.069753 Sep 25 01:06:05.574424 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 633/1188] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:05 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:06.393168 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=16 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:06.398959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:06.399593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:06.424664 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:06.426376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.426885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.427337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:06.428067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.437860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:06.451978 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5eed420f-f730-4b50-aa28-b4f25ee7ca57 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1320 microversion: 2.1 time: 1.094939 Sep 25 01:06:06.452597 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 556/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:05 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1320 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:06.466901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.468383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:06.527556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:06.528187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:06.541341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.547056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.558164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:06.559251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.559898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.560517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:07.395596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:07.405798 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d46f702-a3c5-4fd0-b731-2d767d4a6fd3 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.882347 Sep 25 01:06:07.407886 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 557/1190] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:06 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:07.425512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36bb76f0-917c-499e-8b0c-019d3161fc69 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebcb3820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:07.489588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36bb76f0-917c-499e-8b0c-019d3161fc69 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.080278 Sep 25 01:06:07.502213 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 558/1191] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:07 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:07.508096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-38715203", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "26a09334-dcd7-42d5-9f3c-0bcc3a5e83af"}, {"uuid": "b75d2f9e-bba6-42d8-92f8-f96245b36a78"}, {"uuid": "26a09334-dcd7-42d5-9f3c-0bcc3a5e83af"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:07.579402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] validate_networks() for [('26a09334-dcd7-42d5-9f3c-0bcc3a5e83af', None, None, None, None, None), ('b75d2f9e-bba6-42d8-92f8-f96245b36a78', None, None, None, None, None), ('26a09334-dcd7-42d5-9f3c-0bcc3a5e83af', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:06:07.885039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:07.904380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:07.907737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:07.909821 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae4c6f27-014a-4734-9c87-9c29cf8d4d03 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.526692 Sep 25 01:06:07.932301 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 634/1192] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:06 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:07.940637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:07.944230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:07.959889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:07.964409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:07.965226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:07.966276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:07.968970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:07.970667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:08.577433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:08.588819 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6c6b250-2d1f-49e0-8496-d5aa524d4e72 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1320 microversion: 2.1 time: 0.654561 Sep 25 01:06:08.590203 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 635/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:07 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1320 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:08.599976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:08.600961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:08.611770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:08.612813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:08.614155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:08.615404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:08.616069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:08.617993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:10.115773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:10.126490 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3974bb9c-8040-4748-9219-ff8ba0da9122 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 1.534444 Sep 25 01:06:10.127100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 636/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:08 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:10.137838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4e81b27-c2b7-42bf-9e03-7e9804531e24 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebc701f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:10.215468 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4e81b27-c2b7-42bf-9e03-7e9804531e24 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.087088 Sep 25 01:06:10.216355 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 637/1195] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:10 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:10.222687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:10.223538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:10.230734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:10.231514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:10.232136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:10.233074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:10.233753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:10.234369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.278238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:11.292179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:11.304221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:11.305829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8fcf55c7-a183-461c-86e0-e719199a0d2b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.087767 Sep 25 01:06:11.315333 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 638/1196] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:10 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:11.325786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:11.325786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:11.357632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:11.359081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:11.359877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.361102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:11.361845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:11.362521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.947650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:11.960293 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db710727-73ec-47d7-8365-eed1b94302d4 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1320 microversion: 2.1 time: 0.643617 Sep 25 01:06:11.963305 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 639/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:11 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:11.979231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-97a2ad99-9a47-40ca-9c13-e8bea4a3e420 req-b243c10f-1601-4ffd-b690-552f3b631e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96989006-98c3-46f2-9db8-66dde51cea14", "tag": "1d134a24-f288-4678-bd5b-2444d2754003"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:11.995446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:06:11.996546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:06:11.997239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:06:11.997883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:06:11.999392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:06:12.021251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.022182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.024984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.026068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.026794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.027179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97a2ad99-9a47-40ca-9c13-e8bea4a3e420 req-b243c10f-1601-4ffd-b690-552f3b631e94 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.027955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97a2ad99-9a47-40ca-9c13-e8bea4a3e420 req-b243c10f-1601-4ffd-b690-552f3b631e94 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.028667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.030890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97a2ad99-9a47-40ca-9c13-e8bea4a3e420 req-b243c10f-1601-4ffd-b690-552f3b631e94 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.071224 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-97a2ad99-9a47-40ca-9c13-e8bea4a3e420 req-b243c10f-1601-4ffd-b690-552f3b631e94 service nova] Creating event network-changed:1d134a24-f288-4678-bd5b-2444d2754003 for instance 96989006-98c3-46f2-9db8-66dde51cea14 on n-h2-master-1 Sep 25 01:06:12.088685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Getting quotas for project afce265709264879a2e1cafb56ea22f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:12.090594 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-97a2ad99-9a47-40ca-9c13-e8bea4a3e420 req-b243c10f-1601-4ffd-b690-552f3b631e94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122305 Sep 25 01:06:12.091841 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 640/1198] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:12.101866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.103905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Getting quotas for user 1f85ae026362410fb573c81bef57159e and project afce265709264879a2e1cafb56ea22f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:12.106893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:12.130868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.131490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.132184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.134706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.137003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.137721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.142136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:06:12.148057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:06:12.259890 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e38c5556-2a66-4dbc-b517-e6449aeef1ae tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.756092 Sep 25 01:06:12.263491 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 559/1199] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:06:12.273113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb740c39-f009-4fc8-a1df-fd8a784bf7d3 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba46430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.368099 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb740c39-f009-4fc8-a1df-fd8a784bf7d3 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.102102 Sep 25 01:06:12.379791 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 560/1200] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:12.390387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e8e07025-ea00-4f6f-83de-346b41478498 req-f1ddc6be-f050-4ea6-8131-e1cd1d14f465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969f5f99-9db4-4dde-8677-0efb61e51b23", "name": "network-vif-plugged", "status": "completed", "tag": "6e54e6d2-e16b-404a-aa03-c701d7e26e41"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:12.421958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e8e07025-ea00-4f6f-83de-346b41478498 req-f1ddc6be-f050-4ea6-8131-e1cd1d14f465 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.424169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e8e07025-ea00-4f6f-83de-346b41478498 req-f1ddc6be-f050-4ea6-8131-e1cd1d14f465 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.424976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e8e07025-ea00-4f6f-83de-346b41478498 req-f1ddc6be-f050-4ea6-8131-e1cd1d14f465 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.432364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.444405 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-32c577f1-2bbd-4456-b232-3d5fa8963b8e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.349734 Sep 25 01:06:12.446063 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 641/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:12.459306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bbab1a1-767e-44d8-ae7a-315793e2df65 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.462017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9bbab1a1-767e-44d8-ae7a-315793e2df65 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:12.464829 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e8e07025-ea00-4f6f-83de-346b41478498 req-f1ddc6be-f050-4ea6-8131-e1cd1d14f465 service nova] Creating event network-vif-plugged:6e54e6d2-e16b-404a-aa03-c701d7e26e41 for instance 969f5f99-9db4-4dde-8677-0efb61e51b23 on n-h1-master-1 Sep 25 01:06:12.474577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e8e07025-ea00-4f6f-83de-346b41478498 req-f1ddc6be-f050-4ea6-8131-e1cd1d14f465 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093269 Sep 25 01:06:12.481465 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 561/1202] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:12.487404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.502441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:12.509711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.510619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.511331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.512314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.513025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.515533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.601856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9bbab1a1-767e-44d8-ae7a-315793e2df65 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.610627 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9bbab1a1-767e-44d8-ae7a-315793e2df65 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1211 microversion: 2.1 time: 0.160058 Sep 25 01:06:12.629909 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 642/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:12.966402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.980454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.982445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.989097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.990169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:12.997303 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c879621f-2fd0-4808-9224-84e487954713 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.514074 Sep 25 01:06:12.998904 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 562/1204] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:13.001523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.002367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.003043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.004002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.004682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.005330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.284193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:13.301770 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a59055fd-3353-44b7-a2a2-618f1371f7b1 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1320 microversion: 2.1 time: 0.312217 Sep 25 01:06:13.302679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 643/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:13.387051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f1cd47c9-2619-477a-993f-8eecdc44fb73 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba78820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:13.473773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:13.475072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:13.494605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.496452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.497514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.499249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.504209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.508446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.549582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f1cd47c9-2619-477a-993f-8eecdc44fb73 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.166375 Sep 25 01:06:13.558236 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 563/1206] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:13 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:13.649769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:13.652480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:13.668001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.668881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.669581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.670603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.673002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.677242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.828628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:13.844724 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c7ebbb9d-714f-4a70-acb2-843aef1d1791 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1215 microversion: 2.1 time: 0.199935 Sep 25 01:06:13.859503 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 564/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:13 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:14.031529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:14.032157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:14.063311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.063807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.064246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:14.064962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.065491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.065861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:14.071925 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:14.106553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:14.115369 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef18f16f-0534-495d-87da-9a5dee46f925 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.650981 Sep 25 01:06:14.118585 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 644/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:13 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:14.145370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b5aa1652-844a-4a81-8d78-d81ecbdc66b3 req-f0930101-4dc5-4162-8d77-7fd4a793f1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "de78802c-7150-4aed-a024-96ae56e3dd90"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:14.176007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b5aa1652-844a-4a81-8d78-d81ecbdc66b3 req-f0930101-4dc5-4162-8d77-7fd4a793f1ef service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.188249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b5aa1652-844a-4a81-8d78-d81ecbdc66b3 req-f0930101-4dc5-4162-8d77-7fd4a793f1ef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.189587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b5aa1652-844a-4a81-8d78-d81ecbdc66b3 req-f0930101-4dc5-4162-8d77-7fd4a793f1ef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:14.222385 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b5aa1652-844a-4a81-8d78-d81ecbdc66b3 req-f0930101-4dc5-4162-8d77-7fd4a793f1ef service nova] Creating event network-changed:de78802c-7150-4aed-a024-96ae56e3dd90 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:06:14.241197 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b5aa1652-844a-4a81-8d78-d81ecbdc66b3 req-f0930101-4dc5-4162-8d77-7fd4a793f1ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100943 Sep 25 01:06:14.242994 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 645/1209] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:06:14.334663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:14.337618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:14.383241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.388038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.388882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:14.390551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.391044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.391742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:14.478055 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:14.934154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:14.950408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:14.954820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:14.956403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdf7078a-a1f2-44d6-b781-293b99c0be06 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.928906 Sep 25 01:06:14.974691 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 565/1210] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:14 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:14.974691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9eeee838-a6a0-4e52-acfe-75ac5efe7d72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebaa4ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:14.977089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:14.985767 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8547ea4-7a9c-4aa7-b7c9-d8baca7a96c8 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1470 microversion: 2.1 time: 0.662595 Sep 25 01:06:14.986715 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 646/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:14 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1470 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:14.992333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:14.996840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.005044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.006724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.007743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.009810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.010493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.011214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.038799 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9eeee838-a6a0-4e52-acfe-75ac5efe7d72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.080390 Sep 25 01:06:15.047937 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 566/1212] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:14 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:15.053762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:15.056428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.075581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.076578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.077450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.078265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.078737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.079168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.222772 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bd55c6f-c9dc-42a2-b5a1-871c4a5ce953 tempest-DeleteServersAdminTestJSON-1268058000 tempest-DeleteServersAdminTestJSON-1268058000-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23/action" status: 202 len: 0 microversion: 2.1 time: 0.172951 Sep 25 01:06:15.226438 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 567/1213] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:06:15 2022] POST /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:06:15.259657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:15.262994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.270236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.271092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.271929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.272885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.273638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.274321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.307808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:15.330690 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fac97f52-7f14-4864-80c5-3ef90682d406 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1263 microversion: 2.1 time: 0.335096 Sep 25 01:06:15.333470 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 647/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:14 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1263 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:15.344743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:15.351731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.375249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.378783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.379835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.381624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.382456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.383742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.489491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.490219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.491036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.491650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lazy-loading 'fault' on Instance uuid 969f5f99-9db4-4dde-8677-0efb61e51b23 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:16.070630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:16.085355 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15180184-1db9-444e-93bd-0d023950d06c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.855279 Sep 25 01:06:16.097860 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 568/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:15 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:16.119423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:16.120056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:16.126828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.127622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.128500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:16.129786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.130774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.131534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:16.548339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:16.561876 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c0582d1-2d12-42ba-acc7-b4076be73982 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1453 microversion: 2.1 time: 1.223242 Sep 25 01:06:16.563926 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 648/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:15 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1453 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:16.583239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f890c75f-8eda-4156-8d4c-d07323718aa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebcfadc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:16.665913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f890c75f-8eda-4156-8d4c-d07323718aa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.100432 Sep 25 01:06:16.666802 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 649/1217] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:16 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:16.672721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:16.692168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:16.702126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.702640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.703299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:16.704102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.704635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.705209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:16.920851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:16.935425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:16.943893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:16.945144 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d1f3eb3-8b20-42e7-ae13-60df9004feb2 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.846200 Sep 25 01:06:16.945777 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 569/1218] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:16 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:16.958886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:16.959408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:16.974592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.975092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.977987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:16.978730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.980660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.981155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.043790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:17.147412 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:17.157327 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7defb14-0307-4ddc-a635-a839ae14de54 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1269 microversion: 2.1 time: 0.488616 Sep 25 01:06:17.157879 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 650/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:16 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1269 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:17.190278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:17.194853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:17.215353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:17.215897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:17.216346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.229452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:17.231431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:17.233083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.291306 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e3d41e6-420c-46f7-846a-4cdb33db8fbd tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 204 len: 0 microversion: 2.1 time: 0.344245 Sep 25 01:06:17.292985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 570/1220] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:16 2022] DELETE /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:17.304139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:17.305292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:17.318378 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:17.320116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:17.323134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:17.323831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.325314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:17.332449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:17.333182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.419326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:17.419824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:17.420793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.421259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lazy-loading 'fault' on Instance uuid 969f5f99-9db4-4dde-8677-0efb61e51b23 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:17.926752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:17.935115 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc415107-3e4d-4051-be34-de1a39e3d189 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1459 microversion: 2.1 time: 0.637112 Sep 25 01:06:17.936214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 571/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:17 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1459 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:17.956714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-294cb55e-1d31-48d5-b1d2-b437abb8df06 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebac78b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:18.036782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:18.045437 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-157ab5b0-fe89-4305-bdde-201fce8c6b49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.886408 Sep 25 01:06:18.058141 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 651/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:17 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:18.064217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:18.064936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:18.071820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:18.072698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:18.073204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:18.074078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:18.075006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:18.075648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:18.625617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-294cb55e-1d31-48d5-b1d2-b437abb8df06 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.674222 Sep 25 01:06:18.637281 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 572/1223] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:17 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:18.643314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:18.644212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:18.652267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:18.653063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:18.653792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:18.655281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:18.655935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:18.656587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:18.860789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:18.896989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:18.900883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:18.902153 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f06d956-afaa-4f17-8adb-f2b2c02c82ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.842885 Sep 25 01:06:18.902728 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 652/1224] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:18 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:18.918767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b85702dc-a378-416e-9b81-777e9bcad2ca tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7bebb01ee0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:19.014713 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b85702dc-a378-416e-9b81-777e9bcad2ca tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1" status: 200 len: 636 microversion: 2.1 time: 0.106368 Sep 25 01:06:19.015380 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 653/1225] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:18 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1 => generated 636 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:19.038351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:19.039317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:19.077163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.080060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.080961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.082335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.084369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.085838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.141017 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:19.153250 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be1d8429-729d-4ed9-ab6f-c8a882335535 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1311 microversion: 2.1 time: 0.514175 Sep 25 01:06:19.157271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 573/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:18 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1311 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:19.171732 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04903d74-849d-4d21-b82e-8769d98fe79c tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebb38940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:19.180396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.185161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.186637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.187911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lazy-loading 'fault' on Instance uuid 969f5f99-9db4-4dde-8677-0efb61e51b23 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:19.242994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-04903d74-849d-4d21-b82e-8769d98fe79c tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:19.249793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-04903d74-849d-4d21-b82e-8769d98fe79c tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:19.577332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10739e6066e3468b98e14168ff2df181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ed353f9104a14b276d36b480b850f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:19.586414 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1165f26-5e67-4e14-b544-9ac2a444e00e tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 200 len: 1459 microversion: 2.1 time: 0.569869 Sep 25 01:06:19.590947 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 654/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:19 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 1459 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:19.606870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:19.610182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:19.632695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.635443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.642339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.644937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.646011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.648881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.974730 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-04903d74-849d-4d21-b82e-8769d98fe79c tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.816236 Sep 25 01:06:19.976571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 574/1228] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:19 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:19.986984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-785a0ccd-9601-4893-9dda-4fbdfdccead4 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba78ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:20.091588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-785a0ccd-9601-4893-9dda-4fbdfdccead4 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.112731 Sep 25 01:06:20.092829 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 575/1229] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:19 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:20.101698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d5a9759b-0fe4-4ce4-abba-d46fa5638705 req-65a7dabe-a638-48c1-8ad8-d816df9cfb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969f5f99-9db4-4dde-8677-0efb61e51b23", "name": "network-vif-deleted", "tag": "6e54e6d2-e16b-404a-aa03-c701d7e26e41"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:20.121663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d5a9759b-0fe4-4ce4-abba-d46fa5638705 req-65a7dabe-a638-48c1-8ad8-d816df9cfb87 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.125232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d5a9759b-0fe4-4ce4-abba-d46fa5638705 req-65a7dabe-a638-48c1-8ad8-d816df9cfb87 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.126233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d5a9759b-0fe4-4ce4-abba-d46fa5638705 req-65a7dabe-a638-48c1-8ad8-d816df9cfb87 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.152371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d5a9759b-0fe4-4ce4-abba-d46fa5638705 req-65a7dabe-a638-48c1-8ad8-d816df9cfb87 service nova] Creating event network-vif-deleted:6e54e6d2-e16b-404a-aa03-c701d7e26e41 for instance 969f5f99-9db4-4dde-8677-0efb61e51b23 on n-h1-master-1 Sep 25 01:06:20.157240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:20.169125 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d5a9759b-0fe4-4ce4-abba-d46fa5638705 req-65a7dabe-a638-48c1-8ad8-d816df9cfb87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074720 Sep 25 01:06:20.171354 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b7591986-557d-40d2-8188-2882ff2d8ace tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.575371 Sep 25 01:06:20.171995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 576/1230] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:20.174062 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 655/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:19 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:20.196284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a655943-296b-4acf-87f3-61ad2005d454 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7bebc110d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:20.203436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:20.204293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:20.244606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.249578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.251388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.254495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.255939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.256852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.632605 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a655943-296b-4acf-87f3-61ad2005d454 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "DELETE /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.457218 Sep 25 01:06:20.633183 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 656/1232] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 25 01:06:20 2022] DELETE /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata/os_version => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:20.638233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:20.639376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:20.653746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.654356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.655424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.656470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.656947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.657449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.289062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:21.303815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:21.306090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:21.308297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d2ddd73-2139-4614-b75d-082ca964e3fa tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.132827 Sep 25 01:06:21.331103 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 577/1233] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:20 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:21.336725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:21.346346 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b81d250-d820-48b5-b76f-0df0a0ca2c2f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1311 microversion: 2.1 time: 0.711885 Sep 25 01:06:21.359065 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 657/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:20 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1311 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:21.369970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:21.372276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:21.381497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.382286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.382995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.384196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.385339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.386563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.406019 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] HTTP exception thrown: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Request method failure captured: Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 HTTP/1.1 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lPq3d80hu-uMKRhDMdwICtRFYKhCa25EdEyb7cJWoy_1e5CR4KyHjOdXhKe2UFrKNDs-UCLtSn_ozx4tjuPJ0BlVQiafNUHAF91wfmHsQSq806g1treQeB_3E_skVgfUvStruh97G0jocYUp6ZrOKqwgZz1yIf_7LpwaZF5BP4RNc Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/829ed353f9104a14b276d36b480b850f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_829ed353f9104a14b276d36b480b850f"}]}] Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 10739e6066e3468b98e14168ff2df181 Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '969f5f99-9db4-4dde-8677-0efb61e51b23'} Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.408050 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.412586 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.414661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Returning 404 to user: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:21.415772 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ef61862-e46c-4421-af01-49276d697241 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 404 len: 111 microversion: 2.1 time: 0.055337 Sep 25 01:06:21.416898 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 658/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:21 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:21.422506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3dd95e5c-7dc7-4e5a-ad5a-de04c5b3adfc tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7beba9d160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:21.484457 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3dd95e5c-7dc7-4e5a-ad5a-de04c5b3adfc tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.066177 Sep 25 01:06:21.485251 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 659/1236] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:06:21 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 37 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:21.493584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-888c4d9d-a7fa-4234-8245-b10eaf3f607e tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebc70e50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:21.555730 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-888c4d9d-a7fa-4234-8245-b10eaf3f607e tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1422 microversion: 2.1 time: 0.069608 Sep 25 01:06:21.557475 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 660/1237] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:21 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:21.563128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:21.564070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:21.570658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.571511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.572163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.573131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.573830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.574486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.633721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fa5c3f5a-f326-41d2-a774-21851d4e54ee req-fab7c88a-a42b-42b7-90f3-63902f29339e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96989006-98c3-46f2-9db8-66dde51cea14", "name": "network-vif-plugged", "status": "completed", "tag": "1d134a24-f288-4678-bd5b-2444d2754003"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:21.645113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fa5c3f5a-f326-41d2-a774-21851d4e54ee req-fab7c88a-a42b-42b7-90f3-63902f29339e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.646054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fa5c3f5a-f326-41d2-a774-21851d4e54ee req-fab7c88a-a42b-42b7-90f3-63902f29339e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.646731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fa5c3f5a-f326-41d2-a774-21851d4e54ee req-fab7c88a-a42b-42b7-90f3-63902f29339e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.672271 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fa5c3f5a-f326-41d2-a774-21851d4e54ee req-fab7c88a-a42b-42b7-90f3-63902f29339e service nova] Creating event network-vif-plugged:1d134a24-f288-4678-bd5b-2444d2754003 for instance 96989006-98c3-46f2-9db8-66dde51cea14 on n-h2-master-1 Sep 25 01:06:21.678251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fa5c3f5a-f326-41d2-a774-21851d4e54ee req-fab7c88a-a42b-42b7-90f3-63902f29339e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345374 Sep 25 01:06:21.679592 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 578/1238] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:21.686253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:21.687476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:21.695956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.697104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.697874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.698922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:21.701265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:21.702124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:21.733953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] HTTP exception thrown: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Request method failure captured: Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 HTTP/1.1 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lPq3d80hu-uMKRhDMdwICtRFYKhCa25EdEyb7cJWoy_1e5CR4KyHjOdXhKe2UFrKNDs-UCLtSn_ozx4tjuPJ0BlVQiafNUHAF91wfmHsQSq806g1treQeB_3E_skVgfUvStruh97G0jocYUp6ZrOKqwgZz1yIf_7LpwaZF5BP4RNc Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/829ed353f9104a14b276d36b480b850f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_829ed353f9104a14b276d36b480b850f"}]}] Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 10739e6066e3468b98e14168ff2df181 Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '969f5f99-9db4-4dde-8677-0efb61e51b23'} Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:21.737294 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Returning 404 to user: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10462ff0-459c-4c7d-b037-5feaa09189c0 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 404 len: 111 microversion: 2.1 time: 0.057985 Sep 25 01:06:21.744622 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 579/1239] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:21 2022] DELETE /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:21.746127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f31dda92-bef8-45ab-b406-e790dab0a311 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebaede50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:21.846810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f31dda92-bef8-45ab-b406-e790dab0a311 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:21.855962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f31dda92-bef8-45ab-b406-e790dab0a311 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:22.067317 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:22.100254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:22.109423 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc3973a5-6ad8-413b-acc1-26069b234f81 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.550613 Sep 25 01:06:22.110032 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 661/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:21 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:22.130203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.130915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 969f5f99-9db4-4dde-8677-0efb61e51b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:22.137300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.138088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.139278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.140504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.141169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.142127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.157578 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] HTTP exception thrown: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Request method failure captured: Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 HTTP/1.1 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lPq3d80hu-uMKRhDMdwICtRFYKhCa25EdEyb7cJWoy_1e5CR4KyHjOdXhKe2UFrKNDs-UCLtSn_ozx4tjuPJ0BlVQiafNUHAF91wfmHsQSq806g1treQeB_3E_skVgfUvStruh97G0jocYUp6ZrOKqwgZz1yIf_7LpwaZF5BP4RNc Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/829ed353f9104a14b276d36b480b850f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_829ed353f9104a14b276d36b480b850f"}]}] Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 10739e6066e3468b98e14168ff2df181 Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '969f5f99-9db4-4dde-8677-0efb61e51b23'} Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.159229 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. Sep 25 01:06:22.163505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.169265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Returning 404 to user: Instance 969f5f99-9db4-4dde-8677-0efb61e51b23 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:22.169265 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-36555d03-b6cd-4c60-a50f-ae2d810b6394 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23" status: 404 len: 111 microversion: 2.1 time: 0.056546 Sep 25 01:06:22.169265 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 662/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/servers/969f5f99-9db4-4dde-8677-0efb61e51b23 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:22.179965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.180610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:22.190702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.191295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.191797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.192779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.193604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.194224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.214001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] HTTP exception thrown: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Request method failure captured: Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf HTTP/1.1 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lPq3d80hu-uMKRhDMdwICtRFYKhCa25EdEyb7cJWoy_1e5CR4KyHjOdXhKe2UFrKNDs-UCLtSn_ozx4tjuPJ0BlVQiafNUHAF91wfmHsQSq806g1treQeB_3E_skVgfUvStruh97G0jocYUp6ZrOKqwgZz1yIf_7LpwaZF5BP4RNc Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/829ed353f9104a14b276d36b480b850f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_829ed353f9104a14b276d36b480b850f"}]}] Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 10739e6066e3468b98e14168ff2df181 Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '77d2f0eb-1f9b-4fd7-ab64-370a440914bf'} Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:22.215461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.220293 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.223032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Returning 404 to user: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:22.224115 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-959cb688-2584-40d3-8af4-9ee0db3853ed tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 404 len: 111 microversion: 2.1 time: 0.049734 Sep 25 01:06:22.225483 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 663/1242] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:22 2022] DELETE /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:22.234562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.235585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] [instance: 77d2f0eb-1f9b-4fd7-ab64-370a440914bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:22.243399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.244194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.244944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.246140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.246647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.247411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.258367 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f31dda92-bef8-45ab-b406-e790dab0a311 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.517314 Sep 25 01:06:22.264624 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 580/1243] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:21 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:22.268141 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] HTTP exception thrown: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Request method failure captured: Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf HTTP/1.1 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lPq3d80hu-uMKRhDMdwICtRFYKhCa25EdEyb7cJWoy_1e5CR4KyHjOdXhKe2UFrKNDs-UCLtSn_ozx4tjuPJ0BlVQiafNUHAF91wfmHsQSq806g1treQeB_3E_skVgfUvStruh97G0jocYUp6ZrOKqwgZz1yIf_7LpwaZF5BP4RNc Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/829ed353f9104a14b276d36b480b850f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/829ed353f9104a14b276d36b480b850f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_829ed353f9104a14b276d36b480b850f"}]}] Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 829ed353f9104a14b276d36b480b850f Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1611480770 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 10739e6066e3468b98e14168ff2df181 Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersAdminTestJSON-1611480770-project Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '77d2f0eb-1f9b-4fd7-ab64-370a440914bf'} Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.269781 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] Returning 404 to user: Instance 77d2f0eb-1f9b-4fd7-ab64-370a440914bf could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:22.276249 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb6a4a4f-9306-4b55-b3f8-a30a61411f11 tempest-DeleteServersAdminTestJSON-1611480770 tempest-DeleteServersAdminTestJSON-1611480770-project] 10.222.0.16 "GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf" status: 404 len: 111 microversion: 2.1 time: 0.042239 Sep 25 01:06:22.277724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b957faf9-90c7-4019-8117-6c13b2876f28 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7beba2c1f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.277857 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 664/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/servers/77d2f0eb-1f9b-4fd7-ab64-370a440914bf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:22.335047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b957faf9-90c7-4019-8117-6c13b2876f28 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.069057 Sep 25 01:06:22.336015 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 581/1245] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata/os_distro => generated 33 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:22.350271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-106bae60-c073-40ed-b8e4-2f2874350a18 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebb38b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:22.367019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.368096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:22.376561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.378738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.379399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.382119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.382739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.383288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.408226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-106bae60-c073-40ed-b8e4-2f2874350a18 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:22.413797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-106bae60-c073-40ed-b8e4-2f2874350a18 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:22.594046 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-106bae60-c073-40ed-b8e4-2f2874350a18 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.249639 Sep 25 01:06:22.598078 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 665/1246] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:22 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:06:22.607136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.608662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:22.616107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.616707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.617570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.618812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.620239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.621117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.668776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:22.683450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:22.686644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:22.688251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e843cea4-76ce-4403-b8fe-7bdf9a2551d3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.325857 Sep 25 01:06:22.689557 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 582/1247] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:22.694516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a93b84ca-5aac-4f5f-a994-a85ba88b14cf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebaed670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.770378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a93b84ca-5aac-4f5f-a994-a85ba88b14cf tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1431 microversion: 2.1 time: 0.079483 Sep 25 01:06:22.780210 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 583/1248] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1431 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:22.786286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b5c8bf93-4ec4-4e32-98b6-875cf6f69e93 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7beba2c160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.835315 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b5c8bf93-4ec4-4e32-98b6-875cf6f69e93 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.052925 Sep 25 01:06:22.844713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 584/1249] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:22.850701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-30e07497-3c56-4c23-816f-dd5b8aecfb43 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebba09d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.909059 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-30e07497-3c56-4c23-816f-dd5b8aecfb43 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 200 len: 1431 microversion: 2.1 time: 0.062577 Sep 25 01:06:22.920663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 585/1250] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 1431 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:22.926307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b87f6d5a-2479-4ede-9571-6dd5ba17b673 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebce6b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:22.963111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:22.972568 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f1461f8-d2ba-494b-ba48-92a4c26c94f3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1332 microversion: 2.1 time: 0.373219 Sep 25 01:06:22.973148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 666/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1332 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:22.977800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:22.978415 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:22.982679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b87f6d5a-2479-4ede-9571-6dd5ba17b673 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:22.984910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.985422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.985866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.986654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.987013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.987434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.988409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b87f6d5a-2479-4ede-9571-6dd5ba17b673 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:23.156312 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b87f6d5a-2479-4ede-9571-6dd5ba17b673 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.233821 Sep 25 01:06:23.156960 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 586/1252] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:22 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:23.162117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:23.162751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:23.169079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:23.169818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:23.170625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:23.171456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:23.171932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:23.172373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:23.315973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:23.327447 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c46b8235-1a98-4fa8-b3e3-801ad83740e8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1480 microversion: 2.1 time: 0.352264 Sep 25 01:06:23.328415 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 667/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:22 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1480 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:23.350756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0e8b520-ce64-4c18-9c11-0dd821683974 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebb74b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:23.426158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a0e8b520-ce64-4c18-9c11-0dd821683974 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:23.433257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a0e8b520-ce64-4c18-9c11-0dd821683974 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:23.463418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:23.482084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-78d079cc-9f08-4c36-bd60-4f7c89dd689c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1316 microversion: 2.1 time: 0.323874 Sep 25 01:06:23.483209 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 587/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:23 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:23.719422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:23.720578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:23.734120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:23.734777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:23.735227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:23.735988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:23.736450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:23.736882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:23.887029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0e8b520-ce64-4c18-9c11-0dd821683974 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.557250 Sep 25 01:06:23.887647 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 668/1255] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:23 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 64 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:23.897726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b927edf1-fec9-4925-8f08-5b06db70bc5d tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7bebb01040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:23.946754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b927edf1-fec9-4925-8f08-5b06db70bc5d tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.053139 Sep 25 01:06:23.947341 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 669/1256] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:06:23 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 64 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:23.966030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c210099-1eaf-49b2-94a7-2e5e9b335dcd tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebad2a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:24.023646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3c210099-1eaf-49b2-94a7-2e5e9b335dcd tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:24.030587 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3c210099-1eaf-49b2-94a7-2e5e9b335dcd tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:24.221735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:24.239723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:24.242852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:24.244887 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc695628-de89-4d45-b52e-ddd690c63c40 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.530367 Sep 25 01:06:24.246082 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 588/1257] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:23 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:24.253300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:24.254800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:24.262707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.263663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.264569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:24.265733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.266364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.267373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:24.441091 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c210099-1eaf-49b2-94a7-2e5e9b335dcd tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.486174 Sep 25 01:06:24.442414 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 670/1258] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:23 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:06:24.449436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:24.450318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:24.464377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.464873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.465320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:24.466064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.466525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.467551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:24.734008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:24.743150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3bb6438d-6e03-4fe9-b445-8f8f43042ba5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.495373 Sep 25 01:06:24.745285 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 589/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:24 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:24.752586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-590153b6-4fbf-4af2-9078-99ced9e09c8e tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update', calling method: .version_select at 0x7f7bebba0820>, body: {"meta": {"os_version": "alt"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:24.821276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:24.834345 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-679e5dc9-976e-4ae3-82c5-964e0580db72 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1467 microversion: 2.1 time: 0.390691 Sep 25 01:06:24.835597 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 671/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:24 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1467 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:24.840042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-590153b6-4fbf-4af2-9078-99ced9e09c8e tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:24.841591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:24.842691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:24.845280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-590153b6-4fbf-4af2-9078-99ced9e09c8e tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:24.849577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.850301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.850917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:24.851951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.852977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.853745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:25.130383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:25.139570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b99a516-e76e-44e1-8be3-5704d166c479 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1465 microversion: 2.1 time: 0.302136 Sep 25 01:06:25.140169 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 672/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:24 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1465 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:25.158871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d869cdea-6295-4d7f-b009-9475c0410595 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb863a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:25.198845 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-590153b6-4fbf-4af2-9078-99ced9e09c8e tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.452118 Sep 25 01:06:25.200105 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 590/1262] 10.222.0.16 () {60 vars in 1313 bytes} [Sun Sep 25 01:06:24 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata/os_version => generated 31 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:25.207145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:25.213834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:25.218400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:25.218400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:25.218400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:25.218400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:25.218400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:25.218400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:25.224275 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:25.238513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d869cdea-6295-4d7f-b009-9475c0410595 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3c714ab-6173-44d8-8a52-bcbf97934f05" status: 200 len: 784 microversion: 2.1 time: 0.086289 Sep 25 01:06:25.240328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 673/1263] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:25 2022] GET /compute/v2.1/images/a3c714ab-6173-44d8-8a52-bcbf97934f05 => generated 784 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:25.246992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9142747b-424e-48f9-90be-2f6e2a86f4a4 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7beba9d430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:25.300398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9142747b-424e-48f9-90be-2f6e2a86f4a4 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.058737 Sep 25 01:06:25.306581 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 674/1264] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:06:25 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 58 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:25.313207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2231200-8ead-461f-b6ee-d65ca111baf2 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:25.322329 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2231200-8ead-461f-b6ee-d65ca111baf2 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014173 Sep 25 01:06:25.323203 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 675/1265] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:06:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:25.329585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:25.330450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:25.346295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:25.348903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:25.350036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:25.350977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:25.352044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:25.352659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:25.578103 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f592d08c-66bd-4994-ad2a-cb87bd0867fd tempest-ServersOnMultiNodesTest-1756919625 tempest-ServersOnMultiNodesTest-1756919625-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1616 microversion: 2.1 time: 0.373137 Sep 25 01:06:25.578346 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 591/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:25 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1616 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:25.601701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-42073603-23a1-4594-b8b9-54a44e50790f tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'update_all', calling method: .version_select at 0x7f7bebb388b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:25.674595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-42073603-23a1-4594-b8b9-54a44e50790f tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:25.682776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-42073603-23a1-4594-b8b9-54a44e50790f tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:25.773998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:25.789327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:25.796322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:25.801177 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-59c0e0e9-bae2-442f-ada9-6612b574fc6c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.474505 Sep 25 01:06:25.804654 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 676/1267] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:25 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:25.809849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-281835e5-dec7-4bcf-abd9-d66ee72f1ff6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba9df70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:26.081739 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-42073603-23a1-4594-b8b9-54a44e50790f tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.485405 Sep 25 01:06:26.083684 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 592/1268] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:25 2022] PUT /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:26.089350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-66d805c6-77e6-47e3-81c4-ddc552e7efc6 req-f09ebd91-efe4-49dc-9692-cc9687d96702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "tag": "b527a8a8-622c-45ae-aa5f-7b959e5f1e39"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:26.102223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66d805c6-77e6-47e3-81c4-ddc552e7efc6 req-f09ebd91-efe4-49dc-9692-cc9687d96702 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:26.103334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66d805c6-77e6-47e3-81c4-ddc552e7efc6 req-f09ebd91-efe4-49dc-9692-cc9687d96702 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:26.104092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-66d805c6-77e6-47e3-81c4-ddc552e7efc6 req-f09ebd91-efe4-49dc-9692-cc9687d96702 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:26.118753 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-66d805c6-77e6-47e3-81c4-ddc552e7efc6 req-f09ebd91-efe4-49dc-9692-cc9687d96702 service nova] Creating event network-changed:b527a8a8-622c-45ae-aa5f-7b959e5f1e39 for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:26.131601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-66d805c6-77e6-47e3-81c4-ddc552e7efc6 req-f09ebd91-efe4-49dc-9692-cc9687d96702 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046315 Sep 25 01:06:26.132582 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 593/1269] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:26.143922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:26.146271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:26.164630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:26.165516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:26.167545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:26.169347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:26.171058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:26.171785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:26.208350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:26.319139 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18d328c4-5cc6-4a9d-828d-f1364b298cd1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 204 len: 0 microversion: 2.1 time: 0.184783 Sep 25 01:06:26.321134 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 594/1270] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:26 2022] DELETE /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:26.335996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:26.338138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:26.355850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:26.359463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:26.360073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:26.360905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:26.361586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:26.362021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:26.825890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:26.835915 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-da9ddbe5-bfa6-4137-8615-a6789d86561d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.512106 Sep 25 01:06:26.837479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 595/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:26 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:26.858709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ab8a98c-8a2f-47b8-b9bc-751e7f21be31 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Action: 'create', calling method: .version_select at 0x7f7beba6d790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:26.933730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9ab8a98c-8a2f-47b8-b9bc-751e7f21be31 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:26.941478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9ab8a98c-8a2f-47b8-b9bc-751e7f21be31 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Getting quotas for user cb3218babac5488185fc2f8597cc827f and project 4ea4f73d0bc34551b05b440442cc90fc. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:26.998509 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-281835e5-dec7-4bcf-abd9-d66ee72f1ff6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "DELETE /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 204 len: 0 microversion: 2.1 time: 1.190736 Sep 25 01:06:26.999706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 677/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:25 2022] DELETE /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:27.005316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4f374823-d254-47cc-8b76-6e080dd29d3b req-806c6a01-8a5f-4c6f-afc8-bb1ea3c37621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:27.017081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4f374823-d254-47cc-8b76-6e080dd29d3b req-806c6a01-8a5f-4c6f-afc8-bb1ea3c37621 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.018015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4f374823-d254-47cc-8b76-6e080dd29d3b req-806c6a01-8a5f-4c6f-afc8-bb1ea3c37621 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.019143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4f374823-d254-47cc-8b76-6e080dd29d3b req-806c6a01-8a5f-4c6f-afc8-bb1ea3c37621 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.023876 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:27.034724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4f374823-d254-47cc-8b76-6e080dd29d3b req-806c6a01-8a5f-4c6f-afc8-bb1ea3c37621 service nova] Creating event network-vif-unplugged:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:06:27.040505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4f374823-d254-47cc-8b76-6e080dd29d3b req-806c6a01-8a5f-4c6f-afc8-bb1ea3c37621 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039276 Sep 25 01:06:27.041331 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 678/1273] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:27.048202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:27.048777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:27.057169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.058040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.058670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.059608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.060074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.061025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.292554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:27.311831 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d36862a-68b0-4add-9789-abb31ce2e6f5 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1471 microversion: 2.1 time: 0.267051 Sep 25 01:06:27.313032 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 679/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:27 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:27.323071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:27.324198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:27.329970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ab8a98c-8a2f-47b8-b9bc-751e7f21be31 tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "POST /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.475310 Sep 25 01:06:27.330585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 596/1275] 10.222.0.16 () {60 vars in 1281 bytes} [Sun Sep 25 01:06:26 2022] POST /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 85 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:27.335234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.336159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.336995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.338318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.339652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.340453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.494713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5810bd1-38e2-470d-bfe2-7e387b5f509c tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1627232974", "id": 842849125, "os-flavor-access:is_public": "False"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:27.517334 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5810bd1-38e2-470d-bfe2-7e387b5f509c tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.181807 Sep 25 01:06:27.518620 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 597/1276] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:06:27 2022] POST /compute/v2.1/flavors => generated 428 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:27.527365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1999303-f0ce-46c5-93a7-128af0a78f2d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba789d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:27.566239 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a1999303-f0ce-46c5-93a7-128af0a78f2d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] HTTP exception thrown: Image not found. Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1999303-f0ce-46c5-93a7-128af0a78f2d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Request method failure captured: Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f HTTP/1.1 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lI2EjuyWhmd4LeGdIP1z_lyZn9yLqlEJBA8fU0BLNWmauVaMucx1XRDfxDx0jPQbJNk19keYgwq8n2Xfp5dBFJTvLJyfyFesLhsanPKGQUwKjBHkypFgmxtxg4js8diGzxJXigdW4n37kNV1AL36c2KKsq5z3J7IWtIDrWmh2KJvE Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e3b524092c484ec3b22d1ce29930fa58 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e3b524092c484ec3b22d1ce29930fa58"}]}] Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e3b524092c484ec3b22d1ce29930fa58 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerTestJSON-756436779-project Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 46ba0c28dade4f7abf4e3ef3dcafa957 Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerTestJSON-756436779-project Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'aeb27287-4a27-4778-8170-68178b5a304f'} Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aeb27287-4a27-4778-8170-68178b5a304f Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:06:27.570402 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aeb27287-4a27-4778-8170-68178b5a304f could not be found. Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1999303-f0ce-46c5-93a7-128af0a78f2d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1999303-f0ce-46c5-93a7-128af0a78f2d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 404 len: 62 microversion: 2.1 time: 0.052723 Sep 25 01:06:27.575885 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 598/1277] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:27 2022] GET /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:06:27.584195 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09f8b5c3-f1c1-4eec-98ee-fb7b77ea93ae tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] Calling method '.version_select at 0x7f7bebaed670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:27.637216 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09f8b5c3-f1c1-4eec-98ee-fb7b77ea93ae tempest-ImagesMetadataTestJSON-2126897286 tempest-ImagesMetadataTestJSON-2126897286-project] 10.222.0.16 "GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.061431 Sep 25 01:06:27.637828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 599/1278] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:06:27 2022] GET /compute/v2.1/images/4c1ebaa0-4a70-4bd8-9d2d-c77e900c7fa1/metadata => generated 85 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:27.649951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c0df446-1507-45aa-8ac1-15ccc2b2090f tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f9bc6fcd41a641daa357f3a25ea6ec90"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:27.722106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:27.737311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:27.740503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:27.740987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c0df446-1507-45aa-8ac1-15ccc2b2090f tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/842849125/action" status: 200 len: 96 microversion: 2.1 time: 0.095165 Sep 25 01:06:27.742117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 600/1279] 10.222.0.16 () {60 vars in 1197 bytes} [Sun Sep 25 01:06:27 2022] POST /compute/v2.1/flavors/842849125/action => generated 96 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:27.749353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01fa3e95-c5a4-41f8-9016-efd9e7448c8a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.434334 Sep 25 01:06:27.768520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 680/1280] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:27 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:27.769740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1326211224"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:27.772498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:27.779939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.780833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.781498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.782389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.783015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.783511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.950913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a9f65d8-c7fa-4715-a873-ff61c6be5669 tempest-FlavorsAccessTestJSON-1764600500 tempest-FlavorsAccessTestJSON-1764600500-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:27.981806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a9f65d8-c7fa-4715-a873-ff61c6be5669 tempest-FlavorsAccessTestJSON-1764600500 tempest-FlavorsAccessTestJSON-1764600500-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.229844 Sep 25 01:06:27.982989 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 681/1281] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:06:27 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:27.987997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:27.988924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:27.992115 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:27.995891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:27.996756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:27.997595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:27.999387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:28.000474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:28.001708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:28.062238 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3888d8e1-2987-4b38-857d-a56963e56efd tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "POST /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257/action" status: 202 len: 0 microversion: 2.1 time: 0.318569 Sep 25 01:06:28.062900 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 601/1282] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:06:27 2022] POST /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:06:28.069155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17f642ea-59d0-41eb-810e-eff4edb2727e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f9bc6fcd41a641daa357f3a25ea6ec90"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:28.167080 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:28.174828 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17f642ea-59d0-41eb-810e-eff4edb2727e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/842849125/action" status: 200 len: 21 microversion: 2.1 time: 0.110317 Sep 25 01:06:28.175442 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 602/1283] 10.222.0.16 () {60 vars in 1197 bytes} [Sun Sep 25 01:06:28 2022] POST /compute/v2.1/flavors/842849125/action => generated 21 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:28.187443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-312af86b-c119-45a1-97e0-d36d1319caa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebaed5e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.263215 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-312af86b-c119-45a1-97e0-d36d1319caa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.085643 Sep 25 01:06:28.264263 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 603/1284] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:28.270369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7392767a-5bc2-4d2a-9047-bdb21e11f094 tempest-FlavorsAccessTestJSON-1764600500 tempest-FlavorsAccessTestJSON-1764600500-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.316167 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7392767a-5bc2-4d2a-9047-bdb21e11f094 tempest-FlavorsAccessTestJSON-1764600500 tempest-FlavorsAccessTestJSON-1764600500-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050399 Sep 25 01:06:28.320087 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 604/1285] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:28.338400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.340054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:28.348384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:28.349637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:28.350362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:28.351560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:28.352555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:28.353275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:28.521177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:28.537809 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b622410a-81ff-45d6-bfb5-8826aed76ea9 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.553101 Sep 25 01:06:28.539022 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 682/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:27 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:28.547128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6dc33722-34cb-4771-a9ca-0bf3526d90ce tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.581727 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6dc33722-34cb-4771-a9ca-0bf3526d90ce tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/842849125" status: 202 len: 0 microversion: 2.1 time: 0.040480 Sep 25 01:06:28.583098 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 683/1287] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:06:28 2022] DELETE /compute/v2.1/flavors/842849125 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:06:28.593834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b7be9c6-1a1a-45ac-a427-f14180951fe4 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.620166 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b7be9c6-1a1a-45ac-a427-f14180951fe4 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030962 Sep 25 01:06:28.620978 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 684/1288] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:28.642748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8cca5ed-2685-4c9f-8579-bcff55fb7871 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-646218222", "id": 312061252, "os-flavor-access:is_public": "False"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:28.663570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f8cca5ed-2685-4c9f-8579-bcff55fb7871 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.025918 Sep 25 01:06:28.664180 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 685/1289] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:06:28 2022] POST /compute/v2.1/flavors => generated 427 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:06:28.675872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d1d3754d-7669-4bb9-9a80-4a1cb7bac791 req-c1569ee4-17a9-43d5-afdc-aed9223f8db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "tag": "168bece6-be01-4c4a-bad6-35b900dd0e2a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:28.689306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d1d3754d-7669-4bb9-9a80-4a1cb7bac791 req-c1569ee4-17a9-43d5-afdc-aed9223f8db3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:28.689938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d1d3754d-7669-4bb9-9a80-4a1cb7bac791 req-c1569ee4-17a9-43d5-afdc-aed9223f8db3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:28.690706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d1d3754d-7669-4bb9-9a80-4a1cb7bac791 req-c1569ee4-17a9-43d5-afdc-aed9223f8db3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:28.712954 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d1d3754d-7669-4bb9-9a80-4a1cb7bac791 req-c1569ee4-17a9-43d5-afdc-aed9223f8db3 service nova] Creating event network-changed:168bece6-be01-4c4a-bad6-35b900dd0e2a for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:28.719885 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d1d3754d-7669-4bb9-9a80-4a1cb7bac791 req-c1569ee4-17a9-43d5-afdc-aed9223f8db3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052342 Sep 25 01:06:28.720732 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 686/1290] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:28.726794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4d85646-5ed9-478b-bada-8775eee8d426 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.740414 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4d85646-5ed9-478b-bada-8775eee8d426 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/312061252/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.017900 Sep 25 01:06:28.741569 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 687/1291] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/flavors/312061252/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:28.754294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f969cff5-b540-40df-8de6-ad7b6d1009c6 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.778840 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f969cff5-b540-40df-8de6-ad7b6d1009c6 tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/312061252" status: 202 len: 0 microversion: 2.1 time: 0.028745 Sep 25 01:06:28.780484 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 688/1292] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:06:28 2022] DELETE /compute/v2.1/flavors/312061252 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:06:28.787542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.788610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:28.799506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:28.800378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:28.801223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:28.802296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:28.803023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:28.803600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:28.929988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:28.946792 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ed378ba5-e759-4a70-9322-8f4baf05708d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1471 microversion: 2.1 time: 0.612604 Sep 25 01:06:28.947974 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 605/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1471 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:28.970406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b555d696-faa1-4eff-8beb-821aeef0cf0e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:28.995028 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b555d696-faa1-4eff-8beb-821aeef0cf0e tempest-FlavorsAccessTestJSON-1831628814 tempest-FlavorsAccessTestJSON-1831628814-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030813 Sep 25 01:06:28.995766 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 606/1294] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:29.351304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb25e0d1-c3d2-4e1e-8e7d-fd258401de0d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba2cee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:29.395076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:29.412801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:29.414342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:29.415511 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c356dce8-f0c5-463b-a82b-e1bd6a73416c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.633878 Sep 25 01:06:29.416079 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 689/1295] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:28 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:29.437395 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cb25e0d1-c3d2-4e1e-8e7d-fd258401de0d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.099159 Sep 25 01:06:29.438986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 607/1296] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:29 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:29.571846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:29.576612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:29.590799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:29.592709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:29.594257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:29.595954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:29.596977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:29.598556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:29.979327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:29.979910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:30.001539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:30.002187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:30.002636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:30.003365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:30.008958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:30.009773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:30.088585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:30.100504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a545104e-2554-4b6f-90e3-2d1f57dbfebe tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.541490 Sep 25 01:06:30.113865 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 690/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:29 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:30.213742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:30.229106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-deb1a4c2-8d71-4117-b996-77c96a4b267f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1429 microversion: 2.1 time: 0.256604 Sep 25 01:06:30.229760 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 608/1298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:29 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1429 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:30.456109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f032e11-f7c2-4092-b017-baca711346c8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba78b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:30.456725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:30.458155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:30.476970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:30.479540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:30.480007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:30.484340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:30.488253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:30.490745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:30.526397 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f032e11-f7c2-4092-b017-baca711346c8 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.075869 Sep 25 01:06:30.534700 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 609/1299] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:30 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:31.052306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:31.063518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:31.065460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:31.066832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1b6094e-b31e-46b2-9b0c-e380fb50db7c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.625299 Sep 25 01:06:31.067936 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 691/1300] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:30 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:31.073559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "tag": "8b73a060-a7d8-46d5-a4cc-93ddbdbc901b"}, {"server_uuid": "96989006-98c3-46f2-9db8-66dde51cea14", "name": "network-vif-deleted", "tag": "1d134a24-f288-4678-bd5b-2444d2754003"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:31.085955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.086615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.087192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.101233 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] Creating event network-changed:8b73a060-a7d8-46d5-a4cc-93ddbdbc901b for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:31.102033 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] Creating event network-vif-deleted:1d134a24-f288-4678-bd5b-2444d2754003 for instance 96989006-98c3-46f2-9db8-66dde51cea14 on n-h2-master-1 Sep 25 01:06:31.111512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-caaa8c36-5696-41e0-a6ce-5be3d9f39b84 req-48d4ee8a-1e0d-42c5-ace8-ee29ca85b270 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042196 Sep 25 01:06:31.112842 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 692/1301] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:31.130752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:31.131903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:31.139973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.140717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.141375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.142563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.143246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.144234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.181758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Calling method '.version_select at 0x7f7beba2c8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:31.196251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.196733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.197172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.197976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.198429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.198871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.221305 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f840c1f6-804d-48e3-bd17-9aeacd339f27 tempest-AbsoluteLimitsTestJSON-1749926173 tempest-AbsoluteLimitsTestJSON-1749926173-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.560077 Sep 25 01:06:31.221934 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 610/1302] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:06:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:31.257792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:31.258451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:31.265006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.265857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.266734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.267749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.268354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.269076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.304933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:31.305722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:31.306331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:31.306956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid 96989006-98c3-46f2-9db8-66dde51cea14 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:31.406432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:31.414558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-04921c19-9d0c-42f3-82c3-7efe50ff96c1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1306 microversion: 2.1 time: 0.162117 Sep 25 01:06:31.415746 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 611/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:31 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:31.499575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:31.510111 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-653286a0-a941-407b-a9ed-bde3573b3d30 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.384464 Sep 25 01:06:31.511174 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 693/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:31 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:31.548987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c101a57-e303-46f2-8a1f-eb89687f0ff4 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebaa4040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:31.629248 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c101a57-e303-46f2-8a1f-eb89687f0ff4 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.089691 Sep 25 01:06:31.630452 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 612/1305] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:31 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:32.103184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:32.104522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:32.132336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.134069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.135871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.136903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.139818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.140406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.440037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:32.441040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:32.450302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.453156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.454122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.455348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.456836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.458879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.514233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.515817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.516759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.517570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid 96989006-98c3-46f2-9db8-66dde51cea14 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:32.611285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:32.620794 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4a740d5-0b70-468e-a818-d032e3ad071a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1306 microversion: 2.1 time: 0.184532 Sep 25 01:06:32.621389 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 613/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:32 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1306 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:32.627680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:32.628474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:32.637128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.642102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.642554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.643419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:32.643918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:32.645655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:32.810886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:32.823476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:32.825447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:32.827915 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e802cc9-3fa5-4f90-8a65-c5ca56a85798 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.730884 Sep 25 01:06:32.829580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 694/1307] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:32 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:32.834816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-301dce41-0617-4a67-ae5e-47446c5e7bd6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebab33a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:32.885884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:32.896936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a2aab98-df28-4e60-8836-1e159682e845 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.273092 Sep 25 01:06:32.897707 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 614/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:32 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:32.903695 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-301dce41-0617-4a67-ae5e-47446c5e7bd6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.072762 Sep 25 01:06:32.904366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 695/1309] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:32 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:33.432263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.433856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.434343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.434778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.434907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f20ceb0-3bf0-46bf-8f3a-83fad7e4c96e tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1452787692", "id": 1864908222, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:33.436064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.436547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.437242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.459088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f20ceb0-3bf0-46bf-8f3a-83fad7e4c96e tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.082448 Sep 25 01:06:33.460117 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 696/1310] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:06:33 2022] POST /compute/v2.1/flavors => generated 449 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:06:33.463257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b02d1cdd-22bb-4c9d-9280-2878c1596121 tempest-AZV2TestJSON-566290410 tempest-AZV2TestJSON-566290410-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.273932 Sep 25 01:06:33.463842 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 615/1311] 10.222.0.16 () {58 vars in 1164 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:06:33.578859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-171e6610-de31-4c81-aeac-cbd5ced22418 tempest-FlavorsV255TestJSON-647653261 tempest-FlavorsV255TestJSON-647653261-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.586999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-171e6610-de31-4c81-aeac-cbd5ced22418 tempest-FlavorsV255TestJSON-647653261 tempest-FlavorsV255TestJSON-647653261-project] 10.222.0.16 "GET /compute/v2.1/flavors/1864908222" status: 200 len: 449 microversion: 2.55 time: 0.113868 Sep 25 01:06:33.587846 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 697/1312] 10.222.0.16 () {60 vars in 1199 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/flavors/1864908222 => generated 449 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:06:33.602395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0c6b8ba6-8466-42a7-a6cb-8cceb796ebb9 tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:33.627215 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0c6b8ba6-8466-42a7-a6cb-8cceb796ebb9 tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1864908222" status: 200 len: 450 microversion: 2.55 time: 0.028910 Sep 25 01:06:33.627905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 616/1313] 10.222.0.16 () {62 vars in 1219 bytes} [Sun Sep 25 01:06:33 2022] PUT /compute/v2.1/flavors/1864908222 => generated 450 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:06:33.643424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-889ed6c8-658d-420f-a293-4800bc8a0a84 tempest-FlavorsV255TestJSON-647653261 tempest-FlavorsV255TestJSON-647653261-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.643936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.644729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:33.654878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.655381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.656105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.657112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.657610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.658038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.672921 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-889ed6c8-658d-420f-a293-4800bc8a0a84 tempest-FlavorsV255TestJSON-647653261 tempest-FlavorsV255TestJSON-647653261-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.034862 Sep 25 01:06:33.673144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 698/1314] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:33.692853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.693343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.693788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-631d6c78-1c46-42cd-a278-12b038383357 tempest-FlavorsV255TestJSON-647653261 tempest-FlavorsV255TestJSON-647653261-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.693939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.694255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid 96989006-98c3-46f2-9db8-66dde51cea14 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:33.714931 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-631d6c78-1c46-42cd-a278-12b038383357 tempest-FlavorsV255TestJSON-647653261 tempest-FlavorsV255TestJSON-647653261-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.025026 Sep 25 01:06:33.715536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 699/1315] 10.222.0.16 () {60 vars in 1166 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:33.733261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4386bddb-e5be-4347-916e-9a8e98c4f4e3 tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.749461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:33.753034 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4386bddb-e5be-4347-916e-9a8e98c4f4e3 tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1864908222" status: 202 len: 0 microversion: 2.55 time: 0.024127 Sep 25 01:06:33.754028 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 700/1316] 10.222.0.16 () {60 vars in 1202 bytes} [Sun Sep 25 01:06:33 2022] DELETE /compute/v2.1/flavors/1864908222 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:33.759850 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2eeb8280-4eb5-4275-a14e-442a9f01e22b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 200 len: 1306 microversion: 2.1 time: 0.119881 Sep 25 01:06:33.760519 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 617/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:33.761750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6956883f-6b4c-48ba-9b69-f4163f339427 tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.783885 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6956883f-6b4c-48ba-9b69-f4163f339427 tempest-FlavorsV255TestJSON-1406722646 tempest-FlavorsV255TestJSON-1406722646-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.025689 Sep 25 01:06:33.785218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 701/1318] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:33.858232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.859273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:33.867797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.868926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.869774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.871418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:33.871826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:33.872283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:33.920898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61ec361a-307d-4a5a-9ffc-73f8e73ebcd0 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb869d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:33.995330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61ec361a-307d-4a5a-9ffc-73f8e73ebcd0 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.079448 Sep 25 01:06:33.995917 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 702/1319] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:34.001851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:34.002477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:34.008939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.009750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.010190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.010896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.011351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.011779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.041482 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=14 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:34.352647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:34.364012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:34.366057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:34.367292 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d6ddec4-82ba-41e2-afc9-0440b4b4975e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.514340 Sep 25 01:06:34.368089 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 618/1320] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:34.401713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:34.402622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:34.409225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.410043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.410490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.411236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.418275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.418758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.431224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:34.474999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe8d0a00-6e4c-406b-b306-20af3c2c0e5e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.476269 Sep 25 01:06:34.485520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 703/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:33 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:34.749204 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:34.758244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:34.779111 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83ba6dde-3b88-4b4b-8608-2b491f44ab66 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 2347 microversion: 2.25 time: 0.394868 Sep 25 01:06:34.782127 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 619/1322] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:34 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 2347 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:34.804192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:34.805222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96989006-98c3-46f2-9db8-66dde51cea14] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:34.807840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:34.813206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.813749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.814575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.815558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.816279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.816714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.818165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.820119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.822105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.824954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.827958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.828605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.844000 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance 96989006-98c3-46f2-9db8-66dde51cea14 could not be found. Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 HTTP/1.1 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 96989006-98c3-46f2-9db8-66dde51cea14 could not be found. Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '96989006-98c3-46f2-9db8-66dde51cea14'} Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96989006-98c3-46f2-9db8-66dde51cea14 could not be found. Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96989006-98c3-46f2-9db8-66dde51cea14 could not be found. Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:34.846533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96989006-98c3-46f2-9db8-66dde51cea14 could not be found. Sep 25 01:06:34.851681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:34.858947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance 96989006-98c3-46f2-9db8-66dde51cea14 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:34.862604 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e224835a-555a-4789-9846-2831d14c0f28 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14" status: 404 len: 111 microversion: 2.1 time: 0.082700 Sep 25 01:06:34.863390 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 704/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:34 2022] GET /compute/v2.1/servers/96989006-98c3-46f2-9db8-66dde51cea14 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:06:34.875346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:34.881165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:34.896577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e608c2af-d773-4e65-9be9-c3db3dc2835d tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093965 Sep 25 01:06:34.899857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.903331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.903931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.904924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:34.905468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:34.905887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:34.915919 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 620/1324] 10.222.0.16 () {60 vars in 1217 bytes} [Sun Sep 25 01:06:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:06:34.969517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:35.015933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fbba0805-3f2c-4117-ada2-77c4bfceeec9 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebba0310>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:35.102024 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fbba0805-3f2c-4117-ada2-77c4bfceeec9 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.091218 Sep 25 01:06:35.103025 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 621/1325] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:35 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:35.113651 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00d0e1d8-270a-4ead-8920-1079ae7b517b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 204 len: 0 microversion: 2.1 time: 0.244558 Sep 25 01:06:35.114252 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 705/1326] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:34 2022] DELETE /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:35.138394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:35.142175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:35.160340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:35.160997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:35.162448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:35.163100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:35.164997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:35.165655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:35.355076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:35.366089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc079e93-5e52-4825-a5b0-78080a4f3806 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1470 microversion: 2.1 time: 0.241160 Sep 25 01:06:35.367531 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 622/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:35 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:35.405818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:35.406945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:35.436250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:35.436800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:35.443630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:35.444406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:35.444978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:35.445396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:35.501484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:35.502349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:35.515654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:35.517658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:35.519339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:35.520757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:35.523710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:35.524164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:35.978864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:35.993280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:35.996285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:36.000702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:36.001997 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0893fcd8-c001-4eb7-812f-df56635b8d75 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.601783 Sep 25 01:06:36.005561 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 706/1328] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:35 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:36.017850 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a90a393-63ed-4d11-b64c-2222d62e9da4 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.522416 Sep 25 01:06:36.020141 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 623/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:35 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:36.119307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a962dc92-f277-482b-a6f0-0d4001d63a15 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba4c4c0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:36.180816 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a962dc92-f277-482b-a6f0-0d4001d63a15 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.065391 Sep 25 01:06:36.182457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 707/1330] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:36 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:36.396311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:36.397692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:36.416381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:36.421264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:36.423098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:36.424057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:36.426332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:36.426563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:36.661180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:36.672381 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6949389d-3662-470a-a65e-52a49840eb0e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1470 microversion: 2.1 time: 0.286567 Sep 25 01:06:36.673625 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 624/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:36 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:37.029112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:37.029842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:37.043617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:37.044340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:37.051981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.052472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.052910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.056551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.057012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.057476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.058186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.058645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.059072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.069808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.073812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.076213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.597355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:37.606795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:37.610341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:37.611754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-32c8651d-5946-4935-83ec-f2a2cc74b474 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.587406 Sep 25 01:06:37.613153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:37.626069 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 708/1332] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:37 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:37.637390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1c6cf20-998f-422e-bafb-5b9b7c90337d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba4c280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:37.641273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-30095bad-7735-4c71-a0d7-b0f36d4da476 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.602490 Sep 25 01:06:37.642632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 625/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:37 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:37.692815 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1c6cf20-998f-422e-bafb-5b9b7c90337d tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.065500 Sep 25 01:06:37.695055 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 709/1334] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:37 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:37.701292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-929b0c92-7bf2-4f08-8f2d-30923d436b22 req-53763a44-e0c5-490e-921b-506b314b5446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "name": "network-vif-plugged", "status": "completed", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:37.711970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-929b0c92-7bf2-4f08-8f2d-30923d436b22 req-53763a44-e0c5-490e-921b-506b314b5446 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.712580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-929b0c92-7bf2-4f08-8f2d-30923d436b22 req-53763a44-e0c5-490e-921b-506b314b5446 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.713250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-929b0c92-7bf2-4f08-8f2d-30923d436b22 req-53763a44-e0c5-490e-921b-506b314b5446 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.728184 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-929b0c92-7bf2-4f08-8f2d-30923d436b22 req-53763a44-e0c5-490e-921b-506b314b5446 service nova] Creating event network-vif-plugged:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:06:37.734655 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-929b0c92-7bf2-4f08-8f2d-30923d436b22 req-53763a44-e0c5-490e-921b-506b314b5446 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038333 Sep 25 01:06:37.735867 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 710/1335] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:37.741644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:37.742794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:37.754299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.755042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.755719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.756654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.757548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.758578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.859039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Calling method '.version_select at 0x7f7bebf2d550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:37.861037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.861671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.862339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.880617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.881689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.882363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.886976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:37.901586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:37.904886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:37.905651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:37.907592 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bacc7195-e0e7-4668-985a-271c3e95494e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1428 microversion: 2.1 time: 0.169176 Sep 25 01:06:37.908412 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 711/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:37 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1428 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:37.916786 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2012fa70-3e78-48ca-b98c-219f5c72d1b9 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.272780 Sep 25 01:06:37.917990 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 626/1337] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:06:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:37.984838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-62fa2a33-cd66-43e0-a0f9-89000b6dfc12 req-b5c00605-ec2c-42b3-884f-d5d20e17c600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa", "name": "network-vif-deleted", "tag": "61bf0aef-be4f-4819-a60d-60b39c85f8bb"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:38.000334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-62fa2a33-cd66-43e0-a0f9-89000b6dfc12 req-b5c00605-ec2c-42b3-884f-d5d20e17c600 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.001069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-62fa2a33-cd66-43e0-a0f9-89000b6dfc12 req-b5c00605-ec2c-42b3-884f-d5d20e17c600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.001922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-62fa2a33-cd66-43e0-a0f9-89000b6dfc12 req-b5c00605-ec2c-42b3-884f-d5d20e17c600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.017387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-62fa2a33-cd66-43e0-a0f9-89000b6dfc12 req-b5c00605-ec2c-42b3-884f-d5d20e17c600 service nova] Creating event network-vif-deleted:61bf0aef-be4f-4819-a60d-60b39c85f8bb for instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa on n-h1-master-1 Sep 25 01:06:38.025130 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-62fa2a33-cd66-43e0-a0f9-89000b6dfc12 req-b5c00605-ec2c-42b3-884f-d5d20e17c600 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048789 Sep 25 01:06:38.025794 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 627/1338] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:38.177425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ab33e86-3f3f-489c-88b5-a811cd3d5ad9", "device": "/dev/xvdb"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:38.181579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:38.189586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.190414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.191032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.191963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.192599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.193194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.210223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8d801f9-58a9-4b27-83e0-59d96ba0810b tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Calling method '.version_select at 0x7f7beba4c700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.212060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8d801f9-58a9-4b27-83e0-59d96ba0810b tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'dc4cb8a014f841f9beb300d47fc671a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a7875a3ab248798ffce7191e078d4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8d801f9-58a9-4b27-83e0-59d96ba0810b tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Request method failure captured: Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6mc0k-_igIMDjUrZAGt6a430vzBT35uBENsLkPMiKZb84FekXfZspmXfOIQyER0O-hapDbEYYzoORvWftlGWJUrqCw_tcfgst6tc-LP7CC-I6cYN1G61PUDnj-4Yk0iW_GGH15Unh7OD1FQtZDam_YebBMkv6dh_bSmUmdEw6VQ1Mo Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 29a7875a3ab248798ffce7191e078d4e Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1757851440 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29a7875a3ab248798ffce7191e078d4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29a7875a3ab248798ffce7191e078d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29a7875a3ab248798ffce7191e078d4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29a7875a3ab248798ffce7191e078d4e"}]}] Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1757851440 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 29a7875a3ab248798ffce7191e078d4e Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1757851440 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: dc4cb8a014f841f9beb300d47fc671a8 Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'n-h1-master-1'} Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:38.213778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8d801f9-58a9-4b27-83e0-59d96ba0810b tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8d801f9-58a9-4b27-83e0-59d96ba0810b tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.289071 Sep 25 01:06:38.219557 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 712/1339] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:06:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:38.231159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Calling method '.version_select at 0x7f7bebb381f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.233036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.233562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.234008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.259724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Request method failure captured: Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6mdt7Qi76SgLhi_CxOzRIbVWpG4OlhSDtKCCMmjsIjMZZ4ndJSFtDqI7iCzOMqOByIOiudhOvTwdJa2kag-yphP3dVaU4qL2RMG1qBKIPLSq1uFOTZ3yg4VTSWSsd9vyfW3Y7zfGI4a2sjzmJtSFQGECwC1HtdI58Tc-jxXuC4FQiw Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1fa1bc1da7a64c37adfbf807302fca30 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-182401256 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1fa1bc1da7a64c37adfbf807302fca30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1fa1bc1da7a64c37adfbf807302fca30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1fa1bc1da7a64c37adfbf807302fca30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1fa1bc1da7a64c37adfbf807302fca30"}]}] Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-182401256 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1fa1bc1da7a64c37adfbf807302fca30 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-182401256 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: cd22bf399f0c408fabfbec69df4ade78 Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 25 01:06:38.261466 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.267560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:38.268784 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a96c0eb6-3f4c-488b-b785-bc4c0d137379 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.043653 Sep 25 01:06:38.269582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 713/1340] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:06:38 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:38.281265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Calling method '.version_select at 0x7f7bebcfa0d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.283313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.285179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.285344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.292333 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:38.310594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.311362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.311995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.325342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.329421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.330080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.342792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8e6c0430-f74f-46a7-afef-ef784a7901b3 tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067178 Sep 25 01:06:38.349257 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 714/1341] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:06:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:38.364096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8f1cab5-1e09-4a0f-a7b2-c65cae6fa0e4 tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Calling method '.version_select at 0x7f7bebabdee0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.367753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f8f1cab5-1e09-4a0f-a7b2-c65cae6fa0e4 tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'dc4cb8a014f841f9beb300d47fc671a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a7875a3ab248798ffce7191e078d4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8f1cab5-1e09-4a0f-a7b2-c65cae6fa0e4 tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Request method failure captured: Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6mc0k-_igIMDjUrZAGt6a430vzBT35uBENsLkPMiKZb84FekXfZspmXfOIQyER0O-hapDbEYYzoORvWftlGWJUrqCw_tcfgst6tc-LP7CC-I6cYN1G61PUDnj-4Yk0iW_GGH15Unh7OD1FQtZDam_YebBMkv6dh_bSmUmdEw6VQ1Mo Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 29a7875a3ab248798ffce7191e078d4e Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1757851440 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29a7875a3ab248798ffce7191e078d4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29a7875a3ab248798ffce7191e078d4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29a7875a3ab248798ffce7191e078d4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29a7875a3ab248798ffce7191e078d4e"}]}] Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1757851440 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 29a7875a3ab248798ffce7191e078d4e Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1757851440 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: dc4cb8a014f841f9beb300d47fc671a8 Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1'} Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:38.375521 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8f1cab5-1e09-4a0f-a7b2-c65cae6fa0e4 tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:38.379856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f8f1cab5-1e09-4a0f-a7b2-c65cae6fa0e4 tempest-HypervisorAdminNegativeUnderV252Test-1757851440 tempest-HypervisorAdminNegativeUnderV252Test-1757851440-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021645 Sep 25 01:06:38.386337 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 715/1342] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:06:38 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:38.405189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Calling method '.version_select at 0x7f7beba4c4c0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.409350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.409873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.410371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.417665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] HTTP exception thrown: No hypervisor matching 'db1669e3-7f1e-40e4-97e3-cabf038355df' could be found. Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Request method failure captured: Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-hypervisors/db1669e3-7f1e-40e4-97e3-cabf038355df/servers HTTP/1.1 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6mdt7Qi76SgLhi_CxOzRIbVWpG4OlhSDtKCCMmjsIjMZZ4ndJSFtDqI7iCzOMqOByIOiudhOvTwdJa2kag-yphP3dVaU4qL2RMG1qBKIPLSq1uFOTZ3yg4VTSWSsd9vyfW3Y7zfGI4a2sjzmJtSFQGECwC1HtdI58Tc-jxXuC4FQiw Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1fa1bc1da7a64c37adfbf807302fca30 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-182401256 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1fa1bc1da7a64c37adfbf807302fca30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1fa1bc1da7a64c37adfbf807302fca30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1fa1bc1da7a64c37adfbf807302fca30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1fa1bc1da7a64c37adfbf807302fca30"}]}] Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-182401256 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1fa1bc1da7a64c37adfbf807302fca30 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-182401256 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: cd22bf399f0c408fabfbec69df4ade78 Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: exception: No hypervisor matching 'db1669e3-7f1e-40e4-97e3-cabf038355df' could be found. Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'db1669e3-7f1e-40e4-97e3-cabf038355df'} Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'db1669e3-7f1e-40e4-97e3-cabf038355df' could be found. Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'db1669e3-7f1e-40e4-97e3-cabf038355df' could be found. Sep 25 01:06:38.419341 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:38.425900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] Returning 404 to user: No hypervisor matching 'db1669e3-7f1e-40e4-97e3-cabf038355df' could be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:38.427285 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2bfc6cbe-24a5-4a35-8c79-b8cf476647bf tempest-HypervisorAdminNegativeUnderV252Test-182401256 tempest-HypervisorAdminNegativeUnderV252Test-182401256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/db1669e3-7f1e-40e4-97e3-cabf038355df/servers" status: 404 len: 123 microversion: 2.1 time: 0.039588 Sep 25 01:06:38.429582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 716/1343] 10.222.0.16 () {58 vars in 1281 bytes} [Sun Sep 25 01:06:38 2022] GET /compute/v2.1/os-hypervisors/db1669e3-7f1e-40e4-97e3-cabf038355df/servers => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:38.642627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.643258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:38.651867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.652377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.652830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.653570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.654111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.656498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.722056 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6666af5e-b5c8-4f3b-9309-f244cdf845cc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "POST /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.547139 Sep 25 01:06:38.723758 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 628/1344] 10.222.0.16 () {62 vars in 1364 bytes} [Sun Sep 25 01:06:38 2022] POST /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:06:38.738807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:38.740370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:38.755458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.759017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.759669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:38.762205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:38.763036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:38.763965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:39.147939 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:39.157427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:39.159747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:39.161018 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f8f672a-1c9e-4604-b7af-60b12fb97b71 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.524067 Sep 25 01:06:39.173658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 717/1345] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:38 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:39.173658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b1bb593-5f1b-42a2-88b9-9e64171d3124 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba91940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:39.196122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:39.209844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8dd1038-d749-4566-90ba-c237ae75756d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.484535 Sep 25 01:06:39.210431 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 629/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:38 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:39.219187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:39.219807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:39.241263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:39.243766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:39.244237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:39.246471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:39.246977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:39.247409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:39.251400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b1bb593-5f1b-42a2-88b9-9e64171d3124 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.088289 Sep 25 01:06:39.252416 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 718/1347] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:39 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:39.390771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:39.395623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:39.397589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:39.399416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:39.535190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:39.558240 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d882709-225f-41c4-ad95-d410f4fd969d tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 200 len: 1306 microversion: 2.1 time: 0.345341 Sep 25 01:06:39.562327 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 630/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:39 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 1306 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:40.193667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:40.194945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:40.214177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:40.218026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:40.218700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:40.228739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:40.229235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:40.231426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:40.237772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:40.239250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:40.251418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:40.257715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:40.258530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:40.262479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:40.263275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:40.264286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:40.962300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:40.980226 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82e0f558-484b-44a3-af94-6097a563d90e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.738020 Sep 25 01:06:40.981703 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 631/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:40 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:40.987677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c189aa70-20e5-495c-b2ab-a44908223b24 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebba05e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:41.019885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:41.038051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:41.039999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:41.042434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-484952e2-cfb4-410b-b92f-0f014d8184ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.853599 Sep 25 01:06:41.046273 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 719/1350] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:40 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:41.055219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:41.057706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:41.072397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:41.072919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:41.073370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:41.078301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:41.078995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:41.080870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:41.097471 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c189aa70-20e5-495c-b2ab-a44908223b24 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.114233 Sep 25 01:06:41.101472 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 632/1351] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:40 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:41.111880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa could not be found. Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa HTTP/1.1 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa could not be found. Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa'} Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa could not be found. Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa could not be found. Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:41.114182 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa could not be found. Sep 25 01:06:41.119276 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:41.121216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance 96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:41.122909 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ae59672-eed6-4bb0-8c68-3e5789e65046 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa" status: 404 len: 111 microversion: 2.1 time: 0.075096 Sep 25 01:06:41.129256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 720/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:41 2022] GET /compute/v2.1/servers/96ca2ae1-139b-4c09-a2b6-43c3ecbbd4fa => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:41.134948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:41.143250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:41.159228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:41.160986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:41.162390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:41.167231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:41.168737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:41.175108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:41.196990 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:41.217715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:41.413286 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d7014c6d-bce6-4395-bbda-0e3e7c0cfc49 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 204 len: 0 microversion: 2.1 time: 0.282265 Sep 25 01:06:41.424015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:41.424899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:41.428747 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 633/1353] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:41 2022] DELETE /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:41.439598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:41.440100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:41.440536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:41.445274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:41.446187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:41.447676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:41.822468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:41.831818 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-366a5501-2622-477c-aabb-28008343528b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1472 microversion: 2.1 time: 0.413104 Sep 25 01:06:41.832386 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 721/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:41 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:42.008718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:42.009439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:42.021168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:42.021682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:42.022114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:42.022819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:42.023266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:42.023682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:42.078275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:42.079058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:42.121995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:42.125028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:42.129634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:42.130750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:42.132336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:42.132956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:42.936687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:42.947940 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa8ffdb9-9c99-4ee4-9511-521a858fb911 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.943188 Sep 25 01:06:42.952913 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 634/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:42 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:42.961362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:42.963292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bbbc4077-e4f2-42a5-b12d-93d29922da91 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb99e280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:42.981026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:42.983142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:42.993330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ab5f1e0-8580-4d0b-b84e-bef2ad851cf7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.920530 Sep 25 01:06:42.993832 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 722/1356] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:42 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:43.035826 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bbbc4077-e4f2-42a5-b12d-93d29922da91 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.081408 Sep 25 01:06:43.042664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:43.045607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 635/1357] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:42 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:43.047845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:43.063885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:43.064588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:43.065056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:43.065828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:43.066298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:43.066732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:43.577803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1a17cf0-f61c-4628-a8fe-23242fb0cfae tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:43.579795 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a1a17cf0-f61c-4628-a8fe-23242fb0cfae tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1a17cf0-f61c-4628-a8fe-23242fb0cfae tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin] Request method failure captured: Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6mi9HI13FV6PMSwI6Y2OyoZJAaGUjgeQIpsGRke7YQm-a8chsJoAOPAAD_FeIdb5N2XcJ2Vnpa6kll2-FsdDS1N6Z-Y6YDc4U7UgEvJIKelSdy_hfHjzJJZUpxW3fx6s4P9SHf-URJlY4R0DzjtWi7Vpkn9_48y0QG8NM37ol_OKgY Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: a97a5c10ee5842ab8ad4ccd1b0a7c601 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a97a5c10ee5842ab8ad4ccd1b0a7c601"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97a5c10ee5842ab8ad4ccd1b0a7c601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97a5c10ee5842ab8ad4ccd1b0a7c601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a97a5c10ee5842ab8ad4ccd1b0a7c601"}]}] Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: a97a5c10ee5842ab8ad4ccd1b0a7c601 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 5b8468b1018a46f09368ca1acb4c820b Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid timestamp for date invalid_time Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'invalid_time'} Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:43.597379 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:43.601635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 25 01:06:43.601635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:43.601635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1a17cf0-f61c-4628-a8fe-23242fb0cfae tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:43.601635 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1a17cf0-f61c-4628-a8fe-23242fb0cfae tempest-InstanceUsageAuditLogNegativeTestJSON-339138251 tempest-InstanceUsageAuditLogNegativeTestJSON-339138251-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.488975 Sep 25 01:06:43.601635 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 636/1358] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 25 01:06:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 491 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 25 01:06:43.620870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d426790b-8ea9-4e63-bfc8-af3212be6ea2 req-7d99a096-59c8-499a-92c9-b95d70ea6ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "name": "network-vif-plugged", "status": "completed", "tag": "8b73a060-a7d8-46d5-a4cc-93ddbdbc901b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:43.674299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d426790b-8ea9-4e63-bfc8-af3212be6ea2 req-7d99a096-59c8-499a-92c9-b95d70ea6ec2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:43.694094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d426790b-8ea9-4e63-bfc8-af3212be6ea2 req-7d99a096-59c8-499a-92c9-b95d70ea6ec2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:43.696623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d426790b-8ea9-4e63-bfc8-af3212be6ea2 req-7d99a096-59c8-499a-92c9-b95d70ea6ec2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:43.758952 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d426790b-8ea9-4e63-bfc8-af3212be6ea2 req-7d99a096-59c8-499a-92c9-b95d70ea6ec2 service nova] Creating event network-vif-plugged:8b73a060-a7d8-46d5-a4cc-93ddbdbc901b for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:43.770418 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d426790b-8ea9-4e63-bfc8-af3212be6ea2 req-7d99a096-59c8-499a-92c9-b95d70ea6ec2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167848 Sep 25 01:06:43.771033 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 637/1359] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:43.911681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:43.921370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0aa304f-eaa8-455a-9765-1f591746c90e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1472 microversion: 2.1 time: 0.910741 Sep 25 01:06:43.933781 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 723/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:42 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1472 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:43.980626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:43.983558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:44.018586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:44.020364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:44.022569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:44.024569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:44.027903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:44.029767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:44.104243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4917ca8d-1b43-4e53-9c85-cddd7d0ad89d tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:44.106344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4917ca8d-1b43-4e53-9c85-cddd7d0ad89d tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '84d91deac56c435aa95c64b9f1a327f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a306b9225f4c9da48f9aa5ce0f8a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4917ca8d-1b43-4e53-9c85-cddd7d0ad89d tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Request method failure captured: Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6mhNwJEmHlekubRlBS_dMk2wyyqryiKA8LhGg_DvlvDi_ldNphYFB7Mo7xa6rTZAqVYg7MtCCGkkDwGgsliH7wdoirTz37QTS_DtKqHaXssH8mV4DaYo2nOVWRGFPGuPLssqQyM-GrH7W3vyOzEDM3qeXWbs5ij78p0i3zjA_BiS_I Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 94a306b9225f4c9da48f9aa5ce0f8a2c Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94a306b9225f4c9da48f9aa5ce0f8a2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a306b9225f4c9da48f9aa5ce0f8a2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a306b9225f4c9da48f9aa5ce0f8a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94a306b9225f4c9da48f9aa5ce0f8a2c"}]}] Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 94a306b9225f4c9da48f9aa5ce0f8a2c Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 84d91deac56c435aa95c64b9f1a327f8 Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: action_args: {} Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:44.139852 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4917ca8d-1b43-4e53-9c85-cddd7d0ad89d tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4917ca8d-1b43-4e53-9c85-cddd7d0ad89d tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.369414 Sep 25 01:06:44.144196 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 638/1361] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:06:43 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 371 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:44.170507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:44.174092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:44.206099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:44.212727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:44.215860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:44.220240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:44.221774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:44.225035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:44.744542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:44.755778 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b703f500-bf3d-4a8a-87f1-4b5dc2696c59 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.778939 Sep 25 01:06:44.769315 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 724/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:43 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:44.774465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c6f8a82-cd36-44fa-b146-c496fcbab0af tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba55c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:44.842107 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:44.922148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:44.927383 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:44.940662 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1c6f8a82-cd36-44fa-b146-c496fcbab0af tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.169188 Sep 25 01:06:44.944463 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 725/1363] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:44 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:44.963116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3c99bc1-ef28-4cd1-9475-3126379a81ce tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:44.979468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:44.983973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:44.990697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c3c99bc1-ef28-4cd1-9475-3126379a81ce tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '84d91deac56c435aa95c64b9f1a327f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a306b9225f4c9da48f9aa5ce0f8a2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:45.004334 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2cbd3bb-cc7b-4092-8e30-14e2cae673a3 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.848151 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3c99bc1-ef28-4cd1-9475-3126379a81ce tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Request method failure captured: Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-25%2001:06:44 HTTP/1.1 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6mhNwJEmHlekubRlBS_dMk2wyyqryiKA8LhGg_DvlvDi_ldNphYFB7Mo7xa6rTZAqVYg7MtCCGkkDwGgsliH7wdoirTz37QTS_DtKqHaXssH8mV4DaYo2nOVWRGFPGuPLssqQyM-GrH7W3vyOzEDM3qeXWbs5ij78p0i3zjA_BiS_I Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 94a306b9225f4c9da48f9aa5ce0f8a2c Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94a306b9225f4c9da48f9aa5ce0f8a2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a306b9225f4c9da48f9aa5ce0f8a2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a306b9225f4c9da48f9aa5ce0f8a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94a306b9225f4c9da48f9aa5ce0f8a2c"}]}] Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 94a306b9225f4c9da48f9aa5ce0f8a2c Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 84d91deac56c435aa95c64b9f1a327f8 Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '2022-09-25 01:06:44'} Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:45.013944 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:45.019764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:45.019764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:45.019764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 25 01:06:45.019764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 25 01:06:45.019764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 25 01:06:45.019764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:45.020276 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 639/1364] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:44 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:45.020929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3c99bc1-ef28-4cd1-9475-3126379a81ce tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:45.027503 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c3c99bc1-ef28-4cd1-9475-3126379a81ce tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278 tempest-InstanceUsageAuditLogNegativeTestJSON-1998612278-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-25 01:06:44" status: 403 len: 128 microversion: 2.1 time: 0.081373 Sep 25 01:06:45.028549 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 726/1365] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:06:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-25%2001%3A06%3A44 => generated 128 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:45.038804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:45.046361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:45.088340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:45.090086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:45.095296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:45.098554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:45.100188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:45.101986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:45.645102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:45.659813 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9cef0abd-0238-4a9f-afe8-d67b90eb5a34 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1472 microversion: 2.1 time: 0.637288 Sep 25 01:06:45.660870 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 640/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:45 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1472 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:45.796978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:45.798894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:45.828664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:45.830463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:45.832477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:45.834281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:45.835903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:45.836553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.350960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-80b98691-9576-46c9-b2af-0de4f7405d4a req-984bc95a-50c4-4883-9da9-31babaf34198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6231ebb-d141-4aa8-89f5-86e652654348", "name": "network-vif-deleted", "tag": "c00996ac-5e21-4b68-abba-37e06fe2e878"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:46.399136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-80b98691-9576-46c9-b2af-0de4f7405d4a req-984bc95a-50c4-4883-9da9-31babaf34198 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.399933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-80b98691-9576-46c9-b2af-0de4f7405d4a req-984bc95a-50c4-4883-9da9-31babaf34198 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.400405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-80b98691-9576-46c9-b2af-0de4f7405d4a req-984bc95a-50c4-4883-9da9-31babaf34198 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.400945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:46.439155 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7758c0b0-cdd2-4022-bd43-ee6d6adbcdab tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.648309 Sep 25 01:06:46.444995 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 727/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:45 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:46.450148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-80b98691-9576-46c9-b2af-0de4f7405d4a req-984bc95a-50c4-4883-9da9-31babaf34198 service nova] Creating event network-vif-deleted:c00996ac-5e21-4b68-abba-37e06fe2e878 for instance a6231ebb-d141-4aa8-89f5-86e652654348 on n-h1-master-1 Sep 25 01:06:46.457209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "name": "network-vif-plugged", "status": "completed", "tag": "168bece6-be01-4c4a-bad6-35b900dd0e2a"}, {"server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "name": "network-vif-plugged", "status": "completed", "tag": "b527a8a8-622c-45ae-aa5f-7b959e5f1e39"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:46.467692 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-80b98691-9576-46c9-b2af-0de4f7405d4a req-984bc95a-50c4-4883-9da9-31babaf34198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.570934 Sep 25 01:06:46.470342 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 641/1368] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:46.486444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.488612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b214b08d-75e0-490f-ba98-c927939e5160 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb968940>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:46.489207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.489875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.516911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] Creating event network-vif-plugged:168bece6-be01-4c4a-bad6-35b900dd0e2a for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:46.517845 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] Creating event network-vif-plugged:b527a8a8-622c-45ae-aa5f-7b959e5f1e39 for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:46.524018 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0ef65321-d83f-405b-a9aa-d2d3acfb97c6 req-29f5605a-81e0-41a9-994d-760cdbbb4a74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072022 Sep 25 01:06:46.524703 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 728/1369] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:46.543183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:46.548662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:46.551188 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:46.563843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.564265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.568234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.569071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.569584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.570018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.645431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b214b08d-75e0-490f-ba98-c927939e5160 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.172269 Sep 25 01:06:46.646032 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 642/1370] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:46 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:46.690860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:46.691520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:46.704008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.704794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.705485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.706430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.715521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.716938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.828119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:46.828907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:46.830299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:46.830958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid a6231ebb-d141-4aa8-89f5-86e652654348 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:46.971170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:47.007055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08c55292-5e8a-490d-b38f-7ad491f31591 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 200 len: 1306 microversion: 2.1 time: 0.320146 Sep 25 01:06:47.007906 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 643/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:46 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 1306 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:47.168223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:47.180254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:47.182787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:47.184673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-35caea42-cfff-4865-826b-d0dd8df3ce5e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.649218 Sep 25 01:06:47.206332 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 729/1372] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:46 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:47.472444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:47.473085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:47.487555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:47.490985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:47.492563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:47.493750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:47.494397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:47.495023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:47.666527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1123d3eb-8309-469e-a6c5-8e26af1fac14 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba553a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:47.743509 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1123d3eb-8309-469e-a6c5-8e26af1fac14 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.085627 Sep 25 01:06:47.744800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 730/1373] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:47 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:48.039085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:48.040964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: a6231ebb-d141-4aa8-89f5-86e652654348] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:48.074784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.078599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.080265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.082346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.083801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.085470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.142556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance a6231ebb-d141-4aa8-89f5-86e652654348 could not be found. Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 HTTP/1.1 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: exception: Instance a6231ebb-d141-4aa8-89f5-86e652654348 could not be found. Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'a6231ebb-d141-4aa8-89f5-86e652654348'} Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6231ebb-d141-4aa8-89f5-86e652654348 could not be found. Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6231ebb-d141-4aa8-89f5-86e652654348 could not be found. Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:48.148695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6231ebb-d141-4aa8-89f5-86e652654348 could not be found. Sep 25 01:06:48.162451 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:48.179269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance a6231ebb-d141-4aa8-89f5-86e652654348 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:48.191557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0c8b89d-350a-44e4-8d73-09090f395932 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348" status: 404 len: 111 microversion: 2.1 time: 0.158453 Sep 25 01:06:48.195256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 731/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:48 2022] GET /compute/v2.1/servers/a6231ebb-d141-4aa8-89f5-86e652654348 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:06:48.204686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:48.205095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:48.244340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.244864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.245326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.246112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.246582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.247018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.349935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:48.537872 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d63e47a-6c17-40d6-9dd2-8554ff4063b2 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 204 len: 0 microversion: 2.1 time: 0.340176 Sep 25 01:06:48.543451 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 732/1375] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:48 2022] DELETE /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:48.556289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:48.557098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:48.564253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:48.573243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.573779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.574231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.577743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.578151 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-03e9927b-e12b-4495-9060-b4eed15f1d82 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 1.111612 Sep 25 01:06:48.578946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.581191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.583271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 644/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:47 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:48.593927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:48.594489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:48.615478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.615997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.616453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.617178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:48.617670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:48.618100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:48.698414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:48.862595 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:48.897775 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb5db0df-5a9c-4c13-a774-c2eb6fe7eb4c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 204 len: 0 microversion: 2.1 time: 0.312363 Sep 25 01:06:48.903794 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 645/1377] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:48 2022] DELETE /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:48.913225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d11a6c4-3103-477b-bfcc-c1d7d9b4f0b9 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb9689d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:48.990342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d11a6c4-3103-477b-bfcc-c1d7d9b4f0b9 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.088037 Sep 25 01:06:48.991188 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 646/1378] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:48 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:49.007421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:49.014447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:49.061386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.061626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.063138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.063891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.064348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.070046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.095004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:49.115161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:49.117154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:49.124698 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-410b8675-2d50-462c-abd5-06c74a47e72d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.576483 Sep 25 01:06:49.125970 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 733/1379] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:48 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:49.472920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:49.491836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f7a1678-f512-4649-ba70-02833a705415 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 200 len: 1474 microversion: 2.1 time: 0.498572 Sep 25 01:06:49.494573 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 647/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:48 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 1474 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:49.606291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:49.608766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:49.622116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.623541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.624184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.625561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.626876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.627673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.785509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f47fd5b-53a3-4d19-af72-f945e6113a8a tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Action: 'create', calling method: .version_select at 0x7f7bebb38430>, body: {"keypair": {"name": "tempest-keypair-933402221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOulA0rvT6nxEfxtDxYoxzZ+H3qLwc1H8cz66Vlfd+dWbIKWh7yfepk9yzohE2JHKobjbxwYx2ErjxtJVUoQroPTtxZl39Ux3bCQbH4mkBhwwolnoGAzP2RQTppC4lFkA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:49.845799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1f47fd5b-53a3-4d19-af72-f945e6113a8a tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Getting quotas for project 740928060bf443508f8165c0dfa50514. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:49.854928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1f47fd5b-53a3-4d19-af72-f945e6113a8a tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Getting quotas for user 53d16cedecbe4634bf384effd09ca0a9 and project 740928060bf443508f8165c0dfa50514. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:49.914327 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f47fd5b-53a3-4d19-af72-f945e6113a8a tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.409279 Sep 25 01:06:49.915759 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 734/1381] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:06:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:50.007174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fc2f9a03-d5c9-414f-bac9-636944d02315 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bf098c1f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:50.092481 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fc2f9a03-d5c9-414f-bac9-636944d02315 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.089630 Sep 25 01:06:50.098730 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 735/1382] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:50 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:50.154241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:50.155378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:50.171170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:50.178125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:50.178981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:50.180186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:50.182787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:50.183627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:50.453368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:50.498200 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9a9a10f-9726-40f3-bd13-6a9853eddb45 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1353 microversion: 2.1 time: 0.892771 Sep 25 01:06:50.501592 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 648/1383] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:49 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1353 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:50.526965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:50.527420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:50.566181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:50.567873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:50.569813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:50.574047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:50.574836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:50.576789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:51.147567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:51.161376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:51.164652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:51.172336 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b1228e2-b122-4225-bf05-675cab86af0c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.022578 Sep 25 01:06:51.175434 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 736/1384] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:50 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:51.182627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-491f8fe0-99ea-473f-b2db-ce020734e142 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beba04f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:51.291904 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-491f8fe0-99ea-473f-b2db-ce020734e142 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.114796 Sep 25 01:06:51.292899 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 737/1385] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:51 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:51.532467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:51.533316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:51.545297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:51.545824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:51.551004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:51.552014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:51.565087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:51.568076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.008402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:52.074246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ca451ce-3b5e-471f-b95e-406e0cf190ef tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 200 len: 1474 microversion: 2.1 time: 1.518990 Sep 25 01:06:52.079880 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 649/1386] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:50 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 1474 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:52.161186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ac36f2ff-984b-4a13-aa73-d628da012502 req-f10d38f7-d3ad-4977-b517-f903c8b3d131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79be9a3-4950-4b44-9458-276628f72902", "name": "network-vif-deleted", "tag": "0b41e14e-cf51-44b5-8f42-fd27f1dd5dcc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:52.272875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ac36f2ff-984b-4a13-aa73-d628da012502 req-f10d38f7-d3ad-4977-b517-f903c8b3d131 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.273471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ac36f2ff-984b-4a13-aa73-d628da012502 req-f10d38f7-d3ad-4977-b517-f903c8b3d131 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.274106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ac36f2ff-984b-4a13-aa73-d628da012502 req-f10d38f7-d3ad-4977-b517-f903c8b3d131 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.314433 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ac36f2ff-984b-4a13-aa73-d628da012502 req-f10d38f7-d3ad-4977-b517-f903c8b3d131 service nova] Creating event network-vif-deleted:0b41e14e-cf51-44b5-8f42-fd27f1dd5dcc for instance e79be9a3-4950-4b44-9458-276628f72902 on n-h2-master-1 Sep 25 01:06:52.337771 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ac36f2ff-984b-4a13-aa73-d628da012502 req-f10d38f7-d3ad-4977-b517-f903c8b3d131 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197037 Sep 25 01:06:52.351927 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 650/1387] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:52.374720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:52.375959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:52.386485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.395778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.396586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.399759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:52.403357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.404537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.404930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.426386 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2dbcba75-6962-40f2-8488-b8b9a36a5350 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1804 microversion: 2.1 time: 0.898347 Sep 25 01:06:52.444508 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 738/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:51 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1804 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:52.456501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ac6333b1-1b05-4a53-96e7-25f5c5ae66b3 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebab3d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:52.646285 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ac6333b1-1b05-4a53-96e7-25f5c5ae66b3 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.200333 Sep 25 01:06:52.659452 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 739/1389] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:52 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:52.685267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-18cf69e6-a454-4808-a23d-817f4857a6f8 req-53056991-e3a2-4453-9782-f4d75fec9669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f940cae7-5120-4682-a8a1-e640a8a37aec", "name": "network-vif-deleted", "tag": "3c558a5f-1763-4e4e-ac0a-8a2fd61729d9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:52.779030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18cf69e6-a454-4808-a23d-817f4857a6f8 req-53056991-e3a2-4453-9782-f4d75fec9669 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.779559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18cf69e6-a454-4808-a23d-817f4857a6f8 req-53056991-e3a2-4453-9782-f4d75fec9669 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.780070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18cf69e6-a454-4808-a23d-817f4857a6f8 req-53056991-e3a2-4453-9782-f4d75fec9669 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.845632 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-18cf69e6-a454-4808-a23d-817f4857a6f8 req-53056991-e3a2-4453-9782-f4d75fec9669 service nova] Creating event network-vif-deleted:3c558a5f-1763-4e4e-ac0a-8a2fd61729d9 for instance f940cae7-5120-4682-a8a1-e640a8a37aec on n-h1-master-1 Sep 25 01:06:52.874795 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-18cf69e6-a454-4808-a23d-817f4857a6f8 req-53056991-e3a2-4453-9782-f4d75fec9669 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212723 Sep 25 01:06:52.881859 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 740/1390] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:52.905364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:52.907392 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:52.931526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.935815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.937837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.943530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.948442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.951010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.042306 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:53.052981 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60004d79-bb04-4d6e-ac5a-9c5893e485ed tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020/ips" status: 200 len: 219 microversion: 2.1 time: 0.169455 Sep 25 01:06:53.078110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 741/1391] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:06:52 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020/ips => generated 219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:53.100704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:53.101586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:53.136874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.137664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.138924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.139974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.140772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.141368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.196225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.218635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.221152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.221493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:53.227169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-700ac96e-24d7-44ac-9726-cbf3fbd52a8d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.872866 Sep 25 01:06:53.242902 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 651/1392] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:52 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:53.259578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:53.263303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:53.280259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.280764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.281249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.281971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.282433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.282905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.358458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.362021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.362689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.363354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid e79be9a3-4950-4b44-9458-276628f72902 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:53.434512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3f1a1a1-7548-467b-a103-e7e8a07f517f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 204 len: 0 microversion: 2.1 time: 0.354469 Sep 25 01:06:53.439456 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 742/1393] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:53 2022] DELETE /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:53.450241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:53.452927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:53.470120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.470620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.471060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.471833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.472296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.472890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.519652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.528833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17ba717f-b79d-42c3-abb5-b5cd7437e02f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 200 len: 1308 microversion: 2.1 time: 0.284428 Sep 25 01:06:53.540275 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 652/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:53 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:53.665218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51d5b019-45df-4d83-8d10-4d8bd882a3a5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb98f8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:53.828360 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51d5b019-45df-4d83-8d10-4d8bd882a3a5 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.165131 Sep 25 01:06:53.837857 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 653/1395] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:53 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:53.861828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.905008 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bf67ba61-5f13-4342-be9c-3e271514544b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1810 microversion: 2.1 time: 0.459313 Sep 25 01:06:53.917886 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 743/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:53 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1810 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:54.263963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:54.264746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:54.292107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.292974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.295024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.297073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.297893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.301074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.582880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:54.585968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: e79be9a3-4950-4b44-9458-276628f72902] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:54.604539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.605948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.608124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.610710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.612065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.613854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.639174 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance e79be9a3-4950-4b44-9458-276628f72902 could not be found. Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 HTTP/1.1 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e79be9a3-4950-4b44-9458-276628f72902 could not be found. Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e79be9a3-4950-4b44-9458-276628f72902'} Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79be9a3-4950-4b44-9458-276628f72902 could not be found. Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79be9a3-4950-4b44-9458-276628f72902 could not be found. Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:54.643252 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79be9a3-4950-4b44-9458-276628f72902 could not be found. Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance e79be9a3-4950-4b44-9458-276628f72902 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d06cca8-85e5-4067-a1e6-f091903b9909 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902" status: 404 len: 111 microversion: 2.1 time: 0.094057 Sep 25 01:06:54.659585 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 744/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:54 2022] GET /compute/v2.1/servers/e79be9a3-4950-4b44-9458-276628f72902 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:54.669515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:54.671197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:54.672875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:54.682582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.683799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.685227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.686832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.687871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.688792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.705386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:54.712424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:54.715622 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0b91f87-7c28-432b-ad32-1972496312b7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.460463 Sep 25 01:06:54.719282 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 654/1398] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:54 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:54.804445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.804915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.805596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.806442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid f940cae7-5120-4682-a8a1-e640a8a37aec {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:54.876439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ec6643a-fbd2-415a-854b-0eebe9fcf9eb tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb9104c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:54.894334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:54.911192 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f76b489-acef-4e7f-907e-0b183593c282 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 200 len: 1308 microversion: 2.1 time: 0.246458 Sep 25 01:06:54.912389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 745/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:54 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:54.970577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:54.971405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:54.990026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.991096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.992238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.993893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.996982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:55.005129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:55.063224 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ec6643a-fbd2-415a-854b-0eebe9fcf9eb tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.197277 Sep 25 01:06:55.065580 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 655/1400] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:54 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:55.454270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:55.469902 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23c97366-5ca4-4066-b097-db93014d7818 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1810 microversion: 2.1 time: 0.526932 Sep 25 01:06:55.472144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 746/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:54 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1810 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:55.750405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:55.752049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:55.765801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:55.766551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:55.767414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:55.768315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:55.769278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:55.775943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:55.932257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1371473833", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bff8c58b-4e68-4523-ab7e-86cfd2544597"}], "security_groups": [{"name": "tempest-securitygroup--880421955"}], "key_name": "tempest-keypair-933402221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:56.178394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:56.196680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:56.202091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:56.204676 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13f26a7e-bd11-42c9-b50a-ec00cdc31494 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.459421 Sep 25 01:06:56.206817 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 656/1402] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:55 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:56.225674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:56.226682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: f940cae7-5120-4682-a8a1-e640a8a37aec] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:56.235932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:56.241170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:56.241932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:56.242885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:56.243539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:56.244174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:56.275593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] validate_networks() for [('bff8c58b-4e68-4523-ab7e-86cfd2544597', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:06:56.325236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance f940cae7-5120-4682-a8a1-e640a8a37aec could not be found. Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec HTTP/1.1 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: exception: Instance f940cae7-5120-4682-a8a1-e640a8a37aec could not be found. Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'f940cae7-5120-4682-a8a1-e640a8a37aec'} Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f940cae7-5120-4682-a8a1-e640a8a37aec could not be found. Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f940cae7-5120-4682-a8a1-e640a8a37aec could not be found. Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:56.327333 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f940cae7-5120-4682-a8a1-e640a8a37aec could not be found. Sep 25 01:06:56.332170 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.336952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance f940cae7-5120-4682-a8a1-e640a8a37aec could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:56.342345 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48f2a24b-fa88-457d-9386-46d5be5a2e4b tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec" status: 404 len: 111 microversion: 2.1 time: 0.132222 Sep 25 01:06:56.344226 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 657/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:56 2022] GET /compute/v2.1/servers/f940cae7-5120-4682-a8a1-e640a8a37aec => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:06:56.360268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d8a01f52-5544-4514-92e0-6cfbd54d65ef tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb950550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:56.488010 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d8a01f52-5544-4514-92e0-6cfbd54d65ef tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.142055 Sep 25 01:06:56.493044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 658/1404] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:56 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:56.512349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0aa6d1a-a1b5-4545-bf58-895213299cb0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:56.656452 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0aa6d1a-a1b5-4545-bf58-895213299cb0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [d17a5e8a-2797-4065-9f5e-1e5565479601] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:06:57.580749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Getting quotas for project 740928060bf443508f8165c0dfa50514. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:57.603962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Getting quotas for user 53d16cedecbe4634bf384effd09ca0a9 and project 740928060bf443508f8165c0dfa50514. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:57.663216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:06:57.665473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:06:57.674256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:06:57.677609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:06:57.681108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:06:57.685329 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0aa6d1a-a1b5-4545-bf58-895213299cb0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [d17a5e8a-2797-4065-9f5e-1e5565479601] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48932. Sep 25 01:06:57.694515 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0aa6d1a-a1b5-4545-bf58-895213299cb0 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/09263558-8be0-4f2e-815e-94ffecf58828" status: 204 len: 0 microversion: 2.1 time: 1.198997 Sep 25 01:06:57.701262 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 659/1405] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:06:56 2022] DELETE /compute/v2.1/os-server-groups/09263558-8be0-4f2e-815e-94ffecf58828 => generated 0 bytes in 1202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:57.717582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:57.725857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:57.739816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:57.746218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:57.747952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:57.750884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:57.756114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:57.760439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:57.766673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:57.769941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:57.770736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:57.772055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:57.772887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:57.784127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:57.831685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Getting quotas for project 740928060bf443508f8165c0dfa50514. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:57.854588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Getting quotas for user 53d16cedecbe4634bf384effd09ca0a9 and project 740928060bf443508f8165c0dfa50514. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:57.912092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:06:57.944664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:06:58.095886 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1523f90-e26b-4f1e-ba71-8e753c806b2e tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.169209 Sep 25 01:06:58.108044 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 747/1406] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:06:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:06:58.361088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:58.407407 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f32c600-f7ed-4894-8369-346478c548d5 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1789 microversion: 2.1 time: 0.703969 Sep 25 01:06:58.415026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 660/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:57 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1789 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:58.462704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-aaa05d82-7e62-4a56-a4e1-74cf2bbfbff4 req-6e8f0367-89c5-4f32-b400-fda843dcbd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "name": "network-vif-deleted", "tag": "b527a8a8-622c-45ae-aa5f-7b959e5f1e39"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:58.538468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0580c3d-5305-4daa-9bd5-ff53aad000af tempest-NetworksTest-1470722114 tempest-NetworksTest-1470722114-project-admin] Calling method '.version_select at 0x7f7bebb014c0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:58.547590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-aaa05d82-7e62-4a56-a4e1-74cf2bbfbff4 req-6e8f0367-89c5-4f32-b400-fda843dcbd73 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:58.548462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-aaa05d82-7e62-4a56-a4e1-74cf2bbfbff4 req-6e8f0367-89c5-4f32-b400-fda843dcbd73 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:58.558177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-aaa05d82-7e62-4a56-a4e1-74cf2bbfbff4 req-6e8f0367-89c5-4f32-b400-fda843dcbd73 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:58.675326 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-aaa05d82-7e62-4a56-a4e1-74cf2bbfbff4 req-6e8f0367-89c5-4f32-b400-fda843dcbd73 service nova] Creating event network-vif-deleted:b527a8a8-622c-45ae-aa5f-7b959e5f1e39 for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:06:58.729870 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-aaa05d82-7e62-4a56-a4e1-74cf2bbfbff4 req-6e8f0367-89c5-4f32-b400-fda843dcbd73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309158 Sep 25 01:06:58.748358 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 661/1408] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:58.805954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:58.807218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:58.860310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:58.862743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:58.863389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:58.865198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:58.865865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:58.867820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.275839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0580c3d-5305-4daa-9bd5-ff53aad000af tempest-NetworksTest-1470722114 tempest-NetworksTest-1470722114-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 10105 microversion: 2.1 time: 1.144681 Sep 25 01:06:59.276936 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 748/1409] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:06:58 2022] GET /compute/v2.1/os-networks => generated 10105 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:06:59.285668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2dc2c7ad-d5fb-4d2e-8e03-aad6b260a6f6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bf0116a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.364428 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2dc2c7ad-d5fb-4d2e-8e03-aad6b260a6f6 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.085556 Sep 25 01:06:59.365861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 749/1410] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:06:59 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:59.383402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.394904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:59.409683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.410302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:59.413992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.416828 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:59.419867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.422867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.423416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.423847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.427483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:59.428948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:59.430600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c8eed208-1976-4455-9640-b1961dee491b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.680006 Sep 25 01:06:59.431180 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 662/1411] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:58 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:59.436987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.438080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:59.445251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.446398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.447106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.448078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.448788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.449496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.476992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:59.572433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:59.588353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7c38dd2a-25bb-4216-91c4-69b99701cb4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1281 microversion: 2.1 time: 0.153104 Sep 25 01:06:59.589004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 663/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:59 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:59.612362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.615158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:59.632254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.635831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.636292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.640342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.641265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.642239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:59.721266 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ba3d25a-ad98-41e9-980b-652f14ab970c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 204 len: 0 microversion: 2.1 time: 0.353497 Sep 25 01:06:59.731465 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 750/1413] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:59 2022] DELETE /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:06:59.738901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2308691c-94c8-45d4-8338-dcab50d9d3f0 tempest-NetworksTest-1470722114 tempest-NetworksTest-1470722114-project-admin] Calling method '.version_select at 0x7f7bebb38790>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.940745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:59.968058 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa0c3157-52bd-4b2d-812e-230711da336f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 2425 microversion: 2.25 time: 0.377883 Sep 25 01:06:59.968279 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2308691c-94c8-45d4-8338-dcab50d9d3f0 tempest-NetworksTest-1470722114 tempest-NetworksTest-1470722114-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/d05724ff-ac3f-4b3f-b1a7-77b9bfdac608" status: 200 len: 652 microversion: 2.1 time: 0.234776 Sep 25 01:06:59.968713 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 751/1414] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:06:59 2022] GET /compute/v2.1/os-networks/d05724ff-ac3f-4b3f-b1a7-77b9bfdac608 => generated 652 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:59.975166 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 664/1415] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:59 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 2425 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:59.980903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.982439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:59.993150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:59.996689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:59.998189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:59.998861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.000536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.001308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.003067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.009802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:00.027119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.027649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.028095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.034637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:00.035864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.037728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.040369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.122334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.122334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.123408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.123650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lazy-loading 'fault' on Instance uuid 4aa84695-08bf-40f6-a7b3-4983c2b8d020 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:00.150347 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b38d40b-585a-403f-88da-8d7ae68bd476 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 204 len: 0 microversion: 2.1 time: 0.174434 Sep 25 01:07:00.150958 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 665/1416] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:06:59 2022] DELETE /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:00.165980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9d722f8-ae56-4124-a97b-32ec2744f36a tempest-NetworksTest-1470722114 tempest-NetworksTest-1470722114-project-admin] Calling method '.version_select at 0x7f7beba6dd30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:00.179533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:00.190623 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-efce6767-298f-4e03-ba87-de957b66ba44 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1301 microversion: 2.1 time: 0.219926 Sep 25 01:07:00.191676 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 752/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:59 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:00.228859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:00.240880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:00.257982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.258777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.259657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.260653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.261612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.262267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.301202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'flavor' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:00.317381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Going to try to live migrate instance to n-h2-master-1 {{(pid=122385) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:07:00.360705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9d722f8-ae56-4124-a97b-32ec2744f36a tempest-NetworksTest-1470722114 tempest-NetworksTest-1470722114-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 10105 microversion: 2.1 time: 0.208502 Sep 25 01:07:00.361832 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 666/1418] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:07:00 2022] GET /compute/v2.1/os-networks => generated 10105 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:07:00.377931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:00.379611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:00.390515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.392060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.393552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.395113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.396306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.397370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.677938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:00.694143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7abe9e1-d53b-4675-b674-69fcdfe9378a tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 200 len: 1475 microversion: 2.1 time: 0.330454 Sep 25 01:07:00.695229 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 667/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:00 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:00.716260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5b155d2-2023-4dd4-8b1b-e739c442f90f tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb96d9d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:00.826490 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5b155d2-2023-4dd4-8b1b-e739c442f90f tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.125464 Sep 25 01:07:00.827174 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 668/1420] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:00 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:00.837123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:00.838003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:00.847276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.848145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.848986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.850090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.850818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.851470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.280711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.302316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.305200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.307243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4de001f-afc9-4b8b-b890-81480850021e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.478114 Sep 25 01:07:01.309984 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 669/1421] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:00 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:01.316286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:01.317697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:01.324513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.326004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.326686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.327826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.328618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.329237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.473975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.473975 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45bad7d7-32f9-44c4-a496-919d4d77ac4c tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1335 microversion: 2.1 time: 0.159981 Sep 25 01:07:01.484917 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 670/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:01 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1335 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:01.499506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "name": "network-vif-deleted", "tag": "168bece6-be01-4c4a-bad6-35b900dd0e2a"}, {"server_uuid": "4aa84695-08bf-40f6-a7b3-4983c2b8d020", "name": "network-vif-deleted", "tag": "8b73a060-a7d8-46d5-a4cc-93ddbdbc901b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:01.517084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.517656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.518135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.550228 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] Creating event network-vif-deleted:168bece6-be01-4c4a-bad6-35b900dd0e2a for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:07:01.550843 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] Creating event network-vif-deleted:8b73a060-a7d8-46d5-a4cc-93ddbdbc901b for instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 on n-h1-master-1 Sep 25 01:07:01.556886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fc8b8940-207d-44dd-9a59-a45fd1ace173 req-8dba6559-8d81-49cc-a23d-e0d3b0a537f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068828 Sep 25 01:07:01.557563 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 671/1423] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:01.564783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:01.566012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:01.573662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.574544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.575732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.576606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.577080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.577535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.645447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.646049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.646484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.646941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lazy-loading 'fault' on Instance uuid 4aa84695-08bf-40f6-a7b3-4983c2b8d020 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:01.711464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.720431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9893f2a-51ac-46c3-b263-a0552f749a91 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 200 len: 1301 microversion: 2.1 time: 0.161252 Sep 25 01:07:01.734538 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 672/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:01 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:01.743284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:01.744690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:01.753590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.759349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.760497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:01.762178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:01.763199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:01.763710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:02.017731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.027925 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7cd6d6f7-9096-437f-a1a1-39b1188065ab tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 200 len: 1475 microversion: 2.1 time: 0.292097 Sep 25 01:07:02.046469 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 673/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:01 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 1475 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:02.054286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a0aeb5d0-dd36-40b8-8269-341c759386ef tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb910dc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:02.205050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a0aeb5d0-dd36-40b8-8269-341c759386ef tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.156792 Sep 25 01:07:02.225670 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 674/1426] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:02 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:02.342701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:02.344338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:02.352936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:02.353749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:02.354395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:02.355321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:02.357359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:02.358452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:02.743391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.767683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.774054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.781150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4540f08f-1653-4209-9d5d-3bb30f7a274e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.446986 Sep 25 01:07:02.782031 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 675/1427] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:02 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:02.793451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:02.807833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:02.824129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:02.824903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:02.825424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:02.826179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:02.826652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:02.833676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:03.587413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:03.603496 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-625b0a80-13fd-4bfb-851c-d19b43f7f247 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 0.811942 Sep 25 01:07:03.604892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 676/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:02 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:03.625603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:03.626232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:03.646804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:03.650801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:03.651636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:03.656744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:03.657497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:03.661785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:03.717905 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] HTTP exception thrown: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Request method failure captured: Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 HTTP/1.1 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6l7zMBXl9gxpFplQZV7S8SoG0b2XMMsSkxpO7rZIJHZVwoy_LGR5Lz0W2pEAo5TlKug8BH6LtoZlLWpSAR35eAlm-M03hVhPqXG1ka8iASORmg4GQiLVqK-tmKhTCKZ_8dN05rLQdPAVtrqfQGjdsPoAIOmkaeLMFpYAgeJnSA-t_Y Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afce265709264879a2e1cafb56ea22f7"}]}] Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestMultiNic-1297409580 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1f85ae026362410fb573c81bef57159e Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4aa84695-08bf-40f6-a7b3-4983c2b8d020'} Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:03.720340 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:07:03.724839 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:03.727859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Returning 404 to user: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:03.728939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d1eadd9-8614-4136-9d89-f4f3f5503713 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 404 len: 111 microversion: 2.1 time: 0.122981 Sep 25 01:07:03.729843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 677/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:03 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:03.737937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:03.740047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:03.746570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:03.748826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:03.749650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:03.750641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:03.755726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:03.757196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:04.261334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:04.274089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-783b0757-a0e6-463a-b531-118d1b0cef4e tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 200 len: 1475 microversion: 2.1 time: 0.542182 Sep 25 01:07:04.277078 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 678/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:03 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:04.291661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89161c27-f38d-4817-84f7-7879ac59c934 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb8e38b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:04.383211 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89161c27-f38d-4817-84f7-7879ac59c934 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.103647 Sep 25 01:07:04.393134 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 679/1431] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:04 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:04.398235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:04.398918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:04.415860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:04.416631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:04.417269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:04.418434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:04.419188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:04.419806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:05.155743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:05.171183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:05.186291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:05.187722 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec433e38-6f0a-498b-961d-9ce466ee14e8 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.802094 Sep 25 01:07:05.188312 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 680/1432] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:04 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:05.195818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:05.197160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:05.218341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:05.218925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:05.223720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:05.233691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:05.234849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:05.237621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.292398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5c672978-df06-4431-8f69-ec274fb7a6fb tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/action" status: 202 len: 0 microversion: 2.25 time: 6.099043 Sep 25 01:07:06.295146 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 753/1433] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:07:00 2022] POST /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/action => generated 0 bytes in 6103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:06.302950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7e67b545-36c8-4d5f-a737-d6b11e10984e req-8561d831-03c6-4acb-9de3-01aac5ec7e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49435307-0eef-4502-914e-25c74eb8a56f", "tag": "36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:06.344534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7e67b545-36c8-4d5f-a737-d6b11e10984e req-8561d831-03c6-4acb-9de3-01aac5ec7e58 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.345434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7e67b545-36c8-4d5f-a737-d6b11e10984e req-8561d831-03c6-4acb-9de3-01aac5ec7e58 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.348552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7e67b545-36c8-4d5f-a737-d6b11e10984e req-8561d831-03c6-4acb-9de3-01aac5ec7e58 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.398432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:06.404400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7e67b545-36c8-4d5f-a737-d6b11e10984e req-8561d831-03c6-4acb-9de3-01aac5ec7e58 service nova] Creating event network-changed:36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc for instance 49435307-0eef-4502-914e-25c74eb8a56f on n-h1-master-1 Sep 25 01:07:06.427476 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7e67b545-36c8-4d5f-a737-d6b11e10984e req-8561d831-03c6-4acb-9de3-01aac5ec7e58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130948 Sep 25 01:07:06.430543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 754/1434] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:06.452163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:06.461305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:06.478403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f81b0c8-c844-4515-8c76-baa6e3d065b3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 1.288927 Sep 25 01:07:06.480225 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 681/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:05 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:06.485106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.486134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.486761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.487685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.489478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.493435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.498446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96a5fbdb-e987-4351-88f7-44569de612d2 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb9b9550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:06.660391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.662160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.662977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.663686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lazy-loading 'fault' on Instance uuid ce85d75a-6d29-4271-8442-77904ee95690 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:06.671913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96a5fbdb-e987-4351-88f7-44569de612d2 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.188351 Sep 25 01:07:06.673222 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 682/1436] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:06 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:06.689362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-651a2c3d-5ff3-4bb1-9dd1-f64043cfc26c req-f4e3d6a6-d34e-4cdd-bea3-a32fc29e83fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce85d75a-6d29-4271-8442-77904ee95690", "name": "network-vif-deleted", "tag": "25f4c89c-6759-43ba-9e62-c6d960aa2e50"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:06.760773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-651a2c3d-5ff3-4bb1-9dd1-f64043cfc26c req-f4e3d6a6-d34e-4cdd-bea3-a32fc29e83fe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.762145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-651a2c3d-5ff3-4bb1-9dd1-f64043cfc26c req-f4e3d6a6-d34e-4cdd-bea3-a32fc29e83fe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.763563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-651a2c3d-5ff3-4bb1-9dd1-f64043cfc26c req-f4e3d6a6-d34e-4cdd-bea3-a32fc29e83fe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.804229 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-651a2c3d-5ff3-4bb1-9dd1-f64043cfc26c req-f4e3d6a6-d34e-4cdd-bea3-a32fc29e83fe service nova] Creating event network-vif-deleted:25f4c89c-6759-43ba-9e62-c6d960aa2e50 for instance ce85d75a-6d29-4271-8442-77904ee95690 on n-h2-master-1 Sep 25 01:07:06.820938 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-651a2c3d-5ff3-4bb1-9dd1-f64043cfc26c req-f4e3d6a6-d34e-4cdd-bea3-a32fc29e83fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144840 Sep 25 01:07:06.823585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 683/1437] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:06.835455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:06.836380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:06.839493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:06.865701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.868240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.870485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.872423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.873620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.874819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.879906 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-19866be5-7cbc-4070-9ac3-9584ae6ceb23 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 200 len: 1309 microversion: 2.1 time: 0.441559 Sep 25 01:07:06.885257 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:06.892366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 755/1438] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:06 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:06.936235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e47a967e-27b6-4334-9751-bf1f0cb806f5 req-cfb114a5-8e5b-40ff-b4ed-c7240716870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "55805ffb-c11c-4ab6-8106-f78fa29b3f69"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:06.992911 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:06.998219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e47a967e-27b6-4334-9751-bf1f0cb806f5 req-cfb114a5-8e5b-40ff-b4ed-c7240716870a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.005615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e47a967e-27b6-4334-9751-bf1f0cb806f5 req-cfb114a5-8e5b-40ff-b4ed-c7240716870a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.007187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e47a967e-27b6-4334-9751-bf1f0cb806f5 req-cfb114a5-8e5b-40ff-b4ed-c7240716870a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:07.133851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e47a967e-27b6-4334-9751-bf1f0cb806f5 req-cfb114a5-8e5b-40ff-b4ed-c7240716870a service nova] Creating event network-vif-plugged:55805ffb-c11c-4ab6-8106-f78fa29b3f69 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:07.173769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e47a967e-27b6-4334-9751-bf1f0cb806f5 req-cfb114a5-8e5b-40ff-b4ed-c7240716870a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273161 Sep 25 01:07:07.176520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 756/1439] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:07.219350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:07.226324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:07.290886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.291549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.292267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:07.294124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.298497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.303863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:07.800376 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:07.880849 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=14 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:07.919345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:07.955783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:07.964163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:07.966936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7728c669-e478-4bec-8a08-3e344a63856b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 1.139637 Sep 25 01:07:07.972011 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 684/1440] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:06 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:08.008138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:08.008784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:08.031888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.032739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.033438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.040500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.041387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.042042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.693863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.707671 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:08.720376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.725030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.736655 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0d117e2-3ef4-44c5-a745-f0be8d6508e4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.545306 Sep 25 01:07:08.741014 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 757/1441] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:07 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:08.755099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64ec159c-91da-4f8b-92b6-07c572694a13 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb01f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:08.864694 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64ec159c-91da-4f8b-92b6-07c572694a13 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.121714 Sep 25 01:07:08.875790 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 758/1442] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:08 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:08.883380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:08.887950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: ce85d75a-6d29-4271-8442-77904ee95690] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:08.899620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.900073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.900521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.902239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.903487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.904148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.927434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance ce85d75a-6d29-4271-8442-77904ee95690 could not be found. Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 HTTP/1.1 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ce85d75a-6d29-4271-8442-77904ee95690 could not be found. Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ce85d75a-6d29-4271-8442-77904ee95690'} Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce85d75a-6d29-4271-8442-77904ee95690 could not be found. Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce85d75a-6d29-4271-8442-77904ee95690 could not be found. Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:08.931598 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce85d75a-6d29-4271-8442-77904ee95690 could not be found. Sep 25 01:07:08.940351 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:08.944255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance ce85d75a-6d29-4271-8442-77904ee95690 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:08.948427 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b42e8b9-f22f-4835-99d2-f71398102c1f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690" status: 404 len: 111 microversion: 2.1 time: 0.070775 Sep 25 01:07:08.954685 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 759/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:08 2022] GET /compute/v2.1/servers/ce85d75a-6d29-4271-8442-77904ee95690 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:08.963771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-431696e2-443e-48ec-9266-573619a103a1 req-ff746e30-0f65-4b98-8de5-4b18f0bec238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a79880d-75b5-4e5c-b9f4-64aa404ea459", "name": "network-vif-deleted", "tag": "6f216d4b-e2d8-41eb-95e5-189b7bf41410"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:08.977088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-431696e2-443e-48ec-9266-573619a103a1 req-ff746e30-0f65-4b98-8de5-4b18f0bec238 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.977984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-431696e2-443e-48ec-9266-573619a103a1 req-ff746e30-0f65-4b98-8de5-4b18f0bec238 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.979213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-431696e2-443e-48ec-9266-573619a103a1 req-ff746e30-0f65-4b98-8de5-4b18f0bec238 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.008111 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-431696e2-443e-48ec-9266-573619a103a1 req-ff746e30-0f65-4b98-8de5-4b18f0bec238 service nova] Creating event network-vif-deleted:6f216d4b-e2d8-41eb-95e5-189b7bf41410 for instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 on n-h2-master-1 Sep 25 01:07:09.031193 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-431696e2-443e-48ec-9266-573619a103a1 req-ff746e30-0f65-4b98-8de5-4b18f0bec238 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068869 Sep 25 01:07:09.035082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 760/1444] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:09.046091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.047117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 6a79880d-75b5-4e5c-b9f4-64aa404ea459] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:09.061140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.062568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.063528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.065162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.066185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.067321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.098253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 could not be found. Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 HTTP/1.1 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 could not be found. Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '6a79880d-75b5-4e5c-b9f4-64aa404ea459'} Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 could not be found. Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 could not be found. Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:09.101469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 could not be found. Sep 25 01:07:09.113369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:09.115809 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance 6a79880d-75b5-4e5c-b9f4-64aa404ea459 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:09.117255 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b97b7d34-dd4f-4735-8e80-5264fd6af0bd tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459" status: 404 len: 111 microversion: 2.1 time: 0.079920 Sep 25 01:07:09.123881 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 761/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:09 2022] GET /compute/v2.1/servers/6a79880d-75b5-4e5c-b9f4-64aa404ea459 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:09.132738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.133781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:09.142265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.143115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.143793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.144735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.145796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.146444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.332909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:09.351552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-565b6482-3d6c-4722-95d4-f4b96bcd600b tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 1.361254 Sep 25 01:07:09.382731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 685/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:07 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:09.400943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d48599a-c3c4-4a5e-9e62-75739f78be3c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.472480 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d48599a-c3c4-4a5e-9e62-75739f78be3c tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/0f0b4f56-756f-4d89-b413-02f07b5e36f8" status: 204 len: 0 microversion: 2.1 time: 0.086438 Sep 25 01:07:09.473143 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 686/1447] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:07:09 2022] DELETE /compute/v2.1/os-server-groups/0f0b4f56-756f-4d89-b413-02f07b5e36f8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:09.494600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b46bffab-8e2f-4fc7-9d4c-d8ad58b9294f req-3d554edb-dd2b-4cce-9fd6-a6068701b113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "50fadfa3-bf92-4aac-bdc9-8a535261d330"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:09.536242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b46bffab-8e2f-4fc7-9d4c-d8ad58b9294f req-3d554edb-dd2b-4cce-9fd6-a6068701b113 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.543308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b46bffab-8e2f-4fc7-9d4c-d8ad58b9294f req-3d554edb-dd2b-4cce-9fd6-a6068701b113 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.551191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b46bffab-8e2f-4fc7-9d4c-d8ad58b9294f req-3d554edb-dd2b-4cce-9fd6-a6068701b113 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.593914 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b46bffab-8e2f-4fc7-9d4c-d8ad58b9294f req-3d554edb-dd2b-4cce-9fd6-a6068701b113 service nova] Creating event network-vif-plugged:50fadfa3-bf92-4aac-bdc9-8a535261d330 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:09.605895 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b46bffab-8e2f-4fc7-9d4c-d8ad58b9294f req-3d554edb-dd2b-4cce-9fd6-a6068701b113 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129465 Sep 25 01:07:09.612260 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 687/1448] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:09.620728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.626700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:09.634355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.634863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.635386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.636402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.637182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.637275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.704036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:09.936434 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:09.947297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a74274e-6f19-49fb-a873-52d9d1c14aa1 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 204 len: 0 microversion: 2.1 time: 0.330279 Sep 25 01:07:09.950744 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 688/1449] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:09 2022] DELETE /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:09.965691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.966739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:09.985261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.986091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.986727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.987753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.988377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.988969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.052896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.069885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.079627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.081083 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6cf0f510-2b73-4965-9e72-b5659c896622 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.955845 Sep 25 01:07:10.082263 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 762/1450] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:09 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:10.094437 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3895c3e7-e8eb-433c-a7e8-52f55e29a860 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7bebb5a310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:10.215316 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3895c3e7-e8eb-433c-a7e8-52f55e29a860 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1427 microversion: 2.1 time: 0.131934 Sep 25 01:07:10.227743 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 763/1451] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:10 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:10.227743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:10.228211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:10.244724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.245642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.246451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.248323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.249190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.254840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.610374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.620664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.622660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.624234 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cfcc8e32-182c-401a-9bb9-b58d2f52fb82 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.670630 Sep 25 01:07:10.641739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 689/1452] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:09 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:10.649739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:10.650647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:10.657439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.658334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.658943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.661058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.661780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.662736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.787701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.797807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-89969995-0c9c-4816-92ff-86d24a8874b9 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1473 microversion: 2.1 time: 0.579844 Sep 25 01:07:10.798835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 764/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:10 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1473 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:11.054542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.084561 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d00a224-55f6-402c-91c2-8a0e43af0c18 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 0.440989 Sep 25 01:07:11.085164 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 690/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:10 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:11.111997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:11.112697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:11.119480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.119981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.120474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.121311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.122537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.123123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.251268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-768648e4-39d3-489c-871f-979723821b9b tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb8eed30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:11.363110 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-768648e4-39d3-489c-871f-979723821b9b tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1436 microversion: 2.1 time: 0.132006 Sep 25 01:07:11.372850 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 691/1455] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:11 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1436 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:11.384094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e18daabf-727f-4bc8-9f81-e287ed0ffa10 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb98f5e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:11.453838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e18daabf-727f-4bc8-9f81-e287ed0ffa10 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 200 len: 1436 microversion: 2.1 time: 0.079649 Sep 25 01:07:11.455109 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 692/1456] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:07:11 2022] GET /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:11.469118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:11.470221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:11.476778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.477697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.478440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.479399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.480188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.480822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.610694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.631422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.635061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.638471 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-471741a0-a81d-48fe-b971-a8d193a8c7ff tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.528573 Sep 25 01:07:11.641383 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 765/1457] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:11 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:11.656164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:11.656921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:11.665792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.674137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.674903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.675848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.676483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.677097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.514668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.526281 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22f2b6a9-0fb8-4127-8c0b-71ea9a5e7125 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1480 microversion: 2.1 time: 1.061303 Sep 25 01:07:12.527696 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 693/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:11 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1480 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:12.539696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "2510f7a3-c33d-4ac7-9c28-177187a8049e"}, {"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "f3f44f7c-343a-41d4-9458-4367d49b3d8c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:12.585191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.585920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.586522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.611332 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] Creating event network-vif-plugged:2510f7a3-c33d-4ac7-9c28-177187a8049e for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:12.614303 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] Creating event network-vif-plugged:f3f44f7c-343a-41d4-9458-4367d49b3d8c for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:12.627176 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a73cc44d-e472-450e-bd45-364714fb9506 req-9d8814c4-c5d1-4a56-89d3-b576d73214d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092645 Sep 25 01:07:12.630027 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 694/1459] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:12.645771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:12.646965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:12.665824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.666322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.666774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.667656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.668124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.668826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.799676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.821271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.826222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.830145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67025365-c906-4dad-a76f-fbc33fa613de tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.178774 Sep 25 01:07:12.846167 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 766/1460] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:11 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:12.853825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:12.865202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:12.882881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.883742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.885525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.887947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.888625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.889659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:13.273807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687667b3aadf4dd591e1335678be938d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef923c6104d6ea7bb63db20f13dc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:13.282965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-207a82c7-8bde-441a-b2c5-751f01b67a35 tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 200 len: 1473 microversion: 2.1 time: 0.651610 Sep 25 01:07:13.288739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 695/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:12 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 1473 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:13.300880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:13.302913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:13.320711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:13.321648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:13.322772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:13.327266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:13.328032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:13.328744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:13.602667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:13.619446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5de6279-7642-4763-a748-1c4d3c47dd12 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 0.771762 Sep 25 01:07:13.620354 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 767/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:12 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:13.632674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:13.633712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:13.645964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:13.647819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:13.651206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:13.654897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:13.656036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:13.656929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:14.205817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.211969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.217859 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1595ae8-44f9-4c16-8c68-3e530abbeaa1 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1467 microversion: 2.1 time: 0.596051 Sep 25 01:07:14.221518 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 768/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:13 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1467 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:14.227871 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.229659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.232313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-285972811", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "70e0d88e-390f-46df-b751-930146d30a5a"}, {"uuid": "e10eb3c2-ef8f-42e5-a410-5e81a6df6376"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:14.242483 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-27b668ca-9415-4189-95c3-08342e144890 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.952141 Sep 25 01:07:14.243754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 696/1464] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:13 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:14.249001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:14.250180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:14.267842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:14.268401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:14.269027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:14.269997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:14.270603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:14.271174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:14.371193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] validate_networks() for [('70e0d88e-390f-46df-b751-930146d30a5a', None, None, None, None, None), ('e10eb3c2-ef8f-42e5-a410-5e81a6df6376', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:07:14.828852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.842811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.844414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:14.852680 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5142873a-8af3-492d-bbd7-86ab664f74f0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.607560 Sep 25 01:07:14.867687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 697/1465] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:14 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:14.885068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f75ca91-1de7-4742-8d59-6eebe6ec300c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb88c1f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:15.880162 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f75ca91-1de7-4742-8d59-6eebe6ec300c tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "DELETE /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7" status: 204 len: 0 microversion: 2.1 time: 1.013937 Sep 25 01:07:15.880919 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 698/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:14 2022] DELETE /compute/v2.1/images/a3acfa89-4703-4a90-b8b7-e18d875074a7 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:15.886523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:15.887546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] [instance: 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:15.903328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.904150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.906266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:15.907179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.911792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.912439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:15.967386 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] HTTP exception thrown: Instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 could not be found. Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Request method failure captured: Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 HTTP/1.1 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jFKfe8tDCvTjP-V4Wf94L6Jl6Agl0bnmF79NTWE8H3LlYfmMqRbuep82Y_sloUFTFF2WzOQyYds_Y5D-gqbO_cB7TqR2vd2GNpeJiDQyia3RRWiNurWTcNOhJJ-XqYn_kO4_t6kRztKU_a3-XCZcAb38EbD6XoO_EDRzLrMFvhnIY Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31eef923c6104d6ea7bb63db20f13dc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31eef923c6104d6ea7bb63db20f13dc3"}]}] Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 31eef923c6104d6ea7bb63db20f13dc3 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277347998 Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 687667b3aadf4dd591e1335678be938d Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersOnMultiNodesTest-277347998-project Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 could not be found. Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91'} Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 could not be found. Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 could not be found. Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:15.970292 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 could not be found. Sep 25 01:07:15.976260 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.976837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:07:15.977264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:07:15.977381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:07:15.978499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:07:15.978499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:07:15.980772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] Returning 404 to user: Instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:15.986705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-627858e1-c313-4117-a48b-afaa64120e3f tempest-ServersOnMultiNodesTest-277347998 tempest-ServersOnMultiNodesTest-277347998-project] 10.222.0.16 "GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91" status: 404 len: 111 microversion: 2.1 time: 0.104541 Sep 25 01:07:15.987547 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 699/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:15 2022] GET /compute/v2.1/servers/15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:15.997868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.998371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.999106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.002076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.002568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.003359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-47c1beb1-2a87-4d36-aaa2-ecbd61791149 req-ca01b47e-0f2d-47cc-b1a0-b82352db18de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91", "name": "network-vif-deleted", "tag": "a069a87f-5afa-40d1-aace-7bb3cbecd763"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:16.004003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.016547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47c1beb1-2a87-4d36-aaa2-ecbd61791149 req-ca01b47e-0f2d-47cc-b1a0-b82352db18de service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.017799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47c1beb1-2a87-4d36-aaa2-ecbd61791149 req-ca01b47e-0f2d-47cc-b1a0-b82352db18de service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.018392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47c1beb1-2a87-4d36-aaa2-ecbd61791149 req-ca01b47e-0f2d-47cc-b1a0-b82352db18de service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.039888 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-47c1beb1-2a87-4d36-aaa2-ecbd61791149 req-ca01b47e-0f2d-47cc-b1a0-b82352db18de service nova] Creating event network-vif-deleted:a069a87f-5afa-40d1-aace-7bb3cbecd763 for instance 15ec2e00-ac2d-4aba-b8d2-a9fa9a3bee91 on n-h2-master-1 Sep 25 01:07:16.051935 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-47c1beb1-2a87-4d36-aaa2-ecbd61791149 req-ca01b47e-0f2d-47cc-b1a0-b82352db18de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062726 Sep 25 01:07:16.053357 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 700/1468] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:16.065962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:16.066920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:16.069941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Getting quotas for project afce265709264879a2e1cafb56ea22f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:16.078857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.080109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.080765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.081740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.082697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.083447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.088628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Getting quotas for user 1f85ae026362410fb573c81bef57159e and project afce265709264879a2e1cafb56ea22f7. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:16.138852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:07:16.141177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:07:16.265856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-980dd3ce-3df6-41b8-ba3d-55d48f631b1b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035301 Sep 25 01:07:16.275971 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 769/1469] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:07:16.285500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49435307-0eef-4502-914e-25c74eb8a56f", "name": "network-vif-plugged", "status": "completed", "tag": "36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc"}, {"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "de78802c-7150-4aed-a024-96ae56e3dd90"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:16.306369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.307032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.307579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.323075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] Creating event network-vif-plugged:36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc for instance 49435307-0eef-4502-914e-25c74eb8a56f on n-h1-master-1 Sep 25 01:07:16.323591 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] Creating event network-vif-plugged:de78802c-7150-4aed-a024-96ae56e3dd90 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:16.367670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3498b19b-ad0e-4bae-8e19-aadbb994da68 req-01b46575-f19e-45dc-a876-344b69004e29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089896 Sep 25 01:07:16.373288 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 770/1470] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:16.386090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:16.387309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:16.423213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.424098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.424796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.426311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.428488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.429605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.590924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:16.600046 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5722f05f-ea31-482e-bb56-241c3abc1a37 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 0.545238 Sep 25 01:07:16.600650 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 701/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:16 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:16.634116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:16.634830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:16.664142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.664910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.666840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.670010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.671018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.672398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.104067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.116391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.120599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.128948 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6c91e01-a3a1-49a2-ad06-aaf89d7c2ee5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.521209 Sep 25 01:07:17.144061 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 702/1472] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:16 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:17.161313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e2491e-531c-49d3-8f05-e1f3e2233cba tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '.version_select at 0x7f7beb92ac10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.182914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.198917 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e9e2491e-531c-49d3-8f05-e1f3e2233cba tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] HTTP exception thrown: Image not found. Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e2491e-531c-49d3-8f05-e1f3e2233cba tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Request method failure captured: Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f HTTP/1.1 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6lI2EjuyWhmd4LeGdIP1z_lyZn9yLqlEJBA8fU0BLNWmauVaMucx1XRDfxDx0jPQbJNk19keYgwq8n2Xfp5dBFJTvLJyfyFesLhsanPKGQUwKjBHkypFgmxtxg4js8diGzxJXigdW4n37kNV1AL36c2KKsq5z3J7IWtIDrWmh2KJvE Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e3b524092c484ec3b22d1ce29930fa58 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e3b524092c484ec3b22d1ce29930fa58"}]}] Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e3b524092c484ec3b22d1ce29930fa58 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerTestJSON-756436779-project Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 46ba0c28dade4f7abf4e3ef3dcafa957 Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerTestJSON-756436779-project Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'aeb27287-4a27-4778-8170-68178b5a304f'} Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aeb27287-4a27-4778-8170-68178b5a304f to delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aeb27287-4a27-4778-8170-68178b5a304f could not be found. Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.201850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e2491e-531c-49d3-8f05-e1f3e2233cba tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9e2491e-531c-49d3-8f05-e1f3e2233cba tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "DELETE /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f" status: 404 len: 62 microversion: 2.1 time: 0.057966 Sep 25 01:07:17.210365 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 703/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:17 2022] DELETE /compute/v2.1/images/aeb27287-4a27-4778-8170-68178b5a304f => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:07:17.219107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92674bf4-b9ab-4a5a-b1b2-43eee63ab52c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.221372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92674bf4-b9ab-4a5a-b1b2-43eee63ab52c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:17.223134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.227141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.231569 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-020b8c43-bba4-4868-a41c-123b75518624 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.854698 Sep 25 01:07:17.243830 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 771/1474] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:16 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:17.264920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.267205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:17.282056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.283963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.286070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.288330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.289065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.289771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.338441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:17.409150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92674bf4-b9ab-4a5a-b1b2-43eee63ab52c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.428737 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92674bf4-b9ab-4a5a-b1b2-43eee63ab52c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1212 microversion: 2.1 time: 0.216303 Sep 25 01:07:17.430404 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 704/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:17 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1212 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:17.562450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-96a04cd2-9e81-488f-89ca-630f0c986f93 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "DELETE /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 204 len: 0 microversion: 2.1 time: 0.316407 Sep 25 01:07:17.565304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 772/1476] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:17 2022] DELETE /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:17.574107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.575349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:17.589030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.592745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.594450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.595976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.597213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.599099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.626468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.627352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:17.641171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.642439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.645173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.647696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.651322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.651937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:18.867479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:18.891739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a519bb1d-1252-4176-98cc-413c16809901 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1402 microversion: 2.1 time: 1.270154 Sep 25 01:07:18.896206 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 773/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:17 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1402 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:18.903739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:18.904794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:18.930945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:18.933766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:18.934852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:18.938596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:18.942963 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96be445a-3095-413f-9d1a-b60aaaa96694 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1473 microversion: 2.1 time: 1.373553 Sep 25 01:07:18.943553 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 705/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:17 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1473 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:18.952199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:18.954488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:18.964751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:18.969209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:18.972807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:18.973502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:18.984692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:18.985892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:18.988967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:18.992143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:18.993626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.219283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.237484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.247861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.254393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-777348d3-edf1-4e7b-b0be-77d05e9fb1e8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.357087 Sep 25 01:07:19.256165 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 774/1479] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:18 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:19.274682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8"}, {"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-plugged", "status": "completed", "tag": "e7447597-17d3-4b71-a80e-dccd38a636f5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:19.301785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.302544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.303183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.361790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] Creating event network-vif-plugged:13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:19.362619 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] Creating event network-vif-plugged:e7447597-17d3-4b71-a80e-dccd38a636f5 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:19.379417 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f82e54e0-8ca1-4340-8d78-5412bd7e665b req-d1ac69cd-86f2-4b62-b066-8583f983f061 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113756 Sep 25 01:07:19.403003 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 775/1480] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:19.437585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:19.441234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:19.456746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.459750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.460445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.462207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.466328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.468311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.626886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.640530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b90fe2c-50c3-4f71-9ef8-5d032097fe2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1270 microversion: 2.1 time: 0.232783 Sep 25 01:07:19.655730 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 776/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:19 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:19.667584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:19.671116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:19.695175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.695738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.696193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.696942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.703802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.704305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.741193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.755363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.758674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.763954 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-894e26d1-4ca0-4ede-88a3-5e61aefeb2ee tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.814895 Sep 25 01:07:19.764723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 706/1482] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:18 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:19.917025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:19.917865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:19.926693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.929080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.935389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.937276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.937997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.938739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.700462 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-582bdd88-355d-4f2f-a935-fb6ff712c80b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1808 microversion: 2.1 time: 1.041001 Sep 25 01:07:20.707030 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 777/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:19 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1808 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:20.717361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:20.720311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:20.733796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.734298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.737753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.741519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.742410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.743087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.899483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:20.907242 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:20.911852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce79347e-3354-4648-8841-1c752b788df5 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1588 microversion: 2.1 time: 0.999606 Sep 25 01:07:20.912817 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 707/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:19 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1588 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:20.936091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:20.937258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:20.957002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.957933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.960653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.962273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.964656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.966724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.221444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:21.228190 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:21.231833 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba1ea7c8-3bf9-4da1-a93b-1783b4093543 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1473 microversion: 2.1 time: 0.523008 Sep 25 01:07:21.232803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 778/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:20 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1473 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:21.253726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:21.254719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:21.267346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.270174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.272268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.274166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.276532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.278686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.457030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:21.476740 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f0d343b-ffa4-4836-af9b-ba6994b0b116 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1270 microversion: 2.1 time: 0.229760 Sep 25 01:07:21.477366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 779/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:21 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:21.496266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:21.501350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.502121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.502772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.503528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.503992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.504424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.513319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:21.538370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:21.540179 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-881b9446-ba86-4bad-9e58-4d31b99aa6c1 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061704 Sep 25 01:07:21.540659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:21.542323 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad79bbdb-f153-4c5b-a50b-a9cded5dcff3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.628206 Sep 25 01:07:21.544426 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 708/1487] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:20 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:21.551276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:21.552415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:21.555930 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 780/1488] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:07:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:21.561147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:21.561720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:21.564246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.564773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.565208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.566490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.567022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.567496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.568858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.569349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.569864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.570643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.571040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.571472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.717937 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-864dda71-9b1e-47d0-9493-33492274efb4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160587 Sep 25 01:07:21.720260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 781/1489] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:07:21 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:21.733698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-200ec829-69c6-40e7-a6f3-464c219e1b1e req-2cb04a9a-8618-410e-9ecd-fd1033f8bd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:21.761087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-200ec829-69c6-40e7-a6f3-464c219e1b1e req-2cb04a9a-8618-410e-9ecd-fd1033f8bd91 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.778744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-200ec829-69c6-40e7-a6f3-464c219e1b1e req-2cb04a9a-8618-410e-9ecd-fd1033f8bd91 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.780653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-200ec829-69c6-40e7-a6f3-464c219e1b1e req-2cb04a9a-8618-410e-9ecd-fd1033f8bd91 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.828586 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-200ec829-69c6-40e7-a6f3-464c219e1b1e req-2cb04a9a-8618-410e-9ecd-fd1033f8bd91 service nova] Creating event network-vif-unplugged:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:07:21.854441 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-200ec829-69c6-40e7-a6f3-464c219e1b1e req-2cb04a9a-8618-410e-9ecd-fd1033f8bd91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122120 Sep 25 01:07:21.858266 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 782/1490] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:21.873307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-52ea9a70-f418-4e80-8681-514bf084fe47 req-9fe69cf5-82bd-4c41-ab82-2ed7af7d60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c609e-5dc8-4972-b533-2dccb40e0257", "name": "network-vif-deleted", "tag": "dd8ec86f-66fd-4924-a4a7-11ac676b3e89"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:21.903373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-52ea9a70-f418-4e80-8681-514bf084fe47 req-9fe69cf5-82bd-4c41-ab82-2ed7af7d60b1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.904385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-52ea9a70-f418-4e80-8681-514bf084fe47 req-9fe69cf5-82bd-4c41-ab82-2ed7af7d60b1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.905358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-52ea9a70-f418-4e80-8681-514bf084fe47 req-9fe69cf5-82bd-4c41-ab82-2ed7af7d60b1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.932855 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-52ea9a70-f418-4e80-8681-514bf084fe47 req-9fe69cf5-82bd-4c41-ab82-2ed7af7d60b1 service nova] Creating event network-vif-deleted:dd8ec86f-66fd-4924-a4a7-11ac676b3e89 for instance 899c609e-5dc8-4972-b533-2dccb40e0257 on n-h2-master-1 Sep 25 01:07:21.948326 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-52ea9a70-f418-4e80-8681-514bf084fe47 req-9fe69cf5-82bd-4c41-ab82-2ed7af7d60b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087856 Sep 25 01:07:21.950551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 783/1491] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:22.056601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.070680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.078188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.086829 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3d4746c-ddf5-41d9-8bcd-65810c96c3a1 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1869 microversion: 2.42 time: 0.540108 Sep 25 01:07:22.090785 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 709/1492] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:21 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1869 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:22.259385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:22.260164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:22.282056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.282619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.283066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.284027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.287138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.287606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.339041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.339813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.340513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.341142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lazy-loading 'fault' on Instance uuid 899c609e-5dc8-4972-b533-2dccb40e0257 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:22.424252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ba0c28dade4f7abf4e3ef3dcafa957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b524092c484ec3b22d1ce29930fa58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.441650 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2ff0c199-37ea-47b2-9bd5-f18a2f46e778 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 200 len: 1307 microversion: 2.1 time: 0.186733 Sep 25 01:07:22.457976 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 784/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:22 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:22.500393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:22.501269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:22.517590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.518393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.524236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.529509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.530013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.530646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.570619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:22.571643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:22.597793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.598531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.599324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.600225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.600844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.602105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.799302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.817701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01f84f46-e8a6-4d8b-bc0a-7d0a710a6414 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1270 microversion: 2.1 time: 0.321405 Sep 25 01:07:22.819312 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 710/1494] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:22 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1270 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:22.976000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.992475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.994111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.995378 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c766babd-f7d8-438e-a08a-12b7131e7242 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.428667 Sep 25 01:07:23.000391 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 785/1495] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:22 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:23.122262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.122902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:23.138499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.139024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.146625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.151230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.152396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.152927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.467133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.467769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] [instance: 899c609e-5dc8-4972-b533-2dccb40e0257] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:23.483598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.484685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.486961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.488766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.489527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.490220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.521073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] HTTP exception thrown: Instance 899c609e-5dc8-4972-b533-2dccb40e0257 could not be found. Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Request method failure captured: Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 HTTP/1.1 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6lI2EjuyWhmd4LeGdIP1z_lyZn9yLqlEJBA8fU0BLNWmauVaMucx1XRDfxDx0jPQbJNk19keYgwq8n2Xfp5dBFJTvLJyfyFesLhsanPKGQUwKjBHkypFgmxtxg4js8diGzxJXigdW4n37kNV1AL36c2KKsq5z3J7IWtIDrWmh2KJvE Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: e3b524092c484ec3b22d1ce29930fa58 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e3b524092c484ec3b22d1ce29930fa58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e3b524092c484ec3b22d1ce29930fa58"}]}] Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: e3b524092c484ec3b22d1ce29930fa58 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-756436779 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesOneServerTestJSON-756436779-project Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 46ba0c28dade4f7abf4e3ef3dcafa957 Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesOneServerTestJSON-756436779-project Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 899c609e-5dc8-4972-b533-2dccb40e0257 could not be found. Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '899c609e-5dc8-4972-b533-2dccb40e0257'} Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899c609e-5dc8-4972-b533-2dccb40e0257 could not be found. Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899c609e-5dc8-4972-b533-2dccb40e0257 could not be found. Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:23.523125 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899c609e-5dc8-4972-b533-2dccb40e0257 could not be found. Sep 25 01:07:23.528590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.530606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] Returning 404 to user: Instance 899c609e-5dc8-4972-b533-2dccb40e0257 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:23.531707 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a7f9ad52-b6d4-4622-820d-6fab5ece4753 tempest-ImagesOneServerTestJSON-756436779 tempest-ImagesOneServerTestJSON-756436779-project] 10.222.0.16 "GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257" status: 404 len: 111 microversion: 2.1 time: 0.070530 Sep 25 01:07:23.532862 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 786/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:23 2022] GET /compute/v2.1/servers/899c609e-5dc8-4972-b533-2dccb40e0257 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:07:23.738345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:23.757479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:23.759009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:23.774399 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43ad27e7-2459-4169-91dc-07e788007b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2826 microversion: 2.42 time: 0.657967 Sep 25 01:07:23.790067 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 711/1497] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:23 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2826 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:23.803964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.804477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:23.819289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.827430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.828102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.829804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.830412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.845959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.846888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:23.854253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.855011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.856195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.857120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.863106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.863805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:24.324024 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-385d7bd1-aab8-4795-9550-0c0e3d3b2b1d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.524246 Sep 25 01:07:24.325265 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 787/1498] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:07:23 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea/os-interface => generated 1831 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:24.340821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:24.341514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:24.354147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:24.355039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:24.355975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:24.357252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:24.357940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:24.358703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:24.639088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:24.650108 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee8487bd-a358-4e00-b753-8b01790ffd2d tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1312 microversion: 2.1 time: 0.809841 Sep 25 01:07:24.651548 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 712/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:23 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1312 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:24.829607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de9cde2c-c5cf-478e-a460-3f1669588dc7", "device": "/dev/xvdb"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:24.832602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:24.839488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:24.840379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:24.841177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:24.842134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:24.842801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:24.843440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:24.872833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:24.886058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:24.887576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:24.888848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40c8165e-a8c8-43df-94fa-cf9aee09826b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.562275 Sep 25 01:07:24.889312 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 788/1500] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:24 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:25.099868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:25.100486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:25.109830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.110324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.110767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.115059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.117361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.117857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.206054 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e841ee1d-65b2-4497-8dd4-a491c849753c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "POST /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381511 Sep 25 01:07:25.215738 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 713/1501] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:07:24 2022] POST /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:25.228325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-07c23f2a-4c18-4c5d-8a41-b746d6ad866d req-4676969e-bbbe-4587-850b-57488e16c559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49435307-0eef-4502-914e-25c74eb8a56f", "tag": "36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:25.257268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-07c23f2a-4c18-4c5d-8a41-b746d6ad866d req-4676969e-bbbe-4587-850b-57488e16c559 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.267898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-07c23f2a-4c18-4c5d-8a41-b746d6ad866d req-4676969e-bbbe-4587-850b-57488e16c559 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.268531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-07c23f2a-4c18-4c5d-8a41-b746d6ad866d req-4676969e-bbbe-4587-850b-57488e16c559 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.290749 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-07c23f2a-4c18-4c5d-8a41-b746d6ad866d req-4676969e-bbbe-4587-850b-57488e16c559 service nova] Creating event network-changed:36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc for instance 49435307-0eef-4502-914e-25c74eb8a56f on n-h1-master-1 Sep 25 01:07:25.298867 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-07c23f2a-4c18-4c5d-8a41-b746d6ad866d req-4676969e-bbbe-4587-850b-57488e16c559 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080874 Sep 25 01:07:25.299952 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 714/1502] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:25.674285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:25.674998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:25.695125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.695559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.696005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.696740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.697205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.697672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.116121 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:26.249135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:26.260695 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e897a18a-1f9d-40c1-8970-7fa64caae2d3 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1588 microversion: 2.1 time: 1.161882 Sep 25 01:07:26.261590 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 789/1503] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:25 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1588 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:26.272228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:26.274286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:26.286833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.295455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.296204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.297136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.297801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.298433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:27.224324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:27.233878 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6988457a-46e6-4a5f-9187-6165af78bd52 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 1.564517 Sep 25 01:07:27.242617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 715/1504] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:25 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:27.326963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:27.367915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:27.380375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:27.385514 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c149ef4e-b383-4899-9191-96220a452bd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.121259 Sep 25 01:07:27.386481 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 790/1505] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:26 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:28.269597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.270231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.273549 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:28.292201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.296508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.297304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.301111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.302114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.303408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.343009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-594b2e13-6463-4703-9e40-37dfc2334d25 req-fb3f0f52-cf45-4eab-b95d-5cee93e18ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "tag": "f3f44f7c-343a-41d4-9458-4367d49b3d8c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:28.377369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-594b2e13-6463-4703-9e40-37dfc2334d25 req-fb3f0f52-cf45-4eab-b95d-5cee93e18ef2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.380595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-594b2e13-6463-4703-9e40-37dfc2334d25 req-fb3f0f52-cf45-4eab-b95d-5cee93e18ef2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.381121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-594b2e13-6463-4703-9e40-37dfc2334d25 req-fb3f0f52-cf45-4eab-b95d-5cee93e18ef2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.437709 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-594b2e13-6463-4703-9e40-37dfc2334d25 req-fb3f0f52-cf45-4eab-b95d-5cee93e18ef2 service nova] Creating event network-changed:f3f44f7c-343a-41d4-9458-4367d49b3d8c for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:07:28.454752 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-594b2e13-6463-4703-9e40-37dfc2334d25 req-fb3f0f52-cf45-4eab-b95d-5cee93e18ef2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114467 Sep 25 01:07:28.456409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 791/1506] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:28.475080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.477161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.495008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.495775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.497317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.501055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.501936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.502574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.665266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:28.688416 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e151c28-e490-4df9-8b4f-073a4dc473cc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.422942 Sep 25 01:07:28.689607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 716/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:28 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:29.130362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-db7a00f7-ee6c-424b-a70e-3462c653a38f req-7252edad-1577-4e94-aef5-56d8c7c7b96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "tag": "e0c727ba-73c4-4361-93ef-fe7aa2b9adb4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:29.153979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db7a00f7-ee6c-424b-a70e-3462c653a38f req-7252edad-1577-4e94-aef5-56d8c7c7b96b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.157280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db7a00f7-ee6c-424b-a70e-3462c653a38f req-7252edad-1577-4e94-aef5-56d8c7c7b96b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.161633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db7a00f7-ee6c-424b-a70e-3462c653a38f req-7252edad-1577-4e94-aef5-56d8c7c7b96b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.202802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-db7a00f7-ee6c-424b-a70e-3462c653a38f req-7252edad-1577-4e94-aef5-56d8c7c7b96b service nova] Creating event network-changed:e0c727ba-73c4-4361-93ef-fe7aa2b9adb4 for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:07:29.236187 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-db7a00f7-ee6c-424b-a70e-3462c653a38f req-7252edad-1577-4e94-aef5-56d8c7c7b96b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113278 Sep 25 01:07:29.236876 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 717/1508] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 25 01:07:29.715149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:29.717252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:29.736414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.737756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.738456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.739470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.740178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.741593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.987319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:30.009371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:30.018550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:30.025116 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab40d704-338b-4850-8351-9c8fa69507d0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.565163 Sep 25 01:07:30.028280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 792/1509] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:28 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:31.058269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:31.059868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:31.077214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.078362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.078958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.080957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.083324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.083935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.514169 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:32.384970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:32.404387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-302b86db-f316-4e7f-afa5-d156a067be21 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 2.693749 Sep 25 01:07:32.421516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 718/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:29 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:32.436440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b3971a48-8f88-488b-b17b-a228cd218ec4 req-0ab17037-1323-43cd-a176-2524af60adb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "tag": "254ceebf-7539-4f3d-96c7-a3a352dd788a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:32.468713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b3971a48-8f88-488b-b17b-a228cd218ec4 req-0ab17037-1323-43cd-a176-2524af60adb6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.469219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b3971a48-8f88-488b-b17b-a228cd218ec4 req-0ab17037-1323-43cd-a176-2524af60adb6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.469691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b3971a48-8f88-488b-b17b-a228cd218ec4 req-0ab17037-1323-43cd-a176-2524af60adb6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.517931 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b3971a48-8f88-488b-b17b-a228cd218ec4 req-0ab17037-1323-43cd-a176-2524af60adb6 service nova] Creating event network-changed:254ceebf-7539-4f3d-96c7-a3a352dd788a for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:07:32.525043 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b3971a48-8f88-488b-b17b-a228cd218ec4 req-0ab17037-1323-43cd-a176-2524af60adb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100480 Sep 25 01:07:32.526514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 719/1511] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:32.537186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ab48b7ca-65a2-49f4-a719-a1d242814172 req-55fdfaa9-a007-443b-a82b-fb74635bb833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606c6b18-fed9-4c35-a893-073e837e900e", "name": "network-vif-unplugged", "status": "completed", "tag": "064c9227-3e67-4e2b-93a2-32adff32ffbc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:32.556387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ab48b7ca-65a2-49f4-a719-a1d242814172 req-55fdfaa9-a007-443b-a82b-fb74635bb833 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.557216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ab48b7ca-65a2-49f4-a719-a1d242814172 req-55fdfaa9-a007-443b-a82b-fb74635bb833 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.557848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ab48b7ca-65a2-49f4-a719-a1d242814172 req-55fdfaa9-a007-443b-a82b-fb74635bb833 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.571834 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ab48b7ca-65a2-49f4-a719-a1d242814172 req-55fdfaa9-a007-443b-a82b-fb74635bb833 service nova] Creating event network-vif-unplugged:064c9227-3e67-4e2b-93a2-32adff32ffbc for instance 606c6b18-fed9-4c35-a893-073e837e900e on n-h1-master-1 Sep 25 01:07:32.579164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ab48b7ca-65a2-49f4-a719-a1d242814172 req-55fdfaa9-a007-443b-a82b-fb74635bb833 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050539 Sep 25 01:07:32.580579 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 720/1512] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:32.798303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:32.821674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:32.829299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:32.832144 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-274a697c-4af1-46f4-9b37-bb6f29796ba9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.778737 Sep 25 01:07:32.835124 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 793/1513] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:31 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:33.437343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:33.438091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:33.457456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.458315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.459623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.462314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.464449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.465867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.863836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:33.864469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:33.882657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.885907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.887681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.890042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.890719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.893922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.652023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:34.675120 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aee21bc4-ffec-4d01-82fc-2239171d9980 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 1.243570 Sep 25 01:07:34.685665 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 721/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:33 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:34.826937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d3ee81b0-56c6-4a58-a4f8-71b6694a2b22 req-86d684ab-6265-4b0d-9580-941e6caee05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606c6b18-fed9-4c35-a893-073e837e900e", "tag": "064c9227-3e67-4e2b-93a2-32adff32ffbc"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:34.852146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d3ee81b0-56c6-4a58-a4f8-71b6694a2b22 req-86d684ab-6265-4b0d-9580-941e6caee05d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.852885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d3ee81b0-56c6-4a58-a4f8-71b6694a2b22 req-86d684ab-6265-4b0d-9580-941e6caee05d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.859809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d3ee81b0-56c6-4a58-a4f8-71b6694a2b22 req-86d684ab-6265-4b0d-9580-941e6caee05d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.904605 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d3ee81b0-56c6-4a58-a4f8-71b6694a2b22 req-86d684ab-6265-4b0d-9580-941e6caee05d service nova] Creating event network-changed:064c9227-3e67-4e2b-93a2-32adff32ffbc for instance 606c6b18-fed9-4c35-a893-073e837e900e on n-h1-master-1 Sep 25 01:07:34.919777 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d3ee81b0-56c6-4a58-a4f8-71b6694a2b22 req-86d684ab-6265-4b0d-9580-941e6caee05d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101906 Sep 25 01:07:34.925339 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 722/1515] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:35.039436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:35.062802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:35.068720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:35.078272 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-385678bf-1ca9-4685-9ec1-d02fc5a11733 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.218228 Sep 25 01:07:35.082097 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 794/1516] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:33 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:35.701000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:35.702382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:35.719351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.720204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.720889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.721652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.722109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.722536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.080750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:36.091050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3fb8ae6-bb56-4522-b92f-e6010f456454 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.393982 Sep 25 01:07:36.092877 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 723/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:35 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:36.110909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:36.111519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:36.131995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.133965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.134608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.136270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.138167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.139157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.647928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:36.682612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:36.686297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:36.689365 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb144869-2dbe-41e1-a07a-e866f531d539 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.582605 Sep 25 01:07:36.690574 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 795/1518] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:36 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:37.115812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:37.116518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:37.128970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.130209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.131450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.133703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.135765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.136422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.424878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:37.435030 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0f4648c5-27e7-42a7-b1a3-7b125c19c161 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.323080 Sep 25 01:07:37.435683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 724/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:37 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:37.720361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:37.720979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:37.727804 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:37.752258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.757022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.759425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.760407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.761053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.762345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.139852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.156011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.161624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.166405 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d757135-e98f-452b-9659-a7e3e8e48230 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.446779 Sep 25 01:07:38.169461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 796/1520] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:37 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:38.463808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:38.464536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:38.479185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.479848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.481023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.484755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.491110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.491951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.202380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:39.203641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:39.215963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.216755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.217385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.218615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.219264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.219908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.754157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.766259 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d30a7db-a4a0-4ebc-884c-51865ddcc4bd tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 1.307184 Sep 25 01:07:39.776125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 725/1521] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:38 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:39.934794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.950847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.956524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.957805 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bfa8a9ef-54e1-42b0-b9ca-fccca0f6f21b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.761303 Sep 25 01:07:39.958413 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 797/1522] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:39 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:40.800247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:40.801029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:40.807348 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=69 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:40.822007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.822977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.823680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.825214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.826082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.826774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.925770 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:40.991671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:40.992412 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:41.003517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.007209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.007710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.008472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.009005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.009371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.510786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:41.534726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:41.538281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:41.542698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:41.545836 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aecbe0fa-36be-4860-a22e-4ce9a71e6332 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.558193 Sep 25 01:07:41.547105 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 798/1523] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:40 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:41.569365 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6614d942-a751-409f-84d8-a8e3513b0cc2 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.772977 Sep 25 01:07:41.586104 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 726/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:40 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:42.238672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:42.240153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:42.249954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.250911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.251667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.252653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.253358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.254090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.291163 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:42.553527 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a9e5556-75fe-4a7c-ba1f-807225f4c273 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1854 microversion: 2.1 time: 0.320087 Sep 25 01:07:42.577725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:42.578895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:42.581882 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 799/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:42 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1854 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:42.592252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:42.594065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.596327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.599539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.604852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.606864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:42.607555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.610675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.616800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.617649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.618324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.619416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.620484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.621662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.654937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lazy-loading 'flavor' on Instance uuid d848e47a-66a6-4630-ad21-d24380ffc726 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:42.670017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Going to try to live migrate instance to n-h1-master-1 {{(pid=122385) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:07:42.914597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:42.936098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:42.943029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:42.948574 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6de1b88-51e8-4c91-8127-ead7e141794d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.373207 Sep 25 01:07:42.951075 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 727/1526] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:42 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:42.957114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:42.958680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:42.969702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.978303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.979013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.980163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.981489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.982249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:43.153007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:43.163637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9079625f-c58d-4a51-a5c4-11450e5f285b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.211489 Sep 25 01:07:43.170085 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 728/1527] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:42 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:43.439422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d5b305b-2da4-4c19-8274-36ce184c1b4f tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beb962af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1284778051", "description": "tempest-description-1864695104"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:43.794940 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d5b305b-2da4-4c19-8274-36ce184c1b4f tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.623340 Sep 25 01:07:43.795866 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 729/1528] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:07:43 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:43.801204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fbc05a21-7745-43d2-9586-60bd50e3fe7a req-af27e400-a1d0-4211-8033-cf0265b4f644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "name": "network-vif-plugged", "status": "completed", "tag": "254ceebf-7539-4f3d-96c7-a3a352dd788a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:43.844607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fbc05a21-7745-43d2-9586-60bd50e3fe7a req-af27e400-a1d0-4211-8033-cf0265b4f644 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:43.846308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fbc05a21-7745-43d2-9586-60bd50e3fe7a req-af27e400-a1d0-4211-8033-cf0265b4f644 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:43.848446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fbc05a21-7745-43d2-9586-60bd50e3fe7a req-af27e400-a1d0-4211-8033-cf0265b4f644 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:43.868265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fbc05a21-7745-43d2-9586-60bd50e3fe7a req-af27e400-a1d0-4211-8033-cf0265b4f644 service nova] Creating event network-vif-plugged:254ceebf-7539-4f3d-96c7-a3a352dd788a for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:07:43.891616 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fbc05a21-7745-43d2-9586-60bd50e3fe7a req-af27e400-a1d0-4211-8033-cf0265b4f644 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094478 Sep 25 01:07:43.892688 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 730/1529] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:43.898574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6cf60d9c-e036-401f-a4df-46288e1e72a9 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beb962670>, body: {"security_group_rule": {"parent_group_id": "9284b48f-5605-4ec8-9c8d-1e950e4ecb25", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:44.456791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6cf60d9c-e036-401f-a4df-46288e1e72a9 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.561988 Sep 25 01:07:44.457963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 731/1530] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:07:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:44.463486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:44.464676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:44.477552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:44.481165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:44.481656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:44.484402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:44.485055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:44.485772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:44.668779 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-251b1b70-932d-4d27-9b41-0e6f3303b722 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/action" status: 202 len: 0 microversion: 2.1 time: 2.084667 Sep 25 01:07:44.673974 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 800/1531] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:07:42 2022] POST /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/action => generated 0 bytes in 2091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:07:44.679691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:44.680638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:44.690470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:44.691235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:44.691874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:44.692779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:44.693448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:44.694063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:44.781226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:44.794673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:44.796543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:44.799303 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6aeb1d49-ddcf-4ac6-b7a2-a79f713747dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.340159 Sep 25 01:07:44.800596 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 732/1532] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:44 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:44.807425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8263fd8-7cc0-436b-aed3-9ed4dfeaed3a tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beb962790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1468789255", "description": "tempest-description-828602514"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:45.544581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:45.561203 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-408be261-506b-4229-9985-6357a555a072 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.885225 Sep 25 01:07:45.561823 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 801/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:44 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:45.581941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:45.583571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:45.616746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:45.617459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:45.621398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:45.624064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:45.624476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:45.627106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:45.790647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8263fd8-7cc0-436b-aed3-9ed4dfeaed3a tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.988443 Sep 25 01:07:45.802151 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 733/1534] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:07:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:45.808997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-528d43b7-b460-4578-aee2-719c0bbdcdc6 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beba13b80>, body: {"security_group_rule": {"parent_group_id": "b3020a68-a1d7-48cf-9f3d-c99471857e4b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:47.010617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:47.030192 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4778d93-0399-48b1-8ae8-e9d862327f84 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 1.464842 Sep 25 01:07:47.057439 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 802/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:45 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:47.063426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:47.078651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:47.101564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:47.108930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:47.109668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:47.110671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:47.111304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:47.111937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:47.903210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-528d43b7-b460-4578-aee2-719c0bbdcdc6 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.090039 Sep 25 01:07:47.905079 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 734/1536] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:07:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:47.911397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d10ec75e-f932-47ca-b66f-74143529aba2 req-5e00e15b-31f9-46e4-b661-9dcbd82171fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "name": "network-vif-plugged", "status": "completed", "tag": "e0c727ba-73c4-4361-93ef-fe7aa2b9adb4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:47.941696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d10ec75e-f932-47ca-b66f-74143529aba2 req-5e00e15b-31f9-46e4-b661-9dcbd82171fc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:47.950454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d10ec75e-f932-47ca-b66f-74143529aba2 req-5e00e15b-31f9-46e4-b661-9dcbd82171fc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:47.958224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d10ec75e-f932-47ca-b66f-74143529aba2 req-5e00e15b-31f9-46e4-b661-9dcbd82171fc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:47.973427 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d10ec75e-f932-47ca-b66f-74143529aba2 req-5e00e15b-31f9-46e4-b661-9dcbd82171fc service nova] Creating event network-vif-plugged:e0c727ba-73c4-4361-93ef-fe7aa2b9adb4 for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:07:48.066814 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d10ec75e-f932-47ca-b66f-74143529aba2 req-5e00e15b-31f9-46e4-b661-9dcbd82171fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160048 Sep 25 01:07:48.075750 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 735/1537] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:48.115670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:48.117117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:48.155563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:48.168606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:48.172162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:48.173233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:48.175265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:48.182021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:48.599933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:48.620376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:48.635314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:48.641376 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4587ed0e-0863-468a-a618-212b0ad2ea1a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.577502 Sep 25 01:07:48.642096 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 803/1538] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:47 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:48.680964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5928607c-38f6-4d05-bd45-ab11866c915d tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7bebcf5dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-253864018", "description": "tempest-description-526727862"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:48.983519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:49.000728 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-57f56701-efe3-428e-82d6-e6c0f6046504 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1333 microversion: 2.1 time: 0.919530 Sep 25 01:07:49.003811 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 736/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:48 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1333 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:49.026913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:49.032362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:49.043443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:49.048094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:49.049059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:49.050368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:49.051221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:49.053161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.165730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:51.179591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b20e9559-d105-4e02-98f4-4589accad068 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 2.174367 Sep 25 01:07:51.197948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 737/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:49 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:51.245438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:51.246498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:51.271000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.275202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.277200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.278589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.283320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.283990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.390634 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5928607c-38f6-4d05-bd45-ab11866c915d tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.742664 Sep 25 01:07:51.396038 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 804/1541] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:07:48 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:51.403186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:51.404278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:51.437033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.438105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.439024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.442892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.444604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.449297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.185529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:52.204468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:52.206790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:52.208481 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4494aee8-20e0-44dd-9223-5a36c2ce8e63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.008591 Sep 25 01:07:52.212953 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 738/1542] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:51 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:52.235202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02e6a9c2-8152-41c6-96bb-720817d8b590 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beb968670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-950266022", "description": "tempest-description-265137404"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:52.707067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:52.728926 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc9b8c30-376e-453c-a31f-af172d745e4b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1667 microversion: 2.1 time: 1.330511 Sep 25 01:07:52.736318 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 805/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:51 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1667 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:52.750441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:52.758003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:52.784344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.785228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.785913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.787546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.788193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.791085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.548307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02e6a9c2-8152-41c6-96bb-720817d8b590 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.318319 Sep 25 01:07:53.550493 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 739/1544] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:07:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:53.557435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:53.557868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:53.581170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.582195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.582830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.601018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.601725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.602417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.678483 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-88bd310d-333d-4b76-bc41-dcfde1ad419f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba/ips" status: 200 len: 178 microversion: 2.1 time: 0.125714 Sep 25 01:07:53.688428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 740/1545] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:07:53 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba/ips => generated 178 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:53.700739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:53.705007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:53.722377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.741670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.742408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.743195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.743675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.766178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.898773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:53.935529 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3e8d422-a2a4-462a-bed6-74a7b1aee3cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 1.197766 Sep 25 01:07:53.943447 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 806/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:52 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:53.975027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d606738-b91c-411c-a9f8-9035653a2d27 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7bebb86b80>, body: {"security_group_rule": {"parent_group_id": "4d27722c-239f-4441-8004-df4662f2e7ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b027c0cc-85e0-449a-b78c-d97de4576a7a"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:54.513881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:54.528474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:54.530073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:54.531344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8455a2d8-71c5-4d95-9cae-710a61e524fc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.841526 Sep 25 01:07:54.554355 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 741/1547] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:53 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:54.584010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:54.587521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:54.604793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:54.620287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:54.621715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:54.623188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:54.624957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:54.625619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:54.721235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:54.996947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-438b1686-aa66-4432-9a18-f4fd34311fcc tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 204 len: 0 microversion: 2.1 time: 0.438003 Sep 25 01:07:55.002013 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 742/1548] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:54 2022] DELETE /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:55.296211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8fb829f9-7aac-485d-93c6-58f2bfad86f4 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Action: 'create', calling method: .version_select at 0x7f7bebaa4670>, body: {"keypair": {"name": "tempest-keypair-1914584377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOttRLR8NXHNdedw0Y9K9W6hdSo7vQ+BMfS7NShWxltmhfcGCFC8CUzjRzi/oxWJ0O4P7+yLrkme4RV7TiurSFWGL7zSo1NtlPdxuTIjn8AbfSXNRMM99fl4rJDO5VicHA=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:55.349697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-8fb829f9-7aac-485d-93c6-58f2bfad86f4 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Getting quotas for project 4131663ab3574002b589848f67fbb78d. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:55.368861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-8fb829f9-7aac-485d-93c6-58f2bfad86f4 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Getting quotas for user 7f09255419184d11b8379c6bd0a338b0 and project 4131663ab3574002b589848f67fbb78d. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:55.434338 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8fb829f9-7aac-485d-93c6-58f2bfad86f4 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.429467 Sep 25 01:07:55.438255 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 743/1549] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:07:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:55.456296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:55.461544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:55.501021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:55.505365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:55.507175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:55.509296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:55.511642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:55.519330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:55.984772 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d606738-b91c-411c-a9f8-9035653a2d27 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.023263 Sep 25 01:07:55.987635 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 807/1550] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:07:53 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:55.993221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:55.994216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:56.014966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:56.050421 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cbe53d3c-1b36-498f-bf22-0dba533f209a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.607753 Sep 25 01:07:56.052271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:56.052909 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 744/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:55 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:56.057839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:56.059933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:56.060961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:56.061710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:56.062499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:56.071781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:56.073145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:56.103154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:56.106662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:56.111840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:56.112953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:56.119517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:56.120395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.041947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:57.066658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:57.070670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:57.080855 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d9a2474-5bf0-4c63-ba3b-bed2043d0fce tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 1.022948 Sep 25 01:07:57.093484 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 745/1552] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:56 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:57.144747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-254fd66b-224d-4d0f-ade7-c427967d6254 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beba13b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2115550874", "description": "tempest-description-279402972"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:57.208035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:57.240489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c56c019c-4210-4792-a78d-bda49e47480b tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1673 microversion: 2.1 time: 1.251449 Sep 25 01:07:57.242423 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 808/1553] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:55 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1673 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:57.248354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:57.255642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:57.281989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.284928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.287971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.288886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.291183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.296256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.223724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:59.258036 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3627faf7-c356-4d87-9e7c-b4024fc8e9e5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 2.013243 Sep 25 01:07:59.259274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 809/1554] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:57 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:59.270188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:59.272678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:59.298683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.301279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.303729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.304614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.307419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.308176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.570502 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-254fd66b-224d-4d0f-ade7-c427967d6254 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.470065 Sep 25 01:07:59.572939 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 746/1555] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:07:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:59.585915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:59.590505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:59.609684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.610506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.611136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.613003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.613889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.614757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:00.064573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:00.082186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:00.085173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:00.087170 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43c83002-1d7a-4670-a82d-868dfadb5f16 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.826527 Sep 25 01:08:00.088243 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 810/1556] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:59 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:00.113293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-303705176", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "e4536ee3-a441-4899-956c-857a29ff0c63"}], "security_groups": [{"name": "tempest-securitygroup--1475133145"}], "key_name": "tempest-keypair-1914584377", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:00.372415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:00.382729 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b06d4330-cd3e-406a-bb3a-b3b00af68d4f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1673 microversion: 2.1 time: 0.806581 Sep 25 01:08:00.383330 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 747/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:59 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1673 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:00.427354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fab69716-0365-4370-99d6-83e789bbfac9 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7bf002c550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1380157074", "description": "tempest-description-526220785"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:00.687509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] validate_networks() for [('e4536ee3-a441-4899-956c-857a29ff0c63', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:08:01.218801 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fab69716-0365-4370-99d6-83e789bbfac9 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.812034 Sep 25 01:08:01.219414 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 748/1558] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:08:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:01.244579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:01.246035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:01.260483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.261545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.261970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.262707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.263167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.263623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.791502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:01.822478 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-277b932b-bdbe-4493-be24-f979ff59f858 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.586197 Sep 25 01:08:01.823434 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 749/1559] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:01 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:01.828929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:01.833936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:01.834733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Searching by: {'deleted': False, 'project_id': '740928060bf443508f8165c0dfa50514'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:08:01.867622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.868124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.868573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.869325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.869840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.870373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.932081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:08:02.012333 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:02.020414 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e65bc24-87d3-4aa0-9791-9a5e21d54ae0 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.195088 Sep 25 01:08:02.021045 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 750/1560] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:08:01 2022] GET /compute/v2.1/servers => generated 340 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:02.025878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-58a88200-51c1-4d54-8c7d-3905674b79df req-0711ae0a-9bdd-4b62-9ef1-b92070554273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "name": "network-vif-deleted", "tag": "254ceebf-7539-4f3d-96c7-a3a352dd788a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:02.057875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-58a88200-51c1-4d54-8c7d-3905674b79df req-0711ae0a-9bdd-4b62-9ef1-b92070554273 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.058368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-58a88200-51c1-4d54-8c7d-3905674b79df req-0711ae0a-9bdd-4b62-9ef1-b92070554273 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.059024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-58a88200-51c1-4d54-8c7d-3905674b79df req-0711ae0a-9bdd-4b62-9ef1-b92070554273 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:02.093146 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-58a88200-51c1-4d54-8c7d-3905674b79df req-0711ae0a-9bdd-4b62-9ef1-b92070554273 service nova] Creating event network-vif-deleted:254ceebf-7539-4f3d-96c7-a3a352dd788a for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:08:02.100372 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-58a88200-51c1-4d54-8c7d-3905674b79df req-0711ae0a-9bdd-4b62-9ef1-b92070554273 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076873 Sep 25 01:08:02.101633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 751/1561] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:02.121593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:02.128232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:02.159744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.164823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.168200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:02.173444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.175013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.177150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:02.754090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:02.774262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:02.776019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:02.789123 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b949d75-43e7-4a53-b422-3b7ed6b57993 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1816 microversion: 2.25 time: 0.680268 Sep 25 01:08:02.790614 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 752/1562] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:02 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1816 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:02.804817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ffe9c094-28d4-4ee0-ba99-4bf031482b38 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7beb99e1f0>, body: {"security_group_rule": {"parent_group_id": "6394cca9-f50a-4eb6-a2c5-1add19306fb1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "70967ead-dccf-49f4-b9cf-4ec6918e805f"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:02.926588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:08:02.927656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:08:02.928350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:08:02.929073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:08:02.929791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:08:02.946792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.948386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.950478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:02.954351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.955779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.957567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.008379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Getting quotas for project 4131663ab3574002b589848f67fbb78d. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:08:03.019983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Getting quotas for user 7f09255419184d11b8379c6bd0a338b0 and project 4131663ab3574002b589848f67fbb78d. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:08:03.048753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:08:03.051401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:08:03.142353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-816bca22-fd5d-4ba3-b4f8-57db3800e03b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.052424 Sep 25 01:08:03.143983 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 811/1563] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:08:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 3055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:08:03.151127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:03.152172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:03.160373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.161171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.161816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.163121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.163836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.164434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.556329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:03.566918 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83dc43ab-c6b2-46c2-b7d5-b93c98baf59c tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1452 microversion: 2.1 time: 0.421645 Sep 25 01:08:03.567530 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 812/1564] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:03 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1452 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:03.647656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-14900662-eeff-43d7-b12c-1ec91e3d5930 req-b5a09240-75e0-4b03-8de2-ae4df64345b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "name": "network-vif-unplugged", "status": "completed", "tag": "e0c727ba-73c4-4361-93ef-fe7aa2b9adb4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:03.690183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-14900662-eeff-43d7-b12c-1ec91e3d5930 req-b5a09240-75e0-4b03-8de2-ae4df64345b1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.690745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-14900662-eeff-43d7-b12c-1ec91e3d5930 req-b5a09240-75e0-4b03-8de2-ae4df64345b1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.694433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-14900662-eeff-43d7-b12c-1ec91e3d5930 req-b5a09240-75e0-4b03-8de2-ae4df64345b1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.727843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-14900662-eeff-43d7-b12c-1ec91e3d5930 req-b5a09240-75e0-4b03-8de2-ae4df64345b1 service nova] Creating event network-vif-unplugged:e0c727ba-73c4-4361-93ef-fe7aa2b9adb4 for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:08:03.750913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-14900662-eeff-43d7-b12c-1ec91e3d5930 req-b5a09240-75e0-4b03-8de2-ae4df64345b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182088 Sep 25 01:08:03.755459 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 813/1565] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:03.778535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:03.804563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:03.809836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Searching by: {'deleted': False, 'project_id': '740928060bf443508f8165c0dfa50514'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:08:03.846408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.848654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.851245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.859103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.860401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.861057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.984225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:08:04.167669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:04.195712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.202580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.207506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.566344 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-737b9646-3963-49ed-b6ad-aede7436b3ea tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.807526 Sep 25 01:08:04.567370 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 814/1566] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:08:03 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:04.572749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:04.574468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:04.589263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.592523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.594318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.596388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.599928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.600985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.689999 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ffe9c094-28d4-4ee0-ba99-4bf031482b38 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.894925 Sep 25 01:08:04.692918 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 753/1567] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:08:02 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:04.703698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:04.705577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:04.721924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.723010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.724167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.725636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.726348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.728324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.909547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:04.916429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:04.927899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bef75298-2ccf-40b8-a623-2241c8f8c14b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.358933 Sep 25 01:08:04.936822 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0aedf5db-f7a5-4eb4-b64b-35d877c77d89 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1237 microversion: 2.1 time: 0.240697 Sep 25 01:08:04.937472 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 754/1568] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:04 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1237 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:04.942177 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 815/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:04 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:04.951047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c994e9ee-2822-48c3-8da7-3c57088eca8f req-4962c4a3-b18e-4485-8ae4-1f7cadef3821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32047ae8-0f04-4328-bf11-5b9c2c4d5aba", "name": "network-vif-deleted", "tag": "e0c727ba-73c4-4361-93ef-fe7aa2b9adb4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:04.962795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:04.963376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:04.977514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.978098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.997034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.998042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.998383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.999393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.002880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c994e9ee-2822-48c3-8da7-3c57088eca8f req-4962c4a3-b18e-4485-8ae4-1f7cadef3821 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.008024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c994e9ee-2822-48c3-8da7-3c57088eca8f req-4962c4a3-b18e-4485-8ae4-1f7cadef3821 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.009303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c994e9ee-2822-48c3-8da7-3c57088eca8f req-4962c4a3-b18e-4485-8ae4-1f7cadef3821 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.048513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c994e9ee-2822-48c3-8da7-3c57088eca8f req-4962c4a3-b18e-4485-8ae4-1f7cadef3821 service nova] Creating event network-vif-deleted:e0c727ba-73c4-4361-93ef-fe7aa2b9adb4 for instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba on n-h1-master-1 Sep 25 01:08:05.061649 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c994e9ee-2822-48c3-8da7-3c57088eca8f req-4962c4a3-b18e-4485-8ae4-1f7cadef3821 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118076 Sep 25 01:08:05.063253 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 816/1570] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:05.078759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:05.080160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:05.091499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.098221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.098768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.099633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.100236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.100769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.132209 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:05.175070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.175735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.176353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.177013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lazy-loading 'fault' on Instance uuid 32047ae8-0f04-4328-bf11-5b9c2c4d5aba {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:05.277341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:05.288912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:05.290620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:05.292246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d9230d8-e0ab-41f6-b9fa-0051484f3deb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1806 microversion: 2.25 time: 0.351602 Sep 25 01:08:05.293850 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 755/1571] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:04 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1806 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:05.299742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4757fdea-e772-4f67-b478-e51aa7765105 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:05.314555 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4757fdea-e772-4f67-b478-e51aa7765105 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018620 Sep 25 01:08:05.315156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 756/1572] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:08:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:05.328047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f85ae026362410fb573c81bef57159e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce265709264879a2e1cafb56ea22f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:05.328889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7d283ea-9bb9-424a-a120-4df74ce27047 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7beb9509d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:05.338207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ecacc669-e7bd-4deb-92b1-ab83dc1e962f tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 200 len: 1302 microversion: 2.1 time: 0.272079 Sep 25 01:08:05.340281 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 817/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:05 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 1302 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:05.345378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51dd3fec-8a91-4b31-9806-2f7475dc0c12 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '.version_select at 0x7f7bebc08ee0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:05.349121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51dd3fec-8a91-4b31-9806-2f7475dc0c12 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.349761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51dd3fec-8a91-4b31-9806-2f7475dc0c12 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.359301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51dd3fec-8a91-4b31-9806-2f7475dc0c12 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.394014 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:05.398135 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51dd3fec-8a91-4b31-9806-2f7475dc0c12 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3026 microversion: 2.25 time: 0.052362 Sep 25 01:08:05.415461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 818/1574] 10.222.0.16 () {60 vars in 1184 bytes} [Sun Sep 25 01:08:05 2022] GET /compute/v2.1/os-migrations => generated 3026 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:05.432067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:05.432970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:05.450491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.451294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.451776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.452612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.453082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.453625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.840787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:05.880648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a01b7373-5d15-426f-a0b5-f3956d5ee8a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 2425 microversion: 2.25 time: 0.465459 Sep 25 01:08:05.881261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 819/1575] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:05 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 2425 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:05.886357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:05.890486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:05.906209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.914362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.914825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.915596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:05.916065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:05.916498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.986488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:08:06.139491 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-675caa0f-43d2-487a-a5ee-76f2fa316410 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 204 len: 0 microversion: 2.1 time: 0.255509 Sep 25 01:08:06.147711 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 820/1576] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:08:05 2022] DELETE /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:08:06.164553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.165328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.187325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.187939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.188390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.191390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.191890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.192377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.397759 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c7d283ea-9bb9-424a-a120-4df74ce27047 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/70967ead-dccf-49f4-b9cf-4ec6918e805f" status: 202 len: 0 microversion: 2.1 time: 1.080796 Sep 25 01:08:06.402518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 757/1577] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:05 2022] DELETE /compute/v2.1/os-security-groups/70967ead-dccf-49f4-b9cf-4ec6918e805f => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:06.409279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.409940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.419481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.420232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.420861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.421788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.422438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.423060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.476138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:06.503120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e8c7f0a-035b-4a95-8f63-a5c714e3ab83 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 2425 microversion: 2.25 time: 0.356176 Sep 25 01:08:06.509251 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 821/1578] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 2425 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:06.515514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.516680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.524992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.526268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.527471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.528544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.529182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.529818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.676345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:06.685498 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef8d1611-2151-43a8-bd44-03c1c4ace87a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1299 microversion: 2.1 time: 0.174651 Sep 25 01:08:06.702214 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 822/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:06.707408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.708037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.714772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.715273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.715726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.716442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.716901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.717331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.761084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:06.770115 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e849c536-cdbe-41e9-b0a1-01fa8f320324 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.366102 Sep 25 01:08:06.771014 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 758/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:06.775724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.777300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.783954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.784686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.785331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.786258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.786881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.787487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.802851 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] HTTP exception thrown: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Request method failure captured: Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba HTTP/1.1 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6l7zMBXl9gxpFplQZV7S8SoG0b2XMMsSkxpO7rZIJHZVwoy_LGR5Lz0W2pEAo5TlKug8BH6LtoZlLWpSAR35eAlm-M03hVhPqXG1ka8iASORmg4GQiLVqK-tmKhTCKZ_8dN05rLQdPAVtrqfQGjdsPoAIOmkaeLMFpYAgeJnSA-t_Y Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afce265709264879a2e1cafb56ea22f7"}]}] Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1f85ae026362410fb573c81bef57159e Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '32047ae8-0f04-4328-bf11-5b9c2c4d5aba'} Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:06.804532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Returning 404 to user: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:06.812941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c355cf29-4d56-4cb8-9806-1b995e89e9e3 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 404 len: 111 microversion: 2.1 time: 0.033830 Sep 25 01:08:06.820009 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 759/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:06.825323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-916d76bc-4d97-4c49-bd21-69fa33ef1230 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7beb96d9d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.986465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-916d76bc-4d97-4c49-bd21-69fa33ef1230 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/6394cca9-f50a-4eb6-a2c5-1add19306fb1" status: 200 len: 247 microversion: 2.1 time: 0.164963 Sep 25 01:08:06.987673 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 760/1582] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/os-security-groups/6394cca9-f50a-4eb6-a2c5-1add19306fb1 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:06.993605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.994498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:07.002423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:07.003449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:07.004186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:07.005163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:07.005865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:07.006470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:07.063232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:07.075320 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4885591-36c2-4841-9feb-4a3ebfa8e44f tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1713 microversion: 2.1 time: 0.371767 Sep 25 01:08:07.094661 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 823/1583] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1713 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:07.099761 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e6c0342-b9c8-42dc-b302-ff06ac03fb75 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7bebb019d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1971674435", "description": "tempest-description-285709460"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:07.162951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lazy-loading 'services' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:07.352318 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc18f6f7-5e7c-4f4a-9b9a-b64b7f54b009 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments/5ab33e86-3f3f-489c-88b5-a811cd3d5ad9" status: 202 len: 0 microversion: 2.25 time: 0.361354 Sep 25 01:08:07.354396 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 761/1584] 10.222.0.16 () {60 vars in 1457 bytes} [Sun Sep 25 01:08:06 2022] DELETE /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments/5ab33e86-3f3f-489c-88b5-a811cd3d5ad9 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:08:07.366569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:07.371329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:07.387178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:07.394448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:07.396005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:07.397370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:07.398042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:07.399708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:07.508834 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51341570-1327-4eb0-be70-05dc35139ab0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145192 Sep 25 01:08:07.511891 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 762/1585] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:07 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:07.708544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:07.709075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:07.724501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:07.725117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:07.725607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:07.726367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:07.726822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:07.727258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:07.739983 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e6c0342-b9c8-42dc-b302-ff06ac03fb75 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.643288 Sep 25 01:08:07.742025 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 824/1586] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:08:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:07.759438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca39a743-446d-4f33-b2a2-d0baf497b030 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7bebbf8670>, body: {"security_group_rule": {"parent_group_id": "68ae382d-df4d-4783-8250-8e4a7976cd94", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:08.601005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:08.619546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb449a38-4bef-411c-9740-c41fc0ffff57 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.914542 Sep 25 01:08:08.621320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 763/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:07 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:08.632266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:08.632911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:08.662267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:08.662799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:08.663252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:08.670060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:08.671657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:08.672304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:09.062076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:09.082819 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2159f31e-7597-43e5-a2de-6e785af13918 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.451854 Sep 25 01:08:09.083843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 764/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:08 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:09.092982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:09.095186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:09.114588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:09.115578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:09.116224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:09.116970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:09.117448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:09.117990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:09.229203 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca39a743-446d-4f33-b2a2-d0baf497b030 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.477738 Sep 25 01:08:09.233261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 825/1589] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:08:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:09.244575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:09.256760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:09.269960 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:09.277003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:09.278083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:09.278796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:09.280477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:09.282226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:09.282923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:09.337388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9daccd79-8fcf-41c8-add0-8632378974cf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097691 Sep 25 01:08:09.352767 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 826/1590] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:09 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:09.362932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b41302e4-130e-4b52-ae5f-425dc2fca97f tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Action: 'create', calling method: .version_select at 0x7f7bebd725e0>, body: {"security_group_rule": {"parent_group_id": "68ae382d-df4d-4783-8250-8e4a7976cd94", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:09.559819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:09.582796 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-030ba820-b585-4077-888e-dafac0c0f1a9 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1713 microversion: 2.1 time: 0.497483 Sep 25 01:08:09.583554 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 765/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:09 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1713 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:09.644968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:09.645795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:09.677560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:09.680393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:09.685496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:09.694522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:09.695460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:09.696190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:10.658099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:10.673396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-47449503-fbc5-4091-bb4c-af6aaa09567e tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 1.031105 Sep 25 01:08:10.674433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 766/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:09 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:10.703856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:10.706909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:10.728122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:10.728626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:10.729107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:10.735154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:10.740563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:10.741472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:10.839586 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b41302e4-130e-4b52-ae5f-425dc2fca97f tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.485157 Sep 25 01:08:10.848360 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 827/1593] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:08:09 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:10.854003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:10.865619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:10.881628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:10.882127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:10.882581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:10.883295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:10.883756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:10.884184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:10.984346 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cd68ac79-fa25-4001-a9ea-7967aecd325a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134342 Sep 25 01:08:10.984964 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 828/1594] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:10 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:11.001823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:11.002746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:11.022912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:11.023916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:11.024551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:11.025637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:11.027193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:11.028284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:11.850413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:11.885172 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01a35120-3867-41e7-b54b-c2de99370af0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 1.204172 Sep 25 01:08:11.895030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 767/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:10 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:11.915024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:11.919172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:11.940094 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:11.945618 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:11.947712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:11.951358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:11.953020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:11.955490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:11.957788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:11.960597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.071648 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] HTTP exception thrown: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Request method failure captured: Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba HTTP/1.1 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6l7zMBXl9gxpFplQZV7S8SoG0b2XMMsSkxpO7rZIJHZVwoy_LGR5Lz0W2pEAo5TlKug8BH6LtoZlLWpSAR35eAlm-M03hVhPqXG1ka8iASORmg4GQiLVqK-tmKhTCKZ_8dN05rLQdPAVtrqfQGjdsPoAIOmkaeLMFpYAgeJnSA-t_Y Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afce265709264879a2e1cafb56ea22f7"}]}] Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1f85ae026362410fb573c81bef57159e Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '32047ae8-0f04-4328-bf11-5b9c2c4d5aba'} Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:12.083544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.089809 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.096225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Returning 404 to user: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:12.100548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:12.103860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6c0dca51-6500-41ec-90e3-057ed96a4057 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "DELETE /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 404 len: 111 microversion: 2.1 time: 0.203068 Sep 25 01:08:12.107353 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 768/1596] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:08:11 2022] DELETE /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:12.122428 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e01aac0b-e452-45f4-b613-16c37ea1fd0d tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1713 microversion: 2.1 time: 1.135111 Sep 25 01:08:12.128486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:12.129779 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 829/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:10 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1713 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:12.130971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:12.141727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-777a48a4-ab0e-4a7d-9201-2dffc308ee36 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebabd1f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:12.177602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.179729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.182803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.187980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.189185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.190736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.465313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-777a48a4-ab0e-4a7d-9201-2dffc308ee36 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/68ae382d-df4d-4783-8250-8e4a7976cd94" status: 200 len: 664 microversion: 2.1 time: 0.334005 Sep 25 01:08:12.466001 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 830/1598] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:08:12 2022] GET /compute/v2.1/os-security-groups/68ae382d-df4d-4783-8250-8e4a7976cd94 => generated 664 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:12.470661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d292aa46-7f77-4b56-8630-a5857d4f6993 req-051dec45-f937-45c9-b3f5-8139dadf9214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848e47a-66a6-4630-ad21-d24380ffc726", "name": "network-vif-unplugged", "status": "completed", "tag": "960fd715-aae2-47ef-8376-ebb1c085dc62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:12.496639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d292aa46-7f77-4b56-8630-a5857d4f6993 req-051dec45-f937-45c9-b3f5-8139dadf9214 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.497769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d292aa46-7f77-4b56-8630-a5857d4f6993 req-051dec45-f937-45c9-b3f5-8139dadf9214 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.498398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d292aa46-7f77-4b56-8630-a5857d4f6993 req-051dec45-f937-45c9-b3f5-8139dadf9214 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.521300 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d292aa46-7f77-4b56-8630-a5857d4f6993 req-051dec45-f937-45c9-b3f5-8139dadf9214 service nova] Creating event network-vif-unplugged:960fd715-aae2-47ef-8376-ebb1c085dc62 for instance d848e47a-66a6-4630-ad21-d24380ffc726 on n-h2-master-1 Sep 25 01:08:12.537937 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d292aa46-7f77-4b56-8630-a5857d4f6993 req-051dec45-f937-45c9-b3f5-8139dadf9214 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070553 Sep 25 01:08:12.543009 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 831/1599] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:12.548952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:12.556141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:12.569803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.571837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.578290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.579254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.579902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.580533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.782881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:12.793375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:12.794895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:12.796203 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-980d21b2-3a87-4ae9-b7bd-24962988abef tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2944 microversion: 2.42 time: 0.686984 Sep 25 01:08:12.796764 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 769/1600] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:12 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2944 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:12.813613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:12.819937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:12.839995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.840684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.841299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.842067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.842525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.842954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.916223 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a46815ff-673c-42f8-a1f1-52904a1ff4b4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118246 Sep 25 01:08:12.917852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 770/1601] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:12 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:12.924364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:12.926378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 32047ae8-0f04-4328-bf11-5b9c2c4d5aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:12.933129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.933666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.934078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.934790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:12.935242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:12.935669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:12.958367 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] HTTP exception thrown: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Request method failure captured: Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba HTTP/1.1 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6l7zMBXl9gxpFplQZV7S8SoG0b2XMMsSkxpO7rZIJHZVwoy_LGR5Lz0W2pEAo5TlKug8BH6LtoZlLWpSAR35eAlm-M03hVhPqXG1ka8iASORmg4GQiLVqK-tmKhTCKZ_8dN05rLQdPAVtrqfQGjdsPoAIOmkaeLMFpYAgeJnSA-t_Y Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afce265709264879a2e1cafb56ea22f7"}]}] Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1f85ae026362410fb573c81bef57159e Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '32047ae8-0f04-4328-bf11-5b9c2c4d5aba'} Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:12.960075 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Returning 404 to user: Instance 32047ae8-0f04-4328-bf11-5b9c2c4d5aba could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f96cab2c-0c07-495c-ac81-8868e2e2f52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba" status: 404 len: 111 microversion: 2.1 time: 0.042494 Sep 25 01:08:12.967679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 771/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:12 2022] GET /compute/v2.1/servers/32047ae8-0f04-4328-bf11-5b9c2c4d5aba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:12.970571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d717894-f045-4f7f-bf9c-95931ddf11d4 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebb38430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:13.063383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:13.075641 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-633fa15d-55e5-4563-b13b-7c1167f4f05a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.531003 Sep 25 01:08:13.076901 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 832/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:12 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:13.097544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:13.098145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:13.108117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.108850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.109179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.110222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.110921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.111777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.338378 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-310acc4c-a539-45b9-b94c-1afc112ff30d tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.247073 Sep 25 01:08:13.339256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 833/1604] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:08:13 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea/os-interface => generated 1831 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:13.349344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:13.350313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:13.357035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.359603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.362060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.364406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.367863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.368733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.860423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:13.870939 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c3da3431-fa23-43a7-afd5-141bb77f94a7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.530380 Sep 25 01:08:13.892401 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 834/1605] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:13 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:13.903821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:13.904353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:13.919620 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d717894-f045-4f7f-bf9c-95931ddf11d4 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/7342e24c-8073-4b3c-88c0-ad0e57b9c8a7" status: 202 len: 0 microversion: 2.1 time: 0.956013 Sep 25 01:08:13.922319 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 772/1606] 10.222.0.16 () {58 vars in 1287 bytes} [Sun Sep 25 01:08:12 2022] DELETE /compute/v2.1/os-security-group-rules/7342e24c-8073-4b3c-88c0-ad0e57b9c8a7 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:13.928820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:13.929446 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:13.930807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:13.941758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.942271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.945376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.948910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.949343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.950266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.950984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.953556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.954165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:13.959226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:13.961471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:13.962280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.025101 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] HTTP exception thrown: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Request method failure captured: Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 HTTP/1.1 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6l7zMBXl9gxpFplQZV7S8SoG0b2XMMsSkxpO7rZIJHZVwoy_LGR5Lz0W2pEAo5TlKug8BH6LtoZlLWpSAR35eAlm-M03hVhPqXG1ka8iASORmg4GQiLVqK-tmKhTCKZ_8dN05rLQdPAVtrqfQGjdsPoAIOmkaeLMFpYAgeJnSA-t_Y Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afce265709264879a2e1cafb56ea22f7"}]}] Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1f85ae026362410fb573c81bef57159e Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4aa84695-08bf-40f6-a7b3-4983c2b8d020'} Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:14.031267 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.040527 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.046019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Returning 404 to user: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:14.047278 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3fd42a11-8160-4120-a459-e8899108e52e tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 404 len: 111 microversion: 2.1 time: 0.150104 Sep 25 01:08:14.052089 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 835/1607] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:08:13 2022] DELETE /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:14.058595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-63fc8117-d4ff-4173-a921-179f77b12e01 req-13910f15-f946-411e-afaf-68b9e264ff9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15cf5b07-3309-44b0-a5cd-519a143b5f99", "tag": "f7772c81-4c40-49b6-bd17-9ed8844bfdd5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:14.070229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-63fc8117-d4ff-4173-a921-179f77b12e01 req-13910f15-f946-411e-afaf-68b9e264ff9c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.071109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-63fc8117-d4ff-4173-a921-179f77b12e01 req-13910f15-f946-411e-afaf-68b9e264ff9c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.071826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-63fc8117-d4ff-4173-a921-179f77b12e01 req-13910f15-f946-411e-afaf-68b9e264ff9c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.116580 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-63fc8117-d4ff-4173-a921-179f77b12e01 req-13910f15-f946-411e-afaf-68b9e264ff9c service nova] Creating event network-changed:f7772c81-4c40-49b6-bd17-9ed8844bfdd5 for instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 on n-h2-master-1 Sep 25 01:08:14.158194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-63fc8117-d4ff-4173-a921-179f77b12e01 req-13910f15-f946-411e-afaf-68b9e264ff9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101328 Sep 25 01:08:14.162149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 836/1608] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:14.169678 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:14.182124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:14.185040 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:14.193044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.193044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.193482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.194459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.196298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.196922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.242283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d16cedecbe4634bf384effd09ca0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740928060bf443508f8165c0dfa50514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:14.257394 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bff77c72-acde-4c65-9080-10c5d294b8f4 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 200 len: 1362 microversion: 2.1 time: 0.331267 Sep 25 01:08:14.269437 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 773/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:13 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:14.271931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-173bc36b-aca2-4932-8fb8-7e82d18cd019 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7beb950700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:14.319799 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2b2bce4-6235-453f-af3b-18c5240cd44d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.153529 Sep 25 01:08:14.327743 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 837/1610] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:14 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:14.333353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:14.342273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] [instance: 4aa84695-08bf-40f6-a7b3-4983c2b8d020] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:14.352044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.352931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.353756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.364991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.367654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.375061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.398351 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:14.421190 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] HTTP exception thrown: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Request method failure captured: Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 HTTP/1.1 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6l7zMBXl9gxpFplQZV7S8SoG0b2XMMsSkxpO7rZIJHZVwoy_LGR5Lz0W2pEAo5TlKug8BH6LtoZlLWpSAR35eAlm-M03hVhPqXG1ka8iASORmg4GQiLVqK-tmKhTCKZ_8dN05rLQdPAVtrqfQGjdsPoAIOmkaeLMFpYAgeJnSA-t_Y Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afce265709264879a2e1cafb56ea22f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afce265709264879a2e1cafb56ea22f7"}]}] Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: afce265709264879a2e1cafb56ea22f7 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestMultiNic-1297409580 Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1f85ae026362410fb573c81bef57159e Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestMultiNic-1297409580-project Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4aa84695-08bf-40f6-a7b3-4983c2b8d020'} Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:14.424700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. Sep 25 01:08:14.430966 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:14.431924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] Returning 404 to user: Instance 4aa84695-08bf-40f6-a7b3-4983c2b8d020 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:14.434279 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-802c3a21-7b00-496e-9ad6-7ce905fa2951 tempest-ServersTestMultiNic-1297409580 tempest-ServersTestMultiNic-1297409580-project] 10.222.0.16 "GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020" status: 404 len: 111 microversion: 2.1 time: 0.105470 Sep 25 01:08:14.437719 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 838/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:14 2022] GET /compute/v2.1/servers/4aa84695-08bf-40f6-a7b3-4983c2b8d020 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:14.466285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:14.470260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:14.506922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.513068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.513934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:14.515089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:14.515738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:14.516334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:15.700596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:15.721704 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c951be4-bd75-4517-9ab2-a883a48027e0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 1.276416 Sep 25 01:08:15.732503 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 839/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:14 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:15.749123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c345f0c3-bbf5-4c7c-abe2-179443ecb37e req-4c19a250-497f-485f-bd30-f25335f0665c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d848e47a-66a6-4630-ad21-d24380ffc726", "tag": "960fd715-aae2-47ef-8376-ebb1c085dc62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:15.799857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c345f0c3-bbf5-4c7c-abe2-179443ecb37e req-4c19a250-497f-485f-bd30-f25335f0665c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:15.800262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c345f0c3-bbf5-4c7c-abe2-179443ecb37e req-4c19a250-497f-485f-bd30-f25335f0665c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:15.800703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c345f0c3-bbf5-4c7c-abe2-179443ecb37e req-4c19a250-497f-485f-bd30-f25335f0665c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:15.834246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c345f0c3-bbf5-4c7c-abe2-179443ecb37e req-4c19a250-497f-485f-bd30-f25335f0665c service nova] Creating event network-changed:960fd715-aae2-47ef-8376-ebb1c085dc62 for instance d848e47a-66a6-4630-ad21-d24380ffc726 on n-h2-master-1 Sep 25 01:08:15.851497 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c345f0c3-bbf5-4c7c-abe2-179443ecb37e req-4c19a250-497f-485f-bd30-f25335f0665c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115545 Sep 25 01:08:15.855329 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 840/1613] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:15.871534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:15.876847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:15.896711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:15.903245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:15.908472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:15.909722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:15.913350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:15.914273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.339077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:16.362902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-173bc36b-aca2-4932-8fb8-7e82d18cd019 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/68ae382d-df4d-4783-8250-8e4a7976cd94" status: 202 len: 0 microversion: 2.1 time: 2.100267 Sep 25 01:08:16.364244 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c5bd56e-e4d9-4f70-9806-01b9b5d0647c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.507123 Sep 25 01:08:16.364926 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 841/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:15 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:16.367160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 774/1615] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:14 2022] DELETE /compute/v2.1/os-security-groups/68ae382d-df4d-4783-8250-8e4a7976cd94 => generated 0 bytes in 2105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:16.373110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:16.375305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:16.380586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] [instance: 49435307-0eef-4502-914e-25c74eb8a56f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:16.382664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:16.391620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.396538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.399365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.405674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.406704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.407298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.417425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.418242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.418879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.419794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.421880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.422566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.448105 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] HTTP exception thrown: Instance 49435307-0eef-4502-914e-25c74eb8a56f could not be found. Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Request method failure captured: Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f HTTP/1.1 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6mpwE3msOs4sT30fURw3N2_yiAJPYAm_iSwFzcai2G5LSLwe6Gql7Yi0WAXWoBVte3sGl7HwwkyUiP450_BCEUQpHN1R8zo8dFCIhXOyMrihRQ2P5AukV65No154pspc3Z4RO_Vj8vNnsNut4KnR9KptS6wKTkkfkgg7o4JpJ3hCPM Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 740928060bf443508f8165c0dfa50514 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestManualDisk-384985604 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/740928060bf443508f8165c0dfa50514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/740928060bf443508f8165c0dfa50514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/740928060bf443508f8165c0dfa50514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_740928060bf443508f8165c0dfa50514"}]}] Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestManualDisk-384985604 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 740928060bf443508f8165c0dfa50514 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestManualDisk-384985604 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestManualDisk-384985604-project Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 53d16cedecbe4634bf384effd09ca0a9 Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestManualDisk-384985604-project Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 49435307-0eef-4502-914e-25c74eb8a56f could not be found. Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '49435307-0eef-4502-914e-25c74eb8a56f'} Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49435307-0eef-4502-914e-25c74eb8a56f could not be found. Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49435307-0eef-4502-914e-25c74eb8a56f could not be found. Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:16.452841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49435307-0eef-4502-914e-25c74eb8a56f could not be found. Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.458135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Returning 404 to user: Instance 49435307-0eef-4502-914e-25c74eb8a56f could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:16.459579 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6de5685e-149f-4551-8399-8d0da394b131 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f" status: 404 len: 111 microversion: 2.1 time: 0.092327 Sep 25 01:08:16.460554 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 842/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:16 2022] GET /compute/v2.1/servers/49435307-0eef-4502-914e-25c74eb8a56f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:16.473295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c99bbbc8-e9e4-47c9-a694-dfd86755ec67 req-69a20373-bf04-406b-be98-097e5fc30322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49435307-0eef-4502-914e-25c74eb8a56f", "name": "network-vif-deleted", "tag": "36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:16.477305 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:16.499703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c99bbbc8-e9e4-47c9-a694-dfd86755ec67 req-69a20373-bf04-406b-be98-097e5fc30322 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.500471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c99bbbc8-e9e4-47c9-a694-dfd86755ec67 req-69a20373-bf04-406b-be98-097e5fc30322 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.501102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c99bbbc8-e9e4-47c9-a694-dfd86755ec67 req-69a20373-bf04-406b-be98-097e5fc30322 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.529845 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c99bbbc8-e9e4-47c9-a694-dfd86755ec67 req-69a20373-bf04-406b-be98-097e5fc30322 service nova] Creating event network-vif-deleted:36cac4bb-ec5d-46d5-a585-3adb3c3ad8fc for instance 49435307-0eef-4502-914e-25c74eb8a56f on n-h1-master-1 Sep 25 01:08:16.538833 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c99bbbc8-e9e4-47c9-a694-dfd86755ec67 req-69a20373-bf04-406b-be98-097e5fc30322 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075075 Sep 25 01:08:16.542394 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 843/1617] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:16.549870 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3dd3b77-52b9-4bd9-aee5-ac704cdde773 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.181392 Sep 25 01:08:16.561145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebd72280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:16.571294 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 775/1618] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:16 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:16.578075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d163f2d1-6747-4684-bce0-2b5608121293 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] Calling method '.version_select at 0x7f7beb9681f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:16.626501 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d163f2d1-6747-4684-bce0-2b5608121293 tempest-ServersTestManualDisk-384985604 tempest-ServersTestManualDisk-384985604-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933402221" status: 202 len: 0 microversion: 2.1 time: 0.053306 Sep 25 01:08:16.628348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 776/1619] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:08:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933402221 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:16.654019 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:08:16.654711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Neutron security group 70967ead-dccf-49f4-b9cf-4ec6918e805f not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:08:16.655333 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] HTTP exception thrown: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.655333 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Request method failure captured: Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-security-groups/70967ead-dccf-49f4-b9cf-4ec6918e805f HTTP/1.1 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6neO5367SsH1cCFrVY1pOrt9KOyNug8nJ4Zp5H4jtKBJ0LIeygSWY0xBmg3syyu4siDyDQdEr8W8T8mYP44cYtx3D8cUNLXrRzUbvNG188tmpYq2ptK9fJEtiNYtM4T66dTBQLh_ODgmUxHf96_sicUc03kJyXaH_tAy2YvgD3KzvQ Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ffd0399886514da993711579e359b8a8 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1931206549 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ffd0399886514da993711579e359b8a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ffd0399886514da993711579e359b8a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ffd0399886514da993711579e359b8a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ffd0399886514da993711579e359b8a8"}]}] Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1931206549 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ffd0399886514da993711579e359b8a8 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1931206549 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupRulesTestJSON-1931206549-project Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a67cebe536d64cca984a9c90d3a59589 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1931206549-project Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: exception: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '70967ead-dccf-49f4-b9cf-4ec6918e805f'} Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:08:16.675027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Returning 404 to user: Security group 70967ead-dccf-49f4-b9cf-4ec6918e805f does not exist Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-467e873b-e2c2-4f33-81cf-80cc8bd642d7'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:16.686628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-408a0229-8cde-4c8a-9ecb-b0145b8649fb tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/70967ead-dccf-49f4-b9cf-4ec6918e805f" status: 404 len: 194 microversion: 2.1 time: 0.134681 Sep 25 01:08:16.691839 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 844/1620] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:16 2022] DELETE /compute/v2.1/os-security-groups/70967ead-dccf-49f4-b9cf-4ec6918e805f => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:16.696891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ff990fd-907a-4051-a788-ebe109b5ad7c tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7beba464c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:16.756193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:16.762014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:16.788970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.795425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.799702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:16.803443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:16.805788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:16.808398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:17.239460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:17.255785 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-306ac8a7-d979-40de-ba91-68e49c48b781 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.501051 Sep 25 01:08:17.256625 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 845/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:16 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:17.343358 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ff990fd-907a-4051-a788-ebe109b5ad7c tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6394cca9-f50a-4eb6-a2c5-1add19306fb1" status: 202 len: 0 microversion: 2.1 time: 0.653420 Sep 25 01:08:17.343951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 777/1622] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:16 2022] DELETE /compute/v2.1/os-security-groups/6394cca9-f50a-4eb6-a2c5-1add19306fb1 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:17.352051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8722239b-fa3f-4ee4-8d87-e15c0b6447fe tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebcfa160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:17.403022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:17.405284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:17.436209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:17.440198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:17.442188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:17.446281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:17.447260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:17.467511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:17.986046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:18.007208 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f83f9219-6b29-49e4-b779-e0c0cc21ef55 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.612263 Sep 25 01:08:18.008859 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 778/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:17 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:18.028848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8722239b-fa3f-4ee4-8d87-e15c0b6447fe tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b027c0cc-85e0-449a-b78c-d97de4576a7a" status: 202 len: 0 microversion: 2.1 time: 0.671870 Sep 25 01:08:18.034976 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 846/1624] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:17 2022] DELETE /compute/v2.1/os-security-groups/b027c0cc-85e0-449a-b78c-d97de4576a7a => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:18.041207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c966ed7f-02cf-4f77-bad0-480d6da0703e tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebd72b80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:18.217614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:18.222306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:18.238472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:18.239547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:18.241198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:18.242602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:18.243456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:18.244103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:18.318161 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-868aa507-4546-4540-899f-e25779d07075 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.306958 Sep 25 01:08:18.326367 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 779/1625] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:18 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 197 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:18.332801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:18.333502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:18.341757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:18.342504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:18.342961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:18.343675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:18.344126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:18.345199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:18.431753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c966ed7f-02cf-4f77-bad0-480d6da0703e tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4d27722c-239f-4441-8004-df4662f2e7ee" status: 202 len: 0 microversion: 2.1 time: 0.395090 Sep 25 01:08:18.432711 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 847/1626] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:18 2022] DELETE /compute/v2.1/os-security-groups/4d27722c-239f-4441-8004-df4662f2e7ee => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:18.454201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f500332d-222d-471e-9bb5-d1a8ffe91f50 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebd06550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:18.696250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:18.734365 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d24f304e-d077-4d98-a2d8-ee8b95d2a776 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.406244 Sep 25 01:08:18.753774 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 780/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:18 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:19.036424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:19.037048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:19.054975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:19.055490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:19.055938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:19.056674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:19.070122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:19.070917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:20.287587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:20.300941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8143f16e-6ba9-40f0-bdef-b17882de0242 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 1.268361 Sep 25 01:08:20.320841 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 781/1628] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:19 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:20.336120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:20.339206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:20.356304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:20.356815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:20.357267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:20.358038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:20.358499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:20.358934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:20.421214 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-90cc2a6b-d166-42d7-8ab1-cc1d02a66c69 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.089378 Sep 25 01:08:20.428192 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 782/1629] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:08:20 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:20.435189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:20.436083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:20.443913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:20.444327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:20.445590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:20.447569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:20.447569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:20.447569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:20.463237 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f500332d-222d-471e-9bb5-d1a8ffe91f50 tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b3020a68-a1d7-48cf-9f3d-c99471857e4b" status: 202 len: 0 microversion: 2.1 time: 2.023428 Sep 25 01:08:20.464248 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 848/1630] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:18 2022] DELETE /compute/v2.1/os-security-groups/b3020a68-a1d7-48cf-9f3d-c99471857e4b => generated 0 bytes in 2025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:20.472312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8df57b3a-a0c6-49c8-b174-1146248ad58b tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] Calling method '.version_select at 0x7f7bebd725e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:21.430360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:21.451653 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8635666c-d985-428f-bce3-16eb2b79d0d0 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 1.009025 Sep 25 01:08:21.452526 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 783/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:20 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:21.466458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:21.469074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:21.488865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:21.489634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:21.490085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:21.490932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:21.493996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:21.494846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:21.791035 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8df57b3a-a0c6-49c8-b174-1146248ad58b tempest-SecurityGroupRulesTestJSON-1931206549 tempest-SecurityGroupRulesTestJSON-1931206549-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9284b48f-5605-4ec8-9c8d-1e950e4ecb25" status: 202 len: 0 microversion: 2.1 time: 1.322518 Sep 25 01:08:21.792012 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 849/1632] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:08:20 2022] DELETE /compute/v2.1/os-security-groups/9284b48f-5605-4ec8-9c8d-1e950e4ecb25 => generated 0 bytes in 1324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:08:22.166134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:22.206259 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-47fd0927-5a0b-46cd-a431-ab0cafd1ab07 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.748075 Sep 25 01:08:22.255885 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 784/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:21 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:22.484485 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:22.486287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:22.512967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:22.514277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:22.514908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:22.517185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:22.518203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:22.518836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:23.266356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:23.267091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:23.277371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:23.278296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:23.279590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:23.280658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:23.281320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:23.282666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:23.349438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:23.359861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe323173-d8bd-4857-9c96-e6b80d2a63cb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.885286 Sep 25 01:08:23.377752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 850/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:22 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:24.242096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f761bd4-577c-41a0-9a22-98e4cfb0c194 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Action: 'create', calling method: .version_select at 0x7f7bebbf8ee0>, body: {"keypair": {"name": "tempest-keypair-1312017565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh8guy657E4uAnnHErbiH1cmBTRWW1zKH/GTHdKu/QUSt8syJBAHClUb3xm3rkFOD5P4LdgB7vpowhUUX1LGEwqnznGb53+9zRs8u0l1gFMs9o6LnfNPBU94wYAWlasVw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:24.288068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9f761bd4-577c-41a0-9a22-98e4cfb0c194 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Getting quotas for project ece9c2b6ca644160ad4c5fb7e1131c14. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:08:24.296903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9f761bd4-577c-41a0-9a22-98e4cfb0c194 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Getting quotas for user 9164864381494d9991fd97410bedea72 and project ece9c2b6ca644160ad4c5fb7e1131c14. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:08:24.353754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f761bd4-577c-41a0-9a22-98e4cfb0c194 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.272220 Sep 25 01:08:24.355946 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 851/1635] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:08:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:24.402590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:24.404868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:24.434118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:24.436577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:24.437798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:24.439673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:24.440586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:24.441360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:24.508084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:24.520117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08c1a52b-68b3-4b49-a258-b5ac08d50c21 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 1.256320 Sep 25 01:08:24.520756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 785/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:23 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:24.864962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:24.881826 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1654186f-a926-468f-85ec-575035544c38 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.489024 Sep 25 01:08:24.882487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 852/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:24 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:25.124422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-56b253ee-304d-4c46-b754-723a901dda8d req-16f95103-4d30-4991-b323-0386f15abf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15cf5b07-3309-44b0-a5cd-519a143b5f99", "name": "network-vif-plugged", "status": "completed", "tag": "f7772c81-4c40-49b6-bd17-9ed8844bfdd5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:25.144069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-56b253ee-304d-4c46-b754-723a901dda8d req-16f95103-4d30-4991-b323-0386f15abf21 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:25.146713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-56b253ee-304d-4c46-b754-723a901dda8d req-16f95103-4d30-4991-b323-0386f15abf21 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:25.151733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-56b253ee-304d-4c46-b754-723a901dda8d req-16f95103-4d30-4991-b323-0386f15abf21 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:25.178602 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-56b253ee-304d-4c46-b754-723a901dda8d req-16f95103-4d30-4991-b323-0386f15abf21 service nova] Creating event network-vif-plugged:f7772c81-4c40-49b6-bd17-9ed8844bfdd5 for instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 on n-h2-master-1 Sep 25 01:08:25.198559 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-56b253ee-304d-4c46-b754-723a901dda8d req-16f95103-4d30-4991-b323-0386f15abf21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077837 Sep 25 01:08:25.200138 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 786/1638] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:25.555792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:25.558147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:25.594812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:25.596786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:25.597854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:25.601540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:25.609561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:25.610994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:25.909198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:25.910295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:25.931844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:25.932777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:25.933606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:25.934446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:25.935011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:25.935549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:26.097344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:26.111064 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a72cde9-0b46-4730-b905-42de4ca4a436 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.569452 Sep 25 01:08:26.114669 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 853/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:25 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:26.466893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:26.476220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01e84f68-4f41-406a-87d7-52a3df592347 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1367 microversion: 2.1 time: 0.571332 Sep 25 01:08:26.478327 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 787/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:25 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:27.145756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:27.153764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:27.184585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:27.185257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:27.186200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:27.187016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:27.187623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:27.187892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:27.501792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:27.502583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:27.548185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:27.548756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:27.552571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:27.553547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:27.553992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:27.558145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:28.328072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:28.379665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b877ac3b-bbc3-4a55-8ea8-54889c5b351e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 1.240211 Sep 25 01:08:28.380969 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 854/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:27 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:28.549658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:28.567491 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92ba6e7a-ead4-4fc2-bbff-8f99b0dab889 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1557 microversion: 2.1 time: 1.069019 Sep 25 01:08:28.571006 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 788/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:27 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1557 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:28.593783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:28.594597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:28.601334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:28.602163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:28.602810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:28.603884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:28.604531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:28.605149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:28.869363 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95edd8cf-443b-4ce1-9f38-5461af889e35 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.279517 Sep 25 01:08:28.870024 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 855/1643] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:08:28 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:29.404484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:29.405133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:29.418741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:29.419241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:29.419678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:29.420408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:29.420863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:29.421291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:30.069154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:30.081017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e789cf7c-d2f6-4a59-bb3d-133835ad052f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1713 microversion: 2.1 time: 0.680297 Sep 25 01:08:30.083946 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 789/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:29 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1713 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:30.930229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-303423613", "imageRef": "afe8a23c-7504-47a2-a515-5bfc0879a694", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b81e12f5-3942-4fc2-93e2-d120bab72f9f"}], "security_groups": [{"name": "tempest-securitygroup--24107628"}], "key_name": "tempest-keypair-1312017565", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:31.108258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:31.108881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:31.141776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:31.147755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:31.149201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:31.151064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:31.154066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:31.155482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:31.737063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] validate_networks() for [('b81e12f5-3942-4fc2-93e2-d120bab72f9f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:08:32.535779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:32.552462 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ccf16833-9e11-41de-8b26-5bd93a74f316 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1703 microversion: 2.1 time: 1.449791 Sep 25 01:08:32.554753 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 790/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:31 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1703 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:32.581886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b4be11d-d50a-41e8-b2c0-4081f7ad127b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '.version_select at 0x7f7bebb8d5e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:32.592664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4be11d-d50a-41e8-b2c0-4081f7ad127b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:32.594339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4be11d-d50a-41e8-b2c0-4081f7ad127b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:32.595568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b4be11d-d50a-41e8-b2c0-4081f7ad127b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:32.617117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1b4be11d-d50a-41e8-b2c0-4081f7ad127b tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2320 microversion: 2.1 time: 0.042408 Sep 25 01:08:32.620619 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 791/1646] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:08:32 2022] GET /compute/v2.1/os-migrations => generated 2320 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:32.637617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:32.638259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:32.648656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:32.649348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:32.649826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:32.654211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:32.655693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:32.656463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.176965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33618683-5099-48f7-a440-591fa6c13704 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1854 microversion: 2.1 time: 0.545402 Sep 25 01:08:33.181998 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 792/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:32 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1854 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:33.203486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:33.206893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:33.222616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:33.226308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:33.227752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:08:33.228335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:08:33.228764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:08:33.229243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:08:33.229694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:08:33.230767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.234010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:33.234561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:33.236579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.256638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:33.257463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:33.258377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.260574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:33.261294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:33.262258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.301794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Getting quotas for project ece9c2b6ca644160ad4c5fb7e1131c14. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:08:33.312315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Getting quotas for user 9164864381494d9991fd97410bedea72 and project ece9c2b6ca644160ad4c5fb7e1131c14. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:08:33.332670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:08:33.336224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='afe8a23c-7504-47a2-a515-5bfc0879a694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:08:33.500674 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13c2a319-dbd2-41d1-af4c-781d89a92d28 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1854 microversion: 2.1 time: 0.304024 Sep 25 01:08:33.521119 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 793/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:33 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1854 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:33.539396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-65530b33-dba4-4259-8890-344f6347c51e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.615676 Sep 25 01:08:33.546707 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 856/1649] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:08:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 2619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:08:33.552679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d92b6f34-8d97-45a4-aa2a-226acdfd7f53 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:33.554045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d92b6f34-8d97-45a4-aa2a-226acdfd7f53 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:33.665248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d92b6f34-8d97-45a4-aa2a-226acdfd7f53 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:33.677098 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d92b6f34-8d97-45a4-aa2a-226acdfd7f53 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1245 microversion: 2.1 time: 0.128353 Sep 25 01:08:33.680835 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 794/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:33 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:33.708136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:33.709281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:33.717790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:33.718853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:33.719549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.720527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:33.721226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:33.722078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:33.937444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lazy-loading 'services' on Instance uuid d848e47a-66a6-4630-ad21-d24380ffc726 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:34.018851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c9351626-3843-480f-9183-bbc45191ccd1 req-8b56e039-f936-4bc9-a5ef-5e22140accbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15cf5b07-3309-44b0-a5cd-519a143b5f99", "tag": "f7772c81-4c40-49b6-bd17-9ed8844bfdd5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:34.051898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c9351626-3843-480f-9183-bbc45191ccd1 req-8b56e039-f936-4bc9-a5ef-5e22140accbf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:34.052446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c9351626-3843-480f-9183-bbc45191ccd1 req-8b56e039-f936-4bc9-a5ef-5e22140accbf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:34.053097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c9351626-3843-480f-9183-bbc45191ccd1 req-8b56e039-f936-4bc9-a5ef-5e22140accbf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:34.074097 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c9351626-3843-480f-9183-bbc45191ccd1 req-8b56e039-f936-4bc9-a5ef-5e22140accbf service nova] Creating event network-changed:f7772c81-4c40-49b6-bd17-9ed8844bfdd5 for instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 on n-h2-master-1 Sep 25 01:08:34.094719 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c9351626-3843-480f-9183-bbc45191ccd1 req-8b56e039-f936-4bc9-a5ef-5e22140accbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084122 Sep 25 01:08:34.096419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 795/1651] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:34.147899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fadac79e-77e8-40a0-a106-38fcba9dd1f5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments/de9cde2c-c5cf-478e-a460-3f1669588dc7" status: 202 len: 0 microversion: 2.1 time: 0.443256 Sep 25 01:08:34.153957 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 857/1652] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:08:33 2022] DELETE /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments/de9cde2c-c5cf-478e-a460-3f1669588dc7 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:08:34.163164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:34.165494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:34.185124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:34.185689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:34.186145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:34.186882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:34.187538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:34.188152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:34.282767 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f0d3a7c-1d82-40f2-ada7-f7a492b157dd tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125483 Sep 25 01:08:34.290093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 796/1653] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:34 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:34.704427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:34.705754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:34.722490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:34.722992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:34.723654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:34.725517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:34.730007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:34.731130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:34.869304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:34.891094 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6c78d1e-79bb-4ebe-ac6f-739d5b71ca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1249 microversion: 2.1 time: 0.186587 Sep 25 01:08:34.892330 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 858/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:34 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1249 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:35.295731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:35.298827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:35.312102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.317326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.318122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:35.319136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.319883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.326188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:35.371227 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:35.395911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-695b3453-4982-4867-9816-6930e05a0355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104168 Sep 25 01:08:35.398504 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 797/1655] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:35 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:35.923309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:35.930758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:35.967830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.971180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.972163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:35.978207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.979029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.982276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:36.352151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:36.364352 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-71f74fe7-ff4f-4136-a24c-547504e3b6de tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1305 microversion: 2.1 time: 0.451728 Sep 25 01:08:36.366003 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 859/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:35 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1305 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:36.421318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:36.425074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:36.435037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:36.436113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:36.436743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:36.438049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:36.438766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:36.439477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:36.489279 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18c2034f-d16f-4cc7-a58f-9cfd35fad842 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081833 Sep 25 01:08:36.490612 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 798/1657] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:36 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:37.392795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:37.394251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:37.422392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:37.423113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:37.425642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:37.426616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:37.430293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:37.430933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:37.504575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:37.506886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:37.530650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:37.531273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:37.531732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:37.534547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:37.535047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:37.543683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:37.659057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-637e8a63-fb55-4e85-bf30-256b38e326cc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159477 Sep 25 01:08:37.669612 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 799/1658] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:37 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:38.677520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:38.684817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:38.760205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:38.762137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:38.777252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:38.791087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:38.792618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:38.793458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:38.936387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2f3d3ac0-233c-4ad3-bbbf-e71b522beb79 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260537 Sep 25 01:08:38.937041 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 800/1659] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:38 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:39.090665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:39.107240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed763539-4888-44b9-9e0a-4f091b969960 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1303 microversion: 2.1 time: 1.722205 Sep 25 01:08:39.118861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 860/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:37 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1303 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:39.970246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:39.975336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:40.039492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:40.043012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:40.044155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:40.044965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:40.048761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:40.049218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:40.146250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:40.147047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:40.195277 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-307b03b3-1acc-488d-9351-a16cf89dccc8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247321 Sep 25 01:08:40.197967 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 801/1661] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:39 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:40.203558 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:40.205431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:40.215927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:40.224833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:40.225776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:40.226347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:40.226875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:40.622409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:40.652310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad581bcd-bffc-4115-af98-b166039a4c81 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1303 microversion: 2.1 time: 0.510386 Sep 25 01:08:40.661788 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 861/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:40 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1303 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:41.210760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:41.217154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:41.239216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:41.239716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:41.240153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:41.243029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:41.243494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:41.245950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:41.391313 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61665c71-c707-4eb5-8d06-43f926e1ab51 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180073 Sep 25 01:08:41.397313 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 802/1663] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:41 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:41.679836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:41.681196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:41.704090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:41.705746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:41.709637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:41.710760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:41.711466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:41.712382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:42.422280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:42.426416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:42.443891 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:42.448930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:42.455617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:42.456958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:42.459979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:42.468702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:42.484879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:42.652257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7eb0a0ef-ac4a-43c4-97bd-2c3fcb356fa5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248073 Sep 25 01:08:42.653621 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 803/1664] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:42 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:43.240957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:43.272829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6be28288-c1b3-42ef-b1ff-55cfb25d0295 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 1.589361 Sep 25 01:08:43.277845 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 862/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:41 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:43.668055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:43.672424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:43.681380 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:43.689025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:43.690093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:43.693887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:43.698702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:43.699675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:43.700377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:43.826420 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6cca7353-1ab8-4910-8cce-616b6bdb2b13 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163699 Sep 25 01:08:43.831358 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 804/1666] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:43 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:44.297758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:44.298334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:44.313070 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:44.315637 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:44.322921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:44.334453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:44.335867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:44.340893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:44.346178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:44.346943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:44.845333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:44.847761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:44.893185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:44.893834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:44.904605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:44.918700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:44.920066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:44.920315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:45.146862 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79da28e9-1bc2-49ff-81f0-3d40ec2ef370 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.306248 Sep 25 01:08:45.155756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 805/1667] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:44 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:45.648662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:45.656490 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:45.672532 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b79b4ddc-b1ae-4540-b6ef-fb72d2d85850 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 1.379381 Sep 25 01:08:45.678861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 863/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:44 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:46.160319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:46.165736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:46.187888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:46.189260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:46.194000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:46.199711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:46.205345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:46.209874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:46.400592 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b5baee1-4160-4ca2-b58d-4e553acf4f75 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232426 Sep 25 01:08:46.401450 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 806/1669] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:46 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:46.705492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:46.706125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:46.719532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:46.720331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:46.722074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:46.724784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:46.725560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:46.727478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:47.416330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:47.422136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:47.455876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:47.457095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:47.457791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:47.458722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:47.463408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:47.464207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:47.615935 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b30f7f5-e361-4daa-877b-cbbc57151f03 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204836 Sep 25 01:08:47.624059 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 807/1670] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:47 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:08:48.633809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:48.636800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:48.645312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:48.686714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:48.689372 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ccb2ffc-3702-48dc-9e98-978806aa265b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 1.989262 Sep 25 01:08:48.690507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:48.690976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:48.691739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:48.693328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 864/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:46 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:48.711374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:48.711858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:48.875582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-741668a5-9ad6-4bc3-a2e1-5b4ae5291c89 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.247363 Sep 25 01:08:48.900043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 808/1672] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:08:48 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726/os-volume_attachments => generated 25 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:08:49.719460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:49.720339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:49.745314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:49.747763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:49.748261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:49.752985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:49.753556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:49.754008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:50.639035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:50.653752 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7645966e-526c-43e4-86aa-a541edda1eff tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 0.938761 Sep 25 01:08:50.666394 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 865/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:49 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:51.692807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:51.693391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:51.719687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:51.720379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:51.723922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:51.728591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:51.735395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:51.761512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:52.111574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8c3d5b3e-a65b-4d68-94ca-2428e348b285 req-9c87b495-cd77-4393-b422-59d05b35e11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4", "tag": "59eb7962-89d5-45de-8d28-18934ae89544"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:52.157623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8c3d5b3e-a65b-4d68-94ca-2428e348b285 req-9c87b495-cd77-4393-b422-59d05b35e11a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:52.163152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8c3d5b3e-a65b-4d68-94ca-2428e348b285 req-9c87b495-cd77-4393-b422-59d05b35e11a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:52.168604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8c3d5b3e-a65b-4d68-94ca-2428e348b285 req-9c87b495-cd77-4393-b422-59d05b35e11a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:52.254879 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8c3d5b3e-a65b-4d68-94ca-2428e348b285 req-9c87b495-cd77-4393-b422-59d05b35e11a service nova] Creating event network-changed:59eb7962-89d5-45de-8d28-18934ae89544 for instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 on n-h1-master-1 Sep 25 01:08:52.318184 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8c3d5b3e-a65b-4d68-94ca-2428e348b285 req-9c87b495-cd77-4393-b422-59d05b35e11a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202873 Sep 25 01:08:52.319973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 866/1674] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:08:53.876334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:53.902855 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9160ed1-2d58-497b-a788-092781d2a83b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 2.213795 Sep 25 01:08:53.911022 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 809/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:51 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:54.958461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:54.960343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:54.990120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:54.990613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:54.991059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:54.991777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:55.001561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:55.002055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:55.506795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1738ef0a-c763-42f4-813f-338e0c2868c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebdf9e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1680328593", "description": "tempest-description-1377667110"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:56.328161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:56.346665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54d43b79-c179-4847-a70e-2bf5830bc0c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 1.389601 Sep 25 01:08:56.366139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 867/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:54 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:56.378922 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1738ef0a-c763-42f4-813f-338e0c2868c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.158705 Sep 25 01:08:56.389207 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 810/1677] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:08:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:56.394603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8687ed91-8d8c-46d1-bf10-4f903efcb88e tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7beb96d1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-410136719", "description": "tempest-description-1952257078"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:56.519191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1959680843", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "c677bab1-f1c2-4779-9be9-e9f4a96e4185"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:56.625138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] validate_networks() for [('c677bab1-f1c2-4779-9be9-e9f4a96e4185', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:08:57.763824 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8687ed91-8d8c-46d1-bf10-4f903efcb88e tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.373601 Sep 25 01:08:57.764753 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 811/1678] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:08:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:57.770413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:57.771437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:57.799639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:57.801023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:57.801540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:57.802430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:57.810467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:57.810844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:58.429289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:08:58.430037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:08:58.430947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:08:58.431610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:08:58.432215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:08:58.458075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:58.458579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:58.459027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:58.459772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:58.460513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:58.461153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:58.503366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Getting quotas for project cf45958b75704ca785e000efe1060c47. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:08:58.511079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Getting quotas for user c3512a52716f45cd9998337fb133c84f and project cf45958b75704ca785e000efe1060c47. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:08:58.581275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:08:58.586376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:08:58.669660 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3a177fc-e508-4f7a-9d0a-e8a357937a2d tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301584 Sep 25 01:08:58.670735 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 868/1679] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:08:58.676066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1241459917", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "1516f0ed-2f80-4a66-a6d1-d31c9b9f8f97"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:58.752349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] validate_networks() for [('1516f0ed-2f80-4a66-a6d1-d31c9b9f8f97', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:08:58.937211 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:08:58.937744 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 01:08:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 (ip 10.222.0.16) !!! Sep 25 01:08:59.577462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:59.623539 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-234e9c40-d853-49ca-9044-a084290bca3d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 1.857203 Sep 25 01:08:59.627561 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 812/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:57 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:59.651382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:59.654509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:59.707705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:59.708610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:59.712637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:59.716283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:59.717213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:59.719201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:00.207959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:00.226004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ac2ac89-f223-424e-8c44-8a570e8ac0d8 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1229 microversion: 2.1 time: 0.591012 Sep 25 01:09:00.245848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 813/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:59 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1229 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:00.657253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:00.658454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:00.671594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:00.678992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:00.679747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:00.681352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:00.682014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:00.682537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.187348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:01.204713 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f1fce3ef-67b0-44b1-9658-3e7e8af2d858 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 0.552687 Sep 25 01:09:01.208456 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 814/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:00 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:01.254718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:01.256222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:01.271154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:01.272659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:01.273318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.274280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:01.275252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:01.275901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.293147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:01.299020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:01.300991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:01.302483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:01.303110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:01.365622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:01.366499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:01.372489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.377438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:01.379883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:01.396085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.456278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Getting quotas for project fd330b26476d45a49805765808323420. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:01.463199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Getting quotas for user 7f9c70d4db7246bf97a29ec68f86c92a and project fd330b26476d45a49805765808323420. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:01.479999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:01.483573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:01.545063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:01.549269 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:01.569421 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6bf10e3-4166-403e-8be6-58a2f708f4ab tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1277 microversion: 2.1 time: 0.311957 Sep 25 01:09:01.570116 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 815/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:01 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:01.601995 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f8a3c90-eadf-46a9-8eab-0c49458190cd tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930071 Sep 25 01:09:01.608698 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 869/1684] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:09:01.637114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86d53660-5401-49d7-881a-3fbca04dd0ee tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:01.637963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86d53660-5401-49d7-881a-3fbca04dd0ee tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:01.894310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-86d53660-5401-49d7-881a-3fbca04dd0ee tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:01.911019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86d53660-5401-49d7-881a-3fbca04dd0ee tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1216 microversion: 2.1 time: 0.279606 Sep 25 01:09:01.915658 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 816/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:01 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:02.246936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:02.247843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:02.255842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:02.257543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:02.258289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:02.260751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:02.262227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:02.262970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:02.599162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:02.599911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:02.650070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:02.650971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:02.651432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:02.652191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:02.652654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:02.653087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:02.666388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:02.682450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ea2d9b9-9660-421a-82c2-c3970cbce94b tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 0.442239 Sep 25 01:09:02.683429 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 870/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:02 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:02.889957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2104534985", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cea0503a-4e97-4488-af7a-4679bb5e5ef8"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:03.054408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] validate_networks() for [('cea0503a-4e97-4488-af7a-4679bb5e5ef8', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:09:03.205945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:03.232726 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2d00fe5-468b-4a6d-8f15-b7c4f7f15273 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1283 microversion: 2.1 time: 0.635565 Sep 25 01:09:03.233366 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 817/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:02 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1283 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:03.257193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-df5be328-2123-409a-93e3-42b6877cd60e req-4646f95f-4160-49c6-8db7-4f1952c3c1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4", "name": "network-vif-plugged", "status": "completed", "tag": "59eb7962-89d5-45de-8d28-18934ae89544"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:03.293995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-df5be328-2123-409a-93e3-42b6877cd60e req-4646f95f-4160-49c6-8db7-4f1952c3c1b9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:03.294759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-df5be328-2123-409a-93e3-42b6877cd60e req-4646f95f-4160-49c6-8db7-4f1952c3c1b9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:03.295198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-df5be328-2123-409a-93e3-42b6877cd60e req-4646f95f-4160-49c6-8db7-4f1952c3c1b9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:03.324491 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-df5be328-2123-409a-93e3-42b6877cd60e req-4646f95f-4160-49c6-8db7-4f1952c3c1b9 service nova] Creating event network-vif-plugged:59eb7962-89d5-45de-8d28-18934ae89544 for instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 on n-h1-master-1 Sep 25 01:09:03.330628 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-df5be328-2123-409a-93e3-42b6877cd60e req-4646f95f-4160-49c6-8db7-4f1952c3c1b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095689 Sep 25 01:09:03.333726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 818/1688] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:03.345500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:03.347923 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:03.356340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:03.357052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:03.357772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:03.358761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:03.359457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:03.360099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:03.628284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:03.659622 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1da72c2f-01a2-4e86-8f54-2bdbd80dadd5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1268 microversion: 2.1 time: 0.317488 Sep 25 01:09:03.660332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 819/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:03 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1268 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:03.714751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:03.716426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:03.730866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:03.731459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:03.733534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:03.734509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:03.736168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:03.736734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:04.615510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:04.637820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3e6a9a2-22c9-4107-8f50-b09995580115 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1369 microversion: 2.1 time: 0.931821 Sep 25 01:09:04.650481 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 820/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:03 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1369 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:04.676164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1999896213", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "defca061-1fc0-4eb4-a3fe-f0e809a541e4"}], "block_device_mapping_v2": [{"uuid": "3d4ed382-5908-4c26-84d2-63bf859224d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:04.820336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] validate_networks() for [('defca061-1fc0-4eb4-a3fe-f0e809a541e4', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:09:04.970952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:04.971533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:04.972374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:04.973066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:04.973771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:04.997832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:05.001201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:05.004160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:05.005389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:05.006169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:05.008285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:05.059863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Getting quotas for project e310970d7ec54c99a3d719824c6be1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:05.068078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Getting quotas for user f3931162a615421f8843396650368870 and project e310970d7ec54c99a3d719824c6be1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:05.088281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:05.090718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:05.205557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f0b3956-4d66-4535-9aee-0d28b634bd74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.518406 Sep 25 01:09:05.208516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 871/1691] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:09:05.223832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:05.225557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:05.237033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:05.237795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:05.242528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:05.243776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:05.247499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:05.248886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.291547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:06.320088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bf3975c-3cd5-4a2c-9587-c3d7eab237fe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 1.110204 Sep 25 01:09:06.322749 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 872/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:05 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:06.329708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:06.330494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:06.337921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:06.338574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:06.339143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.339979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:06.340556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:06.341143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.934286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:06.934771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:06.935186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:06.935600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:06.936021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:06.949225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:06.950182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:06.950880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.951820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:06.954226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:06.954860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.958093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:06.978520 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a55e7847-3fde-4359-b05a-f95ec3adcdcc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.650851 Sep 25 01:09:06.980568 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 873/1693] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:06 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:06.993801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:06.994859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:07.001732 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:07.008065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Getting quotas for user 545456a4a4e540be9138c47b0df77bbf and project 868947b52a1d48d6be6e81a2b8718441. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:07.011128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.014791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.015495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:07.018185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.018857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.019694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:07.129960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:07.132897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d4ed382-5908-4c26-84d2-63bf859224d2',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:07.178729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:07.189992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c4f09c1-4ba1-48df-9f39-e16221d4e656 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1270 microversion: 2.1 time: 0.203895 Sep 25 01:09:07.191386 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 874/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:06 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:07.197469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:07.198382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:07.205282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.206070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.206686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:07.207928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.208586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.209190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:07.466738 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-509be3e5-6ccf-4c47-8bf7-d2c734904a5c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.815107 Sep 25 01:09:07.467787 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 821/1695] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:09:07.490914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:07.492266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:07.514876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.516055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.517184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:07.518534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.520851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.522218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.010917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.026119 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-78a226aa-07f7-48ae-8e7a-65465c05387b tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.547750 Sep 25 01:09:08.029044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 822/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:07 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:08.034507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45df6ec7-7340-4913-8df0-99c64202ebe5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:08.036754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45df6ec7-7340-4913-8df0-99c64202ebe5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:08.041081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.056344 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f1db32f-30cc-446a-9930-5aefcbc49f37 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1555 microversion: 2.1 time: 0.863305 Sep 25 01:09:08.059511 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 875/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:07 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1555 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:08.092810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-360952ac-c1da-492f-b8b6-6f3e66e42411 req-ec7f69c9-21ef-4958-a071-e4e470e363b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac", "tag": "22ad6343-e39c-400e-889a-f1fbc77161c3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:08.139667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-360952ac-c1da-492f-b8b6-6f3e66e42411 req-ec7f69c9-21ef-4958-a071-e4e470e363b4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.140316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-360952ac-c1da-492f-b8b6-6f3e66e42411 req-ec7f69c9-21ef-4958-a071-e4e470e363b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.140778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-360952ac-c1da-492f-b8b6-6f3e66e42411 req-ec7f69c9-21ef-4958-a071-e4e470e363b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.189487 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-360952ac-c1da-492f-b8b6-6f3e66e42411 req-ec7f69c9-21ef-4958-a071-e4e470e363b4 service nova] Creating event network-changed:22ad6343-e39c-400e-889a-f1fbc77161c3 for instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac on n-h1-master-1 Sep 25 01:09:08.207255 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-360952ac-c1da-492f-b8b6-6f3e66e42411 req-ec7f69c9-21ef-4958-a071-e4e470e363b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138177 Sep 25 01:09:08.208692 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 876/1698] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:08.219421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:08.220151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:08.237882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.238394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.238853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.239594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.245816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.246921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.447671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45df6ec7-7340-4913-8df0-99c64202ebe5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.497654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45df6ec7-7340-4913-8df0-99c64202ebe5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.502740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45df6ec7-7340-4913-8df0-99c64202ebe5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.504326 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45df6ec7-7340-4913-8df0-99c64202ebe5 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1104 microversion: 2.25 time: 0.473765 Sep 25 01:09:08.506454 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 823/1699] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:08 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1104 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:08.528627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:08.533650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:08.552546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.554724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.558170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.559645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.562503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.567898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.827599 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bac37141-c604-4768-9653-2a9ca678604e tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.319218 Sep 25 01:09:08.828594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 824/1700] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:09:08 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-interface => generated 285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:08.834511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-427c34a1-30fc-4c56-b7eb-42d0e7c13f0a req-6f984492-5764-45fb-943a-efa80e87e47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f02266b-a0ae-4d1b-993b-4a437bdca5bf", "tag": "b95d435b-92b2-4212-abe5-d44112def539"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:08.865162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-427c34a1-30fc-4c56-b7eb-42d0e7c13f0a req-6f984492-5764-45fb-943a-efa80e87e47d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.866071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-427c34a1-30fc-4c56-b7eb-42d0e7c13f0a req-6f984492-5764-45fb-943a-efa80e87e47d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.870100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-427c34a1-30fc-4c56-b7eb-42d0e7c13f0a req-6f984492-5764-45fb-943a-efa80e87e47d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.888671 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-427c34a1-30fc-4c56-b7eb-42d0e7c13f0a req-6f984492-5764-45fb-943a-efa80e87e47d service nova] Creating event network-changed:b95d435b-92b2-4212-abe5-d44112def539 for instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf on n-h2-master-1 Sep 25 01:09:08.903043 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-427c34a1-30fc-4c56-b7eb-42d0e7c13f0a req-6f984492-5764-45fb-943a-efa80e87e47d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072389 Sep 25 01:09:08.904263 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 825/1701] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:08.912712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:08.913932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:08.923070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.923875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.924512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.928930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:08.929762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:08.930615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.954863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.967585 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92e60126-ec87-4f25-98cb-6571b0cdd13d tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.752433 Sep 25 01:09:08.968190 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 877/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:08 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:09.060915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:09.062470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:09.068718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.069483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.070095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.071530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.072509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.073177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.084557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.097830 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02c2bf99-a1b1-4259-bf5d-fef2679bfb80 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1276 microversion: 2.1 time: 0.191057 Sep 25 01:09:09.110459 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 826/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:08 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:09.435029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.453705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60acfd8d-b5fd-4be7-bb22-1a489980adbe tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.397257 Sep 25 01:09:09.463651 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 878/1704] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:09 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:09.537331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:09.538397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:09.575541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.576710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.577542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.578553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.579405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.579834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.707024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.739425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.741323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.742524 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc35dbcf-6144-42b5-b99d-2412190c4fea tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1233 microversion: 2.25 time: 0.211788 Sep 25 01:09:09.744333 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 827/1705] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:09 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1233 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:09.992176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:09.993262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:10.000621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.001450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.002153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.003237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.003923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.004580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.125275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:10.126017 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:10.135211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.136021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.136687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.138302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.138967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.139726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.259439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.269991 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69626867-d2a7-48cf-a1a6-cc0276071a6b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.282209 Sep 25 01:09:10.270588 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 879/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:09 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:10.299421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a1008c40-b7c2-4aa9-8121-6828e2967390 req-db20fe04-3841-4423-a788-ad642f0a766d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4", "tag": "59eb7962-89d5-45de-8d28-18934ae89544"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:10.312419 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:10.315359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a1008c40-b7c2-4aa9-8121-6828e2967390 req-db20fe04-3841-4423-a788-ad642f0a766d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.316125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a1008c40-b7c2-4aa9-8121-6828e2967390 req-db20fe04-3841-4423-a788-ad642f0a766d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.317096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a1008c40-b7c2-4aa9-8121-6828e2967390 req-db20fe04-3841-4423-a788-ad642f0a766d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.332718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a1008c40-b7c2-4aa9-8121-6828e2967390 req-db20fe04-3841-4423-a788-ad642f0a766d service nova] Creating event network-changed:59eb7962-89d5-45de-8d28-18934ae89544 for instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 on n-h1-master-1 Sep 25 01:09:10.340195 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a1008c40-b7c2-4aa9-8121-6828e2967390 req-db20fe04-3841-4423-a788-ad642f0a766d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044583 Sep 25 01:09:10.340809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 880/1707] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:10.342376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.353443 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1866b3c3-6d97-4b70-b1f2-69bf654a26ae tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.232524 Sep 25 01:09:10.354713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 828/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:10 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:10.479608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:10.481101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:10.489367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.500354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.502911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.503883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.506055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.506715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.769318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:10.770233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:10.788690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.789525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.790211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.791202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.791836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.792448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.929909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.957889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.959473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.964175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd31b2ac-e206-4ef0-8b3d-65314b0922cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1241 microversion: 2.25 time: 0.195813 Sep 25 01:09:10.964824 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 829/1709] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:10 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:11.073100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:11.085933 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1df31909-c986-4c71-9111-cf329455ff15 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.609587 Sep 25 01:09:11.086631 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 881/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:10 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:11.295267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:11.295994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:11.311445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.314699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.315544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:11.316706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.317385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.319814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:11.377772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:11.379271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:11.390813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.396929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.403323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:11.404550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.405215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.405880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:12.371838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.429458 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e3d9fe1-198d-48c4-9501-1be11d2a85e0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 1.051181 Sep 25 01:09:12.467456 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 882/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:11 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:12.491851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.522704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:12.526420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:12.527473 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-776be222-77fc-433f-92f0-c9696dae3a8a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 1.236352 Sep 25 01:09:12.541511 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 830/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:11 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:12.556704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:12.558912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:12.561285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:12.562823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:12.567347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:12.567843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:12.568277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:12.573974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:12.599085 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:12.601722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:12.603287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:12.603994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:12.605221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:12.617484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:12.618823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:12.915695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.934063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.941154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.945146 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-986c9404-ba19-4d27-b0d7-8f5eba218764 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1251 microversion: 2.25 time: 0.473830 Sep 25 01:09:12.965963 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 883/1713] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:12 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1251 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:13.415711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:13.432276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0aa97515-8007-4425-9e73-5b75d9e12f8e tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.900260 Sep 25 01:09:13.443336 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 831/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:12 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:13.499740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:13.501081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:13.509082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.510275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.510976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:13.512266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.512994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.513685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:13.557287 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:13.573947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:13.575750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:13.589792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.590855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.591675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:13.592739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.593755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.596470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.264322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:14.275145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:14.295845 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-497fa1b2-7f8c-43ae-8699-5330f809ab98 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.797856 Sep 25 01:09:14.312803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 884/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:13 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:14.317165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba1da29a-d394-4b74-be6a-3a7398c960a3 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.729470 Sep 25 01:09:14.340021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:14.340872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:14.347350 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 832/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:13 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:14.361904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.362390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.363051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.363649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.364162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.364645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.474769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:14.475868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:14.484982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.485805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.486451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.487403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.488221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.488874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.026820 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:15.048215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:15.071825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:15.088676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:15.091491 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1ff4f6d-e7af-4c03-98b8-bf8c3b346729 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1293 microversion: 2.25 time: 0.767139 Sep 25 01:09:15.095274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 885/1717] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:14 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1293 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:15.101204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cbfe1bac-63a8-4b85-b270-419258d47c80 req-09f3fe44-a1c1-4356-b61b-332e50bc85b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f1aacd-e503-4f6c-82b5-f0d05ea5329a", "tag": "f90f8324-63c2-49db-98b6-f9d4aa3992ac"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:15.107818 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=18 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:15.131565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cbfe1bac-63a8-4b85-b270-419258d47c80 req-09f3fe44-a1c1-4356-b61b-332e50bc85b4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.132395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cbfe1bac-63a8-4b85-b270-419258d47c80 req-09f3fe44-a1c1-4356-b61b-332e50bc85b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.132903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cbfe1bac-63a8-4b85-b270-419258d47c80 req-09f3fe44-a1c1-4356-b61b-332e50bc85b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.142100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:15.158894 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b569c99f-fba5-40c8-a779-0a0bfbf563fc tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.689346 Sep 25 01:09:15.159468 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 833/1718] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:14 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:15.180168 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cbfe1bac-63a8-4b85-b270-419258d47c80 req-09f3fe44-a1c1-4356-b61b-332e50bc85b4 service nova] Creating event network-changed:f90f8324-63c2-49db-98b6-f9d4aa3992ac for instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a on n-h1-master-1 Sep 25 01:09:15.202969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cbfe1bac-63a8-4b85-b270-419258d47c80 req-09f3fe44-a1c1-4356-b61b-332e50bc85b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106225 Sep 25 01:09:15.209037 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 886/1719] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:15.343656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:15.344153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:15.355601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.356502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.356502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.357219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.357704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.358134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.371784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:15.373152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:15.391060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.391583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.392044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.396259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.398401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.399030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.239593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:16.256875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:16.274962 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-285b7045-aa7e-43ca-912e-bda36ecc1617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.933997 Sep 25 01:09:16.275951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dda5bb89-46b5-4634-b238-1ef758485837 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.913465 Sep 25 01:09:16.278911 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 834/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:15 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:16.282261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 887/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:15 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:16.295581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bc0c46aa-548a-4f7a-b1a0-46d1e4d49ebf req-a280fad3-b250-4d35-b601-336360dd0996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26f005f-46a7-4d44-be2b-b8afc7fad760", "tag": "5db086cf-1758-472f-bf2c-7ac2e04a2801"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:16.296797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d65c166e-e401-4ed1-86e9-e35a1e08ca2c req-b9070ffb-f10a-497a-869b-2985172562e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f02266b-a0ae-4d1b-993b-4a437bdca5bf", "name": "network-vif-plugged", "status": "completed", "tag": "b95d435b-92b2-4212-abe5-d44112def539"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:16.335355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d65c166e-e401-4ed1-86e9-e35a1e08ca2c req-b9070ffb-f10a-497a-869b-2985172562e7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:16.337836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc0c46aa-548a-4f7a-b1a0-46d1e4d49ebf req-a280fad3-b250-4d35-b601-336360dd0996 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:16.340349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d65c166e-e401-4ed1-86e9-e35a1e08ca2c req-b9070ffb-f10a-497a-869b-2985172562e7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:16.341567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc0c46aa-548a-4f7a-b1a0-46d1e4d49ebf req-a280fad3-b250-4d35-b601-336360dd0996 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:16.345002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d65c166e-e401-4ed1-86e9-e35a1e08ca2c req-b9070ffb-f10a-497a-869b-2985172562e7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.345375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc0c46aa-548a-4f7a-b1a0-46d1e4d49ebf req-a280fad3-b250-4d35-b601-336360dd0996 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.381787 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d65c166e-e401-4ed1-86e9-e35a1e08ca2c req-b9070ffb-f10a-497a-869b-2985172562e7 service nova] Creating event network-vif-plugged:b95d435b-92b2-4212-abe5-d44112def539 for instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf on n-h2-master-1 Sep 25 01:09:16.397645 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bc0c46aa-548a-4f7a-b1a0-46d1e4d49ebf req-a280fad3-b250-4d35-b601-336360dd0996 service nova] Creating event network-changed:5db086cf-1758-472f-bf2c-7ac2e04a2801 for instance e26f005f-46a7-4d44-be2b-b8afc7fad760 on n-h2-master-1 Sep 25 01:09:16.426117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d65c166e-e401-4ed1-86e9-e35a1e08ca2c req-b9070ffb-f10a-497a-869b-2985172562e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140148 Sep 25 01:09:16.427887 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 888/1722] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:16.428403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bc0c46aa-548a-4f7a-b1a0-46d1e4d49ebf req-a280fad3-b250-4d35-b601-336360dd0996 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145532 Sep 25 01:09:16.432356 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 835/1723] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:16.448265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:16.451943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:16.452500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:16.455554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:16.483136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:16.483610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:16.485091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:16.485870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.488251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:16.489032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:16.489208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:16.489529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.490078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.494600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:16.495102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:16.495557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.994468 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:17.052737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.064309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b11e6874-0929-4722-a7d2-9ba11ad7d6d2 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.628978 Sep 25 01:09:17.069332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 836/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:16 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:17.069797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.083296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.085325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.087269 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ceb169d0-50d2-4ddf-b333-c82fb0acc60f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1293 microversion: 2.25 time: 0.655268 Sep 25 01:09:17.089792 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 889/1725] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:16 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1293 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:17.319471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:17.319471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:17.324151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:17.324802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:17.338517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:17.339014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:17.339393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:17.339962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:17.340410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:17.341135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:17.342361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:17.343643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:17.344115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:17.344546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:17.345538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:17.346028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:17.390483 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:17.617189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.623217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.630453 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ddefc590-da0b-4227-903b-49678dd948a2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.321398 Sep 25 01:09:17.631059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 890/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:17 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:17.632570 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc3c86f4-0ba0-4325-a1a2-2fe5a3b4dc85 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.314288 Sep 25 01:09:17.633384 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 837/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:17 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:18.093666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:18.094455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:18.100741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.101365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.102490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.103777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.104346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.104880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.120139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:18.121469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:18.132526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.134126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.135331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.136256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.136891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.137580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.365389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.368544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.380654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.382658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.384651 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3e24bc0-2cd7-48bb-b8fe-3b14f9bbdad1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1293 microversion: 2.25 time: 0.270158 Sep 25 01:09:18.385959 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 838/1728] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:18 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1293 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:18.404314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7be40ad0-fe23-4d74-889b-1f7bb9aa0893 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.296406 Sep 25 01:09:18.408059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 891/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:18 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:18.451858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f1499ace-7152-4d78-9bf2-b30d80d78515 req-194cf258-c97c-4da6-b807-7dccf6f8a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac", "name": "network-vif-plugged", "status": "completed", "tag": "22ad6343-e39c-400e-889a-f1fbc77161c3"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:18.463144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f1499ace-7152-4d78-9bf2-b30d80d78515 req-194cf258-c97c-4da6-b807-7dccf6f8a2f3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.463628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f1499ace-7152-4d78-9bf2-b30d80d78515 req-194cf258-c97c-4da6-b807-7dccf6f8a2f3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.464066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f1499ace-7152-4d78-9bf2-b30d80d78515 req-194cf258-c97c-4da6-b807-7dccf6f8a2f3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.480080 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f1499ace-7152-4d78-9bf2-b30d80d78515 req-194cf258-c97c-4da6-b807-7dccf6f8a2f3 service nova] Creating event network-vif-plugged:22ad6343-e39c-400e-889a-f1fbc77161c3 for instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac on n-h1-master-1 Sep 25 01:09:18.485978 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f1499ace-7152-4d78-9bf2-b30d80d78515 req-194cf258-c97c-4da6-b807-7dccf6f8a2f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041893 Sep 25 01:09:18.486615 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 839/1730] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:18.654773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:18.656161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:18.659183 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:18.668345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:18.669545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:18.670927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.671768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.672498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.674033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.675039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.676469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.678426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.679181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.679884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.682258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.683027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.683686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.901036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.917946 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2bebde05-447c-468b-a15f-f02c0ec6cf30 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.267335 Sep 25 01:09:18.919107 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 892/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:18 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:18.964235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.977491 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c204869-56b3-48f5-a77b-70b78fe3b260 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.320569 Sep 25 01:09:18.978426 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 840/1732] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:18 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:19.421055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:19.426236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:19.430374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:19.432009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:19.436030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:19.436867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:19.437317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:19.438090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:19.438790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:19.439215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:19.441238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:19.441806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:19.446254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:19.451148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:19.451688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:19.452150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.262229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:20.273706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:20.276088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:20.277427 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c286313f-c871-4d59-af39-c00c3b5fbbd1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1293 microversion: 2.25 time: 0.863778 Sep 25 01:09:20.278211 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 893/1733] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:19 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1293 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:20.283474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:20.284423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:20.293752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.294559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.295198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.296343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.296754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.297395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.301024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:20.317391 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-887acdfd-5ee9-495b-ae28-dc187189af88 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.892151 Sep 25 01:09:20.330967 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 841/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:19 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:20.345907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:20.347515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:20.360618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.361476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.362223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.363472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.364434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.365235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.621189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:20.640263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:20.646972 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-70357262-bd9f-4cb2-972a-62152f4d20d6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1316 microversion: 2.1 time: 0.367398 Sep 25 01:09:20.649911 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 894/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:20 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:20.663016 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2dc59853-ad54-4ca8-a7f4-ec79a3096767 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.329718 Sep 25 01:09:20.663878 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 842/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:20 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:21.308018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:21.308794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.316245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.316817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.317333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.328333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.328857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.329304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.349683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:21.350326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.362158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.362994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.364285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.375765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.380256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.384159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.632052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.646082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.658815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.664168 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c951476-8423-485d-ac7a-b6d794068ed9 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1325 microversion: 2.1 time: 0.319235 Sep 25 01:09:21.667069 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 843/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:21 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:21.669250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.677073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b5c9c5a-da7a-40a6-a4fe-8c3eb42d60b0 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1281 microversion: 2.25 time: 0.372685 Sep 25 01:09:21.691671 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 895/1738] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:21 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1281 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:21.692873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:21.697321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.710026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:21.711246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.720340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.725322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.725833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.726599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.727804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.734890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.736807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.741307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.741874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.742959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.745343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.745903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.120641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:22.125735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:22.138979 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e51b80e-e898-4f5f-b595-23e8420b70f9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1503 microversion: 2.1 time: 0.461924 Sep 25 01:09:22.139633 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-102e1404-b8e0-4763-a0c9-49cb7c59a9aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.445020 Sep 25 01:09:22.140444 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 844/1739] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:21 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:22.141334 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 896/1740] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:21 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:22.146801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-769826752", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4f8a553d-e325-4d96-bf39-28985d951e27"}], "block_device_mapping_v2": [{"uuid": "744654d7-b538-4a42-99b0-470403fcbd4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:22.165010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1680328593"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:22.166877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:22.174016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.174566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.175382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.176132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.176618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.177578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.249961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] validate_networks() for [('4f8a553d-e325-4d96-bf39-28985d951e27', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:09:22.450104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Adding security group a030cd92-9ddd-4d95-9776-37672b777c71 to port 22ad6343-e39c-400e-889a-f1fbc77161c3 Sep 25 01:09:23.148356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:23.152127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:23.152127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:23.152127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:23.152837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:23.162503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.163423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.163926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.164878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.165525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.166041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.186065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:23.188718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30bd9bb6-6361-4bbc-9cf1-490d57f7a609 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac/action" status: 202 len: 0 microversion: 2.1 time: 1.027793 Sep 25 01:09:23.190595 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 897/1741] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:09:22 2022] POST /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac/action => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:09:23.191262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Getting quotas for user fe77600029ff40f8b738c097bf184495 and project ce74d459ddb341569f42818c99cbfcaa. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:23.199373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:23.200514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:23.208334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.209074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.209747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.210793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.211294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.211809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.262634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:23.265353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='744654d7-b538-4a42-99b0-470403fcbd4c',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:23.470622 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b03e7c2e-6ee6-4665-9d62-3712f2932ea5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327987 Sep 25 01:09:23.471681 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 845/1742] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:09:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:09:23.477375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:23.478362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:23.487355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.488158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.488791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.489384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.490004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.490637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.491257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.519400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f9267e82-19c9-4d11-a3be-f18eb436b852 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1522 microversion: 2.1 time: 0.326789 Sep 25 01:09:23.523062 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 898/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:23 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:23.531964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:23.536410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:23.560094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.564556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.565786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.568497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.569345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.572092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.821282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.829940 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5c1d47a5-4c14-4922-a894-f4d2760179ab tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.304601 Sep 25 01:09:23.830579 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 899/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:23 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:23.841668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-410136719"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:23.841880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.842063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:23.844648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.845202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.845678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.846471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.846981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.847439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.859753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.862397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.863927 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6586fdc5-7cce-4e9e-922f-f9b8744d42a1 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1281 microversion: 2.25 time: 0.390709 Sep 25 01:09:23.864689 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 846/1745] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:23 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1281 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:23.873143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e5f44511-0a0c-4d45-baab-b0219627edc9 req-c26389ec-cc7d-48f2-b0f8-54dde296acfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac", "tag": "22ad6343-e39c-400e-889a-f1fbc77161c3"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:23.891055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5f44511-0a0c-4d45-baab-b0219627edc9 req-c26389ec-cc7d-48f2-b0f8-54dde296acfe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:23.891904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5f44511-0a0c-4d45-baab-b0219627edc9 req-c26389ec-cc7d-48f2-b0f8-54dde296acfe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:23.892825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5f44511-0a0c-4d45-baab-b0219627edc9 req-c26389ec-cc7d-48f2-b0f8-54dde296acfe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.913752 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e5f44511-0a0c-4d45-baab-b0219627edc9 req-c26389ec-cc7d-48f2-b0f8-54dde296acfe service nova] Creating event network-changed:22ad6343-e39c-400e-889a-f1fbc77161c3 for instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac on n-h1-master-1 Sep 25 01:09:23.921823 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e5f44511-0a0c-4d45-baab-b0219627edc9 req-c26389ec-cc7d-48f2-b0f8-54dde296acfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055280 Sep 25 01:09:23.923381 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 847/1746] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:23.932154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d32cc010-e56c-4ce4-b645-2087659161e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:23.933378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d32cc010-e56c-4ce4-b645-2087659161e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.078287 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Adding security group 7662c194-6972-481c-8383-ad2d14445f63 to port 22ad6343-e39c-400e-889a-f1fbc77161c3 Sep 25 01:09:24.090208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d32cc010-e56c-4ce4-b645-2087659161e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:24.104605 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d32cc010-e56c-4ce4-b645-2087659161e7 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1052 microversion: 2.1 time: 0.179276 Sep 25 01:09:24.107794 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 848/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:23 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1052 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:24.124526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.128197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.137779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.138863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.139824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.140860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.141552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.142202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.192734 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] HTTP exception thrown: Action 999 not found Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Request method failure captured: Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf/os-instance-actions/999 HTTP/1.1 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onySsRrdA0rEqx27X-tg4uxE40ebApK58hsREPuu8XCZoddauXJFkHCawewTg516odKBfIC1w5OXnijE5XRLHbgE2wIkCmngGmyzW8WKVCpXVOBKK5RCnTOHCp88Grp8tCyPwXyF21Hy4-27XEv7Mj5NjdGXyqbK2FurisBnF9g14 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cf45958b75704ca785e000efe1060c47 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf45958b75704ca785e000efe1060c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf45958b75704ca785e000efe1060c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf45958b75704ca785e000efe1060c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf45958b75704ca785e000efe1060c47"}]}] Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cf45958b75704ca785e000efe1060c47 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceActionsNegativeTestJSON-89220596-project Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c3512a52716f45cd9998337fb133c84f Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-89220596-project Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: exception: Action 999 not found Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': '7f02266b-a0ae-4d1b-993b-4a437bdca5bf', 'id': '999'} Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 25 01:09:24.203271 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.214192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Returning 404 to user: Action 999 not found {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:24.216182 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3951c13e-4774-497e-8cd4-e34f8a86b0f0 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.106017 Sep 25 01:09:24.217497 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 849/1748] 10.222.0.16 () {58 vars in 1308 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf/os-instance-actions/999 => generated 66 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:09:24.228374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-64eaefad-ed36-482e-b21b-c3bc96ee68c1 req-743b06ad-53c0-42fe-ad52-913927e10d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f005f-46a7-4d44-be2b-b8afc7fad760", "name": "network-vif-plugged", "status": "completed", "tag": "5db086cf-1758-472f-bf2c-7ac2e04a2801"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:24.241602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64eaefad-ed36-482e-b21b-c3bc96ee68c1 req-743b06ad-53c0-42fe-ad52-913927e10d40 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.242208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64eaefad-ed36-482e-b21b-c3bc96ee68c1 req-743b06ad-53c0-42fe-ad52-913927e10d40 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.243931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64eaefad-ed36-482e-b21b-c3bc96ee68c1 req-743b06ad-53c0-42fe-ad52-913927e10d40 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.258304 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-64eaefad-ed36-482e-b21b-c3bc96ee68c1 req-743b06ad-53c0-42fe-ad52-913927e10d40 service nova] Creating event network-vif-plugged:5db086cf-1758-472f-bf2c-7ac2e04a2801 for instance e26f005f-46a7-4d44-be2b-b8afc7fad760 on n-h2-master-1 Sep 25 01:09:24.266702 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-64eaefad-ed36-482e-b21b-c3bc96ee68c1 req-743b06ad-53c0-42fe-ad52-913927e10d40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043656 Sep 25 01:09:24.270119 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 850/1749] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:24.280231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e9a6908-c455-4110-b51e-b6874b5075eb tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '.version_select at 0x7f7bf016f8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.282135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e9a6908-c455-4110-b51e-b6874b5075eb tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: ee34153f-f41a-4688-b735-4b0bb3c10d0f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.292596 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1e9a6908-c455-4110-b51e-b6874b5075eb tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] HTTP exception thrown: Instance ee34153f-f41a-4688-b735-4b0bb3c10d0f could not be found. Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e9a6908-c455-4110-b51e-b6874b5075eb tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Request method failure captured: Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ee34153f-f41a-4688-b735-4b0bb3c10d0f/os-instance-actions HTTP/1.1 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onySsRrdA0rEqx27X-tg4uxE40ebApK58hsREPuu8XCZoddauXJFkHCawewTg516odKBfIC1w5OXnijE5XRLHbgE2wIkCmngGmyzW8WKVCpXVOBKK5RCnTOHCp88Grp8tCyPwXyF21Hy4-27XEv7Mj5NjdGXyqbK2FurisBnF9g14 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cf45958b75704ca785e000efe1060c47 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf45958b75704ca785e000efe1060c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf45958b75704ca785e000efe1060c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf45958b75704ca785e000efe1060c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf45958b75704ca785e000efe1060c47"}]}] Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cf45958b75704ca785e000efe1060c47 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceActionsNegativeTestJSON-89220596-project Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c3512a52716f45cd9998337fb133c84f Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-89220596-project Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ee34153f-f41a-4688-b735-4b0bb3c10d0f could not be found. Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': 'ee34153f-f41a-4688-b735-4b0bb3c10d0f'} Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee34153f-f41a-4688-b735-4b0bb3c10d0f could not be found. Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:24.295746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee34153f-f41a-4688-b735-4b0bb3c10d0f could not be found. Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee34153f-f41a-4688-b735-4b0bb3c10d0f could not be found. Sep 25 01:09:24.303299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:24.308999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e9a6908-c455-4110-b51e-b6874b5075eb tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Returning 404 to user: Instance ee34153f-f41a-4688-b735-4b0bb3c10d0f could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:24.309420 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e9a6908-c455-4110-b51e-b6874b5075eb tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/ee34153f-f41a-4688-b735-4b0bb3c10d0f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.037534 Sep 25 01:09:24.310200 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 851/1750] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/ee34153f-f41a-4688-b735-4b0bb3c10d0f/os-instance-actions => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:24.323083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.324009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.333524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.334587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.335385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.336739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.338500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.339198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.377648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:09:24.515093 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51a62906-ea60-47a7-9145-ac469892b441 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 204 len: 0 microversion: 2.1 time: 0.197327 Sep 25 01:09:24.520250 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 852/1751] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:09:24 2022] DELETE /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:09:24.529051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.530101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.538804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.541101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.542360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.543497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.544243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.545054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.829672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:24.840389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f7a7446a-514e-41f8-b1a5-79f788e9af0f tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1528 microversion: 2.1 time: 0.318315 Sep 25 01:09:24.840982 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 853/1752] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1528 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:24.859129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.860228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.870955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.871653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.872380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.873271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.874006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.874621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.886048 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-332c39d3-f282-4441-9258-8894994e23c4 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac/action" status: 202 len: 0 microversion: 2.1 time: 1.052093 Sep 25 01:09:24.889455 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 900/1753] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:09:23 2022] POST /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac/action => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:24.897006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.898821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.913749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.914352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.914856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.915668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.916175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.916676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.210199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:25.221463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b715f050-5e8a-4bbb-aff7-ee680455091c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.370409 Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 854/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.260418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.263648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bf86ae8d-7cec-4744-a62e-7f936def7bf9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.359857 Sep 25 01:09:25.264426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.264426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.265159 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 901/1755] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac/os-security-groups => generated 1158 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:25.265159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.265159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:25.273352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.282121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.282121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.282121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.282121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.282121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.399835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:25.420552 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a1ac5fd-5d73-4cf0-95d7-581536a9f0f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1150 microversion: 2.1 time: 0.165571 Sep 25 01:09:25.421164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 902/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:25 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1150 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:25.433698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-557c5c1b-4761-4dd5-ac01-a49e1fc7a856 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebdaadc0>, body: {"security_group": {"name": " tempest-securitygroup -1735543541 ", "description": "tempest-description-1522689705"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:25.516476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:25.526784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:25.528408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:25.529699 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf14246a-dff7-4347-9a45-406ae1344b75 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1281 microversion: 2.25 time: 0.293080 Sep 25 01:09:25.530762 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 855/1757] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:25 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:25.711852 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-557c5c1b-4761-4dd5-ac01-a49e1fc7a856 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.288765 Sep 25 01:09:25.712911 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 903/1758] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:09:25 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:25.726714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bce2b631-7d73-40f7-8c3e-6018095c669a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebfb5700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.784900 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bce2b631-7d73-40f7-8c3e-6018095c669a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5" status: 200 len: 224 microversion: 2.1 time: 0.063062 Sep 25 01:09:25.785523 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 856/1759] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:09:25 2022] GET /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 => generated 224 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:25.799126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a44969cc-58d1-4568-b6be-9e90dac85d4f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebd440d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.877698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.878846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:25.895153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.896336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.899659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.901328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.902396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.903363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.197063 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a44969cc-58d1-4568-b6be-9e90dac85d4f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5" status: 202 len: 0 microversion: 2.1 time: 0.400074 Sep 25 01:09:26.204807 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 904/1760] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:09:25 2022] DELETE /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:26.215304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0efbc00a-0a3b-47ac-b9be-df5d8f3e9046 req-9ca36ad8-7606-42d6-8868-fb4f9163066b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac", "tag": "22ad6343-e39c-400e-889a-f1fbc77161c3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:26.221390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:26.238276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e57ddf9-348a-4595-aa14-326403e8e879 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1528 microversion: 2.1 time: 0.370555 Sep 25 01:09:26.250433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 857/1761] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:25 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1528 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:26.250685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0efbc00a-0a3b-47ac-b9be-df5d8f3e9046 req-9ca36ad8-7606-42d6-8868-fb4f9163066b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.250685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0efbc00a-0a3b-47ac-b9be-df5d8f3e9046 req-9ca36ad8-7606-42d6-8868-fb4f9163066b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.250685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0efbc00a-0a3b-47ac-b9be-df5d8f3e9046 req-9ca36ad8-7606-42d6-8868-fb4f9163066b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.252557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf0269790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.278809 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0efbc00a-0a3b-47ac-b9be-df5d8f3e9046 req-9ca36ad8-7606-42d6-8868-fb4f9163066b service nova] Creating event network-changed:22ad6343-e39c-400e-889a-f1fbc77161c3 for instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac on n-h1-master-1 Sep 25 01:09:26.280787 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:09:26.281458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:09:26.282037 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.282037 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 HTTP/1.1 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: exception: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5'} Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:09:26.284802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] Sep 25 01:09:26.297878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:26.306729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0efbc00a-0a3b-47ac-b9be-df5d8f3e9046 req-9ca36ad8-7606-42d6-8868-fb4f9163066b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077435 Sep 25 01:09:26.306729 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 905/1762] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:26.307558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:09:26.307558 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-6dd2db37-5ef6-4001-bacb-4bbed2ae5d1f'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:26.307558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-42d93c58-5e6d-4b45-a7ae-22c9dabdfdd9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5" status: 404 len: 194 microversion: 2.1 time: 0.050891 Sep 25 01:09:26.307558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 858/1763] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:09:26 2022] GET /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.308923 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:26.311081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4cfa0fb2-4b99-47e8-9bba-599a23fa4f8c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebe988b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1251957734", "description": "tempest-description-417935629"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:26.647124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:26.657702 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db38e886-038d-4df3-b38f-9e73c022d8cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1318 microversion: 2.1 time: 0.370223 Sep 25 01:09:26.659333 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 906/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:26 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:26.672545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.672545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:26.676927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.677838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.678287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.680984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.681809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.682722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.785928 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4cfa0fb2-4b99-47e8-9bba-599a23fa4f8c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.487198 Sep 25 01:09:26.786651 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 859/1765] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:09:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:26.792884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.794512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:26.806336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.807148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.808145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.810746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.815263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.816095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.823850 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:27.023246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.033686 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69c2d7c3-6751-4eae-bfbc-0b83d6e05b1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1210 microversion: 2.1 time: 0.372909 Sep 25 01:09:27.034818 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 907/1766] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:26 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1210 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:27.041621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b95063e5-691c-4d35-a7a7-357add984535 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebddea60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1189824525", "description": "tempest-description-89143560"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:27.630725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.647350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.650652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.652568 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f10fe622-5a5d-4c40-860e-ab439fc7bb63 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1281 microversion: 2.25 time: 0.864484 Sep 25 01:09:27.672743 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 860/1767] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:26 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1281 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:27.680390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:27.680887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:27.700640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:27.700868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:27.704779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:27.705665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:27.706367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:27.706981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.205802 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b95063e5-691c-4d35-a7a7-357add984535 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.169379 Sep 25 01:09:28.217221 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 908/1768] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:09:27 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:28.224494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:28.226252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:28.236921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.238228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.238982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.240310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.241159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.241983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.466818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:28.484901 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-04745db1-5b0e-4370-b458-08f712016e75 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1528 microversion: 2.1 time: 0.809264 Sep 25 01:09:28.507482 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 861/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:27 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1528 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:28.518206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-95d2281a-87b2-4925-a48d-80a80f0714a9 req-ce096052-08c1-413d-9ee8-1aa502923466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46634d57-04e7-41e5-ab07-b519e0c7f1f5", "tag": "45f9a505-6899-473a-bab5-680e01259f2f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:28.531894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-95d2281a-87b2-4925-a48d-80a80f0714a9 req-ce096052-08c1-413d-9ee8-1aa502923466 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.532671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-95d2281a-87b2-4925-a48d-80a80f0714a9 req-ce096052-08c1-413d-9ee8-1aa502923466 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.533297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-95d2281a-87b2-4925-a48d-80a80f0714a9 req-ce096052-08c1-413d-9ee8-1aa502923466 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.549696 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-95d2281a-87b2-4925-a48d-80a80f0714a9 req-ce096052-08c1-413d-9ee8-1aa502923466 service nova] Creating event network-changed:45f9a505-6899-473a-bab5-680e01259f2f for instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 on n-h1-master-1 Sep 25 01:09:28.556765 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-95d2281a-87b2-4925-a48d-80a80f0714a9 req-ce096052-08c1-413d-9ee8-1aa502923466 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046943 Sep 25 01:09:28.558913 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 862/1770] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:28.565109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:28.566210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:28.576525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.577389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.578109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.579214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.579918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.580562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.748076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:28.767253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c555f1f-6372-4286-8b97-6af8f7506d99 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1507 microversion: 2.1 time: 0.547620 Sep 25 01:09:28.772600 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 909/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:28 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:28.781988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a06eadf-2ced-4497-8988-4224f918cb27 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebdde700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-523760621", "description": "tempest-description-1383296951"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:29.108856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.135472 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdf111f6-8fe4-49f2-ab13-c8e1c7ab42c6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1210 microversion: 2.1 time: 0.574294 Sep 25 01:09:29.151348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 863/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:28 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1210 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:29.184446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a06eadf-2ced-4497-8988-4224f918cb27 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.405486 Sep 25 01:09:29.186209 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 910/1773] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:09:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:29.190597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:29.191862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:29.207247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:29.208266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:29.221951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.222787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.223355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.224207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.224795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.225382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.229535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.230289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.230920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.232159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.233138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.233862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.583456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.614337 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38cdc139-c335-48a3-b9d8-98c6c6be1d02 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1507 microversion: 2.1 time: 0.416067 Sep 25 01:09:29.625257 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 911/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:29 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:29.646174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.666225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0dc496c5-9658-4254-a472-18d8b55e54e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf02bb5e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:29.674881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.690368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.693269 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb1744c7-7946-44e4-b657-4d05e68d2708 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1281 microversion: 2.25 time: 0.517292 Sep 25 01:09:29.709926 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 864/1775] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:29 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1281 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:29.725192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:29.725857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:29.749349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.750353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.753237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.755127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.759674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.760499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.892927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3512a52716f45cd9998337fb133c84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf45958b75704ca785e000efe1060c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.911307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3dfbcc95-d309-4002-b427-cb2dd310f092 tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 200 len: 1310 microversion: 2.1 time: 0.199605 Sep 25 01:09:29.913168 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 865/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:29 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:29.925920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8e460659-dada-49d4-8eb1-ded7f7b86aae req-6dde5ff1-42e6-40ff-8f50-c0d507c4b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f02266b-a0ae-4d1b-993b-4a437bdca5bf", "name": "network-vif-deleted", "tag": "b95d435b-92b2-4212-abe5-d44112def539"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:29.951949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8e460659-dada-49d4-8eb1-ded7f7b86aae req-6dde5ff1-42e6-40ff-8f50-c0d507c4b0d8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.953109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8e460659-dada-49d4-8eb1-ded7f7b86aae req-6dde5ff1-42e6-40ff-8f50-c0d507c4b0d8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.954221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8e460659-dada-49d4-8eb1-ded7f7b86aae req-6dde5ff1-42e6-40ff-8f50-c0d507c4b0d8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.991436 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8e460659-dada-49d4-8eb1-ded7f7b86aae req-6dde5ff1-42e6-40ff-8f50-c0d507c4b0d8 service nova] Creating event network-vif-deleted:b95d435b-92b2-4212-abe5-d44112def539 for instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf on n-h2-master-1 Sep 25 01:09:30.010123 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8e460659-dada-49d4-8eb1-ded7f7b86aae req-6dde5ff1-42e6-40ff-8f50-c0d507c4b0d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092434 Sep 25 01:09:30.012537 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 866/1777] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:30.023426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:30.048440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.072367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.074879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.076304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.080143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.081883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.083416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.176312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0dc496c5-9658-4254-a472-18d8b55e54e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.551664 Sep 25 01:09:30.178137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 912/1778] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:09:29 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:30.202981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.204149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.222588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.224366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.225263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.227025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.228801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.229690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.248918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:30.249540 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:30.250196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:30.250759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:30.251435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:30.329860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.341663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.342536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.343251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.344802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.345909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.346731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.427068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95cdb17f-c292-4df1-ba54-0ec7cb075773 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "POST /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760/action" status: 202 len: 1109 microversion: 2.1 time: 0.412013 Sep 25 01:09:30.433756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 867/1779] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:09:30 2022] POST /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760/action => generated 1109 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 25 01:09:30.448611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:30.451686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e126dea-811c-4436-9964-006621bcc523 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebfba280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.460426 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49a4138c-a0c0-4efe-b7a3-b2526f187a92 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1210 microversion: 2.1 time: 0.271582 Sep 25 01:09:30.462297 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 913/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:30 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1210 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:30.476061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-585b3c05-22c3-4e6f-a191-69d14fa14a30 req-2863a77e-6262-4940-95b7-d1dd17e2d979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f1aacd-e503-4f6c-82b5-f0d05ea5329a", "name": "network-vif-plugged", "status": "completed", "tag": "f90f8324-63c2-49db-98b6-f9d4aa3992ac"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:30.491441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-585b3c05-22c3-4e6f-a191-69d14fa14a30 req-2863a77e-6262-4940-95b7-d1dd17e2d979 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.491984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-585b3c05-22c3-4e6f-a191-69d14fa14a30 req-2863a77e-6262-4940-95b7-d1dd17e2d979 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.493274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-585b3c05-22c3-4e6f-a191-69d14fa14a30 req-2863a77e-6262-4940-95b7-d1dd17e2d979 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.509827 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-585b3c05-22c3-4e6f-a191-69d14fa14a30 req-2863a77e-6262-4940-95b7-d1dd17e2d979 service nova] Creating event network-vif-plugged:f90f8324-63c2-49db-98b6-f9d4aa3992ac for instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a on n-h1-master-1 Sep 25 01:09:30.515876 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-585b3c05-22c3-4e6f-a191-69d14fa14a30 req-2863a77e-6262-4940-95b7-d1dd17e2d979 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051714 Sep 25 01:09:30.516512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 914/1781] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:30.524328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.525163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.533387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.534231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.534864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.535808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.536514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.537127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.857268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:30.874498 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e991143a-bb5d-41e0-a52a-d03dc029233a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.356344 Sep 25 01:09:30.875442 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 915/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:30 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:30.884340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.886114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.903303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.904993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.906083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.907614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.908697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.909660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.928709 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e126dea-811c-4436-9964-006621bcc523 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a" status: 202 len: 0 microversion: 2.1 time: 0.493275 Sep 25 01:09:30.929820 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 868/1783] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:09:30 2022] DELETE /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:30.946604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebe989d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.995297 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:09:30.995902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:09:30.996703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:30.996703 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a HTTP/1.1 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: exception: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a'} Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:09:31.001544 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-2cdd9d61-9bc3-4318-a193-3a651d1afc3b'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eca7b9a7-6ec6-41fc-9877-0916218fb020 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a" status: 404 len: 194 microversion: 2.1 time: 0.066724 Sep 25 01:09:31.012174 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 869/1784] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:09:30 2022] GET /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:31.022149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.022149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] [instance: 7f02266b-a0ae-4d1b-993b-4a437bdca5bf] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:31.024694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.025446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.026270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.027364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.028035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.028799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.044670 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] HTTP exception thrown: Instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf could not be found. Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Request method failure captured: Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf HTTP/1.1 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onySsRrdA0rEqx27X-tg4uxE40ebApK58hsREPuu8XCZoddauXJFkHCawewTg516odKBfIC1w5OXnijE5XRLHbgE2wIkCmngGmyzW8WKVCpXVOBKK5RCnTOHCp88Grp8tCyPwXyF21Hy4-27XEv7Mj5NjdGXyqbK2FurisBnF9g14 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cf45958b75704ca785e000efe1060c47 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf45958b75704ca785e000efe1060c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf45958b75704ca785e000efe1060c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf45958b75704ca785e000efe1060c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf45958b75704ca785e000efe1060c47"}]}] Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cf45958b75704ca785e000efe1060c47 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-89220596 Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceActionsNegativeTestJSON-89220596-project Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c3512a52716f45cd9998337fb133c84f Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-89220596-project Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf could not be found. Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7f02266b-a0ae-4d1b-993b-4a437bdca5bf'} Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf could not be found. Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf could not be found. Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.046492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf could not be found. Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] Returning 404 to user: Instance 7f02266b-a0ae-4d1b-993b-4a437bdca5bf could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7f097949-0c42-41ed-85e5-67db97c095ca tempest-InstanceActionsNegativeTestJSON-89220596 tempest-InstanceActionsNegativeTestJSON-89220596-project] 10.222.0.16 "GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf" status: 404 len: 111 microversion: 2.1 time: 0.040752 Sep 25 01:09:31.056090 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 870/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:31 2022] GET /compute/v2.1/servers/7f02266b-a0ae-4d1b-993b-4a437bdca5bf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:31.061248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-477f4906-b038-4d6f-8509-91ce7e01f9f5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebb38280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.294332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.304699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.306823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.308388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f3c40cc-4d91-4270-897b-486aa9c389dc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1281 microversion: 2.25 time: 0.431472 Sep 25 01:09:31.326627 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 916/1786] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:30 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1281 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:31.474974 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-477f4906-b038-4d6f-8509-91ce7e01f9f5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8" status: 202 len: 0 microversion: 2.1 time: 0.419941 Sep 25 01:09:31.478553 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 871/1787] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:09:31 2022] DELETE /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:31.496307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebdaaa60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.510078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.526831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:31.552850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.554207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.557679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.560522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.560728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.561182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.576584 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:09:31.578078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group db641a07-4a8e-462b-ab21-8a9b961a02a8 not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:09:31.579191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.579191 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8 HTTP/1.1 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: exception: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'db641a07-4a8e-462b-ab21-8a9b961a02a8'} Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:09:31.584033 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] Sep 25 01:09:31.592541 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:31.605583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:09:31.605583 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-71aaeb62-bc1c-437b-8072-12534f893496'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:31.605583 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2bc123ae-8547-4e7b-aeb5-12e66945f782 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8" status: 404 len: 194 microversion: 2.1 time: 0.110545 Sep 25 01:09:31.609610 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 917/1788] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:09:31 2022] GET /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:31.631676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3583dfc-e701-4490-8daf-f82e6d9f38a6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebd2bee0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.824755 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.839577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eace72e8-c7e3-42a5-9c2b-2e2500b4b325 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1210 microversion: 2.1 time: 0.345228 Sep 25 01:09:31.853894 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 872/1789] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:31 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1210 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:31.908499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.909464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:31.917010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.917921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.918557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.919542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.920208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.920831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:32.202992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3583dfc-e701-4490-8daf-f82e6d9f38a6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95" status: 202 len: 0 microversion: 2.1 time: 0.590993 Sep 25 01:09:32.205790 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 918/1790] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:09:31 2022] DELETE /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:32.233875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebdd0b80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:32.281529 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:09:32.283072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:32.288625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:09:32.290963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.290963 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] Sep 25 01:09:32.296967 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b5704700-b7b8-477e-88b6-caff7afd3d62 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.392288 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95 HTTP/1.1 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: exception: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'bdb0237d-4d36-4ea5-bbf6-a597f1089a95'} Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:09:32.301464 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-d1d5fdc8-34c0-4553-bd49-cef1938808f6'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:32.306950 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5fe2b60f-a90d-456d-951c-a9beb064a02f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95" status: 404 len: 194 microversion: 2.1 time: 0.095639 Sep 25 01:09:32.310282 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 919/1791] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:09:32 2022] GET /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:09:32.321962 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 873/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:31 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:32.336067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:32.336608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7bd08ac6-7ec8-4d68-a991-edc91f43cc5e tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebd72160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:32.337246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:32.339891 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:32.345445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:32.346244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:32.346940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:32.347884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:32.348531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:32.349307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:32.715601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:32.725860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:32.728046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:32.729795 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e348443-6938-4855-bfa1-d30deceb7a68 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1478 microversion: 2.25 time: 0.398129 Sep 25 01:09:32.731136 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 874/1793] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:32 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1478 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:32.770549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7bd08ac6-7ec8-4d68-a991-edc91f43cc5e tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.455654 Sep 25 01:09:32.771868 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 920/1794] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:09:32 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:32.800282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d17de418-8e1d-4fb8-9d5c-459fd6ee87e2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebdd0b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1468299863", "description": "tempest-description-83006744"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:32.981690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:32.982748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:32.996791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:32.997622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:32.998139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:32.999055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:32.999515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.000157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.056703 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d17de418-8e1d-4fb8-9d5c-459fd6ee87e2 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.260356 Sep 25 01:09:33.057720 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 921/1795] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:09:32 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:33.069653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:33.074590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:33.116134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.117340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.118526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.121809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.122385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.122871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.175693 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:33.281437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid d3f1aacd-e503-4f6c-82b5-f0d05ea5329a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:33.297543 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6dab02b-e7dc-416c-a7e6-86f1a123c40a tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1971 microversion: 2.25 time: 0.545092 Sep 25 01:09:33.299017 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 875/1796] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:32 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1971 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:33.305045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f1821e96-a677-4c1c-bb09-84f9985f7785 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bebb8dd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-418499479", "description": "tempest-description-244624041"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:33.404603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:33.416059 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eb2330fb-ee29-47ad-ac37-d26c3dd8dd61 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1210 microversion: 2.1 time: 0.356972 Sep 25 01:09:33.416728 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 922/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:33 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1210 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:33.428165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:33.428852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:33.436177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.437185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.437853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.438792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.439257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.439690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.626502 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f1821e96-a677-4c1c-bb09-84f9985f7785 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.325411 Sep 25 01:09:33.629443 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 876/1798] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:09:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:33.660708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:33.667896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:33.688671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid d3f1aacd-e503-4f6c-82b5-f0d05ea5329a {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:33.693392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.694848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.698793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.701348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.703514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.707367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.745598 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d17a6502-c2bf-4f0b-a600-df20027b47a7 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1971 microversion: 2.25 time: 0.322048 Sep 25 01:09:33.748134 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 923/1799] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:33 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1971 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:33.763061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1388223825", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "1516f0ed-2f80-4a66-a6d1-d31c9b9f8f97"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:33.883940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] validate_networks() for [('1516f0ed-2f80-4a66-a6d1-d31c9b9f8f97', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:09:34.013569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:34.033651 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce9fbfb0-e6db-481d-aa80-06dc39bd2f18 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.402123 Sep 25 01:09:34.034998 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 877/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:33 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:34.042657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:34.047749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.048577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.049245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.050282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.051202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.051863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.096047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08bfd536-b625-4136-b289-1255b31a1346 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059633 Sep 25 01:09:34.097663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 878/1801] 10.222.0.16 () {60 vars in 1217 bytes} [Sun Sep 25 01:09:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:09:34.120456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:34.129098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:34.136466 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:34.138761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.139522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.140230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.141159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.141939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.142851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.183430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'flavor' on Instance uuid d3f1aacd-e503-4f6c-82b5-f0d05ea5329a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:34.199939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Going to try to live migrate instance to n-h2-master-1 {{(pid=122384) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:09:34.271265 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:34.511873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:34.513028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:34.514014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:34.515336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:34.517056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:34.534904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.535912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.536767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.538103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.539968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.540666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.567864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Getting quotas for project fd330b26476d45a49805765808323420. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:34.579486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Getting quotas for user 7f9c70d4db7246bf97a29ec68f86c92a and project fd330b26476d45a49805765808323420. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:34.606018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:34.610883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:34.692989 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8afd86e3-9811-4246-905b-de80da3242d1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942666 Sep 25 01:09:34.704093 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 924/1802] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:09:34.704971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:34.706917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:34.731662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.732924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.734040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.735544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.736640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.737672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:35.041717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:35.088816 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8af66029-6d13-464d-96a6-0135a6b83995 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.391489 Sep 25 01:09:35.092164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 925/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:34 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:35.098697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-066fbfce-f052-4d03-b905-29787f98e703 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:35.100093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-066fbfce-f052-4d03-b905-29787f98e703 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:35.198258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-066fbfce-f052-4d03-b905-29787f98e703 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:35.206202 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-066fbfce-f052-4d03-b905-29787f98e703 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1216 microversion: 2.1 time: 0.112211 Sep 25 01:09:35.206792 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 926/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:35 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:35.212007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:35.212809 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:35.231174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:35.232022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:35.232998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:35.234104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:35.235144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:35.237066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:35.441149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:35.451076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d560492-bcb8-4bcc-b4a3-1b8d5af081e2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.243052 Sep 25 01:09:35.451702 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 927/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:35 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:36.118438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:36.119023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:36.149663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.150424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.151052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.151794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.152263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.152679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.212071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee24970e-57d1-41ac-b5b0-9193aee4a98f tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a/action" status: 202 len: 0 microversion: 2.25 time: 2.099248 Sep 25 01:09:36.216135 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 879/1806] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:09:34 2022] POST /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a/action => generated 0 bytes in 2105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:09:36.221470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:36.226384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:36.244800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.245337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.245811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.246554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.247018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.247464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.544296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.553862 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57cdd8f3-9ef3-4149-a140-aab1b8cbc31b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.440651 Sep 25 01:09:36.557489 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 928/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:36 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:36.562400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:36.567336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:36.571668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.576016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.576948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.577453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.578159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.578678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.579117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.595688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.597621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.599578 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d405809a-8168-4574-b11d-f93492988ae9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.381813 Sep 25 01:09:36.600547 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 880/1808] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:36 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:36.614535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:36.615156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:36.623232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.623723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.624162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.624865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.625523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.625931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.675684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.686740 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dda30896-49ab-43b4-a9ee-1e68f77be93c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1268 microversion: 2.1 time: 0.128095 Sep 25 01:09:36.702013 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 929/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:36 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:36.942432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.958654 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba9d3426-1d01-412d-8d83-cb893e7bc319 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.355546 Sep 25 01:09:36.959713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 881/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:36 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:37.578805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:37.580040 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:37.591007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.591690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.592298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:37.593206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.593882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.594641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:37.635200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:37.635833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:37.655921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.656520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.656965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:37.657955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.658591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.659204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.301575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.314168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.319060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.321802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.323309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ffc4b96-a2ac-417d-a488-dc71cb6505b9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.696253 Sep 25 01:09:38.324629 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 882/1811] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:37 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:38.331037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:38.331928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:38.334334 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9dcd4a8-0f7e-4e03-8369-ab61b13d1e38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.758512 Sep 25 01:09:38.337858 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 930/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:37 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:38.340357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.341088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.341827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.342816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.343604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.344438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.353132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:38.356082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:38.381326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.383683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.392136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.393221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.393778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.394313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.436398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.446220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1178abe-ce7c-4524-893f-e8e51c75ad3a tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1274 microversion: 2.1 time: 0.119668 Sep 25 01:09:38.449298 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 883/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:38 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:38.665367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.677897 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-20654dc3-cc7a-4798-8610-c5771a200297 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.337078 Sep 25 01:09:38.678840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 931/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:38 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:39.352262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:39.354170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:39.363321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.364151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.364573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:39.364966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.365972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.366831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.367682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.368630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:39.371079 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:39.394373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.395530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.396094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.396860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.397320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.397916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.737493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:39.749053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:39.751336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:39.753363 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6acd416-2efc-42a7-b0ae-5262b86775b8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.407073 Sep 25 01:09:39.755017 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 884/1815] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:39 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:39.769146 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:39.774316 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:39.790034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:39.790850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:39.792761 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a62c258-7c9a-46a8-9a10-57b0f2a47d87 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.434609 Sep 25 01:09:39.795375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 932/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:39 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:39.811313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:39.812309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.814128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.814438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:39.816790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.817874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.820623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.822839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.830807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.831621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.832947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.834658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.836834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.838865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.238530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:40.256649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:40.261891 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d63b74f-3482-4aa3-bd34-7aa26ffb2401 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.505345 Sep 25 01:09:40.268161 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5a770de-dac0-4616-af0e-eb73df36827c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.471159 Sep 25 01:09:40.268879 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 885/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:39 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:40.270328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 933/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:39 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:40.341391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a60b1bb8-7034-478a-b937-e52d21bbfeff req-d8049192-57b5-4a29-9a9e-a6935fccf083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "278b7df8-8638-4435-9d8a-49dde53b4384", "tag": "d2dcdfd2-6c47-4687-8d69-91f23f276ea0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:40.370488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a60b1bb8-7034-478a-b937-e52d21bbfeff req-d8049192-57b5-4a29-9a9e-a6935fccf083 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.371158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a60b1bb8-7034-478a-b937-e52d21bbfeff req-d8049192-57b5-4a29-9a9e-a6935fccf083 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.371650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a60b1bb8-7034-478a-b937-e52d21bbfeff req-d8049192-57b5-4a29-9a9e-a6935fccf083 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.407071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a60b1bb8-7034-478a-b937-e52d21bbfeff req-d8049192-57b5-4a29-9a9e-a6935fccf083 service nova] Creating event network-changed:d2dcdfd2-6c47-4687-8d69-91f23f276ea0 for instance 278b7df8-8638-4435-9d8a-49dde53b4384 on n-h2-master-1 Sep 25 01:09:40.417006 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a60b1bb8-7034-478a-b937-e52d21bbfeff req-d8049192-57b5-4a29-9a9e-a6935fccf083 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082609 Sep 25 01:09:40.418214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 886/1819] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:40.792007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:40.793532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:40.803922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.806536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.807244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.808305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.809122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.811119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.824170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:40.824717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:40.831708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.832890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.833635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.834712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.835372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.837735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.122090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.136979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.138410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.139645 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-445ab720-467e-4d38-9952-1737c81ba727 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.355833 Sep 25 01:09:41.149580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 934/1820] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:40 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:41.163709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.190710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c59834b-71c4-4701-a556-22f2c7c734d5 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.373456 Sep 25 01:09:41.192779 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 887/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:40 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:41.292647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:41.293826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:41.298145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:41.299484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:41.300524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.301032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.301512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.302236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.302696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.306868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.309501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.310505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.311166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.312002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.313480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.314334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.578045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.590910 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ef728b1-5a89-44b9-8958-e2d22ffa7524 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.302627 Sep 25 01:09:41.595479 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 935/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:41 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:41.630818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.640807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20e8e014-b584-4ce9-b87c-df0bcd7d7280 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.349327 Sep 25 01:09:41.644540 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 888/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:41 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:42.167910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:42.168548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:42.183562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.184365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.185086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.186123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.189114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.190082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.216000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:42.217001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:42.231696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.232674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.233923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.234913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.238097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.238875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.668751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.679321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.686091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.689721 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d4128f7-f8aa-4118-b653-412eb152cfdb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.526903 Sep 25 01:09:42.690992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.691527 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 936/1824] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:42 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:42.697926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:42.699450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:42.703609 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba9f5641-18f0-4927-897e-18d72a0b0b91 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.492766 Sep 25 01:09:42.709827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.712589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.713300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.714273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.714743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.715188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.719892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 889/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:42 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:42.733830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:42.734517 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:42.746810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.747334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.747742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.751590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.758770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.759513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.021154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:43.041298 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-549d4c48-7bd4-47c3-95c8-2581805c8f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.320122 Sep 25 01:09:43.045086 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 890/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:42 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:43.072470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:43.083014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4df48e1-e732-4ade-9c1a-aa6a2f84f41f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.390828 Sep 25 01:09:43.084411 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 937/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:42 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:43.719699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:43.721387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:43.734090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:43.735696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.736296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:43.736961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.739646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.740899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.745349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.746201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.758182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.761770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.762767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.765341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.769088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.771633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:44.062355 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:44.508015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:44.531843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:44.550654 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd883d2b-5573-43e5-9da4-ccb343070daf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.818649 Sep 25 01:09:44.552448 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 938/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:43 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:44.565165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:44.566255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:44.576975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:44.577851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:44.584676 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-641dda22-246d-424b-a2ce-dcd6ff9c44e9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.868428 Sep 25 01:09:44.588267 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 891/1829] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:43 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:44.605217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:44.610736 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:44.612437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:44.614212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:44.616318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:44.618124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:44.622217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:44.626993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:44.628459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:44.654565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:44.662090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:44.663231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:44.664731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:44.665451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:44.667021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.206336 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:45.377004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:45.391930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:45.407075 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e5ca87f-1817-4ccf-abca-0a5f2cec6640 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.814101 Sep 25 01:09:45.408448 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 892/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:44 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:45.431787 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ad4af5e-de3d-492c-a7e9-dc8f9bdeb6c5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.865801 Sep 25 01:09:45.432762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 939/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:44 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:45.439644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6410c1cf-84dc-41f2-abf9-7f8ee85095f7 req-7020e31f-149e-4101-9031-fa88500e1c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46634d57-04e7-41e5-ab07-b519e0c7f1f5", "name": "network-vif-plugged", "status": "completed", "tag": "45f9a505-6899-473a-bab5-680e01259f2f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:45.456397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6410c1cf-84dc-41f2-abf9-7f8ee85095f7 req-7020e31f-149e-4101-9031-fa88500e1c7c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:45.458005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6410c1cf-84dc-41f2-abf9-7f8ee85095f7 req-7020e31f-149e-4101-9031-fa88500e1c7c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:45.458866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6410c1cf-84dc-41f2-abf9-7f8ee85095f7 req-7020e31f-149e-4101-9031-fa88500e1c7c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.478880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6410c1cf-84dc-41f2-abf9-7f8ee85095f7 req-7020e31f-149e-4101-9031-fa88500e1c7c service nova] Creating event network-vif-plugged:45f9a505-6899-473a-bab5-680e01259f2f for instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 on n-h1-master-1 Sep 25 01:09:45.490398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6410c1cf-84dc-41f2-abf9-7f8ee85095f7 req-7020e31f-149e-4101-9031-fa88500e1c7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054246 Sep 25 01:09:45.500705 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 940/1832] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:45.579723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:45.581056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:45.598227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:45.599689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:45.602815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.604665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:45.605817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:45.609834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.727117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1056775266", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:45.803649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] validate_networks() for [('8ba3b16a-d4e1-4380-90ab-b76fb35361c6', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:09:46.067560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.089103 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0f511de-9621-4350-83d7-862a06797ac9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1198 microversion: 2.1 time: 0.515223 Sep 25 01:09:46.090800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 941/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:45 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1198 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:46.110149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:46.114317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:46.134984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:46.136612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:46.138422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:46.140335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:46.140813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:46.141267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:46.968171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.983522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.986990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.990943 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6461033b-8c18-4853-92e6-a74666f633bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.895937 Sep 25 01:09:46.995152 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 942/1834] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:46 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:47.003050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:47.003683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.010199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.010770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.011217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.011940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.012396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.012830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.226449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:47.227753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:47.228464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:47.229032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:47.229541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:47.249085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.251570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.252611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.254320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.255231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.255991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.290922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Getting quotas for project 3f5c70f93bfe400eb0b65480498af9e8. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:47.296200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:47.298725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Getting quotas for user 552a5b16cc6644c7b0249f6dee152d15 and project 3f5c70f93bfe400eb0b65480498af9e8. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:47.312741 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53f57dd6-2a3d-457e-8ce9-3ff79882235a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.314286 Sep 25 01:09:47.314838 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 943/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:46 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:47.315059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:47.317949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:47.324391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:47.325269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.354662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.355313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.356014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.357054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.365180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.365561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.407726 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7699725a-3346-4e8c-9efa-2a1f2c91957c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.997660 Sep 25 01:09:47.421776 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 893/1836] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:09:47.431684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d49adfcb-18e4-4e4b-b8d5-89531628ec8b"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:47.434329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.475110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.479802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.482178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.484787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.486656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.487331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.704321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:47.720049 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c154d7ed-f7d9-425c-a08e-ee7b076b9630 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.403319 Sep 25 01:09:47.722263 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 944/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:47 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:47.735523 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:47.737117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.761019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.761543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.761984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.762689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.763147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.763601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.988061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.007160 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e29e4001-290a-499f-aac0-6d8d998228db tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1380 microversion: 2.1 time: 0.280161 Sep 25 01:09:48.008641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 945/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:47 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1380 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:48.018706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-68a17013-7f46-4e9b-a7dc-6b3d21943e35 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.019888 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-68a17013-7f46-4e9b-a7dc-6b3d21943e35 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.083772 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83ae85f6-e891-4e1c-b85a-c9d20c2ee35a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "POST /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660227 Sep 25 01:09:48.084015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-68a17013-7f46-4e9b-a7dc-6b3d21943e35 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.085922 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 894/1839] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:09:47 2022] POST /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments => generated 194 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:48.092113 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-68a17013-7f46-4e9b-a7dc-6b3d21943e35 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1224 microversion: 2.1 time: 0.082045 Sep 25 01:09:48.093297 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 946/1840] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:48.097471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.098470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.109970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.110607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.113801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.115706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.116371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.119941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.120802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.121925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.122986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.123799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.124256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.124636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.124808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.126523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.398226 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ff02a88-8e02-4496-8bde-bdf4d23d7ac3 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1531 microversion: 2.1 time: 0.303841 Sep 25 01:09:48.401844 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 947/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1531 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:48.407976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.409092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.413462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.425581 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:48.439580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.440312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.441048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.453028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.454304 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-683653cf-1004-48d0-9d55-d748e629bda3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.366268 Sep 25 01:09:48.455396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.456331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.457109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.457563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.473985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 895/1842] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:48.486247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.494966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.504936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.505462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.505907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.506635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.510154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.510602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.832175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e491d2ce-6a0c-46ed-8242-135d1e935dd8 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1531 microversion: 2.1 time: 0.356928 Sep 25 01:09:48.836420 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 896/1843] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1531 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:48.848412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.849330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.865417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.869097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.869791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.871991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.873739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.874646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.908374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.919781 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b138c00-107b-4665-a47f-6ac8fc44e2d1 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.516079 Sep 25 01:09:48.921715 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 948/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:48.937106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.954124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.954714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.955168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.955918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.956380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.956900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.037244 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a1af1f3-5b78-401f-a727-2c0e53c790ad tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.114083 Sep 25 01:09:49.049217 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 949/1845] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:49.059193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:49.067190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.088288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.090276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.091378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.092969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.094154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.097535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.120881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:49.135499 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae7183e6-b4cf-4d65-93e3-1893d9faf21c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.294559 Sep 25 01:09:49.143617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 897/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:49.149980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.150904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.155112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lazy-loading 'flavor' on Instance uuid 46634d57-04e7-41e5-ab07-b519e0c7f1f5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:49.167755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.168250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.172423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.173210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.173718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.174208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.179622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Going to try to live migrate instance to n-h2-master-1 {{(pid=122385) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:09:49.312850 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:49.363386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:49.375953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b3993f76-a851-4587-afbe-b8d08f4272bc tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1276 microversion: 2.1 time: 0.230817 Sep 25 01:09:49.376867 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 898/1847] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:49 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:49.492056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.493044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.498729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.499460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.500097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.501083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.501467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.501898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.872544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:49.893465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:49.895197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:49.896615 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13f8c08c-b0b7-4197-aa5a-acd74793ba67 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.409445 Sep 25 01:09:49.918962 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 899/1848] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:49 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:49.924372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd65ceef-ca83-4de5-977a-5f8112f9a42c"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:49.932455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.947865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.950410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.951199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.953483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.954243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.958383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.485678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d0ec8fb-96be-400f-87ff-cfb4972a4eab tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "POST /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564828 Sep 25 01:09:50.487117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 900/1849] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:09:49 2022] POST /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 194 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:50.511201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:50.512769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:50.531413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.537821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.538660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.539748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.541139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.542234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.003313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:51.012766 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-156a6325-775f-46a7-bbe1-a2f66b067649 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.524303 Sep 25 01:09:51.021453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 901/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:50 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:51.033821 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:51.034550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:51.060659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.061172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.061723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.065052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.065801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.066420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.377699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:51.393634 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d71c7933-8bcb-4383-bc17-4e2cf9ad46e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.366917 Sep 25 01:09:51.394593 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 902/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:51 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:51.417778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:51.419042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:51.453964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.454368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.454900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.455723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.456303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.456832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.814644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:51.824942 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d1d8143b-d893-4913-a11c-2a8a5b5f1df7 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.428995 Sep 25 01:09:51.842070 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 903/1852] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:51 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:51.856239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-75626ae8-01e7-4c51-91a2-78a9c8bd6278 req-8d07dd45-4084-4985-ae21-89c661940027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278b7df8-8638-4435-9d8a-49dde53b4384", "name": "network-vif-plugged", "status": "completed", "tag": "d2dcdfd2-6c47-4687-8d69-91f23f276ea0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:51.878019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-75626ae8-01e7-4c51-91a2-78a9c8bd6278 req-8d07dd45-4084-4985-ae21-89c661940027 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.879634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-75626ae8-01e7-4c51-91a2-78a9c8bd6278 req-8d07dd45-4084-4985-ae21-89c661940027 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.880105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-75626ae8-01e7-4c51-91a2-78a9c8bd6278 req-8d07dd45-4084-4985-ae21-89c661940027 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.902442 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-75626ae8-01e7-4c51-91a2-78a9c8bd6278 req-8d07dd45-4084-4985-ae21-89c661940027 service nova] Creating event network-vif-plugged:d2dcdfd2-6c47-4687-8d69-91f23f276ea0 for instance 278b7df8-8638-4435-9d8a-49dde53b4384 on n-h2-master-1 Sep 25 01:09:51.919342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-75626ae8-01e7-4c51-91a2-78a9c8bd6278 req-8d07dd45-4084-4985-ae21-89c661940027 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075793 Sep 25 01:09:51.919972 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 904/1853] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:51.928959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:51.929777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:51.951688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.952222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.952667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.953395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.961023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.961621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.016768 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5517277-876e-40ec-9f26-efba4fc0e141 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5/action" status: 202 len: 0 microversion: 2.1 time: 2.965250 Sep 25 01:09:52.018734 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 950/1854] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:09:49 2022] POST /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5/action => generated 0 bytes in 2969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:52.039758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:52.042821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:52.071655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.073466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.074528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.076366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.077159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.081801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.313523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.324458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.327239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.329873 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b043289-39df-4615-942d-2b82370d00bc tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.404735 Sep 25 01:09:52.330857 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 905/1855] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:51 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:52.341661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:52.343525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:52.354555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.359840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.370486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.370935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.371724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.374189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.375085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.375876 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e92c173-831a-4c28-8208-05c3ba01cdfe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.351305 Sep 25 01:09:52.377889 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 951/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:52 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:52.416616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-01100381-d6a5-4d2d-8898-bbb6a28dc7e3 req-9a8a5a00-cbde-416b-bcb8-43bb348d432a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4640d36-a9c9-413a-89d0-2c6d808d5af5", "tag": "ea735752-0639-455f-bd67-b08f5be4538f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:52.436124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01100381-d6a5-4d2d-8898-bbb6a28dc7e3 req-9a8a5a00-cbde-416b-bcb8-43bb348d432a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.436615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01100381-d6a5-4d2d-8898-bbb6a28dc7e3 req-9a8a5a00-cbde-416b-bcb8-43bb348d432a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.437041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01100381-d6a5-4d2d-8898-bbb6a28dc7e3 req-9a8a5a00-cbde-416b-bcb8-43bb348d432a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.476430 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-01100381-d6a5-4d2d-8898-bbb6a28dc7e3 req-9a8a5a00-cbde-416b-bcb8-43bb348d432a service nova] Creating event network-changed:ea735752-0639-455f-bd67-b08f5be4538f for instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 on n-h1-master-1 Sep 25 01:09:52.485884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-01100381-d6a5-4d2d-8898-bbb6a28dc7e3 req-9a8a5a00-cbde-416b-bcb8-43bb348d432a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074428 Sep 25 01:09:52.487534 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 952/1857] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:52.497757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:52.498528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:52.508559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.509067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.509558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.512080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.512741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.513326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.636242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.662353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a6f28aa-e8b9-45c9-b0c0-05a5c028ddb9 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.328216 Sep 25 01:09:52.662956 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 906/1858] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:52 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:52.708582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.716706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1869176-4ff1-40f7-a73c-9dad87bb9bbe tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.223671 Sep 25 01:09:52.724498 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 953/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:52 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:52.855583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:52.856280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:52.862688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.863172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.863611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.864311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.864760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.865180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.015619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.024247 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bcbfaf8e-6335-4d49-99a3-8e55bd616a9d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.172512 Sep 25 01:09:53.029446 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 907/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:52 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:53.360595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:53.361304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:53.369213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.369757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.370235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.370971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.371476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.371866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.403456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:53.404362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:53.419465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.420110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.420759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.421921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.422449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.422955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.581099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.591669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.593265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.594878 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3016d3aa-15ea-44fa-87d4-1031aed04399 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.238188 Sep 25 01:09:53.596126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 954/1861] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:53 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:53.622850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.632577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-460f9a8e-7a7f-48a6-84de-81ff3911741a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.233456 Sep 25 01:09:53.635916 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 908/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:53 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:53.686387 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:53.687016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:53.694956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.695471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.696064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.696819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.697810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.698246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.741052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:53.741947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:53.749132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.749132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.749756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.750653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.751281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.751844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.923850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.938742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-89e743d1-acd7-4087-ab06-b80dc7e7b024 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.256359 Sep 25 01:09:53.953427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 955/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:53 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:53.954760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.963636 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f264b45c-6ddc-4a05-b2ce-30354b2b0cfc tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1316 microversion: 2.1 time: 0.226873 Sep 25 01:09:53.964602 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 909/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:53 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:54.052056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:54.053492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:54.064139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.064685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.065136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.065901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.066351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.066782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.272659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.284920 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df8233c6-ac60-4e70-a626-862e638d3f0a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.240636 Sep 25 01:09:54.286077 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 956/1865] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:54 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:54.626111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:54.626837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:54.634437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.635022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.635522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.636337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.636853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.637394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.659725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:54.660398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:54.668807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.669506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.669963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.670745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.671272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.671786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.942099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.951692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.953152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.954440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ba29ea7-a25d-4a23-8106-a7fc868de6f7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.332622 Sep 25 01:09:54.967886 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 910/1866] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:54 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:54.980381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:54.981791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:54.983905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.988076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.988670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.989111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.989868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.990295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.990714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.996436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74e238d3-7c37-4268-88d6-a296e1736a3a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.339075 Sep 25 01:09:54.997291 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 957/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:54 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:55.001755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:55.002394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:55.029527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.031040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.032338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.034293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.035247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.036472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.318433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:55.323733 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:55.330820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8ef3a9d-b725-445e-b164-3733b4b0fb8e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.361660 Sep 25 01:09:55.338323 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 911/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:54 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:55.338909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:55.339648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:55.349061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:55.357665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.358515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.359656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8a0d8317-e858-410f-80aa-88b3b2f18166 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1504 microversion: 2.1 time: 0.361472 Sep 25 01:09:55.359895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.360827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 958/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:54 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:55.361133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.361722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.362152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.388981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1468299863"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:55.388981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:55.401906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.404526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.405387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.408382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.409743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.410370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.695907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:55.705886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80af3ba1-287e-4c68-b586-468cb81abd5e tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.372509 Sep 25 01:09:55.707253 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 912/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:55 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:55.723604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ae302a1e-a3c9-4e51-9133-9e7c2785756a req-b1ecd89b-7a09-4309-88e6-84e91aefb30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f1aacd-e503-4f6c-82b5-f0d05ea5329a", "name": "network-vif-unplugged", "status": "completed", "tag": "f90f8324-63c2-49db-98b6-f9d4aa3992ac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:55.738033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae302a1e-a3c9-4e51-9133-9e7c2785756a req-b1ecd89b-7a09-4309-88e6-84e91aefb30f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.738513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae302a1e-a3c9-4e51-9133-9e7c2785756a req-b1ecd89b-7a09-4309-88e6-84e91aefb30f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.738936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae302a1e-a3c9-4e51-9133-9e7c2785756a req-b1ecd89b-7a09-4309-88e6-84e91aefb30f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.754110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Adding security group 40b06461-2eab-4049-b365-0f8d7efa4cbf to port d2dcdfd2-6c47-4687-8d69-91f23f276ea0 Sep 25 01:09:55.755251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ae302a1e-a3c9-4e51-9133-9e7c2785756a req-b1ecd89b-7a09-4309-88e6-84e91aefb30f service nova] Creating event network-vif-unplugged:f90f8324-63c2-49db-98b6-f9d4aa3992ac for instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a on n-h1-master-1 Sep 25 01:09:55.762748 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ae302a1e-a3c9-4e51-9133-9e7c2785756a req-b1ecd89b-7a09-4309-88e6-84e91aefb30f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052940 Sep 25 01:09:55.763679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 913/1871] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:55.987000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:55.987687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:55.995114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.995604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.996037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.996742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.997189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.997796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:56.331749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:56.347856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:56.353054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:56.354815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55b3547d-c983-4236-b8bf-eec69a11c2cb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.372533 Sep 25 01:09:56.357585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 914/1872] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:55 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:56.368886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:56.369898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:56.379830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:56.380865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:56.381578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:56.383391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:56.384664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:56.385473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:56.527512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5621e5e7-e76f-4ed2-83cd-aad3ba5b715f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384/action" status: 202 len: 0 microversion: 2.1 time: 1.147292 Sep 25 01:09:56.529440 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 959/1873] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:09:55 2022] POST /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384/action => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:09:56.546856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:56.549577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:56.574513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:56.574975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:56.575423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:56.576150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:56.576607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:56.577030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:56.766080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:56.775615 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff5e20ef-b6d1-4afe-bf6e-0ea146ad0efb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.415833 Sep 25 01:09:56.776570 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 915/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:56 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:56.797934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d5a6bbb-ec6b-49b8-a92b-c94a0568c413 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebcb54c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:56.849665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:56.860301 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9cb614d6-e498-4b90-b63f-4bc2df583bef tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.328951 Sep 25 01:09:56.861266 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 960/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:56 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:56.867209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:56.868383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:56.875066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:56.876036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:56.876957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:56.878213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:56.879642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:56.880489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.013372 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-5d5a6bbb-ec6b-49b8-a92b-c94a0568c413 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use.", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:09:57.014086 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5d5a6bbb-ec6b-49b8-a92b-c94a0568c413 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.014086 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d5a6bbb-ec6b-49b8-a92b-c94a0568c413 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf HTTP/1.1 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: exception: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '40b06461-2eab-4049-b365-0f8d7efa4cbf'} Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:09:57.016060 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d5a6bbb-ec6b-49b8-a92b-c94a0568c413 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 400 to user: Security Group 40b06461-2eab-4049-b365-0f8d7efa4cbf in use. Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-849ac83f-e932-4677-9476-3dfcbb121891'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d5a6bbb-ec6b-49b8-a92b-c94a0568c413 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf" status: 400 len: 185 microversion: 2.1 time: 0.239563 Sep 25 01:09:57.021516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 916/1876] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:09:56 2022] DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf => generated 185 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:09:57.028749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:57.031933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:57.045072 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:57.047632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.048552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.051211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.052462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.054397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.055211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.090240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:57.100400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-562cb7cf-0421-4dd3-9486-c7fc24407d52 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.237625 Sep 25 01:09:57.118189 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 961/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:56 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:57.165380 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea8b9796-49c3-4fa0-b363-d2f6d4315650 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384/action" status: 202 len: 0 microversion: 2.1 time: 0.142106 Sep 25 01:09:57.169315 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 917/1878] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:09:57 2022] POST /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:57.176308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:57.177183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:57.186673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.186916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.187566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.188893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.189561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.190841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.386775 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:57.387853 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:57.393022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:57.394046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:57.408403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.414166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.416633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.417879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.418391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.418834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.474310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:57.483905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e6a3f66c-b494-44ad-86ca-88755b68b46b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1575 microversion: 2.1 time: 0.313057 Sep 25 01:09:57.484987 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 962/1879] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:57 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1575 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:57.707549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:57.724852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:57.737049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:57.740069 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb262de6-6e58-419f-bd4a-ac605eae171e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.354178 Sep 25 01:09:57.742794 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 918/1880] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:57 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:57.794851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f1aacd-e503-4f6c-82b5-f0d05ea5329a", "tag": "f90f8324-63c2-49db-98b6-f9d4aa3992ac"}, {"name": "network-changed", "server_uuid": "278b7df8-8638-4435-9d8a-49dde53b4384", "tag": "d2dcdfd2-6c47-4687-8d69-91f23f276ea0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:57.802223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:57.803011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:57.810937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.811688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.812395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.813656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.814392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.815072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.816742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.817224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.817686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.833352 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] Creating event network-changed:f90f8324-63c2-49db-98b6-f9d4aa3992ac for instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a on n-h1-master-1 Sep 25 01:09:57.834254 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] Creating event network-changed:d2dcdfd2-6c47-4687-8d69-91f23f276ea0 for instance 278b7df8-8638-4435-9d8a-49dde53b4384 on n-h2-master-1 Sep 25 01:09:57.844977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e3477d38-7da5-4a0e-8871-af51532eb45e req-b542f02a-ef4c-4ff1-8724-fa4c0f6f08ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054241 Sep 25 01:09:57.846897 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 963/1881] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:57.891840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:57.894265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:57.904467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.905524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.906209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:57.907194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:57.908292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:57.909370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.088962 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:58.111015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:58.124720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86cecd5e-d881-40ee-aa98-d255deb259f3 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.325960 Sep 25 01:09:58.134975 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 919/1882] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:57 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:58.134975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:58.140477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:58.146697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:58.147888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:58.148671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.150397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:58.151016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:58.151716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.540577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:58.551582 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1127bc79-f7ee-4528-b072-cb3c7a85e7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.665679 Sep 25 01:09:58.558218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 964/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:57 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:58.567751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:58.568739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:58.579183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:58.580164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:58.580799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.582209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:58.582841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:58.583438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.675376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:58.699990 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d086e94-bb65-4313-b3b1-a8c78b107db1 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.570727 Sep 25 01:09:58.701116 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 920/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:58 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:58.768200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:58.769615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:58.781450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:58.782489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:58.783194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.784255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:58.784991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:58.785720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:58.802925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:58.817557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a5a9f70-f161-4e56-972a-e9511e698eab tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1575 microversion: 2.1 time: 0.257706 Sep 25 01:09:58.834474 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 965/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:58 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:59.093704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:59.108289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:59.109981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:59.111259 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4202620b-8d56-4ec8-a2c9-7163f1457a5e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.349018 Sep 25 01:09:59.129135 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 921/1886] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:58 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:59.153765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:59.155092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:59.158186 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:59.164870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.165694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.166318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.167235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.167873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.168486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.342119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:59.352476 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1af3679d-57d1-4b8e-bfb2-d31534280515 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.202833 Sep 25 01:09:59.353352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 966/1887] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:59 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:59.558948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8f2e9055-d107-4130-9cc2-26f3453b1658 req-a35ba3c2-39b0-4727-9511-85dcde7ef9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4640d36-a9c9-413a-89d0-2c6d808d5af5", "name": "network-vif-plugged", "status": "completed", "tag": "ea735752-0639-455f-bd67-b08f5be4538f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:59.587299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:59.587564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8f2e9055-d107-4130-9cc2-26f3453b1658 req-a35ba3c2-39b0-4727-9511-85dcde7ef9fb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.588002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8f2e9055-d107-4130-9cc2-26f3453b1658 req-a35ba3c2-39b0-4727-9511-85dcde7ef9fb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.588436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8f2e9055-d107-4130-9cc2-26f3453b1658 req-a35ba3c2-39b0-4727-9511-85dcde7ef9fb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.588994 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:59.611906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8f2e9055-d107-4130-9cc2-26f3453b1658 req-a35ba3c2-39b0-4727-9511-85dcde7ef9fb service nova] Creating event network-vif-plugged:ea735752-0639-455f-bd67-b08f5be4538f for instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 on n-h1-master-1 Sep 25 01:09:59.613363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.614061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.617419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.620421 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8f2e9055-d107-4130-9cc2-26f3453b1658 req-a35ba3c2-39b0-4727-9511-85dcde7ef9fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067543 Sep 25 01:09:59.621508 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 922/1888] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:59.621851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.622600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.623308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.723780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:59.724634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:59.735104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.735723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.736435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.737727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.738433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.739034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.962672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:59.972391 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8de1a1b6-c510-4a9b-bda8-ca809a8233aa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.389853 Sep 25 01:09:59.973206 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 967/1889] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:59 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:59.979822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:59.980470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:59.987020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.987779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.988390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.989373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.990033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.990637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.993887 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:00.015997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:00.033253 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc24ad7c-e21e-4fe0-a950-c4608be45ed0 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.313881 Sep 25 01:10:00.034211 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 923/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:59 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:00.161899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:00.162609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:00.171444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:00.172249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:00.172818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:00.173714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:00.174166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:00.174733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:00.223533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:00.233261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d81c9446-0c62-4af6-9f1c-684ac5077cae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1573 microversion: 2.1 time: 0.258689 Sep 25 01:10:00.234280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 968/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:59 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1573 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:00.260160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-418499479"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:00.260746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:00.268546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:00.269511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:00.270213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:00.271195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:00.271897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:00.272859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:00.406151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:00.415916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:00.418497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:00.420088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3451eb6-1d31-4aae-9bb9-46a2a7bfe599 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.262198 Sep 25 01:10:00.421250 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 924/1892] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:00 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:10:00.438173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:00.439287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:00.447564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:00.448879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:00.449257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:00.450011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:00.450465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:00.450882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:00.475623 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Adding security group 817467bf-1e8b-4abe-9978-ad022a45348b to port d2dcdfd2-6c47-4687-8d69-91f23f276ea0 Sep 25 01:10:00.718789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:00.729152 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb89b95a-9144-4cb9-b16c-56e0cd35eb4e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.306365 Sep 25 01:10:00.739621 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 925/1893] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:00 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:01.002431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.003022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.010617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.011279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.011993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.012956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.013588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.014022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.119075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b12249fa-05a7-4001-8703-ea524660cd8f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384/action" status: 202 len: 0 microversion: 2.1 time: 0.863913 Sep 25 01:10:01.119735 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 969/1894] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:10:00 2022] POST /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:10:01.128453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.129081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.137119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.138065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.138190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.138898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.140036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.140256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.309859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.321873 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0d6a50f-3379-4861-ac60-949bd312af5e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1514 microversion: 2.1 time: 0.323298 Sep 25 01:10:01.325772 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 926/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:00 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:01.330819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97077d9e-cf20-4b09-84fb-98cf0e05b16b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebcb59d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.412198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.433492 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b9bfb864-7ab6-42fa-be1b-3f530f800b95 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1324 microversion: 2.1 time: 0.312165 Sep 25 01:10:01.434321 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 970/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:01 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:01.441643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-18e79d0b-6dd0-43d9-9a76-f152b4d1e5c2 req-279819e5-49a5-42b1-a1a2-8e68593ab316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "278b7df8-8638-4435-9d8a-49dde53b4384", "tag": "d2dcdfd2-6c47-4687-8d69-91f23f276ea0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:01.454686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18e79d0b-6dd0-43d9-9a76-f152b4d1e5c2 req-279819e5-49a5-42b1-a1a2-8e68593ab316 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.456253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18e79d0b-6dd0-43d9-9a76-f152b4d1e5c2 req-279819e5-49a5-42b1-a1a2-8e68593ab316 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.456766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18e79d0b-6dd0-43d9-9a76-f152b4d1e5c2 req-279819e5-49a5-42b1-a1a2-8e68593ab316 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.471990 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-18e79d0b-6dd0-43d9-9a76-f152b4d1e5c2 req-279819e5-49a5-42b1-a1a2-8e68593ab316 service nova] Creating event network-changed:d2dcdfd2-6c47-4687-8d69-91f23f276ea0 for instance 278b7df8-8638-4435-9d8a-49dde53b4384 on n-h2-master-1 Sep 25 01:10:01.478639 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-18e79d0b-6dd0-43d9-9a76-f152b4d1e5c2 req-279819e5-49a5-42b1-a1a2-8e68593ab316 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042750 Sep 25 01:10:01.479532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 971/1897] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:01.485736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.486770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.496195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.496745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.497191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.498080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.498572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.499087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.500131 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-97077d9e-cf20-4b09-84fb-98cf0e05b16b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use.", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:01.501478 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-97077d9e-cf20-4b09-84fb-98cf0e05b16b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.501478 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97077d9e-cf20-4b09-84fb-98cf0e05b16b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b HTTP/1.1 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: exception: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '817467bf-1e8b-4abe-9978-ad022a45348b'} Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:01.503854 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97077d9e-cf20-4b09-84fb-98cf0e05b16b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 400 to user: Security Group 817467bf-1e8b-4abe-9978-ad022a45348b in use. Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-b11b599d-a763-42d4-ba21-99396bd55ddf'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-97077d9e-cf20-4b09-84fb-98cf0e05b16b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b" status: 400 len: 185 microversion: 2.1 time: 0.178066 Sep 25 01:10:01.511642 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 927/1898] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:01 2022] DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b => generated 185 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:10:01.518039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.518636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.530041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.530638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.531271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.532122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.532666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.533165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.563736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:01.673758 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18dfd45a-bf49-4bb0-96f5-8092cd0756d0 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 204 len: 0 microversion: 2.1 time: 0.161730 Sep 25 01:10:01.679819 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 928/1899] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:01 2022] DELETE /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:10:01.687222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.688372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.698373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.699131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.699786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.700772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.701245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.701792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.727382 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:01.846637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.856868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.858725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.859927 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b7f222e-fe2f-4eaf-8cf2-bcef04c3e96c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.379025 Sep 25 01:10:01.860490 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 972/1900] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:01 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:01.865360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.866790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.873691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.874487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.875159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.875880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.876572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.877008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.969279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.979344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5deaf35c-de56-4271-a10a-e3ea073df3fa tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1647 microversion: 2.1 time: 0.297556 Sep 25 01:10:01.988122 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 929/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:01 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1647 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:02.041438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:02.050083 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eccc1679-5518-4bc3-b84d-417faf8fb019 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.188251 Sep 25 01:10:02.050637 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 973/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:01 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:02.346236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:02.346864 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:02.354499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.354986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.355430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.356138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.356593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.357027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.458838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:02.459571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:02.467220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.467714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.468155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.468869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.469473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.469912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.500922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:02.510441 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1329535-669f-41b4-8a62-fcd39f39b1b8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.168047 Sep 25 01:10:02.511203 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 930/1903] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:02 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:02.641007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:02.653435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ada730a8-b1cc-4088-bebe-935ebd7cfa01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1519 microversion: 2.1 time: 0.198635 Sep 25 01:10:02.654036 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 974/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:02 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:02.720519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6fd1163-783d-42fe-b4bd-d4cbc237e26c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-528867363", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6fd1163-783d-42fe-b4bd-d4cbc237e26c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 242 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-528867363", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-528867363', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8ba3b16a-d4e1-4380-90ab-b76fb35361c6'}]}}} Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:02.724897 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6fd1163-783d-42fe-b4bd-d4cbc237e26c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6fd1163-783d-42fe-b4bd-d4cbc237e26c tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010749 Sep 25 01:10:02.733927 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 931/1905] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:10:02.738383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8aa0bde9-9b50-4ebc-ad28-e419e2a16a9a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:02.738889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8aa0bde9-9b50-4ebc-ad28-e419e2a16a9a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: 58e13435-752f-43b3-9a02-565f73f30818] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:02.744995 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-8aa0bde9-9b50-4ebc-ad28-e419e2a16a9a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] HTTP exception thrown: Instance 58e13435-752f-43b3-9a02-565f73f30818 could not be found. Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8aa0bde9-9b50-4ebc-ad28-e419e2a16a9a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/58e13435-752f-43b3-9a02-565f73f30818/metadata HTTP/1.1 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 58e13435-752f-43b3-9a02-565f73f30818 could not be found. Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': '58e13435-752f-43b3-9a02-565f73f30818'} Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e13435-752f-43b3-9a02-565f73f30818 could not be found. Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e13435-752f-43b3-9a02-565f73f30818 could not be found. Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.749582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e13435-752f-43b3-9a02-565f73f30818 could not be found. Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8aa0bde9-9b50-4ebc-ad28-e419e2a16a9a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 404 to user: Instance 58e13435-752f-43b3-9a02-565f73f30818 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8aa0bde9-9b50-4ebc-ad28-e419e2a16a9a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/58e13435-752f-43b3-9a02-565f73f30818/metadata" status: 404 len: 111 microversion: 2.1 time: 0.016633 Sep 25 01:10:02.755045 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 975/1906] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:10:02 2022] GET /compute/v2.1/servers/58e13435-752f-43b3-9a02-565f73f30818/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:02.804217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bada3d11-407e-4f24-a971-c3149ca8c64a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1066178578", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bada3d11-407e-4f24-a971-c3149ca8c64a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 499 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1066178578", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1066178578', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ba3b16a-d4e1-4380-90ab-b76fb35361c6'}]}}} Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:10:02.808540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bada3d11-407e-4f24-a971-c3149ca8c64a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bada3d11-407e-4f24-a971-c3149ca8c64a tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010056 Sep 25 01:10:02.812895 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 932/1907] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:02 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:10:02.862229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c2b73a1-6f73-455e-b8e2-0ef8a5c1d2b4 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1126342524", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c2b73a1-6f73-455e-b8e2-0ef8a5c1d2b4 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 500 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1126342524", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1126342524', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ba3b16a-d4e1-4380-90ab-b76fb35361c6'}]}}} Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:10:02.867070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c2b73a1-6f73-455e-b8e2-0ef8a5c1d2b4 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c2b73a1-6f73-455e-b8e2-0ef8a5c1d2b4 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011008 Sep 25 01:10:02.872450 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 976/1908] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:02 2022] POST /compute/v2.1/servers => generated 689 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:10:02.889508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:02.890189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:02.896727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.897259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.898330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.899058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.899506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.899931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.923625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02299d06-0de5-4c17-8fc0-97589c8dc0d5 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1784137288", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02299d06-0de5-4c17-8fc0-97589c8dc0d5 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 754 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1784137288", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1784137288', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ba3b16a-d4e1-4380-90ab-b76fb35361c6'}]}}} Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:10:02.928228 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:10:02.932103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:10:02.935463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.935463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.935463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02299d06-0de5-4c17-8fc0-97589c8dc0d5 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:02.935463 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-02299d06-0de5-4c17-8fc0-97589c8dc0d5 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012435 Sep 25 01:10:02.936230 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 977/1909] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:02 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 25 01:10:02.983671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710c29e1-2874-4921-aab2-de90e3590b01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1067307852", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710c29e1-2874-4921-aab2-de90e3590b01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 1266 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1067307852", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ba3b16a-d4e1-4380-90ab-b76fb35361c6"}]}} Sep 25 01:10:02.988405 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1067307852', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ba3b16a-d4e1-4380-90ab-b76fb35361c6'}]}}} Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.991447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:10:02.993176 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:10:02.995684 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:10:02.995684 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:02.995684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710c29e1-2874-4921-aab2-de90e3590b01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:02.995684 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-710c29e1-2874-4921-aab2-de90e3590b01 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010795 Sep 25 01:10:02.995684 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 978/1910] 10.222.0.16 () {60 vars in 1148 bytes} [Sun Sep 25 01:10:02 2022] POST /compute/v2.1/servers => generated 2221 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 25 01:10:03.002938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-790db7a5-8168-40f8-bb1f-fc4edf5d0a06 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.003436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-790db7a5-8168-40f8-bb1f-fc4edf5d0a06 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: 4ecf3362-e551-42fd-9270-5025c0160dd2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.010779 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-790db7a5-8168-40f8-bb1f-fc4edf5d0a06 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] HTTP exception thrown: Instance 4ecf3362-e551-42fd-9270-5025c0160dd2 could not be found. Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-790db7a5-8168-40f8-bb1f-fc4edf5d0a06 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/4ecf3362-e551-42fd-9270-5025c0160dd2/metadata/test2 HTTP/1.1 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4ecf3362-e551-42fd-9270-5025c0160dd2 could not be found. Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': '4ecf3362-e551-42fd-9270-5025c0160dd2', 'id': 'test2'} Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ecf3362-e551-42fd-9270-5025c0160dd2 could not be found. Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ecf3362-e551-42fd-9270-5025c0160dd2 could not be found. Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:03.012294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ecf3362-e551-42fd-9270-5025c0160dd2 could not be found. Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-790db7a5-8168-40f8-bb1f-fc4edf5d0a06 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 404 to user: Instance 4ecf3362-e551-42fd-9270-5025c0160dd2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-790db7a5-8168-40f8-bb1f-fc4edf5d0a06 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/4ecf3362-e551-42fd-9270-5025c0160dd2/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015856 Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 979/1911] 10.222.0.16 () {58 vars in 1281 bytes} [Sun Sep 25 01:10:02 2022] GET /compute/v2.1/servers/4ecf3362-e551-42fd-9270-5025c0160dd2/metadata/test2 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:03.034399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.035235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.046102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.046500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.047303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.048539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.049488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.050287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.053482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.062536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.063946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.065148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c888e010-7483-4232-a82d-cffde2687cb8 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.180576 Sep 25 01:10:03.071728 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 933/1912] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:02 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:03.071728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.071728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.077967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.078281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.078590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.079301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.079753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.080182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.108263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:03.192314 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ddf786fd-1913-47b9-bf9e-b6c26c94abb8 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 204 len: 0 microversion: 2.1 time: 0.125156 Sep 25 01:10:03.196791 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 934/1913] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:03 2022] DELETE /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:10:03.200034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.200768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.207518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.208013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.208518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.209249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.209911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.210328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.246770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.249760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2ede6974-c8c3-4b7d-b833-758764b0c12f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1647 microversion: 2.1 time: 0.233891 Sep 25 01:10:03.250352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 980/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:03 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1647 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:03.255140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.255963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.262553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.263040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.263483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.264183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.264639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.265065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.509989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.518875 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59f4e741-c42b-4772-9e78-d01084e5c8ec tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.323507 Sep 25 01:10:03.519470 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 935/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:03 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:03.534577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.536217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.536837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.544503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.545097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.545381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a1ec73c-6a57-420d-b2d9-996991e59b65 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1525 microversion: 2.1 time: 0.293926 Sep 25 01:10:03.545743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.545998 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 981/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:03 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1525 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:03.546610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.547074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.547501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.691818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.704885 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2d020f9-e10d-4899-bfdb-8e446db66e74 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.172158 Sep 25 01:10:03.705985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 936/1917] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:03 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:04.092655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:04.093317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:04.096292 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:04.103557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.104151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.104616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.105564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.106094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.106537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.260199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.269976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.271601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.273585 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83c86d2b-60ed-41a2-8b72-8eefe78759ba tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.185120 Sep 25 01:10:04.274476 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 982/1918] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:04 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:10:04.274772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:04.275402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:04.281721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.282215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.282650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.283355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.283812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.284270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.457160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.471555 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2357fceb-2704-4833-a014-699d28d81d4b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1647 microversion: 2.1 time: 0.200877 Sep 25 01:10:04.472617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 937/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:04 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1647 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:04.543190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:04.543883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:04.550441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.550934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.551375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.552082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.552530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.552953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.572394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:04.573068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:04.582756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.583244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.583680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.584388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.585614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.586050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.782684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.786728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.791041 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e84cbeb0-89e4-447f-8a0b-7679c343d54d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.252050 Sep 25 01:10:04.791628 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 983/1920] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:04 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:04.794678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8d4aa0d7-6f30-49a9-ba79-db18b3c6c806 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1525 microversion: 2.1 time: 0.227583 Sep 25 01:10:04.795406 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 938/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:04 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1525 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:04.796381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:04.797028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:04.804206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.804951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.805500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.806286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.806814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.807414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.942560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.951902 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-466b4a07-8204-43cc-b02a-e9e8c85a3c7a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.159253 Sep 25 01:10:04.952533 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 984/1922] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:04 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:05.084879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1f05f556-a361-446d-a485-b47a3de83c31 req-3f519495-78bf-47c2-8817-f8ae08048df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f005f-46a7-4d44-be2b-b8afc7fad760", "name": "network-vif-unplugged", "status": "completed", "tag": "5db086cf-1758-472f-bf2c-7ac2e04a2801"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:05.102660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1f05f556-a361-446d-a485-b47a3de83c31 req-3f519495-78bf-47c2-8817-f8ae08048df2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.103172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1f05f556-a361-446d-a485-b47a3de83c31 req-3f519495-78bf-47c2-8817-f8ae08048df2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.103705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1f05f556-a361-446d-a485-b47a3de83c31 req-3f519495-78bf-47c2-8817-f8ae08048df2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.116704 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1f05f556-a361-446d-a485-b47a3de83c31 req-3f519495-78bf-47c2-8817-f8ae08048df2 service nova] Creating event network-vif-unplugged:5db086cf-1758-472f-bf2c-7ac2e04a2801 for instance e26f005f-46a7-4d44-be2b-b8afc7fad760 on n-h2-master-1 Sep 25 01:10:05.121906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1f05f556-a361-446d-a485-b47a3de83c31 req-3f519495-78bf-47c2-8817-f8ae08048df2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042013 Sep 25 01:10:05.122518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 939/1923] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:05.300325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:05.300953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:05.308766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.309252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.309727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.310432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.310924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.311355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.453262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:05.463426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:05.465130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:05.466345 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a8e8e397-1ada-465a-8b49-39f0c9aecfd9 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.170098 Sep 25 01:10:05.466921 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 985/1924] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:05 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:05.499311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:05.500000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:05.511203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.511203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.511203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.511203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.511203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.511203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.699554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:05.710179 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5773d6b2-27cc-4d6b-b2f8-053e2ecc9709 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1647 microversion: 2.1 time: 0.215548 Sep 25 01:10:05.711150 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 940/1925] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:05 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1647 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:05.815173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:05.815724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:05.820715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:05.822193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:05.823092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.823801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.824420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.825316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.826003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.826660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.829921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.830646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.831159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.833828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.834392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.835460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.072989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.082006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e636b36-c7fe-4364-b0d5-ad5392cbce83 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.270806 Sep 25 01:10:06.098816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552a5b16cc6644c7b0249f6dee152d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5c70f93bfe400eb0b65480498af9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.099252 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 986/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:05 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:06.105257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:06.106216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:06.114608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.115357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.116197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.117136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.118140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.119075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.120476 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c850fb05-1c2d-4a15-8bb1-9b708d8ab899 tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 200 len: 1525 microversion: 2.1 time: 0.304829 Sep 25 01:10:06.135522 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 941/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:05 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 1525 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:06.252445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-55eeaae9-db52-4d04-9cf1-17992e02c605 req-8745ca88-4df0-4dba-af50-0f8fdf3aec0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4640d36-a9c9-413a-89d0-2c6d808d5af5", "name": "network-vif-deleted", "tag": "ea735752-0639-455f-bd67-b08f5be4538f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:06.291847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55eeaae9-db52-4d04-9cf1-17992e02c605 req-8745ca88-4df0-4dba-af50-0f8fdf3aec0c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.292417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55eeaae9-db52-4d04-9cf1-17992e02c605 req-8745ca88-4df0-4dba-af50-0f8fdf3aec0c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.292855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55eeaae9-db52-4d04-9cf1-17992e02c605 req-8745ca88-4df0-4dba-af50-0f8fdf3aec0c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.316629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-55eeaae9-db52-4d04-9cf1-17992e02c605 req-8745ca88-4df0-4dba-af50-0f8fdf3aec0c service nova] Creating event network-vif-deleted:ea735752-0639-455f-bd67-b08f5be4538f for instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 on n-h1-master-1 Sep 25 01:10:06.323841 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-55eeaae9-db52-4d04-9cf1-17992e02c605 req-8745ca88-4df0-4dba-af50-0f8fdf3aec0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079713 Sep 25 01:10:06.324783 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 942/1928] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:06.375428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.384839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a53b980f-ea19-489e-b4e7-4df95387dee4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.284427 Sep 25 01:10:06.385749 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 987/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:06 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:06.496013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:06.496752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:06.506233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.507613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.508053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.508792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.510154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.510608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.733548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.744360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.746365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.748382 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3e59ee2-e673-402b-8cfc-8361ca520261 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.258543 Sep 25 01:10:06.748966 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 943/1930] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:06 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:06.762672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:06.765365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:06.795109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.797386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.800777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.803465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.806722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.807277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.881067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:06.884344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:06.891618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.892382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.893156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.894029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.894887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.895646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.942236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-167686d9-9c4d-48ed-9e30-88b756ade3c0 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065292 Sep 25 01:10:06.943929 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 944/1931] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:06 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:06.968187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:06.969094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:06.987497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.988475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.989385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.991574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:06.992552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:06.993457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.233961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lazy-loading 'services' on Instance uuid 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:07.322675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:07.339101 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c3044611-52c5-4424-bbe4-1e401709bfb9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1647 microversion: 2.1 time: 0.603421 Sep 25 01:10:07.353832 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 988/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:06 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1647 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:07.363579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:07.364378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:07.378057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.379413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.381931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.383886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.385263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.386396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.409948 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01b078b7-4c51-4627-b39b-2ba10fedac07 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments/d49adfcb-18e4-4e4b-b8d5-89531628ec8b" status: 202 len: 0 microversion: 2.1 time: 0.443625 Sep 25 01:10:07.412762 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 945/1933] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:10:06 2022] DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments/d49adfcb-18e4-4e4b-b8d5-89531628ec8b => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:07.448334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:07.449209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] [instance: d4640d36-a9c9-413a-89d0-2c6d808d5af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:07.483968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.484466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.484903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.489791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.491115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.492262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.519722 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] HTTP exception thrown: Instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 could not be found. Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Request method failure captured: Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 HTTP/1.1 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6pYspf4DgomczIk6eE8z4MBHWq5FejxoI-Es0gkNB-4uHPkInFHbd2v6FXm-KHnUR5lb4e9sJiP-EjPUsPzI5aWY_I7Xlso5qrXgdLGcLc92luPJZF0ID4uX35dEPPQiPL_xlRiCOYIzIu9L2jCmOw9P2vRhFZ2wImCbcLovssVbHM Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5c70f93bfe400eb0b65480498af9e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5c70f93bfe400eb0b65480498af9e8"}]}] Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3f5c70f93bfe400eb0b65480498af9e8 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1877175508 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 552a5b16cc6644c7b0249f6dee152d15 Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1877175508-project Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: exception: Instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 could not be found. Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'd4640d36-a9c9-413a-89d0-2c6d808d5af5'} Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 could not be found. Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 could not be found. Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:07.521757 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 could not be found. Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:07.528391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] Returning 404 to user: Instance d4640d36-a9c9-413a-89d0-2c6d808d5af5 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:07.544659 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8284a72-554e-4268-be87-bf57f92ed56d tempest-ServerMetadataNegativeTestJSON-1877175508 tempest-ServerMetadataNegativeTestJSON-1877175508-project] 10.222.0.16 "GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5" status: 404 len: 111 microversion: 2.1 time: 0.116347 Sep 25 01:10:07.548696 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 946/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:07 2022] GET /compute/v2.1/servers/d4640d36-a9c9-413a-89d0-2c6d808d5af5 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:07.568661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:07.571137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:07.588161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.589218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.590885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.593347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.594043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.596222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.650146 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:07.792472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:07.812407 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b489cec0-d91f-486d-a586-1e24400783f9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.457366 Sep 25 01:10:07.813020 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 989/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:07 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:07.835670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:07.835883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:07.843151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.843663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.844193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.845166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.845846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.846693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:08.463306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:08.479259 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22de402a-97eb-4eb6-a294-0d41faf7b77c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.932177 Sep 25 01:10:08.480705 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 947/1936] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:07 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:08.680454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:08.683815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:08.703652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:08.704680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:08.706629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:08.710857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:08.711782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:08.712909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:08.907538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:08.916991 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:08.961812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:08.978226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:08.985664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-324933f4-74fd-4a7c-98f2-b25e9fa1ef27 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 1.154386 Sep 25 01:10:08.987837 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] HTTP exception thrown: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. Sep 25 01:10:09.003230 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 990/1937] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:07 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Request method failure captured: Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments/dd65ceef-ca83-4de5-977a-5f8112f9a42c HTTP/1.1 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 74 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6nqjuGoO4b-84bZy73bov5WloWFIrDCO6uioc97f3JXZKiRI5h83kd9swShUDDjw5eOsTcboiyzJ5LbBbaNk2dJ2SyHgHeEpvZJzA3kUhrGD5vB_efd-97t7mmnA6DJzspJn76KdG-p4l05iadukr2pkrs_zNnNle6PjMHg7W5yjMM Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ddfc98737e554a74a138eb2fe8bf5092 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesAdminNegativeTest-1284137513 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddfc98737e554a74a138eb2fe8bf5092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddfc98737e554a74a138eb2fe8bf5092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddfc98737e554a74a138eb2fe8bf5092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddfc98737e554a74a138eb2fe8bf5092"}]}] Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesAdminNegativeTest-1284137513 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ddfc98737e554a74a138eb2fe8bf5092 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1284137513 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesAdminNegativeTest-1284137513-project-admin Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c8bfed82c804419eaddc0aae23f34b70 Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesAdminNegativeTest-1284137513-project-admin Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: {"volumeAttachment": {"volumeId": "8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839"}} Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: exception: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': '15cf5b07-3309-44b0-a5cd-519a143b5f99', 'id': 'dd65ceef-ca83-4de5-977a-5f8112f9a42c', 'body': {'volumeAttachment': {'volumeId': '8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839'}}} Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. (HTTP 404) (Request-ID: req-dc73659a-0e1f-44a3-b04c-0bd90e7dd606) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:10:09.024458 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Returning 400 to user: Volume 8dd788b1-4a0f-4ee6-bf03-6af1f0e4e839 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5e3e012-e8f9-463c-885f-8a5fa157a1d7 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments/dd65ceef-ca83-4de5-977a-5f8112f9a42c" status: 400 len: 107 microversion: 2.1 time: 0.544008 Sep 25 01:10:09.029953 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 948/1938] 10.222.0.16 () {60 vars in 1433 bytes} [Sun Sep 25 01:10:08 2022] PUT /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments/dd65ceef-ca83-4de5-977a-5f8112f9a42c => generated 107 bytes in 546 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:10:09.039688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:09.043170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:09.047332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:09.051697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:09.064546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.067792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.069606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.071963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.073197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.073800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.075048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.076169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.076387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.077852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.080480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.081360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.242883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:09.255060 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f94c112-7635-4744-b620-05e53b6ac10c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 200 len: 1301 microversion: 2.1 time: 0.250090 Sep 25 01:10:09.258129 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 991/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:09 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 1301 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:09.272360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-dfa590c5-17cd-4498-9a71-36a27caef483 req-d2d6ee98-72cb-4422-80a4-181075ca71ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278b7df8-8638-4435-9d8a-49dde53b4384", "name": "network-vif-deleted", "tag": "d2dcdfd2-6c47-4687-8d69-91f23f276ea0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:09.316568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dfa590c5-17cd-4498-9a71-36a27caef483 req-d2d6ee98-72cb-4422-80a4-181075ca71ce service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.317467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dfa590c5-17cd-4498-9a71-36a27caef483 req-d2d6ee98-72cb-4422-80a4-181075ca71ce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.319956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dfa590c5-17cd-4498-9a71-36a27caef483 req-d2d6ee98-72cb-4422-80a4-181075ca71ce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.365060 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-dfa590c5-17cd-4498-9a71-36a27caef483 req-d2d6ee98-72cb-4422-80a4-181075ca71ce service nova] Creating event network-vif-deleted:d2dcdfd2-6c47-4687-8d69-91f23f276ea0 for instance 278b7df8-8638-4435-9d8a-49dde53b4384 on n-h2-master-1 Sep 25 01:10:09.379066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-dfa590c5-17cd-4498-9a71-36a27caef483 req-d2d6ee98-72cb-4422-80a4-181075ca71ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117731 Sep 25 01:10:09.379751 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 992/1940] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:09.415003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:09.419254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:09.448506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.450309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.452522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.454901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.456540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.457853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.587829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:09.629959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5d33fb2-a7e7-4879-8679-83c63fb32ade tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.590282 Sep 25 01:10:09.632631 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 949/1941] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:09 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:09.657148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:09.659471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:09.699277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.700428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.707131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.708712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.711526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.715459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.762546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lazy-loading 'services' on Instance uuid 15cf5b07-3309-44b0-a5cd-519a143b5f99 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:10.001526 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17c07835-cd90-4930-b17c-e939a293de5a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments/dd65ceef-ca83-4de5-977a-5f8112f9a42c" status: 202 len: 0 microversion: 2.1 time: 0.612879 Sep 25 01:10:10.003158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 993/1942] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:10:09 2022] DELETE /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments/dd65ceef-ca83-4de5-977a-5f8112f9a42c => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:10.016055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.023989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:10.056735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.062101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.062974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.063989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.064696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.065356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.168485 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c9068ea-9eee-4582-9557-2f665c436df9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159882 Sep 25 01:10:10.175803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 994/1943] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:10 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:10.183541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:10.194809 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e4dabbed-2436-4d49-bad1-5f349cb6d011 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.559708 Sep 25 01:10:10.199036 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 950/1944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:09 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:10.201838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.205516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:10.213781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f54a3948-dafa-4cce-9384-e18d0d022642 req-0eb05d23-d574-4eec-a931-01a8a1b5abbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f005f-46a7-4d44-be2b-b8afc7fad760", "name": "network-vif-plugged", "status": "completed", "tag": "5db086cf-1758-472f-bf2c-7ac2e04a2801"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:10.222452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.227691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.228227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.229266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.230104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.230827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.233548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f54a3948-dafa-4cce-9384-e18d0d022642 req-0eb05d23-d574-4eec-a931-01a8a1b5abbe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.234098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f54a3948-dafa-4cce-9384-e18d0d022642 req-0eb05d23-d574-4eec-a931-01a8a1b5abbe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.234611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f54a3948-dafa-4cce-9384-e18d0d022642 req-0eb05d23-d574-4eec-a931-01a8a1b5abbe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.252227 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f54a3948-dafa-4cce-9384-e18d0d022642 req-0eb05d23-d574-4eec-a931-01a8a1b5abbe service nova] Creating event network-vif-plugged:5db086cf-1758-472f-bf2c-7ac2e04a2801 for instance e26f005f-46a7-4d44-be2b-b8afc7fad760 on n-h2-master-1 Sep 25 01:10:10.259015 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f54a3948-dafa-4cce-9384-e18d0d022642 req-0eb05d23-d574-4eec-a931-01a8a1b5abbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058279 Sep 25 01:10:10.259905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 951/1945] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:10.302804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.304433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:10.349649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.357802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.358263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.359040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.359516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.359977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.392116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 HTTP/1.1 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '278b7df8-8638-4435-9d8a-49dde53b4384'} Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:10.395248 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7eeb08ca-5bcf-4d19-9478-0e32551dd20b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 404 len: 111 microversion: 2.1 time: 0.104441 Sep 25 01:10:10.406682 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 952/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:10 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:10:10.422365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb879503-35f6-4f41-aca0-03a9c3e40bcf tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf40df670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.571158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:10.583673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:10.586839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:10.588474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5af01b6d-72bb-4ea2-b19d-b8d6de7fdd6e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.411275 Sep 25 01:10:10.589691 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 995/1947] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:10 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:10.672357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.673315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:10.682900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.684774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.685290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.686146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.686873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.687590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.698657 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb879503-35f6-4f41-aca0-03a9c3e40bcf tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf" status: 202 len: 0 microversion: 2.1 time: 0.289885 Sep 25 01:10:10.703306 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 953/1948] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:10 2022] DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:10.708943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa6e476f-0019-48b8-9a01-a91a504e5845 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf408a700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:11.191498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:11.200792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-381113fd-7495-4a8f-9520-fcd503b0fb1a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.532585 Sep 25 01:10:11.202104 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 996/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:10 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:11.207510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:11.210905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:11.217535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:11.218390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:11.219327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:11.220910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:11.221672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:11.222338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:11.274898 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1c21482-133c-435d-8e4d-4af787f2d4cd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071156 Sep 25 01:10:11.276375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 997/1950] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:11 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:11.281418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:11.282407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:11.289427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:11.289942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:11.290532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:11.291276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:11.291735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:11.292167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:11.430257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa6e476f-0019-48b8-9a01-a91a504e5845 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b" status: 202 len: 0 microversion: 2.1 time: 0.724855 Sep 25 01:10:11.431741 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 954/1951] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:10 2022] DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:11.455684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22e7d685-dda4-45e8-9090-fb7b73b5e221 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'create', calling method: .version_select at 0x7f7bf4024e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2093948874", "description": "tempest-description-2137752677"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:11.796061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:11.821880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e84d52dc-11bd-4a2e-9496-5f1fd04b26a7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1520 microversion: 2.1 time: 0.541299 Sep 25 01:10:11.822589 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 998/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:11 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1520 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:11.848237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:11.848237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:11.870378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:11.871505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:11.872203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:11.873535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:11.874185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:11.874853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.096016 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22e7d685-dda4-45e8-9090-fb7b73b5e221 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.649509 Sep 25 01:10:12.114111 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 955/1953] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:10:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:10:12.126997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:12.136777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a956a9e2-70d4-44bd-bb86-dba2f1b19d26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Action: 'update', calling method: .version_select at 0x7f7bf40e15e0>, body: {"security_group": {"name": "tempest-sg-hth-1646823841", "description": "tempest-description-hth-159191497"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:12.144826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:12.164700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:12.169502 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f520093-2f35-4783-9ff1-6a1087c92d8b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.336222 Sep 25 01:10:12.171178 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 999/1954] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:11 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:12.234105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:12.235555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:12.243851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.244672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.245423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.247628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.248332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.249036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.573194 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a956a9e2-70d4-44bd-bb86-dba2f1b19d26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/7aa04fcc-aa7b-4acb-a0c6-59372dfb6347" status: 200 len: 217 microversion: 2.1 time: 0.457474 Sep 25 01:10:12.573835 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 956/1955] 10.222.0.16 () {60 vars in 1290 bytes} [Sun Sep 25 01:10:12 2022] PUT /compute/v2.1/os-security-groups/7aa04fcc-aa7b-4acb-a0c6-59372dfb6347 => generated 217 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:12.583148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:12.586854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:12.589350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:12.593130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0518ef54-1e5c-40e2-b804-1d4e889c7a2d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.366551 Sep 25 01:10:12.593814 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1000/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:12 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:12.601947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ff983a9-68d0-4578-a475-dcd16d180be8 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf0028dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:12.604353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.605079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.605720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.606606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.607222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.607800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.668954 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a09b7d98-1c1c-4341-a9e9-221357784552 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093923 Sep 25 01:10:12.672036 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 957/1957] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:12 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:12.713134 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ff983a9-68d0-4578-a475-dcd16d180be8 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7aa04fcc-aa7b-4acb-a0c6-59372dfb6347" status: 200 len: 217 microversion: 2.1 time: 0.118103 Sep 25 01:10:12.713803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1001/1958] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:10:12 2022] GET /compute/v2.1/os-security-groups/7aa04fcc-aa7b-4acb-a0c6-59372dfb6347 => generated 217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:12.729523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-faff6c07-5a19-492c-947c-9745ce1a47b6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf0d1d1f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:12.847369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:12.847991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:12.867921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.868421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.868866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.869623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.870084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.870519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.320155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-faff6c07-5a19-492c-947c-9745ce1a47b6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7aa04fcc-aa7b-4acb-a0c6-59372dfb6347" status: 202 len: 0 microversion: 2.1 time: 0.594573 Sep 25 01:10:13.321718 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 958/1959] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:12 2022] DELETE /compute/v2.1/os-security-groups/7aa04fcc-aa7b-4acb-a0c6-59372dfb6347 => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:13.328641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:13.329840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:13.337571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.338505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.339141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.340343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.341054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.341821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.364028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:13.405809 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec121649-2539-465a-a34d-cdf311bbe7f2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1505 microversion: 2.1 time: 0.562243 Sep 25 01:10:13.413446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1002/1960] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:12 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:13.441429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:13.443448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:13.470421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.470953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.471764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.477820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.480097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.480936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.523353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 HTTP/1.1 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '278b7df8-8638-4435-9d8a-49dde53b4384'} Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:13.531885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.538965 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.545795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:13.548743 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15e40507-31d9-4462-9346-3992ee938cd7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 404 len: 111 microversion: 2.1 time: 0.131454 Sep 25 01:10:13.555872 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1003/1961] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:13 2022] DELETE /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:13.570228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:13.570864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:13.588513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.592774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.593256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.598059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.598555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.599005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.760521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:13.780690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:13.790558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:13.793892 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95b3b0eb-e69a-4d1a-8148-7597097d36d7 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1488 microversion: 2.25 time: 0.469542 Sep 25 01:10:13.814704 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 959/1962] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:13 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1488 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:13.828536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:13.831867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 278b7df8-8638-4435-9d8a-49dde53b4384] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:13.843150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.843959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.844977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.846700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.847405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.848064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.875967 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 HTTP/1.1 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '278b7df8-8638-4435-9d8a-49dde53b4384'} Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:13.879355 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. Sep 25 01:10:13.888763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:13.892123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Instance 278b7df8-8638-4435-9d8a-49dde53b4384 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:13.893717 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f93fa4d-f139-42d5-bdd8-2acff0417cf1 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384" status: 404 len: 111 microversion: 2.1 time: 0.076835 Sep 25 01:10:13.894847 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 960/1963] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:13 2022] GET /compute/v2.1/servers/278b7df8-8638-4435-9d8a-49dde53b4384 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:13.903590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:13.904915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:13.915515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.916625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.917328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.918502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:13.919221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:13.921022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:13.953915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:13.968432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7fb4ad59-c5a3-46f0-bf90-7f57a839b338 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 200 len: 1505 microversion: 2.1 time: 0.409308 Sep 25 01:10:13.978134 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1004/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:13 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:13.988474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:13.999977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:14.034992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.035534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.035992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.036749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.037229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.042003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.121101 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b86a982-d4b3-4e38-8ab7-3424fbeda8a6 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143629 Sep 25 01:10:14.127046 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1005/1965] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:13 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:14.130573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebfb35e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.227784 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:14.230438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group 817467bf-1e8b-4abe-9978-ad022a45348b not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:10:14.234624 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.234624 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b HTTP/1.1 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: exception: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '817467bf-1e8b-4abe-9978-ad022a45348b'} Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:14.243135 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group 817467bf-1e8b-4abe-9978-ad022a45348b does not exist Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-a563ae33-d747-4fce-ad24-d75dfd50b2a1'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:14.248571 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c159ea32-1a5b-4b53-ac15-e8feedb2d061 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b" status: 404 len: 194 microversion: 2.1 time: 0.123053 Sep 25 01:10:14.254799 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1006/1966] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/os-security-groups/817467bf-1e8b-4abe-9978-ad022a45348b => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:14.266612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.267340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:14.275758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:14.284480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.284995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.287372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.288542 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0101a2f-aba2-4496-a40d-e7d7b3792f2b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.390770 Sep 25 01:10:14.289307 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 961/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:13 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:14.289770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.293662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.294520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.297025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf40e1550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.349375 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:14.350285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group 40b06461-2eab-4049-b365-0f8d7efa4cbf not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:10:14.351116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.351116 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf HTTP/1.1 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: exception: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '40b06461-2eab-4049-b365-0f8d7efa4cbf'} Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:14.354147 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group 40b06461-2eab-4049-b365-0f8d7efa4cbf does not exist Sep 25 01:10:14.359726 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-3bba6e09-7c6d-4e75-aa4c-29986a5fe233'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:14.363298 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-93f7c16f-9735-426a-a8f9-ee74d6856f26 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf" status: 404 len: 194 microversion: 2.1 time: 0.068357 Sep 25 01:10:14.367979 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 962/1968] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/os-security-groups/40b06461-2eab-4049-b365-0f8d7efa4cbf => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:14.376858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:14.380192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf3ffc160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.448593 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:14.449432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:10:14.449887 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.449887 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95 HTTP/1.1 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: exception: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'bdb0237d-4d36-4ea5-bbf6-a597f1089a95'} Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:14.452722 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group bdb0237d-4d36-4ea5-bbf6-a597f1089a95 does not exist Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-f10c850c-6f3b-4bbe-83e1-04e0e8702a78'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8566b378-15cc-4fd0-844c-78e767b164e5 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95" status: 404 len: 194 microversion: 2.1 time: 0.085143 Sep 25 01:10:14.458153 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 963/1969] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/os-security-groups/bdb0237d-4d36-4ea5-bbf6-a597f1089a95 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:14.463273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebcb5820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.511037 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-68550fae-960a-4c2c-b174-512320e5a194 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 204 len: 0 microversion: 2.1 time: 0.254419 Sep 25 01:10:14.513951 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1007/1970] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group db641a07-4a8e-462b-ab21-8a9b961a02a8 not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8 HTTP/1.1 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: exception: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'db641a07-4a8e-462b-ab21-8a9b961a02a8'} Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:14.524939 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group db641a07-4a8e-462b-ab21-8a9b961a02a8 does not exist Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-da14fb84-4f42-4ec6-832b-2e52b5beef8f'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa80d733-8dc5-4939-87bf-8ff84b8175e9 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8" status: 404 len: 194 microversion: 2.1 time: 0.064639 Sep 25 01:10:14.533033 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 964/1971] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/os-security-groups/db641a07-4a8e-462b-ab21-8a9b961a02a8 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:10:14.544889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebf4a670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.580344 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:14.582500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:10:14.586178 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.586178 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a HTTP/1.1 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: exception: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a'} Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:14.588401 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group 2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a does not exist Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-d7280dae-7ab5-4f82-8f4a-5bbe2847f56b'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-46ea1e10-3a10-4e20-9cf4-df4d8e80825f tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a" status: 404 len: 194 microversion: 2.1 time: 0.058842 Sep 25 01:10:14.599310 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1008/1972] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/os-security-groups/2fc27c8d-5f7b-4f7d-a8eb-050e1d379e1a => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:14.603298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebe98ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.637775 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:10:14.638840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Neutron security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:10:14.639554 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.639554 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 HTTP/1.1 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: exception: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5'} Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:10:14.642264 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] Sep 25 01:10:14.647777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:14.657665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Security group b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 does not exist Sep 25 01:10:14.657665 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-5e641b8c-c661-4698-ac69-04672b0324c0'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:14.663819 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f1d62a8-2a03-430f-9100-aa7e708a910c tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5" status: 404 len: 194 microversion: 2.1 time: 0.064219 Sep 25 01:10:14.670845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-904593945", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cea0503a-4e97-4488-af7a-4679bb5e5ef8"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:14.674003 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 965/1973] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/os-security-groups/b0f7c3a7-2f9f-4077-8abb-348e96ebcbd5 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:10:14.680007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.680668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:14.688182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.688673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.689109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.690107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.690768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.691254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.728637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:14.760262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] validate_networks() for [('cea0503a-4e97-4488-af7a-4679bb5e5ef8', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:10:14.824652 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7003baab-7bde-41de-b082-d8d677a37504 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 204 len: 0 microversion: 2.1 time: 0.148984 Sep 25 01:10:14.828950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 966/1974] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:14 2022] DELETE /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:10:14.836468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:14.837344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:14.847027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.847524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.848012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:14.848735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:14.849722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:14.851383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.080436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:15.093209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:15.096903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:15.098260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51c05d57-1f92-432c-9d39-abb97fa9c895 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1478 microversion: 2.25 time: 0.267946 Sep 25 01:10:15.098800 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 967/1975] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:14 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1478 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:15.123939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:15.134600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:15.150010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.150504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.150944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.151655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.152107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.152533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.540102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:15.564376 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b15f1ee1-0bb7-4017-be96-914de0c11ee6 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1646 microversion: 2.1 time: 0.444164 Sep 25 01:10:15.585594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 968/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:15 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1646 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:15.590026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-158a9288-0c73-4579-a8a5-612300a5030c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '.version_select at 0x7f7bebcb5ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:15.596940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-158a9288-0c73-4579-a8a5-612300a5030c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.605601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-158a9288-0c73-4579-a8a5-612300a5030c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.606445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-158a9288-0c73-4579-a8a5-612300a5030c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.644436 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-158a9288-0c73-4579-a8a5-612300a5030c tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3863 microversion: 2.25 time: 0.063503 Sep 25 01:10:15.645094 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 969/1977] 10.222.0.16 () {60 vars in 1184 bytes} [Sun Sep 25 01:10:15 2022] GET /compute/v2.1/os-migrations => generated 3863 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:15.669431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:10:15.669969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:10:15.670371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:10:15.670851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:10:15.671343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:10:15.674448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:15.680132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:15.690374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.690873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.691388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.692115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.692799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.693458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.694522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.695197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.695664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.696430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.697053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.697517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.720078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Getting quotas for project e310970d7ec54c99a3d719824c6be1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:15.727700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Getting quotas for user f3931162a615421f8843396650368870 and project e310970d7ec54c99a3d719824c6be1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:15.740260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-988386ab-9c5a-4bd9-904a-a57734e9d869 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092565 Sep 25 01:10:15.742258 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 970/1978] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:15 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:15.747210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:15.748311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:15.755582 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:15.758910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.759579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.760158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.760265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:10:15.761163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.762579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.763160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.772635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:10:15.853039 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-663fb041-07d6-47b1-86ab-568e11bb32d3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186917 Sep 25 01:10:15.854390 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1009/1979] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:10:15.860887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:15.863683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:15.873197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.874025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.874898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.875758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.876355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.877114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.880408 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:15.933822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a309d5d4-f388-4af7-bf33-6f7824d64109 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078102 Sep 25 01:10:15.935132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1010/1980] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:15 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:15.940927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:15.942008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:15.951147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.952146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.953437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:15.955271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:15.956044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:15.956683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:16.173488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:16.194992 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22244bb9-b6e6-4284-b67e-a9be65166717 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.445620 Sep 25 01:10:16.195652 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 971/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:15 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:16.226100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80bfb1ee-4ad3-4a18-a379-6a635ce0c066 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:16.228650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80bfb1ee-4ad3-4a18-a379-6a635ce0c066 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:16.422665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80bfb1ee-4ad3-4a18-a379-6a635ce0c066 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:16.432350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80bfb1ee-4ad3-4a18-a379-6a635ce0c066 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1217 microversion: 2.1 time: 0.217095 Sep 25 01:10:16.432943 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 972/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:16 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:16.498435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] Lazy-loading 'services' on Instance uuid d3f1aacd-e503-4f6c-82b5-f0d05ea5329a {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:16.562180 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-52a3dddc-5f10-4a0d-96b9-1ab2d4f0add2 tempest-LiveAutoBlockMigrationV225Test-351541495 tempest-LiveAutoBlockMigrationV225Test-351541495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1971 microversion: 2.25 time: 0.620792 Sep 25 01:10:16.566699 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1011/1983] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:15 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1971 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:16.619290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:16.620053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:16.625032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:16.625634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:16.643404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:16.644019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:16.645609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:16.646212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:16.647322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:16.648249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:16.649510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:16.650404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:16.651666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:16.670547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:16.671048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:16.671488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:16.778977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:16.961489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-edd8ea22-f73d-40b4-8b19-1a5b96a10ddd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 204 len: 0 microversion: 2.25 time: 0.341310 Sep 25 01:10:16.962456 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1012/1984] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:10:16 2022] DELETE /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:10:16.969497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:16.972912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:16.982296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:16.983191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:16.984150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:16.985715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:16.986672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:16.987312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:17.050767 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8821235d-59f3-4d22-9dee-d6954f2bf66c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086445 Sep 25 01:10:17.051768 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1013/1985] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:16 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:17.063160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:17.068806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:17.076888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:17.077875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:17.078466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:17.080128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:17.080831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:17.081466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:17.127132 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a079fb5-dd75-4c78-b3c8-e5cb199535f6 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073983 Sep 25 01:10:17.128241 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1014/1986] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:17 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:10:17.145993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:17.147904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:17.167063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:17.167788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:17.169926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:17.170857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:17.174322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:17.174944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:17.718649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:17.750587 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-125a9747-a3d2-4c78-8526-c5a4f6b0c52b tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1646 microversion: 2.1 time: 1.153502 Sep 25 01:10:17.753732 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 973/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:16 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1646 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:17.779209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:17.786283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:17.795730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:17.796507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:17.797169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:17.798465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:17.799163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:17.799808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.016020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:18.028473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:18.030884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:18.032434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c35448d8-a016-407f-bec9-342391f4322e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1484 microversion: 2.25 time: 0.902763 Sep 25 01:10:18.033988 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1015/1988] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:17 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1484 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:18.040318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:18.043158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:18.050790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.053036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.056098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.058310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.060388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.061094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.120077 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db89bdbc-06d8-4f63-92cc-a95849b9ef9d tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084189 Sep 25 01:10:18.121361 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1016/1989] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:18 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:10:18.132692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:18.133590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:18.141567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.142118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.143307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.144323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.145101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.145840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.727824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:18.742637 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-397f10cb-ce21-4379-b357-9d901c4b136d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1269 microversion: 2.1 time: 0.619024 Sep 25 01:10:18.743986 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1017/1990] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:18 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1269 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:18.749587 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ce7ce0ba-605d-4795-81ce-ddc9a42976ad req-253bf31d-a7a2-4883-8612-f1ed3ba58c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac", "name": "network-vif-deleted", "tag": "22ad6343-e39c-400e-889a-f1fbc77161c3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:18.762397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ce7ce0ba-605d-4795-81ce-ddc9a42976ad req-253bf31d-a7a2-4883-8612-f1ed3ba58c4b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.763312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ce7ce0ba-605d-4795-81ce-ddc9a42976ad req-253bf31d-a7a2-4883-8612-f1ed3ba58c4b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.764151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ce7ce0ba-605d-4795-81ce-ddc9a42976ad req-253bf31d-a7a2-4883-8612-f1ed3ba58c4b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.782303 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ce7ce0ba-605d-4795-81ce-ddc9a42976ad req-253bf31d-a7a2-4883-8612-f1ed3ba58c4b service nova] Creating event network-vif-deleted:22ad6343-e39c-400e-889a-f1fbc77161c3 for instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac on n-h1-master-1 Sep 25 01:10:18.789121 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ce7ce0ba-605d-4795-81ce-ddc9a42976ad req-253bf31d-a7a2-4883-8612-f1ed3ba58c4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043324 Sep 25 01:10:18.790445 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1018/1991] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:18.796613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:18.800165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:18.810246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.810900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.811941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.814140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.814759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.815320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.859031 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-334e6646-7794-4f03-88ce-fb7d502bcbba tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066843 Sep 25 01:10:18.865573 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1019/1992] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:18 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:18.878162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:18.879037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:18.889684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.891001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.892351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.893628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:18.894682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:18.895349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:18.932993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:19.043614 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:19.054502 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fd57614-d4bb-4c7c-81c0-dd90404842f1 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 204 len: 0 microversion: 2.1 time: 0.185770 Sep 25 01:10:19.057164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1020/1993] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:18 2022] DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:10:19.256232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:19.278253 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-27a07146-6a0f-439d-9349-b5d48fc8907c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 1.502893 Sep 25 01:10:19.278848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 974/1994] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:17 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:19.297069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:19.298483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:19.327724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.346071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.349589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.351915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.354827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.359793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.417166 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:19.488866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:19.490251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:19.510032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.510537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.510979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.512899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.513650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.514100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.514852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.515329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.522051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.523140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lazy-loading 'fault' on Instance uuid 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:19.622046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:19.770013 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-398bc3e0-966e-4486-bd94-5ba209691327 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 204 len: 0 microversion: 2.42 time: 0.712472 Sep 25 01:10:19.772312 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1021/1995] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:10:19 2022] DELETE /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:10:19.782377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:19.784573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:19.797939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.798576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.799297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.800250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:19.800991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:19.801475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:19.816831 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:19.947394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c70d4db7246bf97a29ec68f86c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd330b26476d45a49805765808323420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:19.964445 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7f9e9891-25d0-4338-86ea-fd04789cd1f7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 200 len: 1306 microversion: 2.1 time: 0.682129 Sep 25 01:10:19.988154 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 975/1996] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:19 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 1306 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:20.000777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:20.002851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:20.016326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.019740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.020838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:20.028196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.028960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.029621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:20.549741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:20.560188 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-52a9ddbe-e42e-4851-80d4-08aff601fd52 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1679 microversion: 2.1 time: 0.570003 Sep 25 01:10:20.561118 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 976/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:19 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1679 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:20.574021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:20.574021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:20.574797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:20.575754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-230160e0-5ff8-41ea-9229-f79a40036e7d tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1484 microversion: 2.25 time: 0.802119 Sep 25 01:10:20.590667 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1022/1998] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:19 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1484 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:20.600568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:20.600749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-be647696-ae85-428e-860f-154791c246a8 req-a5fa130d-df0e-4acb-9034-77dc0b7a9088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f005f-46a7-4d44-be2b-b8afc7fad760", "name": "network-vif-deleted", "tag": "5db086cf-1758-472f-bf2c-7ac2e04a2801"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:20.602046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:20.608653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.609533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.610242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:20.611169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.611840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.612479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:20.630151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-be647696-ae85-428e-860f-154791c246a8 req-a5fa130d-df0e-4acb-9034-77dc0b7a9088 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.631797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-be647696-ae85-428e-860f-154791c246a8 req-a5fa130d-df0e-4acb-9034-77dc0b7a9088 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.632247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-be647696-ae85-428e-860f-154791c246a8 req-a5fa130d-df0e-4acb-9034-77dc0b7a9088 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:20.660556 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-be647696-ae85-428e-860f-154791c246a8 req-a5fa130d-df0e-4acb-9034-77dc0b7a9088 service nova] Creating event network-vif-deleted:5db086cf-1758-472f-bf2c-7ac2e04a2801 for instance e26f005f-46a7-4d44-be2b-b8afc7fad760 on n-h2-master-1 Sep 25 01:10:20.675547 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-be647696-ae85-428e-860f-154791c246a8 req-a5fa130d-df0e-4acb-9034-77dc0b7a9088 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097807 Sep 25 01:10:20.676690 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 977/1999] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:20.683344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:20.684320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:20.691903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.692660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.693295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:20.695781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:20.696491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:20.697808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.352043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:21.370171 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6f6f30b-754a-44db-84c4-c64188f47351 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1317 microversion: 2.1 time: 0.777743 Sep 25 01:10:21.373108 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1023/2000] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:20 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:21.387568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:21.395704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:21.416412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.416931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.417373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.450382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.452973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.453571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.552880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df68a9ff-2431-4cad-b9e9-c5ef8df9f7b1 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175316 Sep 25 01:10:21.560002 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1024/2001] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:21 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:21.566656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:21.567670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:21.577819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.585882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.586711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.587918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.588601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.589209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.603839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:21.623930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:21.625715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:21.633325 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a42233b-9b26-4a94-85db-ad980d95ffdd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2950 microversion: 2.42 time: 0.954070 Sep 25 01:10:21.638963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 978/2002] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:20 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2950 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:21.644891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:21.654229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] [instance: 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:21.666962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.667635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.669738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.670792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.671544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.672479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.702687 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] HTTP exception thrown: Instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac could not be found. Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Request method failure captured: Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac HTTP/1.1 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6onYnn2lJ0VSFLV9dv_v0Bx2DjSaaOvz8PjFmfC2TM8tovqaXrgPVsi4g4JlU_UoWU_OJpIZUgbz5CZP2PpwDI10ZOa707V8F6_QbxhhK_xaaBQvh6Dq3UhvMxFPln9TIlD3qRdNvDMiZnzW9U85iii6YBJRbGh_GRK1w0XRGzYbcI Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd330b26476d45a49805765808323420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd330b26476d45a49805765808323420"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd330b26476d45a49805765808323420"}]}] Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd330b26476d45a49805765808323420 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1194039819 Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f9c70d4db7246bf97a29ec68f86c92a Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsTestJSON-1194039819-project Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac could not be found. Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac'} Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac could not be found. Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac could not be found. Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:21.704943 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac could not be found. Sep 25 01:10:21.708146 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:21.714420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Returning 404 to user: Instance 7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:21.715512 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f7f615ac-cf29-4574-841d-cf301440bea7 tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac" status: 404 len: 111 microversion: 2.1 time: 0.075310 Sep 25 01:10:21.716633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 979/2003] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:21 2022] GET /compute/v2.1/servers/7b826c3d-c5f2-4703-bd33-1fc4bb5d06ac => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:21.740256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:21.744433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:21.759481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.763094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.763812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:21.768016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:21.768782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:21.771166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:23.187485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:23.189000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:23.199744 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d33a015-a80d-4507-986a-0b4bafde7801 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 1.638014 Sep 25 01:10:23.200365 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1025/2004] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:21 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:23.204490 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ea76b56-c2ea-48cd-ac00-f7e10f3b99d4 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1679 microversion: 2.1 time: 1.485679 Sep 25 01:10:23.224096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:23.224096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:23.227024 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 980/2005] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:21 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1679 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:23.233036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:23.233565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:23.234013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:23.234735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:23.235203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:23.235628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:23.236232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46165ac4-83a6-49a1-8717-c1535600465e tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bebcb54c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:23.434273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:23.451884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:23.454095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:23.457926 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-829721bc-f861-44c9-a1bd-3b1083c7bee4 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1266 microversion: 2.25 time: 0.256342 Sep 25 01:10:23.459849 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1026/2006] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:23 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:23.468305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-291d9760-21b4-4e29-a681-aa7444a5b0a7 req-a837b551-9d1a-4c1d-89fe-cf2863d15fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8837fcf1-fc71-4722-ab37-9235d38749ac", "tag": "b51fce4d-7221-45d6-85b3-dd73795a3928"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:23.480014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-291d9760-21b4-4e29-a681-aa7444a5b0a7 req-a837b551-9d1a-4c1d-89fe-cf2863d15fca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:23.480720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-291d9760-21b4-4e29-a681-aa7444a5b0a7 req-a837b551-9d1a-4c1d-89fe-cf2863d15fca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:23.481550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-291d9760-21b4-4e29-a681-aa7444a5b0a7 req-a837b551-9d1a-4c1d-89fe-cf2863d15fca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:23.504418 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-291d9760-21b4-4e29-a681-aa7444a5b0a7 req-a837b551-9d1a-4c1d-89fe-cf2863d15fca service nova] Creating event network-changed:b51fce4d-7221-45d6-85b3-dd73795a3928 for instance 8837fcf1-fc71-4722-ab37-9235d38749ac on n-h1-master-1 Sep 25 01:10:23.512372 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-291d9760-21b4-4e29-a681-aa7444a5b0a7 req-a837b551-9d1a-4c1d-89fe-cf2863d15fca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049305 Sep 25 01:10:23.520398 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1027/2007] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:23.526967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:23.528323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:23.538068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:23.539243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:23.539842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:23.540701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:23.541317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:23.542081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.073014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:24.081913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93863ffe-2a7d-4e41-a285-2a5668733f9d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1317 microversion: 2.1 time: 0.559874 Sep 25 01:10:24.094360 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1028/2008] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:23 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:24.099336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:24.102743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:24.119594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.120265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.120822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.121705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.122298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.122846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.171760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7596304-098b-4754-a528-e887eaa05d08 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075814 Sep 25 01:10:24.179681 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1029/2009] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:10:24 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:10:24.179681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:24.179681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:24.186551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.187235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.187780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.188651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.189227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.189793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.257507 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46165ac4-83a6-49a1-8717-c1535600465e tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7662c194-6972-481c-8383-ad2d14445f63" status: 202 len: 0 microversion: 2.1 time: 1.028310 Sep 25 01:10:24.260181 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 981/2010] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:23 2022] DELETE /compute/v2.1/os-security-groups/7662c194-6972-481c-8383-ad2d14445f63 => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:24.266685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2d5ae0ca-69cd-4334-8db7-7f423a0761cd req-8ab4061d-74bb-43e4-a4cc-dc27e58a7346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f1aacd-e503-4f6c-82b5-f0d05ea5329a", "name": "network-vif-deleted", "tag": "f90f8324-63c2-49db-98b6-f9d4aa3992ac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:24.305181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d5ae0ca-69cd-4334-8db7-7f423a0761cd req-8ab4061d-74bb-43e4-a4cc-dc27e58a7346 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.305804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d5ae0ca-69cd-4334-8db7-7f423a0761cd req-8ab4061d-74bb-43e4-a4cc-dc27e58a7346 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.306236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d5ae0ca-69cd-4334-8db7-7f423a0761cd req-8ab4061d-74bb-43e4-a4cc-dc27e58a7346 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.348023 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2d5ae0ca-69cd-4334-8db7-7f423a0761cd req-8ab4061d-74bb-43e4-a4cc-dc27e58a7346 service nova] Creating event network-vif-deleted:f90f8324-63c2-49db-98b6-f9d4aa3992ac for instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a on n-h2-master-1 Sep 25 01:10:24.356326 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2d5ae0ca-69cd-4334-8db7-7f423a0761cd req-8ab4061d-74bb-43e4-a4cc-dc27e58a7346 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094607 Sep 25 01:10:24.356975 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 982/2011] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:24.362643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:24.363612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:24.372433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.372920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.373564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.374271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:24.374718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:24.375140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:24.999845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.011839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.013441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.014711 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-37d67959-1f18-4fc5-a3ea-ed4af792da1f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2950 microversion: 2.42 time: 0.840666 Sep 25 01:10:25.021387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.029961 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1030/2012] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:24 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2950 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:25.040917 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-759506ad-15dd-4500-a3ce-e68c6a29bcd4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.682289 Sep 25 01:10:25.047563 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 983/2013] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:24 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:25.048065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:25.048855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:25.056517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:25.057282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:25.057920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:25.058784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:25.059386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:25.059959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:25.062663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a43f594d-bac8-4d3a-ab41-c2c1fdb418ae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] Calling method '.version_select at 0x7f7bf4013700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:25.215367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.224986 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c00f3693-7902-414e-ad2d-235566c87e24 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1613 microversion: 2.1 time: 0.193649 Sep 25 01:10:25.233641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1031/2014] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:25 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1613 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:25.233641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:25.233641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:25.241100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:25.241720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:25.244178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:25.244178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:25.244178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:25.245562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:25.711690 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:25.726993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.750029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.752106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:25.753969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-06a2ede9-fe60-45ab-8c0d-780222abc660 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1266 microversion: 2.25 time: 0.527357 Sep 25 01:10:25.773075 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1032/2015] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:25 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1266 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:25.779089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:25.780337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:25.785907 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:25.799658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:25.800676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:25.801251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:25.802188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:25.803202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:25.804202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.367558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:26.379588 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1280094-3c7d-4ccd-a804-84eced8968cb tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1317 microversion: 2.1 time: 0.604690 Sep 25 01:10:26.381274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1033/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:25 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:26.404769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-97e83c91-eadd-4bf7-8aaa-25d628800661 req-fae3eecf-6f80-48fe-9f0e-4e4f8847ea38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "f3f44f7c-343a-41d4-9458-4367d49b3d8c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:26.419409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97e83c91-eadd-4bf7-8aaa-25d628800661 req-fae3eecf-6f80-48fe-9f0e-4e4f8847ea38 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.419860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97e83c91-eadd-4bf7-8aaa-25d628800661 req-fae3eecf-6f80-48fe-9f0e-4e4f8847ea38 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.420305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-97e83c91-eadd-4bf7-8aaa-25d628800661 req-fae3eecf-6f80-48fe-9f0e-4e4f8847ea38 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.427046 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:26.440162 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-97e83c91-eadd-4bf7-8aaa-25d628800661 req-fae3eecf-6f80-48fe-9f0e-4e4f8847ea38 service nova] Creating event network-vif-unplugged:f3f44f7c-343a-41d4-9458-4367d49b3d8c for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:26.448830 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-97e83c91-eadd-4bf7-8aaa-25d628800661 req-fae3eecf-6f80-48fe-9f0e-4e4f8847ea38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047946 Sep 25 01:10:26.450066 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1034/2017] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:26.458284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:26.460343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:26.470865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.471916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.472692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.473725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.474423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.476040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.593450 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a43f594d-bac8-4d3a-ab41-c2c1fdb418ae tempest-SecurityGroupsTestJSON-1194039819 tempest-SecurityGroupsTestJSON-1194039819-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a030cd92-9ddd-4d95-9776-37672b777c71" status: 202 len: 0 microversion: 2.1 time: 1.543334 Sep 25 01:10:26.594670 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 984/2018] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:10:25 2022] DELETE /compute/v2.1/os-security-groups/a030cd92-9ddd-4d95-9776-37672b777c71 => generated 0 bytes in 1546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:26.602018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:26.603069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:26.611959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.613068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.625592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.626786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.627558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.629349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.901597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:26.913694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:26.919246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:26.927108 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8eeff07b-debc-43ae-bfef-196bb62de8bb tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2929 microversion: 2.42 time: 0.475191 Sep 25 01:10:26.928706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1035/2019] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:26 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2929 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:26.938174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:26.939036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:26.971889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.971889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.972303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:26.973013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:26.973490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:26.973923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.054966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.055455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.055891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.056347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lazy-loading 'fault' on Instance uuid 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:27.200041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9164864381494d9991fd97410bedea72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece9c2b6ca644160ad4c5fb7e1131c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:27.211675 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de50cae5-2b94-4ad1-b9e7-500a84630800 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 200 len: 1331 microversion: 2.1 time: 0.281693 Sep 25 01:10:27.214588 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1036/2020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:26 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 1331 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:27.223138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b794f768-7e65-4a55-a808-1eff1a6f4459 req-c726e5a0-c905-4d23-9213-f07901cc1906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4", "name": "network-vif-deleted", "tag": "59eb7962-89d5-45de-8d28-18934ae89544"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:27.249621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b794f768-7e65-4a55-a808-1eff1a6f4459 req-c726e5a0-c905-4d23-9213-f07901cc1906 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.262229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b794f768-7e65-4a55-a808-1eff1a6f4459 req-c726e5a0-c905-4d23-9213-f07901cc1906 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.262910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b794f768-7e65-4a55-a808-1eff1a6f4459 req-c726e5a0-c905-4d23-9213-f07901cc1906 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.275810 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b794f768-7e65-4a55-a808-1eff1a6f4459 req-c726e5a0-c905-4d23-9213-f07901cc1906 service nova] Creating event network-vif-deleted:59eb7962-89d5-45de-8d28-18934ae89544 for instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 on n-h1-master-1 Sep 25 01:10:27.291453 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b794f768-7e65-4a55-a808-1eff1a6f4459 req-c726e5a0-c905-4d23-9213-f07901cc1906 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075546 Sep 25 01:10:27.292384 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1037/2021] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:27.307125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:27.307834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:27.325393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.326413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.326549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.327278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.327744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.328176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.572407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:27.586640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19aab516-4734-4638-858c-5bff33bba62f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.990184 Sep 25 01:10:27.587783 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 985/2022] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:26 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:27.592737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:27.593524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:27.603077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.603815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.604392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.605905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.606610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.607187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.801317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:27.817136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:27.822855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:27.824336 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-77858b8d-72dc-4053-bca0-a4d3269cc77a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 200 len: 1266 microversion: 2.25 time: 0.530835 Sep 25 01:10:27.827624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1038/2023] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:27 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 1266 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:27.962539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:27.963179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:27.975732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.976590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.977186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:27.978196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:27.979277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:27.979942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:28.095705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:28.110980 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23db9def-34f4-4e5e-8231-512501401618 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1317 microversion: 2.1 time: 0.521863 Sep 25 01:10:28.112295 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 986/2024] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:27 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:28.237042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:28.242485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:28.260980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:28.262503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:28.266865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:28.269580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:28.273156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:28.274123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:28.307890 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] HTTP exception thrown: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Request method failure captured: Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 HTTP/1.1 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6nQAV1CqSXD53T-BW2wdK1a0fRlGrbbq75_dAhKN5hTMcaSqz0TvgNwnOTgOEtavfB0WH5d0roA9RpV5JX6nCAfEtSEC9bqNXy4ioi4XdA5I_DCXYD3BoZLE5WsD-rJLbyXArXbn3H3P2BFRU7a15cT40m2bi4HjTN_jhbErakwVOw Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ece9c2b6ca644160ad4c5fb7e1131c14 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ece9c2b6ca644160ad4c5fb7e1131c14"}]}] Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ece9c2b6ca644160ad4c5fb7e1131c14 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachSCSIVolumeTestJSON-232199607-project Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9164864381494d9991fd97410bedea72 Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-232199607-project Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4'} Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:28.314766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:28.317915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:28.321616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Returning 404 to user: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:28.322689 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de63b929-5def-4664-bd12-ebaa2da68fbc tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 404 len: 111 microversion: 2.1 time: 0.089698 Sep 25 01:10:28.326992 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 987/2025] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:28 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:28.338867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8851a928-ed94-4b8d-9bf6-22af5ae2b616 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '.version_select at 0x7f7bf3ff7790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:28.379676 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8851a928-ed94-4b8d-9bf6-22af5ae2b616 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312017565" status: 202 len: 0 microversion: 2.1 time: 0.051244 Sep 25 01:10:28.380507 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 988/2026] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312017565 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:10:28.612333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:28.613780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:28.622603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:28.631700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:28.632615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:28.637165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:28.637981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:28.639277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:29.125836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:29.145246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:29.154728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:29.156117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8032bf90-5da5-46d4-acba-b47eaeb4558c tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2908 microversion: 2.42 time: 1.199553 Sep 25 01:10:29.156690 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1039/2027] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:27 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2908 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:10:29.173672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1983624423", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "e4536ee3-a441-4899-956c-857a29ff0c63"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:29.256258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] validate_networks() for [('e4536ee3-a441-4899-956c-857a29ff0c63', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:10:29.661097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:29.671916 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce180125-09f6-4cf8-bdf3-b8c4e3d46fe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 1.063560 Sep 25 01:10:29.690683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 989/2028] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:28 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:29.708133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "de78802c-7150-4aed-a024-96ae56e3dd90"}, {"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8"}, {"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "55805ffb-c11c-4ab6-8106-f78fa29b3f69"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:29.751356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:29.751838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:29.752273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:29.804889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Creating event network-vif-unplugged:de78802c-7150-4aed-a024-96ae56e3dd90 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:29.823343 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Creating event network-vif-unplugged:13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:29.827796 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] Creating event network-vif-unplugged:55805ffb-c11c-4ab6-8106-f78fa29b3f69 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:29.845625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-dd3776e2-6ffc-4947-be0c-7585278814e9 req-11abd86e-f9a1-4859-a308-870ebd3e6600 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.142909 Sep 25 01:10:29.851050 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 990/2029] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:29.873139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:29.877320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: d3f1aacd-e503-4f6c-82b5-f0d05ea5329a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:29.893557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:29.894269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:29.897341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:29.901982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:29.902484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:29.904993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:29.940410 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] HTTP exception thrown: Instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a could not be found. Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Request method failure captured: Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a HTTP/1.1 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jD4ZOeXGY30lKSqt_EzZxS4vFJG2K1nPMOo08SN8Bs8bpMujMXC-OOC17qpRJU2y_J1O-4n6_SQmdGZuEFTj4AlYVr7s53yLlM8vHMytgw0AnWXJBEY7Jl5uHkaqLdZ1OdeJalS0jcr72vZHIF2GDYZXouXFn-Y6E05XNTtxaIs3Q Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.25 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_868947b52a1d48d6be6e81a2b8718441"}]}] Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 545456a4a4e540be9138c47b0df77bbf Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: exception: Instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a could not be found. Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'd3f1aacd-e503-4f6c-82b5-f0d05ea5329a'} Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a could not be found. Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a could not be found. Sep 25 01:10:29.946703 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a could not be found. Sep 25 01:10:29.950585 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:10:29.954426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Returning 404 to user: Instance d3f1aacd-e503-4f6c-82b5-f0d05ea5329a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:29.958740 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9383e3c-6ef5-4edc-8c90-4d9c8e05b674 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a" status: 404 len: 111 microversion: 2.25 time: 0.101525 Sep 25 01:10:29.959868 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 991/2030] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:29 2022] GET /compute/v2.1/servers/d3f1aacd-e503-4f6c-82b5-f0d05ea5329a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:10:29.994090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:29.998356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:30.020330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:30.023155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:30.028829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:30.031768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:30.055174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:30.058564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.090036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:31.109806 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-642d2433-927b-4627-92b6-dd9d0e4e9d1e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1317 microversion: 2.1 time: 1.147179 Sep 25 01:10:31.127237 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 992/2031] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:29 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:31.150043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2db866bf-bb23-4d6e-8cf1-c73aa18a63e7 req-e01993f1-c471-4718-90a8-7f179b1fc8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-deleted", "tag": "13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:31.184768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2db866bf-bb23-4d6e-8cf1-c73aa18a63e7 req-e01993f1-c471-4718-90a8-7f179b1fc8fe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.185359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2db866bf-bb23-4d6e-8cf1-c73aa18a63e7 req-e01993f1-c471-4718-90a8-7f179b1fc8fe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.185969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2db866bf-bb23-4d6e-8cf1-c73aa18a63e7 req-e01993f1-c471-4718-90a8-7f179b1fc8fe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.212910 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2db866bf-bb23-4d6e-8cf1-c73aa18a63e7 req-e01993f1-c471-4718-90a8-7f179b1fc8fe service nova] Creating event network-vif-deleted:13cbb2f2-cd5f-42cf-bb5d-a410edc0bcd8 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:31.229297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2db866bf-bb23-4d6e-8cf1-c73aa18a63e7 req-e01993f1-c471-4718-90a8-7f179b1fc8fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100623 Sep 25 01:10:31.231366 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 993/2032] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:31.242245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:31.243151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:31.251126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.252860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.253579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.254810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.255562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.256154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.604552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:10:31.605151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:10:31.605737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:10:31.606253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:10:31.606778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:10:31.624816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.628423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.629151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.630216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.638236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.639071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.702894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Getting quotas for project 4131663ab3574002b589848f67fbb78d. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:31.716838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Getting quotas for user 7f09255419184d11b8379c6bd0a338b0 and project 4131663ab3574002b589848f67fbb78d. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:31.755317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:10:31.759132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:10:31.868150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f289ae3b-f342-4f86-a68f-2852a1cd8fd3 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.710364 Sep 25 01:10:31.869735 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1040/2033] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:10:31.875765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:31.876618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:31.890996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.891997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.892916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.894106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:31.897189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:31.897872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:31.966509 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:32.403588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:32.431097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:32.432987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:32.434551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c15daf42-907e-4a47-9040-ce5ed26d7099 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2749 microversion: 2.42 time: 1.201994 Sep 25 01:10:32.435120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 994/2034] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:31 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2749 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:32.486746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-367b8acd-81ad-4b47-a821-64a41da508d8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:32.487620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-367b8acd-81ad-4b47-a821-64a41da508d8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:32.633499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-367b8acd-81ad-4b47-a821-64a41da508d8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:32.647530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-367b8acd-81ad-4b47-a821-64a41da508d8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1218 microversion: 2.1 time: 0.176875 Sep 25 01:10:32.657999 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 995/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:32 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:32.665023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "e7447597-17d3-4b71-a80e-dccd38a636f5"}, {"server_uuid": "8837fcf1-fc71-4722-ab37-9235d38749ac", "name": "network-vif-plugged", "status": "completed", "tag": "b51fce4d-7221-45d6-85b3-dd73795a3928"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:32.714698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:32.714957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:32.722202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:32.773857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] Creating event network-vif-unplugged:e7447597-17d3-4b71-a80e-dccd38a636f5 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:32.774464 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] Creating event network-vif-plugged:b51fce4d-7221-45d6-85b3-dd73795a3928 for instance 8837fcf1-fc71-4722-ab37-9235d38749ac on n-h1-master-1 Sep 25 01:10:32.803559 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7b56c4e6-e809-4be5-ac01-d01fd515d29a req-118654e1-4600-4cf0-b40a-c0618bfdaaa6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.143316 Sep 25 01:10:32.806404 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 996/2036] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:32.815510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:32.837194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:32.838016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:32.838393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4aa7bcf7-8793-423f-8184-8815accfcde0 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.961667 Sep 25 01:10:32.839814 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1041/2037] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:31 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:32.859737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:32.860363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:32.861018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:32.862001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:32.876818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:32.877220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:33.399321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6b7e0917-faa0-4830-908c-f22b4622cdde req-1c254b5b-97f2-4eef-9432-55f83b374a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-deleted", "tag": "55805ffb-c11c-4ab6-8106-f78fa29b3f69"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:33.420726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6b7e0917-faa0-4830-908c-f22b4622cdde req-1c254b5b-97f2-4eef-9432-55f83b374a84 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:33.421207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6b7e0917-faa0-4830-908c-f22b4622cdde req-1c254b5b-97f2-4eef-9432-55f83b374a84 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:33.421661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6b7e0917-faa0-4830-908c-f22b4622cdde req-1c254b5b-97f2-4eef-9432-55f83b374a84 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:33.497839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6b7e0917-faa0-4830-908c-f22b4622cdde req-1c254b5b-97f2-4eef-9432-55f83b374a84 service nova] Creating event network-vif-deleted:55805ffb-c11c-4ab6-8106-f78fa29b3f69 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:33.508002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6b7e0917-faa0-4830-908c-f22b4622cdde req-1c254b5b-97f2-4eef-9432-55f83b374a84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112745 Sep 25 01:10:33.510846 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1042/2038] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:33.519714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:33.520427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:33.551394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:33.552257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:33.553942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:33.554966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:33.555579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:33.558770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:33.886720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:33.906303 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d0bc8d0-0688-4ed2-83c7-6007b95fcf5a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1317 microversion: 2.1 time: 1.096441 Sep 25 01:10:33.918453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 997/2039] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:32 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1317 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:33.962291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:33.964989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:33.995853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:33.998407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:33.999109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:34.001817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:34.003063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:34.007741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:34.291280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:34.316742 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d156b71-5f73-4ecf-bab2-27a49d574d2c tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1270 microversion: 2.1 time: 0.374027 Sep 25 01:10:34.317467 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 998/2040] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:33 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1270 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:34.344082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:34.347472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:34.366086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:34.366615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:34.367049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:34.378575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:34.381216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:34.397463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:34.709909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:34.742395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:34.744147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:34.748524 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-056dbd7a-8b19-4df4-9ed5-9e468a367cb7 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2704 microversion: 2.42 time: 1.236170 Sep 25 01:10:34.750482 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1043/2041] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:33 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2704 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:34.937646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:34.938508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:34.959470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:34.960217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:34.960678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:34.961371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:34.961859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:34.962284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:34.996434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:35.012068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0f5718ff-f6f7-407b-af84-e29734ccb734 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.690925 Sep 25 01:10:35.017303 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 999/2042] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:34 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:35.347481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:35.348103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:35.364007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:35.364497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:35.365530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:35.368844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:35.370463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:35.370924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:35.481195 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:35.504507 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc990171-b13f-412d-8bf1-b8b3f1aeaa4d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1506 microversion: 2.1 time: 0.570682 Sep 25 01:10:35.506919 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1044/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:34 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:35.529866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:35.542157 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:35.545872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:35.557805 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9246946a-d40c-4eab-9a8e-f3cf25384e86 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1276 microversion: 2.1 time: 0.211064 Sep 25 01:10:35.561004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1000/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:35 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:35.562658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:35.563816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:35.564767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:35.565865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:35.566541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:35.567299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:35.828512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7af006f5-98f3-40d1-bf11-5ab98df97867 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: .version_select at 0x7f7bf40779d0>, body: {"keypair": {"name": "tempest-keypair-1676953441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTfC/HF0g9KEhYbT0l12VptPJ3Bw6HLwhDsaaeY01ngcJGFVLhHVi3xU+jfebfntBMZV3bbM8HKw8ZwCqiBkRG4C1ZZDXs6dLAuafx6rt7H3QdOdK6+FnThCq6NgkpLwQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:35.882974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7af006f5-98f3-40d1-bf11-5ab98df97867 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:35.905228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7af006f5-98f3-40d1-bf11-5ab98df97867 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:35.955428 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7af006f5-98f3-40d1-bf11-5ab98df97867 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.265517 Sep 25 01:10:35.957251 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1001/2045] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:10:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:10:35.972503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:35.976180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:35.995820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:35.996330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:35.996773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:36.004884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:36.006026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:36.006545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:36.020509 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:36.823066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:36.853912 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba5ef5b2-74bc-48fc-963c-4099d907d6c0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1506 microversion: 2.1 time: 1.305621 Sep 25 01:10:36.855001 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1045/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:35 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1506 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:36.861425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-38ae7e43-9cdf-4ff0-97cb-f32394f68b10 req-4430c7e6-5005-44a8-a016-7fd3e1e4810f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-deleted", "tag": "de78802c-7150-4aed-a024-96ae56e3dd90"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:36.885204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38ae7e43-9cdf-4ff0-97cb-f32394f68b10 req-4430c7e6-5005-44a8-a016-7fd3e1e4810f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:36.885976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38ae7e43-9cdf-4ff0-97cb-f32394f68b10 req-4430c7e6-5005-44a8-a016-7fd3e1e4810f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:36.886606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38ae7e43-9cdf-4ff0-97cb-f32394f68b10 req-4430c7e6-5005-44a8-a016-7fd3e1e4810f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:36.929335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-38ae7e43-9cdf-4ff0-97cb-f32394f68b10 req-4430c7e6-5005-44a8-a016-7fd3e1e4810f service nova] Creating event network-vif-deleted:de78802c-7150-4aed-a024-96ae56e3dd90 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:36.948452 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-38ae7e43-9cdf-4ff0-97cb-f32394f68b10 req-4430c7e6-5005-44a8-a016-7fd3e1e4810f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088879 Sep 25 01:10:36.949113 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1046/2047] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:36.987060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:36.987928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:37.016294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:37.022064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:37.022738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:37.023640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:37.024255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:37.024835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:37.472072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:37.496981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:37.510240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:37.518526 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7dbb6c00-3ea5-4348-8883-0f6dd79eda1e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2545 microversion: 2.42 time: 1.557120 Sep 25 01:10:37.523748 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1002/2048] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:35 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2545 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:37.545982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:37.552027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:37.583197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:37.584689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:37.585538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:37.586867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:37.587743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:37.588562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:37.732552 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:10:37.732868 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 01:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 (ip 10.222.0.16) !!! Sep 25 01:10:37.928916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:37.968620 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43302ae4-b2d1-4ef6-ab0d-4bec293ce111 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1276 microversion: 2.1 time: 0.440742 Sep 25 01:10:37.977293 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1003/2049] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:37 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1276 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:37.992186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:38.000277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:38.026647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:38.027402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:38.028028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:38.028933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:38.029576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:38.030141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:38.082778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:38.110515 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2316a7bf-1482-429b-8cc9-12d7d5191c30 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 1.148546 Sep 25 01:10:38.117893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1047/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:36 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:38.254148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ecdda0a2-b18b-489c-be6c-1ce0e874f617 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "PUT /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1078 microversion: 2.1 time: 0.271616 Sep 25 01:10:38.254865 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1004/2051] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:10:37 2022] PUT /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1078 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:38.284842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:38.285978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:38.310113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:38.316056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:38.320777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:38.325786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:38.327116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:38.330197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:38.556758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:38.557981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:38.585825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:38.592938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:38.593874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:38.595855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:38.597709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:38.600019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:39.314627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:39.325556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-052908fa-2f30-460e-b0d7-2acb423dd9b3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1504 microversion: 2.1 time: 1.047998 Sep 25 01:10:39.349855 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1048/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:38 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1504 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:39.368269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:39.374025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:39.394166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:39.395665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:39.397971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:39.399916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:39.400612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:39.404472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:39.893809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:39.905864 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:39.908725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:39.910298 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5072e3c-90fd-418a-8874-fa2b54ecc6cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2431 microversion: 2.42 time: 1.359485 Sep 25 01:10:39.911075 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1005/2053] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:38 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2431 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:10:39.924848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:39.925828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:39.950967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:39.952056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:39.952734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:39.954046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:39.954736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:39.955774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.055246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:41.065094 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-adf71011-7702-43ce-9184-f9fdeb6604c9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 1.712989 Sep 25 01:10:41.070136 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1049/2054] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:39 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:41.090098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:41.090824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:41.103235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.103739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.108308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.109162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.109860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.110543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.350681 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:41.360519 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f05640dc-de9b-417b-81cf-61aac8506ca2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 1.447850 Sep 25 01:10:41.373621 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1006/2055] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:39 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:41.399742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-491050782", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e11de-11e2-49b9-9778-5d1ca46edda6"}], "security_groups": [{"name": "tempest-securitygroup--2082519394"}], "key_name": "tempest-keypair-1676953441", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:41.541882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:41.558651 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8b2fd5ef-a008-47ab-bf41-c9dbf8734c09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1504 microversion: 2.1 time: 0.484727 Sep 25 01:10:41.579079 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1050/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:41 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:41.609350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:41.610020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:41.629181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.629789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.630805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.631885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.632353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.632786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.686566 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:41.738060 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:42.079028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] validate_networks() for [('859e11de-11e2-49b9-9778-5d1ca46edda6', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:10:42.410147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:42.426949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:42.434165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:42.435458 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6545abab-7195-4039-a12e-a841d5f26d07 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 2386 microversion: 2.42 time: 0.854861 Sep 25 01:10:42.437794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1051/2057] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:41 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 2386 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:42.469022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:42.469792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:42.483055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:42.488829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:42.489650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:42.490926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:42.491536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:42.492115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:42.554932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:42.743312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3afb7bcf-36ee-4f3d-a8f4-e29b3cdc1e87 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 204 len: 0 microversion: 2.25 time: 0.303954 Sep 25 01:10:42.747580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1052/2058] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:10:42 2022] DELETE /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:10:42.760875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:42.764453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:42.788415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:42.789502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:42.790170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:42.791068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:42.791754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:42.792329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:42.928554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:10:42.929718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:10:42.930230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:10:42.930647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:10:42.931065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:10:43.135349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:43.149903 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:43.154313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:43.156799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:43.157525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:43.162180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:43.162951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:43.163645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:43.221022 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be341f3e-2028-45e0-96ad-e403d704f8d0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "POST /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac/action" status: 202 len: 1110 microversion: 2.1 time: 0.471904 Sep 25 01:10:43.223409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1053/2059] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:10:42 2022] POST /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac/action => generated 1110 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 25 01:10:43.251721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:43.252575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:43.266116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:43.267136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:43.268073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:43.269565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:43.270238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:43.271081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:44.318950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:44.338884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c202417c-86e2-4a19-a15b-1111d79581db tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 1.112925 Sep 25 01:10:44.340158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1054/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:43 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:44.346297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:44.349974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:44.370038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:44.375691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:44.376163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:44.376925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:44.377528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:44.378056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:44.420302 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:45.107298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:10:45.107839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:10:45.108207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:10:45.108621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:10:45.109038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:10:45.151359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.151852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.156149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.157322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.158015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.158591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.205376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:45.216490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:45.232008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:10:45.235133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:10:45.241203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:45.253861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57cc4559-245d-4c6b-8426-c885dec795fe tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.908859 Sep 25 01:10:45.265429 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1055/2061] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:44 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:45.269610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5be85e19-b467-433b-a9a9-a5e7f3ed343f req-3ea4d31c-a90a-4548-bb85-668e88dd5a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-deleted", "tag": "f3f44f7c-343a-41d4-9458-4367d49b3d8c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:45.291889 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:45.315600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5be85e19-b467-433b-a9a9-a5e7f3ed343f req-3ea4d31c-a90a-4548-bb85-668e88dd5a83 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.318333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5be85e19-b467-433b-a9a9-a5e7f3ed343f req-3ea4d31c-a90a-4548-bb85-668e88dd5a83 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.319193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5be85e19-b467-433b-a9a9-a5e7f3ed343f req-3ea4d31c-a90a-4548-bb85-668e88dd5a83 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.320899 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-68040694-e0c5-4561-815f-6435eb8ecd4a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.945546 Sep 25 01:10:45.329898 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1007/2062] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:10:45.338084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:45.338924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:45.352089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5be85e19-b467-433b-a9a9-a5e7f3ed343f req-3ea4d31c-a90a-4548-bb85-668e88dd5a83 service nova] Creating event network-vif-deleted:f3f44f7c-343a-41d4-9458-4367d49b3d8c for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:45.367454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5be85e19-b467-433b-a9a9-a5e7f3ed343f req-3ea4d31c-a90a-4548-bb85-668e88dd5a83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108886 Sep 25 01:10:45.369213 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1056/2063] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:45.375019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.375523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.385993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.386807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.387294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.387735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.406165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:45.408555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:45.436343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.438582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.440507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.443811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.444328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.444777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.049042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.063541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.072444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.077770 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-32aa74e0-15e1-4ef6-84c2-11deae340fbd tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1734 microversion: 2.25 time: 1.743825 Sep 25 01:10:47.082554 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1008/2064] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:45 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1734 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:47.113855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:47.114552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:47.136393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.141703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.149670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.150339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.150887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.157685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.326231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.343630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.347220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.349881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10a147fe-f382-4d84-998f-33b9f947d38a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.261694 Sep 25 01:10:47.352702 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1009/2065] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:47 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:47.364644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:47.367621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:47.404453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.418161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.418705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.419536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.419951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.421538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.748515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.760607 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0354b54c-e636-4e72-bf08-bfa4c3b89bcc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 2.386981 Sep 25 01:10:47.769017 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1057/2066] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:45 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:47.777035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.811857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:47.814273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:47.816164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5175088-2377-4976-8702-edaad69e5530 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1293 microversion: 2.1 time: 0.461856 Sep 25 01:10:47.820513 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1010/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:47 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1293 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:47.850791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:47.851776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.853488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.854116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.855768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.858047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.858502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:47.860047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.880763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.885561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.886170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.887021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.890975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.896820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.501596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:49.515546 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9d98aefa-6262-4a0c-a10e-e5746d193334 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 1.743306 Sep 25 01:10:49.517512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1058/2068] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:47 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:49.529375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887a377a-fe62-45c1-a7a3-162291919821", "tag": "fa6cd17b-8f35-485d-8444-ae2074d8182a"}, {"server_uuid": "29e8c01b-620f-46f8-9599-f0ae0f92e1ea", "name": "network-vif-deleted", "tag": "e7447597-17d3-4b71-a80e-dccd38a636f5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:49.559674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.565723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.566708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.600882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] Creating event network-changed:fa6cd17b-8f35-485d-8444-ae2074d8182a for instance 887a377a-fe62-45c1-a7a3-162291919821 on n-h2-master-1 Sep 25 01:10:49.601807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] Creating event network-vif-deleted:e7447597-17d3-4b71-a80e-dccd38a636f5 for instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea on n-h2-master-1 Sep 25 01:10:49.620988 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-47a5b992-e23b-4a3f-9c30-46b1f1b404a6 req-5573d020-723f-4c72-bb9f-69ac259a2ba0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.096279 Sep 25 01:10:49.622359 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1059/2069] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:49.637015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:49.637985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:49.651953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.656265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.657178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.659824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.667558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:49.669276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.670343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.686857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8010492-e6dc-4c93-a582-f261940130cf tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 1.862921 Sep 25 01:10:49.687893 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1011/2070] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:47 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:49.694090 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] HTTP exception thrown: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Request method failure captured: Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 HTTP/1.1 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6nQAV1CqSXD53T-BW2wdK1a0fRlGrbbq75_dAhKN5hTMcaSqz0TvgNwnOTgOEtavfB0WH5d0roA9RpV5JX6nCAfEtSEC9bqNXy4ioi4XdA5I_DCXYD3BoZLE5WsD-rJLbyXArXbn3H3P2BFRU7a15cT40m2bi4HjTN_jhbErakwVOw Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ece9c2b6ca644160ad4c5fb7e1131c14 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ece9c2b6ca644160ad4c5fb7e1131c14"}]}] Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ece9c2b6ca644160ad4c5fb7e1131c14 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachSCSIVolumeTestJSON-232199607-project Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9164864381494d9991fd97410bedea72 Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-232199607-project Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4'} Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:49.696818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:49.700150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:49.702618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Returning 404 to user: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:49.703736 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41f738bd-9484-4322-879e-ba2ed9839c0a tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 404 len: 111 microversion: 2.1 time: 0.080024 Sep 25 01:10:49.705131 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1060/2071] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:49 2022] DELETE /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:49.706731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:49.707565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:49.714352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:49.715637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:49.725999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.726882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.727549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.728494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.729182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.729900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.745045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.745842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.746310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.754661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.756143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.756608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:50.463577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.475766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.480535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.486623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.491053 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-adc417a3-f864-44fe-afca-6a7aa621fc3e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.784103 Sep 25 01:10:50.496741 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1061/2072] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:49 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:50.510348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.512083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:50.516003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.517044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:50.522417 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-000b8dee-de59-4083-939f-2f1cbf432725 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1666 microversion: 2.25 time: 0.832075 Sep 25 01:10:50.529796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1012/2073] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:49 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1666 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:50.541808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:50.543265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:50.550657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:50.551594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:50.552871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:50.554305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:50.554942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:50.558414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:50.573878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:50.579419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:50.585423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:50.587778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:50.588565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:50.598195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.331041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:51.340663 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b8b96c0-b105-42d6-9f8e-a625ec7ed4c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.841251 Sep 25 01:10:51.346251 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1062/2074] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:50 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:51.362488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:51.363400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] [instance: 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:51.371853 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:51.373726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.377214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.377968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.378873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.379488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.381994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.391577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6fa014b7-7d9b-4246-8212-68632203d34e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.850525 Sep 25 01:10:51.393743 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1013/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:50 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:51.418475 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] HTTP exception thrown: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Request method failure captured: Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 HTTP/1.1 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6nQAV1CqSXD53T-BW2wdK1a0fRlGrbbq75_dAhKN5hTMcaSqz0TvgNwnOTgOEtavfB0WH5d0roA9RpV5JX6nCAfEtSEC9bqNXy4ioi4XdA5I_DCXYD3BoZLE5WsD-rJLbyXArXbn3H3P2BFRU7a15cT40m2bi4HjTN_jhbErakwVOw Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ece9c2b6ca644160ad4c5fb7e1131c14 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ece9c2b6ca644160ad4c5fb7e1131c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ece9c2b6ca644160ad4c5fb7e1131c14"}]}] Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ece9c2b6ca644160ad4c5fb7e1131c14 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-232199607 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachSCSIVolumeTestJSON-232199607-project Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9164864381494d9991fd97410bedea72 Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-232199607-project Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4'} Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:51.432607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] Returning 404 to user: Instance 5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e216f06-2334-4c91-83f6-3bc91b8beea2 tempest-AttachSCSIVolumeTestJSON-232199607 tempest-AttachSCSIVolumeTestJSON-232199607-project] 10.222.0.16 "GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4" status: 404 len: 111 microversion: 2.1 time: 0.086587 Sep 25 01:10:51.436144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1063/2076] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:51 2022] GET /compute/v2.1/servers/5b8b32ae-04db-43f0-a8b2-df2bf6a6c8c4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:51.457787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:51.458996 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:51.480963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.481642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.482089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.494190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.494622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.495072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.523738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9595fa61-5c86-4e57-b362-fcf53949c4fc tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Action: 'create', calling method: .version_select at 0x7f7bf4013670>, body: {"keypair": {"name": "tempest-keypair-152594226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUxj98KYDGu1Vwotw/cEaHVL3kgUcY8znY86fGf0w7dkdXHm24PJuy3WHXWy3qSkopaGhI3qyHpnQVI9vaS5zFoc3TddGHf9WU9YNGGF45ao5/p1TucqzaGaqqzqiCW/g=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:51.565655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9595fa61-5c86-4e57-b362-fcf53949c4fc tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Getting quotas for project 2767668c8f624a71b787a1334c9091da. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:51.576060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9595fa61-5c86-4e57-b362-fcf53949c4fc tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Getting quotas for user 4a8f4f941c504950b4f8217de48f3f58 and project 2767668c8f624a71b787a1334c9091da. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:51.637736 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9595fa61-5c86-4e57-b362-fcf53949c4fc tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.240654 Sep 25 01:10:51.638282 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1014/2077] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:10:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:51.653500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:51.654222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:51.669487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.670194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.671274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.672153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.672753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.673813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.132276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.139148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.148699 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a4814cc4-e807-4b1e-96a9-8034ac0cc6b8 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 0.712834 Sep 25 01:10:52.149615 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1064/2078] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:51 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:52.152125 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8d74c78b-0e91-4b74-9fad-5f503a93b55e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.508227 Sep 25 01:10:52.153782 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1015/2079] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:51 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:52.166886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:52.167243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:52.167526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:52.169443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:52.173934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.174463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.174908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.175626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.176258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.177367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.183687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.186119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.186940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.188194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.190821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.191519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.336249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.347817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.351654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.358046 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d670eda-d56b-47c6-b75d-f46be23d536f tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1666 microversion: 2.25 time: 0.198084 Sep 25 01:10:52.359297 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1016/2080] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:52 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1666 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:52.370910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606c6b18-fed9-4c35-a893-073e837e900e", "name": "network-vif-deleted", "tag": "064c9227-3e67-4e2b-93a2-32adff32ffbc"}, {"server_uuid": "46634d57-04e7-41e5-ab07-b519e0c7f1f5", "name": "network-vif-unplugged", "status": "completed", "tag": "45f9a505-6899-473a-bab5-680e01259f2f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:52.382442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.397700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.399253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.400794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4321654e-d016-40e6-9b16-596a04e9c4a6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.250130 Sep 25 01:10:52.417881 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1065/2081] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:52 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:52.429342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:52.430006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:52.443136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.443917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.444536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.445461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.446075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.446652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.447676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.448152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.452943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.491885 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] Creating event network-vif-deleted:064c9227-3e67-4e2b-93a2-32adff32ffbc for instance 606c6b18-fed9-4c35-a893-073e837e900e on n-h2-master-1 Sep 25 01:10:52.494076 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] Creating event network-vif-unplugged:45f9a505-6899-473a-bab5-680e01259f2f for instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 on n-h1-master-1 Sep 25 01:10:52.515276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7bbb9e24-6fd3-4ae2-95cd-1b756ac364eb req-0cb8a9a8-084a-4c26-9c0f-4e11219aef90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.154622 Sep 25 01:10:52.522652 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1017/2082] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:52.532177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:52.533858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:52.541621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.542388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.543029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.543944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.544693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.545310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.249290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:53.271720 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d76e5cc-b007-4402-af38-5adf11096696 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.849696 Sep 25 01:10:53.276360 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1066/2083] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:52 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:53.289207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:53.301112 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56a529dc-812c-44d0-bf07-aa5a796b66b9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.776248 Sep 25 01:10:53.301918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-156fb224-3001-46a8-965a-a5129a07e723 req-0e442934-5f64-4242-9cc9-0e0e76bf8560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77babc4e-c612-45ee-8bd0-f477b4329ccd", "tag": "475f3c24-db7c-44b9-b1ac-deaaf6cbc268"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:53.306678 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1018/2084] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:52 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:53.326256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:53.330078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:53.344268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-156fb224-3001-46a8-965a-a5129a07e723 req-0e442934-5f64-4242-9cc9-0e0e76bf8560 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.346964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-156fb224-3001-46a8-965a-a5129a07e723 req-0e442934-5f64-4242-9cc9-0e0e76bf8560 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.351614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.354246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.359870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.361384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-156fb224-3001-46a8-965a-a5129a07e723 req-0e442934-5f64-4242-9cc9-0e0e76bf8560 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.362369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.366196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.366935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.419700 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-156fb224-3001-46a8-965a-a5129a07e723 req-0e442934-5f64-4242-9cc9-0e0e76bf8560 service nova] Creating event network-changed:475f3c24-db7c-44b9-b1ac-deaaf6cbc268 for instance 77babc4e-c612-45ee-8bd0-f477b4329ccd on n-h1-master-1 Sep 25 01:10:53.461320 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-156fb224-3001-46a8-965a-a5129a07e723 req-0e442934-5f64-4242-9cc9-0e0e76bf8560 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177398 Sep 25 01:10:53.474783 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1067/2085] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:53.514119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:53.518684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:53.559119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.559615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.560056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.560763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.561217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.561667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.951970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:53.962455 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0fe378d3-e705-478d-ba71-ce3acbf91979 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.654416 Sep 25 01:10:53.966120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1019/2086] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:53 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:53.979527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:53.985936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:53.999874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:54.002659 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-866fd0d1-04ce-4b74-b2a9-0df079cb1d4b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 0.523947 Sep 25 01:10:54.010234 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1068/2087] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:53 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:54.029905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.032420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.032791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:54.033330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.035225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:54.037896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.039949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.041543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.065465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.066083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.069942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.072761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.074940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.078298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.136795 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:54.193127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.194051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.194744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.195444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lazy-loading 'fault' on Instance uuid 606c6b18-fed9-4c35-a893-073e837e900e {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:54.379716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.382453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.405883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.428708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.438127 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0f57abd-2e7c-4812-9968-2ff5bd140cbf tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 200 len: 1376 microversion: 2.25 time: 0.466096 Sep 25 01:10:54.439671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.440571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1020/2088] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:53 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 1376 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:54.446895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.453599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-012758f9-99dc-4586-aba3-c406123e99cd tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.436267 Sep 25 01:10:54.465433 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1069/2089] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:54 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:54.465822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:54.466757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:54.477678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:54.477678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:54.490059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.494506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.496083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.498377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.503102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.504490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.507774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.509931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.510548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.514155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.518083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.520480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.191421 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:55.434594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:55.450712 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fddc6b01-14f5-45c3-8821-66cd898c3387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.992552 Sep 25 01:10:55.469624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1070/2090] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:54 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:55.494287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:55.510726 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a606109-c189-4c81-86ee-9bd3456c9926 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 1.061875 Sep 25 01:10:55.524157 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1021/2091] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:54 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:55.524157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:55.524157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:55.535289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.540620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.541180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.542537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.543038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.543476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.576686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f66b53fa-9a47-406f-bb4d-d8a55ba3c103 req-745277a6-3a45-43b5-a049-97d040d0b870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46634d57-04e7-41e5-ab07-b519e0c7f1f5", "tag": "45f9a505-6899-473a-bab5-680e01259f2f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:55.593899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f66b53fa-9a47-406f-bb4d-d8a55ba3c103 req-745277a6-3a45-43b5-a049-97d040d0b870 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.594449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f66b53fa-9a47-406f-bb4d-d8a55ba3c103 req-745277a6-3a45-43b5-a049-97d040d0b870 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.594898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f66b53fa-9a47-406f-bb4d-d8a55ba3c103 req-745277a6-3a45-43b5-a049-97d040d0b870 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.607728 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f66b53fa-9a47-406f-bb4d-d8a55ba3c103 req-745277a6-3a45-43b5-a049-97d040d0b870 service nova] Creating event network-changed:45f9a505-6899-473a-bab5-680e01259f2f for instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 on n-h1-master-1 Sep 25 01:10:55.613286 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f66b53fa-9a47-406f-bb4d-d8a55ba3c103 req-745277a6-3a45-43b5-a049-97d040d0b870 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142319 Sep 25 01:10:55.613972 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1071/2092] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:55.622336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:55.623442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:55.630678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.631414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.631863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.632575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.633211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.633681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.175635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.184272 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-faa78baa-d23b-46eb-9272-69a4825de648 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 0.567773 Sep 25 01:10:56.184885 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1072/2093] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:55 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:56.205693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:56.206989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 606c6b18-fed9-4c35-a893-073e837e900e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:56.217143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.221907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.227240 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-948e13fa-baea-4a1f-a48f-1fc9811e601c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.714305 Sep 25 01:10:56.228232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.228947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.230013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.230702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.246254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.246985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1022/2094] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:55 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:56.260149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:56.262636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:56.274822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] HTTP exception thrown: Instance 606c6b18-fed9-4c35-a893-073e837e900e could not be found. Sep 25 01:10:56.275022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Request method failure captured: Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e HTTP/1.1 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jD4ZOeXGY30lKSqt_EzZxS4vFJG2K1nPMOo08SN8Bs8bpMujMXC-OOC17qpRJU2y_J1O-4n6_SQmdGZuEFTj4AlYVr7s53yLlM8vHMytgw0AnWXJBEY7Jl5uHkaqLdZ1OdeJalS0jcr72vZHIF2GDYZXouXFn-Y6E05XNTtxaIs3Q Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.25 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_868947b52a1d48d6be6e81a2b8718441"}]}] Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 545456a4a4e540be9138c47b0df77bbf Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 606c6b18-fed9-4c35-a893-073e837e900e could not be found. Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '606c6b18-fed9-4c35-a893-073e837e900e'} Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606c6b18-fed9-4c35-a893-073e837e900e could not be found. Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606c6b18-fed9-4c35-a893-073e837e900e could not be found. Sep 25 01:10:56.277049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606c6b18-fed9-4c35-a893-073e837e900e could not be found. Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Returning 404 to user: Instance 606c6b18-fed9-4c35-a893-073e837e900e could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:56.280951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de59d5ec-9971-4b78-85e9-57dee5ba186c tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e" status: 404 len: 111 microversion: 2.25 time: 0.080297 Sep 25 01:10:56.282739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.283199 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1073/2095] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:56 2022] GET /compute/v2.1/servers/606c6b18-fed9-4c35-a893-073e837e900e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:10:56.283330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.284070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.284580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.284982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.294763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4e57b52-3f19-4bda-8665-705f95408eeb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '.version_select at 0x7f7bf40d8790>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:56.341229 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4e57b52-3f19-4bda-8665-705f95408eeb tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480425643" status: 204 len: 0 microversion: 2.25 time: 0.056651 Sep 25 01:10:56.342156 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1074/2096] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480425643 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:10:56.476108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:56.476798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:56.486479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.499882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.502594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.503296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.509881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.512058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.513310 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cce9361e-8417-4b43-a0d5-61cbc0f7bb0a tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.265034 Sep 25 01:10:56.513927 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1023/2097] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:56 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:56.526577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.533444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.534479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.550378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:56.551175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:56.562371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.566061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.566738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.567888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.569925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.570541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.912811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.926402 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-732bb70f-78d7-4f29-9d8d-534d25ba1932 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.386755 Sep 25 01:10:56.941436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1024/2098] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:56 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:56.943303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:56.949017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90a2292e-ff64-4cdf-ab0a-707836f91642 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.476467 Sep 25 01:10:56.950085 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1075/2099] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:56 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:56.989008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-afb8feff-c176-4c24-9a50-97a362dcd380 req-24a94904-ff79-4073-9b9f-16aaf3722cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887a377a-fe62-45c1-a7a3-162291919821", "name": "network-vif-plugged", "status": "completed", "tag": "fa6cd17b-8f35-485d-8444-ae2074d8182a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:57.017361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-afb8feff-c176-4c24-9a50-97a362dcd380 req-24a94904-ff79-4073-9b9f-16aaf3722cf7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.024130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-afb8feff-c176-4c24-9a50-97a362dcd380 req-24a94904-ff79-4073-9b9f-16aaf3722cf7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.026361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-afb8feff-c176-4c24-9a50-97a362dcd380 req-24a94904-ff79-4073-9b9f-16aaf3722cf7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.042246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-afb8feff-c176-4c24-9a50-97a362dcd380 req-24a94904-ff79-4073-9b9f-16aaf3722cf7 service nova] Creating event network-vif-plugged:fa6cd17b-8f35-485d-8444-ae2074d8182a for instance 887a377a-fe62-45c1-a7a3-162291919821 on n-h2-master-1 Sep 25 01:10:57.049872 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-afb8feff-c176-4c24-9a50-97a362dcd380 req-24a94904-ff79-4073-9b9f-16aaf3722cf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064134 Sep 25 01:10:57.051122 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1025/2100] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:57.212727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:57.214068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:57.246961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.248512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.251526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.252636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.253255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.254162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.265628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:57.265628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:57.273959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.280775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.282157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.283244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.283960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.284500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.729590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:57.745704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:57.758005 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d6b7adb-83ae-4bec-a0c4-4c04a0456ccd tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 0.551138 Sep 25 01:10:57.759149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1076/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:57 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:57.764925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:57.765954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:57.775276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c0f221d8-66bd-4297-ae86-36eecc5c2b0f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.518072 Sep 25 01:10:57.775889 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1026/2102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:57 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:57.779317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.780208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.780801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.804685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.808590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.812363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.955288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:57.956190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:57.964100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.964843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.965597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.966456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.967245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.967818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.074486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:58.078883 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:58.092808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:58.095381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:58.097824 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-650a275e-9c34-4e89-b879-00cd710a99ed tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.337401 Sep 25 01:10:58.100316 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1077/2103] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:57 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:58.106356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:58.107998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:58.115501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.116507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.118045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.119878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.120620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.121575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.276384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:58.286470 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38245e65-bca7-424a-929d-e0465d2099d8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.334598 Sep 25 01:10:58.307458 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1027/2104] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:57 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:58.334064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:58.343060 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-58d27a43-3aa7-44e1-a8c6-b146118f302c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.241334 Sep 25 01:10:58.344246 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1078/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:58 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:58.783614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:58.784504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:58.792736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.800166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:58.801373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:58.804949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.805750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.806518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.806994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.807425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.815047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.816327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.816935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.817915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.818527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.819106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.056719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.066490 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff80925d-7c01-4b63-8bf5-84045dc141fb tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1318 microversion: 2.1 time: 0.286525 Sep 25 01:10:59.068171 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1028/2106] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:58 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:59.073719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "6d41ff94-a6c4-4e7f-bbc1-95d01a92d049"}], "security_groups": [{"name": "tempest-securitygroup--972707319"}], "key_name": "tempest-keypair-152594226", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:59.084301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.100104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e54a8086-c0d2-4221-913e-daeba481bde4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.303650 Sep 25 01:10:59.114020 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1079/2107] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:58 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:59.124413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.125159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.132687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.134397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.135028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.135921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.136533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.137120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.167118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:59.191659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] validate_networks() for [('6d41ff94-a6c4-4e7f-bbc1-95d01a92d049', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:10:59.305897 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-212f6e20-8f55-4298-a282-8793129cb9c3 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 204 len: 0 microversion: 2.25 time: 0.188016 Sep 25 01:10:59.314431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1080/2108] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:10:59 2022] DELETE /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:10:59.332366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.333900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.342819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.346818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.350380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.351383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.354864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.355518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.479858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.491047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.492900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.494424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd185da1-f680-481b-924e-5444d4f93215 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.177870 Sep 25 01:10:59.495216 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1081/2109] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:59 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:59.500769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.501694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.510735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.511652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.512393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.513340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.514059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.514713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.824571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.836518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.838157 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.839337 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-861680e0-90f3-457d-8179-90e9b75d020e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1550 microversion: 2.25 time: 0.342874 Sep 25 01:10:59.846507 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1082/2110] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:59 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1550 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:10:59.854373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.855002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.873678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.874176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.874699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.875426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.875886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.876312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.119040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:11:00.121000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:11:00.121675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:11:00.122241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:11:00.123084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:11:00.166844 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=17 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:00.169153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.169774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.170455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.172686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.177659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.178178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.204892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Getting quotas for project 2767668c8f624a71b787a1334c9091da. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:11:00.212340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Getting quotas for user 4a8f4f941c504950b4f8217de48f3f58 and project 2767668c8f624a71b787a1334c9091da. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:11:00.235425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:11:00.239326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:11:00.300793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:00.316164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd00c4cb-a3b4-4e26-83a9-39a1c9580e19 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.246762 Sep 25 01:11:00.317746 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1029/2111] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:11:00.323262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f47a06c-f569-4a9b-ac96-4b9d3729f443 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.462482 Sep 25 01:11:00.323901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:00.325629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:00.325837 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1083/2112] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:59 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:00.337103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:00.337764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:00.341058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.341730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.342173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.343267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.343733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.344343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.368598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.369098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.369576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.370284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.370739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.380379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.051128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.074098 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b5ec11d-1c32-4e60-aa5d-7b72148d2382 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.754882 Sep 25 01:11:01.076963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1030/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:00 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:01.083500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:01.084379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:01.091605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.104840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.107365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.112079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.112079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.112079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.138449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.151339 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-59198daa-2071-4c9f-b975-1c9a5b87d9ee tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1508 microversion: 2.1 time: 0.821417 Sep 25 01:11:01.162679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1084/2114] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:00 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:01.169755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:01.174747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:01.185786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.186288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.186736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.203214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.205809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.208867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.322668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.335691 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-58dda5f0-0c30-45fb-a638-a83f869e7f69 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1229 microversion: 2.1 time: 0.170456 Sep 25 01:11:01.336578 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1085/2115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:01 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:01.346100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:01.355905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:01.369146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.372289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.374047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.374859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.377145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.379122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.462651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.472393 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7917e1f5-8240-4946-ac96-0e46ab5c5060 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.392897 Sep 25 01:11:01.473721 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1031/2116] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:01 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:01.479326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:01.480149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:01.486699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.487436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.487877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.488663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.489744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.490608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.493657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.503587 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.505731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.507139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fa0288f6-6f5f-4126-ad87-477724834345 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.169446 Sep 25 01:11:01.508130 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1086/2117] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:01 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:01.513080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c9613344-f9e4-43b3-97af-2fa1513517fa req-ba57c3f4-1941-4c58-b79a-2876cb17074b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4569b875-6e5c-4e5c-b602-f5454f874bba", "name": "network-vif-deleted", "tag": "9b02ba0e-f61b-4006-b9f3-05b72df925b3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:01.525440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c9613344-f9e4-43b3-97af-2fa1513517fa req-ba57c3f4-1941-4c58-b79a-2876cb17074b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.526251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c9613344-f9e4-43b3-97af-2fa1513517fa req-ba57c3f4-1941-4c58-b79a-2876cb17074b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.526907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c9613344-f9e4-43b3-97af-2fa1513517fa req-ba57c3f4-1941-4c58-b79a-2876cb17074b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.550469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.550961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.556952 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c9613344-f9e4-43b3-97af-2fa1513517fa req-ba57c3f4-1941-4c58-b79a-2876cb17074b service nova] Creating event network-vif-deleted:9b02ba0e-f61b-4006-b9f3-05b72df925b3 for instance 4569b875-6e5c-4e5c-b602-f5454f874bba on n-h2-master-1 Sep 25 01:11:01.557565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.558152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lazy-loading 'fault' on Instance uuid 4569b875-6e5c-4e5c-b602-f5454f874bba {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:01.573611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c9613344-f9e4-43b3-97af-2fa1513517fa req-ba57c3f4-1941-4c58-b79a-2876cb17074b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064159 Sep 25 01:11:01.574780 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1087/2118] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:01.581512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:01.582154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:01.590876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.591616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.592202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.593652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.594402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.594974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.649396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.676212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.678509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.686947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc3050ce-8207-4b94-9ecd-c40982fae92e tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 200 len: 1352 microversion: 2.25 time: 0.211806 Sep 25 01:11:01.688279 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1032/2119] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:01 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 1352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:02.099727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:02.100578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:02.107664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.118928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.119952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.124971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.130456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.131178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.578558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.591701 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-230f144c-bc52-4727-b06d-9f9760791ad7 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 1.015214 Sep 25 01:11:02.610038 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1088/2120] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:01 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:02.622323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b3c971eb-2fc6-4959-8665-889f3fbe9f2a req-1489b60b-4814-43cd-a38b-3ac51952f3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77babc4e-c612-45ee-8bd0-f477b4329ccd", "name": "network-vif-plugged", "status": "completed", "tag": "475f3c24-db7c-44b9-b1ac-deaaf6cbc268"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:02.643944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b3c971eb-2fc6-4959-8665-889f3fbe9f2a req-1489b60b-4814-43cd-a38b-3ac51952f3a3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.644438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b3c971eb-2fc6-4959-8665-889f3fbe9f2a req-1489b60b-4814-43cd-a38b-3ac51952f3a3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.644877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b3c971eb-2fc6-4959-8665-889f3fbe9f2a req-1489b60b-4814-43cd-a38b-3ac51952f3a3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.667596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b3c971eb-2fc6-4959-8665-889f3fbe9f2a req-1489b60b-4814-43cd-a38b-3ac51952f3a3 service nova] Creating event network-vif-plugged:475f3c24-db7c-44b9-b1ac-deaaf6cbc268 for instance 77babc4e-c612-45ee-8bd0-f477b4329ccd on n-h1-master-1 Sep 25 01:11:02.675523 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b3c971eb-2fc6-4959-8665-889f3fbe9f2a req-1489b60b-4814-43cd-a38b-3ac51952f3a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063721 Sep 25 01:11:02.676148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1089/2121] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:02.695531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:02.696756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:02.703468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.704360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.704965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.705951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.706634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.707272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.718700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.753964 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25521061-8af8-4074-b360-03bc18b8cb9a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.634748 Sep 25 01:11:02.760163 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1033/2122] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:02 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:02.766739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:02.768075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:02.775730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.776965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.777822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.778771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.779441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.780085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.822114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.833431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e381f5f8-a330-4ff4-b8e0-2f11219e5030 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1277 microversion: 2.1 time: 0.153559 Sep 25 01:11:02.862330 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1090/2123] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:02 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:02.877693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:02.878377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:02.891420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.891927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.892358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.893365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.893809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.897778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.027368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.045634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.049958 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9dfab9a8-0b57-4e87-b842-602440aca357 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.287340 Sep 25 01:11:03.052407 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1034/2124] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:02 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:03.060447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.061512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 4569b875-6e5c-4e5c-b602-f5454f874bba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.071368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.072201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.073022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.074217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.074905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.076035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.086134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.087636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.089136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-abd27036-d39f-4350-8884-cf1a8eb3dddc tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.225569 Sep 25 01:11:03.089768 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1091/2125] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:02 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:03.118429 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] HTTP exception thrown: Instance 4569b875-6e5c-4e5c-b602-f5454f874bba could not be found. Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Request method failure captured: Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba HTTP/1.1 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6jD4ZOeXGY30lKSqt_EzZxS4vFJG2K1nPMOo08SN8Bs8bpMujMXC-OOC17qpRJU2y_J1O-4n6_SQmdGZuEFTj4AlYVr7s53yLlM8vHMytgw0AnWXJBEY7Jl5uHkaqLdZ1OdeJalS0jcr72vZHIF2GDYZXouXFn-Y6E05XNTtxaIs3Q Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.25 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_868947b52a1d48d6be6e81a2b8718441"}]}] Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 545456a4a4e540be9138c47b0df77bbf Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4569b875-6e5c-4e5c-b602-f5454f874bba could not be found. Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4569b875-6e5c-4e5c-b602-f5454f874bba'} Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4569b875-6e5c-4e5c-b602-f5454f874bba could not be found. Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4569b875-6e5c-4e5c-b602-f5454f874bba could not be found. Sep 25 01:11:03.120429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4569b875-6e5c-4e5c-b602-f5454f874bba could not be found. Sep 25 01:11:03.123877 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:03.126728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Returning 404 to user: Instance 4569b875-6e5c-4e5c-b602-f5454f874bba could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:03.127875 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-651dd9c3-a4d3-4a89-832c-76c739b8df40 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba" status: 404 len: 111 microversion: 2.25 time: 0.074287 Sep 25 01:11:03.132120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1035/2126] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:03 2022] GET /compute/v2.1/servers/4569b875-6e5c-4e5c-b602-f5454f874bba => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:03.137437 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.137942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.147556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.148061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.148509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.149240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.156759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.157227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.209462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:03.320730 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:03.377690 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27265bde-ed09-4c76-80c1-c2b4fd880d3b tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 204 len: 0 microversion: 2.25 time: 0.244186 Sep 25 01:11:03.378293 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1092/2127] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:11:03 2022] DELETE /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:11:03.386620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.388227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.396566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.397261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.397882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.398857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.399525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.400403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.624832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.626120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.636808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.637270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.648551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.649019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.649580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.650017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.749581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.763463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.764942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.766187 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a5548a5-92a6-4b87-9396-caeaf260836a tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1564 microversion: 2.25 time: 0.383682 Sep 25 01:11:03.766796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1036/2128] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:03 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1564 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:03.784266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.785256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.798500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.806424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.807144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.808273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.808905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.809585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.024555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.037323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-268d6295-1edd-4a22-ae18-6a0bf134bbd2 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.416777 Sep 25 01:11:04.038230 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1093/2129] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:03 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:04.053932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:04.054574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.062451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.062994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.063449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.064187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.064654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.065088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.084534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.101738 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f582785e-3194-4dc9-8733-c28566a3f4e7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1367 microversion: 2.1 time: 0.325312 Sep 25 01:11:04.102350 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1037/2130] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:03 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:04.111850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:04.112538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.143620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.149342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.149342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.149342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.149671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.149914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.222366 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:04.270347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.290043 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24c6744a-2cab-4a03-a442-439b8b780cdd tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1283 microversion: 2.1 time: 0.239953 Sep 25 01:11:04.291429 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1094/2131] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:04 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:04.305978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:04.306641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.313282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.313621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.314077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.314881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.315345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.315911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.502345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.515402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.517002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.518918 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c92fb77f-4b61-411d-b250-de179071589e tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.226274 Sep 25 01:11:04.519886 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1095/2132] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:04 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:04.646163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.667341 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5bb9935e-f5cf-414d-b8bf-8b994743a20b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.548568 Sep 25 01:11:04.673618 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1038/2133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:04 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:04.808649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:04.810084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.818517 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:04.821147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.822277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.823377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.824806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.825645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.826285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.942477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0e8ae33a-3702-4b46-8fcc-229ba42fa3c8"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:04.946084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.958494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.961555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.962260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.963542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.965056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.965910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.088557 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] HTTP exception thrown: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Request method failure captured: Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821/os-volume_attachments/52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b HTTP/1.1 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 74 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6nqjuGoO4b-84bZy73bov5WloWFIrDCO6uioc97f3JXZKiRI5h83kd9swShUDDjw5eOsTcboiyzJ5LbBbaNk2dJ2SyHgHeEpvZJzA3kUhrGD5vB_efd-97t7mmnA6DJzspJn76KdG-p4l05iadukr2pkrs_zNnNle6PjMHg7W5yjMM Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ddfc98737e554a74a138eb2fe8bf5092 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesAdminNegativeTest-1284137513 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddfc98737e554a74a138eb2fe8bf5092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddfc98737e554a74a138eb2fe8bf5092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddfc98737e554a74a138eb2fe8bf5092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddfc98737e554a74a138eb2fe8bf5092"}]}] Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesAdminNegativeTest-1284137513 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ddfc98737e554a74a138eb2fe8bf5092 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1284137513 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesAdminNegativeTest-1284137513-project-admin Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c8bfed82c804419eaddc0aae23f34b70 Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesAdminNegativeTest-1284137513-project-admin Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: {"volumeAttachment": {"volumeId": "0e8ae33a-3702-4b46-8fcc-229ba42fa3c8"}} Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: exception: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': '887a377a-fe62-45c1-a7a3-162291919821', 'id': '52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b', 'body': {'volumeAttachment': {'volumeId': '0e8ae33a-3702-4b46-8fcc-229ba42fa3c8'}}} Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. (HTTP 404) (Request-ID: req-2f79790d-fb53-4f02-996d-ef22cb2f17a0) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:11:05.090949 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. Sep 25 01:11:05.094834 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.099742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] Returning 404 to user: Volume 52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:05.100860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-569c8b62-f484-4d44-bee4-de8094f94090 tempest-VolumesAdminNegativeTest-1284137513 tempest-VolumesAdminNegativeTest-1284137513-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821/os-volume_attachments/52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b" status: 404 len: 109 microversion: 2.1 time: 0.162718 Sep 25 01:11:05.103592 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1039/2134] 10.222.0.16 () {60 vars in 1433 bytes} [Sun Sep 25 01:11:04 2022] PUT /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821/os-volume_attachments/52fd4bbf-e0e9-4a0d-86f6-4d6a2c85a33b => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:11:05.120311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:05.121367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:05.132971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:05.133892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:05.134550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.135509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:05.136206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:05.136847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.895093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:05.903265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25e82568-41fa-446c-9f3a-8b4f6138bcb6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1515 microversion: 2.1 time: 0.798251 Sep 25 01:11:05.924443 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1040/2135] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:05 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1515 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:05.939733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:05.940298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:05.991664 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:05.996821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.000112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.006531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.006531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.008363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.010355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.029986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.041595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.055488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.057021 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9ea9889b-2434-4c16-8323-56bfbf852756 tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1564 microversion: 2.25 time: 1.253504 Sep 25 01:11:06.058130 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1096/2136] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:04 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1564 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:06.079660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:06.081332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:06.095493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.096388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.097865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.098834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.103393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.104154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.447527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.456385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6780ed5-70d4-4baf-8dcb-932ee124b6f6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1558 microversion: 2.1 time: 0.530460 Sep 25 01:11:06.469273 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1041/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:05 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1558 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:06.474982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:06.475890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:06.493258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.494966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.495404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.498460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.499117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.499700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.793194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.808969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.811094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.813081 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa791a86-3869-4dc5-ab71-660adef5162b tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.342600 Sep 25 01:11:06.814330 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1042/2138] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:06 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:06.820277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:06.822170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:06.830127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.830930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.831514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.833732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.834345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.834949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.901547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.909945 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da57b56c-0818-4818-a992-3cf84fb4cbc1 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.850518 Sep 25 01:11:06.919337 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1097/2139] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:06 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:06.935010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:06.935781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:06.948047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.949022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.949669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.950548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.951420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.952947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.251060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:07.263775 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ecf18626-d587-4ac9-ae7d-ce9db00e0748 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343079 Sep 25 01:11:07.265308 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1098/2140] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:11:06 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:07.271715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:07.281296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:07.300088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-848c393d-299b-45f7-a7f7-6a12065dd181 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.482474 Sep 25 01:11:07.301363 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1043/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:06 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:07.308933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.309452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.310109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.310692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.316583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:07.318291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:07.318471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.319241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.340458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.346186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.346870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.347785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.348468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.349312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.764001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:07.788429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:07.791535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '545456a4a4e540be9138c47b0df77bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868947b52a1d48d6be6e81a2b8718441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:07.795128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17eecaac-4fe6-40bf-8a7f-58d96c2706aa tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 200 len: 1522 microversion: 2.25 time: 0.492387 Sep 25 01:11:07.796346 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1044/2142] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:07 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:07.810812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-27b00dc8-0b55-411f-a2ab-f4d88181036e req-9daec7dc-8e97-4757-adbd-31d2d7be87e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286adbb8-ab65-4c43-bd6c-d73ae0f11a6c", "name": "network-vif-deleted", "tag": "250f468b-3568-4cf8-9c11-e739f9bd20cf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:07.831377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-27b00dc8-0b55-411f-a2ab-f4d88181036e req-9daec7dc-8e97-4757-adbd-31d2d7be87e6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.833059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-27b00dc8-0b55-411f-a2ab-f4d88181036e req-9daec7dc-8e97-4757-adbd-31d2d7be87e6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.833575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-27b00dc8-0b55-411f-a2ab-f4d88181036e req-9daec7dc-8e97-4757-adbd-31d2d7be87e6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.871640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-27b00dc8-0b55-411f-a2ab-f4d88181036e req-9daec7dc-8e97-4757-adbd-31d2d7be87e6 service nova] Creating event network-vif-deleted:250f468b-3568-4cf8-9c11-e739f9bd20cf for instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c on n-h2-master-1 Sep 25 01:11:07.882874 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-27b00dc8-0b55-411f-a2ab-f4d88181036e req-9daec7dc-8e97-4757-adbd-31d2d7be87e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084835 Sep 25 01:11:07.902960 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1045/2143] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:07.911649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:07.912327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:07.932544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.935200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.935697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.936474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.936929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.939570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.191909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:08.220474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:08.226992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:08.229037 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e59eb596-e46d-4cb3-a11d-ad4a5d6c0582 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.324658 Sep 25 01:11:08.232622 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1046/2144] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:07 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:08.260218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:08.268294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:08.294722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.295422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.296086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.297832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.298606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.299189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.380726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:08.395999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6421a609-36f3-46c7-805a-4f74e1b593cf tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1521 microversion: 2.1 time: 1.129001 Sep 25 01:11:08.419725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1099/2145] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:07 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1521 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:08.419725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:08.419725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:08.423922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.424712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.425473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.427223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.427853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.428472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.090865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:09.105062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:09.120802 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d2d4912-a9e4-43ce-a104-fd7346914550 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.710928 Sep 25 01:11:09.121277 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a41f0fa2-0af7-40f8-ab25-615e57e7da8e tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.886128 Sep 25 01:11:09.142799 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1100/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:08 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:09.143030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1047/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:08 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:09.148795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:09.149637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] [instance: 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:09.157324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.158028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.158985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.159895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.160642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.161230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.180145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] HTTP exception thrown: Instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c could not be found. Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Request method failure captured: Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c HTTP/1.1 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6jD4ZOeXGY30lKSqt_EzZxS4vFJG2K1nPMOo08SN8Bs8bpMujMXC-OOC17qpRJU2y_J1O-4n6_SQmdGZuEFTj4AlYVr7s53yLlM8vHMytgw0AnWXJBEY7Jl5uHkaqLdZ1OdeJalS0jcr72vZHIF2GDYZXouXFn-Y6E05XNTtxaIs3Q Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.25 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/868947b52a1d48d6be6e81a2b8718441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_868947b52a1d48d6be6e81a2b8718441"}]}] Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 868947b52a1d48d6be6e81a2b8718441 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-645510952 Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 545456a4a4e540be9138c47b0df77bbf Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-645510952-project Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c could not be found. Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '286adbb8-ab65-4c43-bd6c-d73ae0f11a6c'} Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c could not be found. Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c could not be found. Sep 25 01:11:09.182676 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c could not be found. Sep 25 01:11:09.186877 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:09.188271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] Returning 404 to user: Instance 286adbb8-ab65-4c43-bd6c-d73ae0f11a6c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:09.189849 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da33e385-15e3-42f1-8335-5dadfc7035da tempest-LiveAutoBlockMigrationV225Test-645510952 tempest-LiveAutoBlockMigrationV225Test-645510952-project] 10.222.0.16 "GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c" status: 404 len: 111 microversion: 2.25 time: 0.045605 Sep 25 01:11:09.190906 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1101/2148] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:09 2022] GET /compute/v2.1/servers/286adbb8-ab65-4c43-bd6c-d73ae0f11a6c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:09.264717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:09.266260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:09.278219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.280587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.281204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.282234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.282843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.283438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.402588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:09.418790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:09.420721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:09.432079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:09.433351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:09.440188 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f2bb592-1bee-4100-b59c-6dac4583d432 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.163440 Sep 25 01:11:09.443362 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1048/2149] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:09 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:09.449932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.450735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.451350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.453564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.454204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.457173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.586817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-873856e4-137d-46e1-9b6f-dae80b9f7271 req-fbcd188f-593c-4305-add3-35c3ba1b5aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77babc4e-c612-45ee-8bd0-f477b4329ccd", "tag": "475f3c24-db7c-44b9-b1ac-deaaf6cbc268"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:09.604692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-873856e4-137d-46e1-9b6f-dae80b9f7271 req-fbcd188f-593c-4305-add3-35c3ba1b5aa0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.605129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-873856e4-137d-46e1-9b6f-dae80b9f7271 req-fbcd188f-593c-4305-add3-35c3ba1b5aa0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.608284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-873856e4-137d-46e1-9b6f-dae80b9f7271 req-fbcd188f-593c-4305-add3-35c3ba1b5aa0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.647601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-873856e4-137d-46e1-9b6f-dae80b9f7271 req-fbcd188f-593c-4305-add3-35c3ba1b5aa0 service nova] Creating event network-changed:475f3c24-db7c-44b9-b1ac-deaaf6cbc268 for instance 77babc4e-c612-45ee-8bd0-f477b4329ccd on n-h1-master-1 Sep 25 01:11:09.658777 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-873856e4-137d-46e1-9b6f-dae80b9f7271 req-fbcd188f-593c-4305-add3-35c3ba1b5aa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076340 Sep 25 01:11:09.663469 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1049/2150] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 25 01:11:09.737239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:09.738131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:09.752952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.753653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.756929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.757901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.758693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.759651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.829312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:10.048204 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5586828-b2c5-4adc-afaf-ad64e1ec6bf9 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "DELETE /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 204 len: 0 microversion: 2.1 time: 0.315594 Sep 25 01:11:10.053351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1050/2151] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:09 2022] DELETE /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:10.059691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:10.064911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:10.081242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.081776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.082733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.083529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.083984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.087936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.192910 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:10.224263 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=5 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:10.533726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:10.558352 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b648359-6e6f-4a4c-9eb9-94ca7371ab27 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1514 microversion: 2.1 time: 0.502994 Sep 25 01:11:10.562794 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1051/2152] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:10 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:10.571128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:10.571748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:10.593336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:10.603743 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88685e84-a56f-4fd6-8110-f8717bed8305 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1521 microversion: 2.1 time: 1.176264 Sep 25 01:11:10.604328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1102/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:09 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1521 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:10.612594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.613086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.614153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.624306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:10.625463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.626153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.626789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.627641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:10.646924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.647650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.648277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.650523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.651182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.653440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.982799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:10.991882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a7999424-4636-4a09-bd10-63198b8d8a27 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1390 microversion: 2.1 time: 0.380789 Sep 25 01:11:10.997375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1103/2154] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:10 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:11.003638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:11.013271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-db96ea65-e3e0-44fa-a30b-7e54f4beb03d req-fb82b67f-4a27-4044-974c-9c555947a2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18af2166-4a52-4cee-9e7f-12811ff94f11", "tag": "a8ea4563-746c-4656-867c-082f12bdf9f6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:11.021877 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-829ce83d-53e7-49fa-9d97-f764b4b084f6 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.457670 Sep 25 01:11:11.025184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1052/2155] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:10 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:11.036755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-db96ea65-e3e0-44fa-a30b-7e54f4beb03d req-fb82b67f-4a27-4044-974c-9c555947a2bd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.037052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:11.037914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-db96ea65-e3e0-44fa-a30b-7e54f4beb03d req-fb82b67f-4a27-4044-974c-9c555947a2bd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.039288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:11.039978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-db96ea65-e3e0-44fa-a30b-7e54f4beb03d req-fb82b67f-4a27-4044-974c-9c555947a2bd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.057094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.061051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.062778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.065221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.067758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.068235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.071468 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-db96ea65-e3e0-44fa-a30b-7e54f4beb03d req-fb82b67f-4a27-4044-974c-9c555947a2bd service nova] Creating event network-changed:a8ea4563-746c-4656-867c-082f12bdf9f6 for instance 18af2166-4a52-4cee-9e7f-12811ff94f11 on n-h2-master-1 Sep 25 01:11:11.082119 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-db96ea65-e3e0-44fa-a30b-7e54f4beb03d req-fb82b67f-4a27-4044-974c-9c555947a2bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079400 Sep 25 01:11:11.086032 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1104/2156] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:11.099863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0a9c229c-cc38-4261-a6bc-32c7dfc9e243 req-4743e4d6-4809-45de-bcf1-358743e350d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8837fcf1-fc71-4722-ab37-9235d38749ac", "name": "network-vif-unplugged", "status": "completed", "tag": "b51fce4d-7221-45d6-85b3-dd73795a3928"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:11.129940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0a9c229c-cc38-4261-a6bc-32c7dfc9e243 req-4743e4d6-4809-45de-bcf1-358743e350d9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.131033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0a9c229c-cc38-4261-a6bc-32c7dfc9e243 req-4743e4d6-4809-45de-bcf1-358743e350d9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.131692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0a9c229c-cc38-4261-a6bc-32c7dfc9e243 req-4743e4d6-4809-45de-bcf1-358743e350d9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.151710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0a9c229c-cc38-4261-a6bc-32c7dfc9e243 req-4743e4d6-4809-45de-bcf1-358743e350d9 service nova] Creating event network-vif-unplugged:b51fce4d-7221-45d6-85b3-dd73795a3928 for instance 8837fcf1-fc71-4722-ab37-9235d38749ac on n-h1-master-1 Sep 25 01:11:11.168007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0a9c229c-cc38-4261-a6bc-32c7dfc9e243 req-4743e4d6-4809-45de-bcf1-358743e350d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078087 Sep 25 01:11:11.173242 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1105/2157] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:11.257338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:11.283256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:11.286985 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:11.288705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ff6cee1-98bc-4f4b-9bc9-2f94c8d55d23 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.262446 Sep 25 01:11:11.289960 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1053/2158] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:11 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:11.589082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:11.590108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:11.609318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.620501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.621221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.622316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.622934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.623511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.635460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:11.636081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:11.653767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.654368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.654880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.655626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.656084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.656673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.382229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:12.403808 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-25e232ad-f765-4bab-b77b-d17b7739be39 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1514 microversion: 2.1 time: 0.821345 Sep 25 01:11:12.405017 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1106/2159] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:11 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1514 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:12.411403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:12.412032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:12.440333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.442856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.443846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.446309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.449082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.449678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.577420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:12.591155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eea25f91-554f-44b4-9542-52bcad30f277 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1521 microversion: 2.1 time: 0.956372 Sep 25 01:11:12.606137 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1054/2160] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:11 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1521 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:12.618224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:12.619861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:12.627651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.628731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.629473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.630452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.631164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.631811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.638988 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:12.923653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:12.933524 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0efee8a6-75e2-4120-bd59-3cf647db62f8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1380 microversion: 2.1 time: 0.527223 Sep 25 01:11:12.934386 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1107/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:12 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1380 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:12.939731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:12.940828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:12.956467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:12.958968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.960946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.961523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.962777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.963391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.963917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.971719 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2a70a84-15cf-4f99-99bb-f35175eddfaa tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.364048 Sep 25 01:11:12.972332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1055/2162] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:12 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:12.977968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06896372-2ffe-4384-84b7-92152eaeddba tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '.version_select at 0x7f7bf408a790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:12.988902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06896372-2ffe-4384-84b7-92152eaeddba tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.989440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06896372-2ffe-4384-84b7-92152eaeddba tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.990525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06896372-2ffe-4384-84b7-92152eaeddba tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.010842 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06896372-2ffe-4384-84b7-92152eaeddba tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.037353 Sep 25 01:11:13.011534 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1056/2163] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:11:12 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:13.026138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:13.026760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:13.045756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.046349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.046806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.048253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.048746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.049187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.123872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.148035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.153845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.156488 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8605f21d-1b15-463c-8057-85cfc3643b8f tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.220605 Sep 25 01:11:13.158596 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1108/2164] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:12 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:13.352164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fa79698f-5df3-47a5-b0d7-b3f3d16e2d53 req-97f6cf68-1901-4885-b336-739236480b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887a377a-fe62-45c1-a7a3-162291919821", "name": "network-vif-deleted", "tag": "fa6cd17b-8f35-485d-8444-ae2074d8182a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:13.358378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-090954ec-9cb2-4dc4-8877-05b686b0ed02 tempest-LiveMigrationTest-1166883773 tempest-LiveMigrationTest-1166883773-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1531 microversion: 2.1 time: 0.335341 Sep 25 01:11:13.373739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1057/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:13 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1531 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:13.379975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fa79698f-5df3-47a5-b0d7-b3f3d16e2d53 req-97f6cf68-1901-4885-b336-739236480b26 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.379975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fa79698f-5df3-47a5-b0d7-b3f3d16e2d53 req-97f6cf68-1901-4885-b336-739236480b26 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.379975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fa79698f-5df3-47a5-b0d7-b3f3d16e2d53 req-97f6cf68-1901-4885-b336-739236480b26 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.406936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:13.407660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:13.410949 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fa79698f-5df3-47a5-b0d7-b3f3d16e2d53 req-97f6cf68-1901-4885-b336-739236480b26 service nova] Creating event network-vif-deleted:fa6cd17b-8f35-485d-8444-ae2074d8182a for instance 887a377a-fe62-45c1-a7a3-162291919821 on n-h2-master-1 Sep 25 01:11:13.415947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.416449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.416895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.417648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.418116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.418550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.426343 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fa79698f-5df3-47a5-b0d7-b3f3d16e2d53 req-97f6cf68-1901-4885-b336-739236480b26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080013 Sep 25 01:11:13.430755 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1109/2166] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:11:13.444113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:13.448521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:13.464137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.466783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.467575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.468790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.472558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.473316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.473768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:13.575467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.593710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c06768fd-a3c6-4e2d-8002-ab37f8ad6d26 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1472 microversion: 2.1 time: 0.161124 Sep 25 01:11:13.595093 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1110/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:13 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:13.616703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c57e39d-a9a8-4aed-bf25-48c86f366355 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 204 len: 0 microversion: 2.1 time: 0.222538 Sep 25 01:11:13.617851 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1058/2168] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:13 2022] DELETE /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:11:13.619405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:13.620755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:13.628879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:13.630635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:13.634450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.634951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.635393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.636108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.637632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.637632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.637947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.637947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.638220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.638999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.639541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.640606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.871880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.885976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5fa36a9f-d8b3-4f9c-a57d-22824c3cc695 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1521 microversion: 2.1 time: 0.270278 Sep 25 01:11:13.888549 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1111/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:13 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:13.918547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.929719 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-751d6487-1f6b-4b9d-a37a-78f79a6d3d1d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1386 microversion: 2.1 time: 0.306852 Sep 25 01:11:13.931674 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1059/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:13 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:13.999462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.001760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:14.009290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.010071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.010530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.011620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.012265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.012696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.018927 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:14.172828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:14.184922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f502a32f-69ec-4e3d-a044-d0aceae54162 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.190820 Sep 25 01:11:14.186452 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1112/2171] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:13 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:14.187304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.187931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:14.194314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.194812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.195253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.195966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.196576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.197152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.277064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:14.292888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:14.295403 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:14.296411 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9d244b9-2379-4c24-922a-b796eabe6807 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1604 microversion: 2.42 time: 0.113130 Sep 25 01:11:14.297524 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1060/2172] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:14 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:14.538241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d5801878-e780-4ee0-9fb4-2d68835541b7 req-bce2abf1-bf49-43d6-9c63-cd097b37283a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8837fcf1-fc71-4722-ab37-9235d38749ac", "name": "network-vif-plugged", "status": "completed", "tag": "b51fce4d-7221-45d6-85b3-dd73795a3928"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:14.551661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d5801878-e780-4ee0-9fb4-2d68835541b7 req-bce2abf1-bf49-43d6-9c63-cd097b37283a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.552702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d5801878-e780-4ee0-9fb4-2d68835541b7 req-bce2abf1-bf49-43d6-9c63-cd097b37283a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.553297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d5801878-e780-4ee0-9fb4-2d68835541b7 req-bce2abf1-bf49-43d6-9c63-cd097b37283a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.573465 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d5801878-e780-4ee0-9fb4-2d68835541b7 req-bce2abf1-bf49-43d6-9c63-cd097b37283a service nova] Creating event network-vif-plugged:b51fce4d-7221-45d6-85b3-dd73795a3928 for instance 8837fcf1-fc71-4722-ab37-9235d38749ac on n-h1-master-1 Sep 25 01:11:14.583352 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d5801878-e780-4ee0-9fb4-2d68835541b7 req-bce2abf1-bf49-43d6-9c63-cd097b37283a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051648 Sep 25 01:11:14.585539 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1113/2173] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:14.618757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.619563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:14.634275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.634940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.638113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.639388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.640083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.642055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.909260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:14.923055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-94c6a84a-c4c8-4960-b8fc-c3e9dc90c1be tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1303 microversion: 2.1 time: 0.307966 Sep 25 01:11:14.923245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.923778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:14.924128 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1061/2174] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:14 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1303 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:14.958944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.962075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.962488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:14.964316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.964943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.968131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.969038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.970935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.009511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.013159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.013800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.014732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.018204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.022140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.494417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:15.504905 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e0a0817-28f0-414e-bb41-1955d386235c tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1386 microversion: 2.1 time: 0.552111 Sep 25 01:11:15.525384 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1062/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:14 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1386 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:15.530529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.543153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:15.572524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:15.583254 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-36bedaa2-4bd0-4fa8-9977-0f15e7bbabff tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1521 microversion: 2.1 time: 0.674362 Sep 25 01:11:15.595279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1114/2176] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:14 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:15.604816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.606332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:15.608053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.612149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.614043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.628265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.629367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.631953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.637523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.639094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.639978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.641029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.641547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.642006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.763328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.766847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.769776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.770715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lazy-loading 'fault' on Instance uuid 29e8c01b-620f-46f8-9599-f0ae0f92e1ea {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:15.880198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:15.895739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:15.901866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e62f0277cf04e87be2017098f3d6327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624fa9637d2844fbbce4439455fbe41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:15.904972 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cd22e4ea-815f-45bb-b5f1-4041fcdfbdc6 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 200 len: 1609 microversion: 2.42 time: 0.307174 Sep 25 01:11:15.907910 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1115/2177] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 1609 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:15.951426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.954240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:15.978510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.979836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.981185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.984362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.985274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.986567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.055054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.056022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.056655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.057343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lazy-loading 'fault' on Instance uuid 887a377a-fe62-45c1-a7a3-162291919821 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:16.252686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:16.265344 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3fc70ee3-00b9-4727-9fcf-11fe3a89d47b tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 200 len: 1308 microversion: 2.1 time: 0.323560 Sep 25 01:11:16.267371 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1116/2178] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:16.410531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:16.431799 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74657674-5225-471b-96a4-e7835962ecb0 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.905111 Sep 25 01:11:16.435386 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1063/2179] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:16.540995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:16.544366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:16.565031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.571502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.574940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.576573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.580266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.584124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.620119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:16.620758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:16.642238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.643165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.651183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.655852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.657547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.658032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.357708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:17.385886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-139cad37-f882-402d-8929-fb7ebb264273 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1521 microversion: 2.1 time: 0.767780 Sep 25 01:11:17.396037 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1064/2180] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:16 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:17.412927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:17.414116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:17.423537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.427207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.428155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.429691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.431232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.432460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.434249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:17.451352 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7365eb04-6f13-41c7-b513-d6664993efa8 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1386 microversion: 2.1 time: 0.922280 Sep 25 01:11:17.454136 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1117/2181] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:16 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1386 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:17.467109 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] HTTP exception thrown: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Request method failure captured: Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea HTTP/1.1 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6j2okJqLfw1G3sD7GZLxk38zwVmDhagziKIXlv74GnT3TYLgP6BadELGJshPsKS7PxPzQeqVvHlX76B4kCUZxLFaPKRTLKrIWDYCvq0Lv_n8WLpk25excwFBaxo_MBbCimJTizNHt6u8G3cL9vSjaOVuqsT2pefda41RW8HB6bDXTc Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.42 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 624fa9637d2844fbbce4439455fbe41f Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_624fa9637d2844fbbce4439455fbe41f"}]}] Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 624fa9637d2844fbbce4439455fbe41f Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TaggedBootDevicesTest_v242-1750810445-project Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1e62f0277cf04e87be2017098f3d6327 Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1750810445-project Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '29e8c01b-620f-46f8-9599-f0ae0f92e1ea'} Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.468787 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Returning 404 to user: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d0932cd-6248-41c3-88ae-6090c9868648 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 404 len: 111 microversion: 2.42 time: 0.072842 Sep 25 01:11:17.474594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1065/2182] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:17 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:17.479056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:17.481048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:17.481701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:17.483194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 887a377a-fe62-45c1-a7a3-162291919821] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:17.501887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.502377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.502640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.503447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.505477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.505793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.506743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.506869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.507272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.507844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.510588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.511626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.560335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] HTTP exception thrown: Instance 887a377a-fe62-45c1-a7a3-162291919821 could not be found. Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Request method failure captured: Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 HTTP/1.1 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6na7-ZC0yfgqdMpGDEymLu5LBJFqYi19VTaRz7ScR0iZVIX5zTa7QCQTUHg3FfV6KDJ9pfcIMtD9Qbd9bkgJtzW99Z5-BRo4KLd9OewyqWKNj51KJBo62omHhopKuSftxZPgqVAGxp2hdTLDsMkk_jebzGeq7F3fxFcRgySxhBzFyo Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 4131663ab3574002b589848f67fbb78d Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesAdminNegativeTest-1717297369 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4131663ab3574002b589848f67fbb78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4131663ab3574002b589848f67fbb78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4131663ab3574002b589848f67fbb78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4131663ab3574002b589848f67fbb78d"}]}] Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesAdminNegativeTest-1717297369 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 4131663ab3574002b589848f67fbb78d Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1717297369 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesAdminNegativeTest-1717297369-project Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7f09255419184d11b8379c6bd0a338b0 Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesAdminNegativeTest-1717297369-project Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 887a377a-fe62-45c1-a7a3-162291919821 could not be found. Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '887a377a-fe62-45c1-a7a3-162291919821'} Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887a377a-fe62-45c1-a7a3-162291919821 could not be found. Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887a377a-fe62-45c1-a7a3-162291919821 could not be found. Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.569936 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887a377a-fe62-45c1-a7a3-162291919821 could not be found. Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.574772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Returning 404 to user: Instance 887a377a-fe62-45c1-a7a3-162291919821 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:17.576765 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e21934f-c93f-402a-8e1f-06d5297f3966 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821" status: 404 len: 111 microversion: 2.1 time: 0.116588 Sep 25 01:11:17.580724 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1118/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:17 2022] GET /compute/v2.1/servers/887a377a-fe62-45c1-a7a3-162291919821 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:17.599394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67a0e9cd-a857-4053-b380-59d3012a4821 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '.version_select at 0x7f7bf40340d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:17.656198 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67a0e9cd-a857-4053-b380-59d3012a4821 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922956414" status: 204 len: 0 microversion: 2.42 time: 0.073628 Sep 25 01:11:17.657453 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1119/2184] 10.222.0.16 () {60 vars in 1259 bytes} [Sun Sep 25 01:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922956414 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:11:17.893549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c21d791c-51c9-47d5-97cf-e635d69775c7 req-ccd76120-c0c5-433b-a71c-77c20271ff3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46634d57-04e7-41e5-ab07-b519e0c7f1f5", "name": "network-vif-deleted", "tag": "45f9a505-6899-473a-bab5-680e01259f2f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:17.932133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c21d791c-51c9-47d5-97cf-e635d69775c7 req-ccd76120-c0c5-433b-a71c-77c20271ff3b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:17.932631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c21d791c-51c9-47d5-97cf-e635d69775c7 req-ccd76120-c0c5-433b-a71c-77c20271ff3b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:17.933837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c21d791c-51c9-47d5-97cf-e635d69775c7 req-ccd76120-c0c5-433b-a71c-77c20271ff3b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:17.942750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:17.952435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c21d791c-51c9-47d5-97cf-e635d69775c7 req-ccd76120-c0c5-433b-a71c-77c20271ff3b service nova] Creating event network-vif-deleted:45f9a505-6899-473a-bab5-680e01259f2f for instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 on n-h2-master-1 Sep 25 01:11:17.960140 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c21d791c-51c9-47d5-97cf-e635d69775c7 req-ccd76120-c0c5-433b-a71c-77c20271ff3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077581 Sep 25 01:11:17.961365 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1120/2185] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:17.965237 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8f02adb-ba1a-471c-93ee-6b1820c869ef tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.488153 Sep 25 01:11:17.969664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1066/2186] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:17 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:18.415065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:18.416173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:18.433734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:18.439102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:18.439634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:18.442261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:18.444956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:18.447303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:18.478146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:18.478943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:18.495726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:18.496377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:18.496938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:18.497788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:18.498374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:18.498900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:18.693870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:18.706099 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38ce6ba3-4a66-462d-bfb0-878d3bcf2645 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.233716 Sep 25 01:11:18.706683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1067/2187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:18 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:18.821093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:18.829275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d4cd71b-71fb-40d2-9b5b-894bef483376 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1506 microversion: 2.1 time: 0.421445 Sep 25 01:11:18.842069 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1121/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:18 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:18.869147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:18.869799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:18.880675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:18.881174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:18.881677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:18.882358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:18.882807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:18.883291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.009222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:19.009922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:19.020946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:19.024669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:19.032749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.034109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:19.034768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:19.036234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.233642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:19.243149 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1b6c31e-62b0-48a0-a43d-35fc09cb959b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 200 len: 1506 microversion: 2.1 time: 0.377904 Sep 25 01:11:19.249846 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1068/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:18 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:19.274080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:19.274822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:19.288922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:19.289694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:19.290315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.291204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:19.293525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:19.306226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.357038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:19.383819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:19.405099 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f52b6aa-f797-4c6d-aa4a-a022c3030d2c tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.412362 Sep 25 01:11:19.409193 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1122/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:18 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:19.495792 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:19.562776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96e54b6b-dd83-4726-8f65-0bb29f0c19bc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 204 len: 0 microversion: 2.1 time: 0.293400 Sep 25 01:11:19.564372 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1069/2191] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:19 2022] DELETE /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:11:19.723884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-202611000", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cea0503a-4e97-4488-af7a-4679bb5e5ef8"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:19.739215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:19.747779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:19.784454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:19.790121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:19.791651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.793318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:19.798632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:19.799301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:19.946844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] validate_networks() for [('cea0503a-4e97-4488-af7a-4679bb5e5ef8', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:11:20.090901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:20.107661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92575fd4-573b-4f10-ab07-20a5a5bf5802 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.376832 Sep 25 01:11:20.108318 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1070/2192] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:19 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:20.436760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:20.437506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:20.451840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:20.456346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:20.457903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:20.459133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:20.462048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:20.464038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:21.300180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:11:21.301781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:11:21.302691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:11:21.303141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:11:21.303662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:11:21.319666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:21.322457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:21.323692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:21.329279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:21.333132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:21.333734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:21.386460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Getting quotas for project e310970d7ec54c99a3d719824c6be1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:11:21.402608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Getting quotas for user f3931162a615421f8843396650368870 and project e310970d7ec54c99a3d719824c6be1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:11:21.433950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:11:21.439846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:11:21.487207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:21.509517 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0c0b4fa-3170-4bf5-8d44-162417c9c4eb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 1.070665 Sep 25 01:11:21.514023 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1071/2193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:20 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:21.525955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:21.528579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:21.547120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:21.547895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:21.548499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:21.551819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:21.553915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:21.556769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:21.558956 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-382ebe0c-d66a-4257-b612-e5e7887a1163 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842665 Sep 25 01:11:21.567972 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1123/2194] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:11:21.576095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86d58232-34cc-4988-a1df-e176b069dbd6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:21.577224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86d58232-34cc-4988-a1df-e176b069dbd6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:21.897752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:21.900882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86d58232-34cc-4988-a1df-e176b069dbd6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:21.909775 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86d58232-34cc-4988-a1df-e176b069dbd6 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1217 microversion: 2.1 time: 0.338665 Sep 25 01:11:21.915478 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1124/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:21 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:21.915934 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92fe2489-95cb-4047-978e-177fcf1021e9 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.400405 Sep 25 01:11:21.916524 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1072/2196] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:21 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:22.536775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:22.537488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:22.552030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:22.552527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:22.553008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:22.553760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:22.567542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:22.568333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:22.608970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c5a15e27-a0ba-4d4b-bac7-967afaf86524 req-ef73e9e2-50d2-42c7-926f-627df882d146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18af2166-4a52-4cee-9e7f-12811ff94f11", "name": "network-vif-plugged", "status": "completed", "tag": "a8ea4563-746c-4656-867c-082f12bdf9f6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:22.635126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c5a15e27-a0ba-4d4b-bac7-967afaf86524 req-ef73e9e2-50d2-42c7-926f-627df882d146 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:22.636307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c5a15e27-a0ba-4d4b-bac7-967afaf86524 req-ef73e9e2-50d2-42c7-926f-627df882d146 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:22.637085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c5a15e27-a0ba-4d4b-bac7-967afaf86524 req-ef73e9e2-50d2-42c7-926f-627df882d146 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:22.652628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c5a15e27-a0ba-4d4b-bac7-967afaf86524 req-ef73e9e2-50d2-42c7-926f-627df882d146 service nova] Creating event network-vif-plugged:a8ea4563-746c-4656-867c-082f12bdf9f6 for instance 18af2166-4a52-4cee-9e7f-12811ff94f11 on n-h2-master-1 Sep 25 01:11:22.665225 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c5a15e27-a0ba-4d4b-bac7-967afaf86524 req-ef73e9e2-50d2-42c7-926f-627df882d146 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315080 Sep 25 01:11:22.666716 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1125/2197] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:22.945435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:22.950605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:22.969310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:22.971671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:22.972454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:22.975440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:22.977584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:22.981748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:23.117328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:23.130619 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eb0ee43d-bb05-4c47-bbe8-ed2bc8d788cb tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.598211 Sep 25 01:11:23.146198 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1073/2198] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:22 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:23.146198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:23.146198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:23.179534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:23.188441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:23.189013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:23.189925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:23.190407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:23.190848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:23.260098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:23.277955 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9cee75b4-322d-47c8-b0db-0f59a3135f64 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.333360 Sep 25 01:11:23.278676 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1126/2199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:22 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:24.075131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:24.105695 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d3eb3b2-5ffe-4386-b8de-12ce49364e21 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1269 microversion: 2.1 time: 0.970881 Sep 25 01:11:24.130538 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1074/2200] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:23 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1269 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:24.161278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:24.163686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:24.180379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.181463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.182249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.184101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.185877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.186582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.310637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:24.311741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:24.331154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.332362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.339038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.342307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.346570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.350283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.574180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:24.632074 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3fada924-f0cb-4372-b400-6d4ed6376410 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.328397 Sep 25 01:11:24.643132 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1075/2201] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:24 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:24.656296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:24.663440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:24.684027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.684690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.685571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.686430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.694828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.695497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.735424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:24.757655 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1116daf8-9420-458d-b158-7976941120b2 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1350 microversion: 2.1 time: 0.599035 Sep 25 01:11:24.763477 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1127/2202] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:24 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1350 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:24.777217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:24.878493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1cf927e4-1ed4-4c54-81be-322b8972af5a req-1c294e60-9ba9-4956-a933-c7d3a5eaea0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8837fcf1-fc71-4722-ab37-9235d38749ac", "name": "network-vif-deleted", "tag": "b51fce4d-7221-45d6-85b3-dd73795a3928"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:24.919631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1cf927e4-1ed4-4c54-81be-322b8972af5a req-1c294e60-9ba9-4956-a933-c7d3a5eaea0b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:24.920468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1cf927e4-1ed4-4c54-81be-322b8972af5a req-1c294e60-9ba9-4956-a933-c7d3a5eaea0b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:24.921197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1cf927e4-1ed4-4c54-81be-322b8972af5a req-1c294e60-9ba9-4956-a933-c7d3a5eaea0b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:24.960807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1cf927e4-1ed4-4c54-81be-322b8972af5a req-1c294e60-9ba9-4956-a933-c7d3a5eaea0b service nova] Creating event network-vif-deleted:b51fce4d-7221-45d6-85b3-dd73795a3928 for instance 8837fcf1-fc71-4722-ab37-9235d38749ac on n-h1-master-1 Sep 25 01:11:24.977059 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1cf927e4-1ed4-4c54-81be-322b8972af5a req-1c294e60-9ba9-4956-a933-c7d3a5eaea0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106534 Sep 25 01:11:24.979487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1128/2203] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:11:25.035688 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-028936f1-bd03-443c-a1a6-976c02e4ceac tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 204 len: 0 microversion: 2.1 time: 0.389364 Sep 25 01:11:25.038509 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1076/2204] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:24 2022] DELETE /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:11:25.050347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:25.051974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:25.084584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.085189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.092895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.094259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.094965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.098610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.153333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:25.154709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:25.168893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.169819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.170453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.172800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.173548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.174314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.577386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:25.593466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a84ceb32-9f7b-45f8-b38c-abdc607c6846 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1275 microversion: 2.1 time: 0.446013 Sep 25 01:11:25.597047 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1077/2205] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:25 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1275 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:25.667436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:25.667838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:25.677945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.683021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.684648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.685510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.686087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.688488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.948425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:25.960577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ec89e70-f519-4d12-b62e-3f6b419ec6b2 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.296071 Sep 25 01:11:25.963723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1078/2206] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:25 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:25.973852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:25.978328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:25.990331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.991080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.993430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:25.995937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:25.996615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:25.997212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:26.189678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:26.202086 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb6e767e-fc34-4610-aeda-8e55aa02272d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1681 microversion: 2.1 time: 1.159283 Sep 25 01:11:26.206935 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1129/2207] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:25 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1681 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:26.615186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-374749344", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "0301c1a5-7c3a-4965-960e-b2cc1b01b7f9"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:26.710642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] validate_networks() for [('0301c1a5-7c3a-4965-960e-b2cc1b01b7f9', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:11:26.716833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:26.733678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d65d010-bd11-4a1a-8a07-7cd83527e437 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1539 microversion: 2.1 time: 0.763690 Sep 25 01:11:26.734431 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1079/2208] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:25 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1539 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:26.752411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:26.755510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:26.795466 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:26.804187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:26.805016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:26.805660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:26.812230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:26.812935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:26.813589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:27.215889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:27.227121 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4a01319-3d74-4bdb-8c84-387376ba6a01 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1275 microversion: 2.1 time: 0.488117 Sep 25 01:11:27.231943 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1080/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:26 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1275 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:27.238684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:27.244235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:27.262121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:27.262903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:27.263516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:27.264824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:27.268934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:27.269863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:27.524598 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b20fcdc9-3f64-4e28-8cf3-e89eead1bba9 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291295 Sep 25 01:11:27.525226 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1081/2210] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:11:27 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:27.531603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:27.532521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:27.565840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:27.567519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:27.573973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:27.575323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:27.582839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:27.583662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:27.730106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:27.746703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8430b1ff-706f-485e-9543-eb757f6b2b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1183 microversion: 2.1 time: 0.220162 Sep 25 01:11:27.750027 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1082/2211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:27 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:27.765260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:27.766245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:27.779995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:27.782661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:27.783276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:27.784178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:27.786090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:27.788499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:28.245845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:28.257789 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6ee8535-22c9-4200-b193-a362fbf5d165 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1681 microversion: 2.1 time: 0.506447 Sep 25 01:11:28.260762 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1083/2212] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:27 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1681 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:28.273346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:28.274006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:28.309849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:28.311835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:28.314695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:28.317515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:28.318554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:28.321253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:28.480785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:28.517879 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c0f1c5e5-c22f-4642-9d9f-43127cb2961d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1275 microversion: 2.1 time: 0.248429 Sep 25 01:11:28.522708 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1084/2213] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:28 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:28.788952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:28.789963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:28.811061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:28.813208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:28.814104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:28.815217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:28.816248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:28.816997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:28.832463 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:28.915627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:28.916136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:28.916589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:28.917062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lazy-loading 'fault' on Instance uuid 46634d57-04e7-41e5-ab07-b519e0c7f1f5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:29.254090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:11:29.255210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:11:29.255704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:11:29.256117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:11:29.256531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:11:29.275497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:29.276001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:29.276444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:29.277217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:29.280383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:29.281155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:29.345955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for project 56773bfde588477493c4d44b0d3e74b9. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:11:29.363769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for user 1cc384987bb247d88d0027e60d600ed1 and project 56773bfde588477493c4d44b0d3e74b9. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:11:29.383210 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:29.395248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:11:29.412057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:11:29.429393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:29.440288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2eb86d01-5563-4a3c-bc35-8aaeaf03a45b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 200 len: 1142 microversion: 2.1 time: 0.659638 Sep 25 01:11:29.444985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1085/2214] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:28 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 1142 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:29.469730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:29.470550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:29.490781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:29.493940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:29.494696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:29.495758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:29.498633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:29.499507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:29.512277 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7758a120-ce5c-4956-8844-e846513c04a5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.982400 Sep 25 01:11:29.522019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1130/2215] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:11:29.527014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4a274d6-f3cb-4d63-bb62-9aa807d4a754 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:29.527665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4a274d6-f3cb-4d63-bb62-9aa807d4a754 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:29.669903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4a274d6-f3cb-4d63-bb62-9aa807d4a754 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:29.681909 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4a274d6-f3cb-4d63-bb62-9aa807d4a754 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1224 microversion: 2.1 time: 0.158661 Sep 25 01:11:29.684201 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1131/2216] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:29 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1224 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:29.698707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:29.699787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:29.715317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:29.715832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:29.718519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:29.719286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:29.719763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:29.727100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:29.969927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:29.986398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7ba4d2dd-ef33-4f68-880b-ce92b4ef21c8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1275 microversion: 2.1 time: 0.300895 Sep 25 01:11:29.987712 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1132/2217] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:29 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1275 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:30.411824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:30.427023 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-311169ef-a834-47a9-abe9-d61175d9057a tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1681 microversion: 2.1 time: 0.967915 Sep 25 01:11:30.428354 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1086/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:29 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1681 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:30.472030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:30.473612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 46634d57-04e7-41e5-ab07-b519e0c7f1f5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:30.494187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:30.505448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:30.506246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:30.507023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:30.507503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:30.508601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:30.547207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] HTTP exception thrown: Instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 could not be found. Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Request method failure captured: Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 HTTP/1.1 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iP4ofTHkE4O5aZjiuNuFNJ6bt2Gh6bXMVF6mosMMOiDhE5jzc2vYBx-_C7-L8xur-5jyu2p_V94gRmGdnNYIyhkzMQF_lTFM5iyVNnpj_JgnUSbh5WpoW_FgewxriV4CGO8CzAzkDjLKjg9PZWjAbAm5qd_5JbqN92Wj07-9e1NfM Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce74d459ddb341569f42818c99cbfcaa"}]}] Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: fe77600029ff40f8b738c097bf184495 Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 could not be found. Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '46634d57-04e7-41e5-ab07-b519e0c7f1f5'} Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 could not be found. Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 could not be found. Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:30.548918 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 could not be found. Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Returning 404 to user: Instance 46634d57-04e7-41e5-ab07-b519e0c7f1f5 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:30.552724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b23b3bfa-74b5-4892-8d43-4ab17fcd9b0b tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5" status: 404 len: 111 microversion: 2.1 time: 0.082318 Sep 25 01:11:30.554643 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1133/2219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:30 2022] GET /compute/v2.1/servers/46634d57-04e7-41e5-ab07-b519e0c7f1f5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:30.708094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-465a7f36-2cab-4967-8307-0462eefb4a64 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:30.709062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-465a7f36-2cab-4967-8307-0462eefb4a64 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:30.842678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-465a7f36-2cab-4967-8307-0462eefb4a64 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:30.854893 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-465a7f36-2cab-4967-8307-0462eefb4a64 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1224 microversion: 2.1 time: 0.151967 Sep 25 01:11:30.873687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1087/2220] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:30 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1224 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:31.013196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:31.015773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:31.034138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:31.036847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:31.039681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:31.040552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:31.041102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:31.043737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:31.454687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:31.455164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:31.465695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:31.469580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:31.470041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:31.470788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:31.478097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:31.479394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:31.729160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:31.748017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-278f1ad6-6db4-4be7-a767-28eb1042ff54 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1613 microversion: 2.1 time: 0.296463 Sep 25 01:11:31.749181 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1088/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:31 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1613 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:31.888824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:31.893569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:31.914777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:31.934708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:31.936947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:31.944259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:31.944908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:31.945486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:32.662193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:32.685901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f89a2d7-e2da-48c0-b642-d0ba2085f6a0 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 1.664337 Sep 25 01:11:32.687304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1134/2222] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:31 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:32.751317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:32.769804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0251cf8-5560-470c-95ea-c70e5494a6ac tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1276 microversion: 2.1 time: 0.891688 Sep 25 01:11:32.775052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:32.776031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:32.776479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1089/2223] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:31 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1276 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:32.793300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:32.794687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:32.795390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:32.799245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:32.802636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:32.803342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:32.811713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-52e3507b-94e1-4922-8d37-9e2259b5c32a req-18aa8ab9-6782-4bb1-97fd-f67a949d27c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18af2166-4a52-4cee-9e7f-12811ff94f11", "tag": "a8ea4563-746c-4656-867c-082f12bdf9f6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:32.846365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-52e3507b-94e1-4922-8d37-9e2259b5c32a req-18aa8ab9-6782-4bb1-97fd-f67a949d27c6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:32.854602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-52e3507b-94e1-4922-8d37-9e2259b5c32a req-18aa8ab9-6782-4bb1-97fd-f67a949d27c6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:32.855337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-52e3507b-94e1-4922-8d37-9e2259b5c32a req-18aa8ab9-6782-4bb1-97fd-f67a949d27c6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:32.886032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-52e3507b-94e1-4922-8d37-9e2259b5c32a req-18aa8ab9-6782-4bb1-97fd-f67a949d27c6 service nova] Creating event network-changed:a8ea4563-746c-4656-867c-082f12bdf9f6 for instance 18af2166-4a52-4cee-9e7f-12811ff94f11 on n-h2-master-1 Sep 25 01:11:32.905090 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-52e3507b-94e1-4922-8d37-9e2259b5c32a req-18aa8ab9-6782-4bb1-97fd-f67a949d27c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099028 Sep 25 01:11:32.905912 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1090/2224] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:11:33.119524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:33.120385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:33.129847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:33.134784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.135940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.136600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.138285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.143419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.143544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67514f9f-af39-4536-9f6d-1e238cbea796 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1613 microversion: 2.1 time: 0.374861 Sep 25 01:11:33.144272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.154378 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1135/2225] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:32 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1613 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:33.187871 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] HTTP exception thrown: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Request method failure captured: Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea HTTP/1.1 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6j2okJqLfw1G3sD7GZLxk38zwVmDhagziKIXlv74GnT3TYLgP6BadELGJshPsKS7PxPzQeqVvHlX76B4kCUZxLFaPKRTLKrIWDYCvq0Lv_n8WLpk25excwFBaxo_MBbCimJTizNHt6u8G3cL9vSjaOVuqsT2pefda41RW8HB6bDXTc Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.42 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 624fa9637d2844fbbce4439455fbe41f Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_624fa9637d2844fbbce4439455fbe41f"}]}] Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 624fa9637d2844fbbce4439455fbe41f Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TaggedBootDevicesTest_v242-1750810445-project Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1e62f0277cf04e87be2017098f3d6327 Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1750810445-project Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '29e8c01b-620f-46f8-9599-f0ae0f92e1ea'} Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:33.192383 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.195777 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.203356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Returning 404 to user: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:33.204629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76aa73aa-2c78-49d9-b7a4-4a94f02eee25 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 404 len: 111 microversion: 2.42 time: 0.089724 Sep 25 01:11:33.208880 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1091/2226] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:11:33 2022] DELETE /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:11:33.217824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:33.218690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] [instance: 29e8c01b-620f-46f8-9599-f0ae0f92e1ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:33.229432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.232723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.233465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.241238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.242697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.243270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.275689 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] HTTP exception thrown: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Request method failure captured: Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea HTTP/1.1 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6j2okJqLfw1G3sD7GZLxk38zwVmDhagziKIXlv74GnT3TYLgP6BadELGJshPsKS7PxPzQeqVvHlX76B4kCUZxLFaPKRTLKrIWDYCvq0Lv_n8WLpk25excwFBaxo_MBbCimJTizNHt6u8G3cL9vSjaOVuqsT2pefda41RW8HB6bDXTc Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.42 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 624fa9637d2844fbbce4439455fbe41f Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/624fa9637d2844fbbce4439455fbe41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_624fa9637d2844fbbce4439455fbe41f"}]}] Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 624fa9637d2844fbbce4439455fbe41f Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1750810445 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TaggedBootDevicesTest_v242-1750810445-project Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1e62f0277cf04e87be2017098f3d6327 Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1750810445-project Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '29e8c01b-620f-46f8-9599-f0ae0f92e1ea'} Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.278051 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. Sep 25 01:11:33.282256 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:33.284268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] Returning 404 to user: Instance 29e8c01b-620f-46f8-9599-f0ae0f92e1ea could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:33.285431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-838cd73c-0a2a-44e1-9342-4cb99f302626 tempest-TaggedBootDevicesTest_v242-1750810445 tempest-TaggedBootDevicesTest_v242-1750810445-project] 10.222.0.16 "GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea" status: 404 len: 111 microversion: 2.42 time: 0.072033 Sep 25 01:11:33.289223 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1136/2227] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:33 2022] GET /compute/v2.1/servers/29e8c01b-620f-46f8-9599-f0ae0f92e1ea => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:33.714452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:33.716148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:33.735252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.735656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.746831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.747743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.753624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.754392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.799161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:33.800980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:33.816971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.817878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.818716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.819935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:33.822360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:33.824796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:33.830568 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:35.240764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:35.263918 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c8acfda0-cb8e-4783-bcf4-2db591f8b799 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 1.550835 Sep 25 01:11:35.267292 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1092/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:33 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:35.319117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:35.323287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:35.341124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:35.341867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:35.342750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:35.343767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:35.344393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:35.345870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:35.423818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:35.461783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:35.462192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:35.462951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-71422f7e-9967-4f4f-91a3-eef39496a28d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 1.661213 Sep 25 01:11:35.464317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:35.465966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lazy-loading 'fault' on Instance uuid 15cf5b07-3309-44b0-a5cd-519a143b5f99 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:35.497713 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1137/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:33 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:35.510516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bb62b2fe-4745-424f-ac72-ce9d5d2602f4 req-2819ca37-79ca-4dda-8b5b-04377d600181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15cf5b07-3309-44b0-a5cd-519a143b5f99", "name": "network-vif-deleted", "tag": "f7772c81-4c40-49b6-bd17-9ed8844bfdd5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:35.537888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb62b2fe-4745-424f-ac72-ce9d5d2602f4 req-2819ca37-79ca-4dda-8b5b-04377d600181 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:35.539133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb62b2fe-4745-424f-ac72-ce9d5d2602f4 req-2819ca37-79ca-4dda-8b5b-04377d600181 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:35.540462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb62b2fe-4745-424f-ac72-ce9d5d2602f4 req-2819ca37-79ca-4dda-8b5b-04377d600181 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:35.558497 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bb62b2fe-4745-424f-ac72-ce9d5d2602f4 req-2819ca37-79ca-4dda-8b5b-04377d600181 service nova] Creating event network-vif-deleted:f7772c81-4c40-49b6-bd17-9ed8844bfdd5 for instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 on n-h2-master-1 Sep 25 01:11:35.566461 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bb62b2fe-4745-424f-ac72-ce9d5d2602f4 req-2819ca37-79ca-4dda-8b5b-04377d600181 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066080 Sep 25 01:11:35.569037 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1138/2230] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:35.577329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f09255419184d11b8379c6bd0a338b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4131663ab3574002b589848f67fbb78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:35.597715 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d22d930-007d-4ef4-b7d5-d87c5d137987 tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 200 len: 1331 microversion: 2.1 time: 0.328598 Sep 25 01:11:35.599398 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1093/2231] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:35 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:36.115495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bb374917-e80a-4591-9f99-0939c02a1955 req-27416a82-4ce4-4145-b24d-b90626249154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb42563-a714-4865-b942-2cc08db50744", "tag": "eb6d6aea-af17-4cb2-bcf6-b7231e0117ee"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:36.152916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb374917-e80a-4591-9f99-0939c02a1955 req-27416a82-4ce4-4145-b24d-b90626249154 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:36.156544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb374917-e80a-4591-9f99-0939c02a1955 req-27416a82-4ce4-4145-b24d-b90626249154 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:36.158457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb374917-e80a-4591-9f99-0939c02a1955 req-27416a82-4ce4-4145-b24d-b90626249154 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:36.202604 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bb374917-e80a-4591-9f99-0939c02a1955 req-27416a82-4ce4-4145-b24d-b90626249154 service nova] Creating event network-changed:eb6d6aea-af17-4cb2-bcf6-b7231e0117ee for instance efb42563-a714-4865-b942-2cc08db50744 on n-h1-master-1 Sep 25 01:11:36.215446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bb374917-e80a-4591-9f99-0939c02a1955 req-27416a82-4ce4-4145-b24d-b90626249154 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106545 Sep 25 01:11:36.218425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1139/2232] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:36.289335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:36.298362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:36.313524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:36.314015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:36.314455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:36.315174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:36.315632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:36.316148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:36.506802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:36.507877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:36.518479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:36.519498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:36.520143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:36.521092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:36.521762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:36.526438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.196988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:37.208362 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-112fa480-bdff-4e2c-b584-fc8ec5465fa8 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.923761 Sep 25 01:11:37.212843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1094/2233] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:36 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:37.220292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:37.228004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] [instance: 15cf5b07-3309-44b0-a5cd-519a143b5f99] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:37.235697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:37.241063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.241815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.242422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.243317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.244958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.247991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.248242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a9a4f9d-abcb-4325-8fc8-db6e1f2dea41 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 0.746652 Sep 25 01:11:37.267533 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1140/2234] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:36 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:37.277642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:37.283048 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] HTTP exception thrown: Instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 could not be found. Sep 25 01:11:37.283988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Request method failure captured: Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 HTTP/1.1 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6na7-ZC0yfgqdMpGDEymLu5LBJFqYi19VTaRz7ScR0iZVIX5zTa7QCQTUHg3FfV6KDJ9pfcIMtD9Qbd9bkgJtzW99Z5-BRo4KLd9OewyqWKNj51KJBo62omHhopKuSftxZPgqVAGxp2hdTLDsMkk_jebzGeq7F3fxFcRgySxhBzFyo Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 4131663ab3574002b589848f67fbb78d Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesAdminNegativeTest-1717297369 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4131663ab3574002b589848f67fbb78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4131663ab3574002b589848f67fbb78d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4131663ab3574002b589848f67fbb78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4131663ab3574002b589848f67fbb78d"}]}] Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesAdminNegativeTest-1717297369 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 4131663ab3574002b589848f67fbb78d Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1717297369 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesAdminNegativeTest-1717297369-project Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7f09255419184d11b8379c6bd0a338b0 Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesAdminNegativeTest-1717297369-project Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 could not be found. Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '15cf5b07-3309-44b0-a5cd-519a143b5f99'} Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 could not be found. Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 could not be found. Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:37.285212 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 could not be found. Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Returning 404 to user: Instance 15cf5b07-3309-44b0-a5cd-519a143b5f99 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c1415286-a357-496b-a8f6-7e4b392884ed tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99" status: 404 len: 111 microversion: 2.1 time: 0.071927 Sep 25 01:11:37.289067 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1095/2235] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:37 2022] GET /compute/v2.1/servers/15cf5b07-3309-44b0-a5cd-519a143b5f99 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:37.308204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.308854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60bc047d-5785-421e-9126-64bac072166d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] Calling method '.version_select at 0x7f7bf3f4c160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:37.309182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.309870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.310762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.311376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.311984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.351777 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60bc047d-5785-421e-9126-64bac072166d tempest-VolumesAdminNegativeTest-1717297369 tempest-VolumesAdminNegativeTest-1717297369-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914584377" status: 202 len: 0 microversion: 2.1 time: 0.046558 Sep 25 01:11:37.352590 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1096/2236] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914584377 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:11:37.369361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:37.548951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d2baf322-753f-4d9b-be61-e03d0353022a tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 204 len: 0 microversion: 2.1 time: 0.279696 Sep 25 01:11:37.558324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:37.559018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:37.562700 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1141/2237] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:37 2022] DELETE /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:11:37.566661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.567295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.568189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.568976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.569532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.570034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.624585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-95b88d05-6f56-45cf-95ce-1d522f88414f req-30ca249f-b000-4bb7-8362-c7fe933959e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184e29ea-6342-4d3a-8bfc-8f05580d9eea", "tag": "4a1f387d-51bf-4e70-9c9a-d04a465c3d8a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:37.665460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-95b88d05-6f56-45cf-95ce-1d522f88414f req-30ca249f-b000-4bb7-8362-c7fe933959e2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:37.666228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-95b88d05-6f56-45cf-95ce-1d522f88414f req-30ca249f-b000-4bb7-8362-c7fe933959e2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:37.666889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-95b88d05-6f56-45cf-95ce-1d522f88414f req-30ca249f-b000-4bb7-8362-c7fe933959e2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:37.680841 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-95b88d05-6f56-45cf-95ce-1d522f88414f req-30ca249f-b000-4bb7-8362-c7fe933959e2 service nova] Creating event network-changed:4a1f387d-51bf-4e70-9c9a-d04a465c3d8a for instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea on n-h1-master-1 Sep 25 01:11:37.693993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-95b88d05-6f56-45cf-95ce-1d522f88414f req-30ca249f-b000-4bb7-8362-c7fe933959e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077305 Sep 25 01:11:37.695434 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1142/2238] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:11:37.927366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:37.943805 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-484a92ec-1499-46f8-931d-58df8436e6a6 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1663 microversion: 2.1 time: 0.388688 Sep 25 01:11:37.959529 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1097/2239] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:37 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1663 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:38.243398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:38.244120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:38.275203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:38.275828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:38.281479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:38.282389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:38.287857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:38.295451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:38.295933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:38.296477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:38.297143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:38.297256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:38.297661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:38.298268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:38.298688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:38.299133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:38.765359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:38.782813 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9f41b3fa-cdc3-490f-b762-02f051057029 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 0.511632 Sep 25 01:11:38.786352 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1098/2240] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:38 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:38.836619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:38.854921 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc527435-5b04-4311-bebe-a7bc368532a3 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.617624 Sep 25 01:11:38.856202 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1143/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:38 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:38.975007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:38.975575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:38.988731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:38.989276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:38.990471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:38.991579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:38.992204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:38.992790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:39.317643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:39.330044 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6df648d6-b6e7-4952-bae6-3914d9f77e2f tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1663 microversion: 2.1 time: 0.365481 Sep 25 01:11:39.331761 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1099/2242] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:38 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1663 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:39.810108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:39.810736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:39.818893 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:39.819766 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=16 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:39.826183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:39.826801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:39.827316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:39.828110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:39.828637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:39.833307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:39.879376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:39.880129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:39.888595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:39.889084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:39.889564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:39.890538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:39.891011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:39.891444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:40.353374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:40.356335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:40.366484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54b92c60-63ab-4f55-997b-b589e53414b7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 0.560378 Sep 25 01:11:40.374884 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-827d0895-1d77-45da-890c-74afb1963006 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.500059 Sep 25 01:11:40.377596 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1144/2243] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:39 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:40.379430 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1100/2244] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:39 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:40.426573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:40.427211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:40.446133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:40.446706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:40.447072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:40.447788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:40.448249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:40.448683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.037840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8d86051c-a311-472b-871c-13c7b14da8ff req-70b9d1b5-e06b-4fd8-a279-774c416cde70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d848e47a-66a6-4630-ad21-d24380ffc726", "name": "network-vif-deleted", "tag": "960fd715-aae2-47ef-8376-ebb1c085dc62"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:41.049452 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:41.072360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8d86051c-a311-472b-871c-13c7b14da8ff req-70b9d1b5-e06b-4fd8-a279-774c416cde70 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.072855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8d86051c-a311-472b-871c-13c7b14da8ff req-70b9d1b5-e06b-4fd8-a279-774c416cde70 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.074560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8d86051c-a311-472b-871c-13c7b14da8ff req-70b9d1b5-e06b-4fd8-a279-774c416cde70 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.105041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8d86051c-a311-472b-871c-13c7b14da8ff req-70b9d1b5-e06b-4fd8-a279-774c416cde70 service nova] Creating event network-vif-deleted:960fd715-aae2-47ef-8376-ebb1c085dc62 for instance d848e47a-66a6-4630-ad21-d24380ffc726 on n-h1-master-1 Sep 25 01:11:41.118114 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8d86051c-a311-472b-871c-13c7b14da8ff req-70b9d1b5-e06b-4fd8-a279-774c416cde70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087049 Sep 25 01:11:41.118827 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1101/2245] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:41.302027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:41.320186 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d254a6a-3b11-4c37-a91d-b40d93b0297e tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1596 microversion: 2.1 time: 0.905491 Sep 25 01:11:41.321028 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1145/2246] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:40 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1596 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:41.392553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:41.394952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:41.414752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:41.419507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:41.438907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.444351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.445264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.447025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.447658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.449430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.450658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.453080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.457826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.460467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.460875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.461622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.963549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:41.975847 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92dc5fbf-20f9-4f08-9bce-96a4ee291def tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 0.587577 Sep 25 01:11:41.978720 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1102/2247] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:41 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:42.014850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:42.025007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-140d48fd-0dd0-4cda-bc75-3730f4dbeb1c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.620646 Sep 25 01:11:42.031723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1146/2248] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:41 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:42.345239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:42.345890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:42.360894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:42.361482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:42.361927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:42.363168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:42.363805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:42.364243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:42.470389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:42.470932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:42.471307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:42.471797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lazy-loading 'fault' on Instance uuid d848e47a-66a6-4630-ad21-d24380ffc726 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:42.693258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e6ae484a-a385-4f34-9114-108128797d8f req-852a0823-0e75-4b64-ac90-102ed2e97877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb42563-a714-4865-b942-2cc08db50744", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d6aea-af17-4cb2-bcf6-b7231e0117ee"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:42.713877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e6ae484a-a385-4f34-9114-108128797d8f req-852a0823-0e75-4b64-ac90-102ed2e97877 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:42.714735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e6ae484a-a385-4f34-9114-108128797d8f req-852a0823-0e75-4b64-ac90-102ed2e97877 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:42.715329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e6ae484a-a385-4f34-9114-108128797d8f req-852a0823-0e75-4b64-ac90-102ed2e97877 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:42.774342 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e6ae484a-a385-4f34-9114-108128797d8f req-852a0823-0e75-4b64-ac90-102ed2e97877 service nova] Creating event network-vif-plugged:eb6d6aea-af17-4cb2-bcf6-b7231e0117ee for instance efb42563-a714-4865-b942-2cc08db50744 on n-h1-master-1 Sep 25 01:11:42.781570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e6ae484a-a385-4f34-9114-108128797d8f req-852a0823-0e75-4b64-ac90-102ed2e97877 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098558 Sep 25 01:11:42.782714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1147/2249] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:11:42.838303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:42.851453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15f6132e-314b-47fc-bc22-f5a42225bfe4 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 200 len: 1323 microversion: 2.1 time: 0.509956 Sep 25 01:11:42.852780 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1103/2250] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:42 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:43.011505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:43.013633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:43.048346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.049245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.050014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.052775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.056790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.057565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.060986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:43.061703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:43.084918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.085450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.085902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.088927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.090579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.092062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.472067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:43.489299 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ba9a9e8-6bbb-4737-af06-283780f355de tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 0.486173 Sep 25 01:11:43.491425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1148/2251] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:42 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:43.499420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:43.500061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:43.516086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.517016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.518009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.519505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.520265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.520940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.564481 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80c1d1e9-c46a-4900-b496-3901efeb618d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/ips" status: 200 len: 151 microversion: 2.1 time: 0.071573 Sep 25 01:11:43.567398 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1149/2252] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:11:43 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:43.790812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:43.813209 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-71c85b49-c1c6-4fad-8c9f-5e23be6ba8fe tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.758698 Sep 25 01:11:43.826754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1104/2253] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:43 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:43.879167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:43.880508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: d848e47a-66a6-4630-ad21-d24380ffc726] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:43.895314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.899076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.899595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.900429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.900931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.901353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.981843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] HTTP exception thrown: Instance d848e47a-66a6-4630-ad21-d24380ffc726 could not be found. Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Request method failure captured: Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 HTTP/1.1 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6iP4ofTHkE4O5aZjiuNuFNJ6bt2Gh6bXMVF6mosMMOiDhE5jzc2vYBx-_C7-L8xur-5jyu2p_V94gRmGdnNYIyhkzMQF_lTFM5iyVNnpj_JgnUSbh5WpoW_FgewxriV4CGO8CzAzkDjLKjg9PZWjAbAm5qd_5JbqN92Wj07-9e1NfM Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce74d459ddb341569f42818c99cbfcaa"}]}] Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: fe77600029ff40f8b738c097bf184495 Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: exception: Instance d848e47a-66a6-4630-ad21-d24380ffc726 could not be found. Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'd848e47a-66a6-4630-ad21-d24380ffc726'} Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d848e47a-66a6-4630-ad21-d24380ffc726 could not be found. Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d848e47a-66a6-4630-ad21-d24380ffc726 could not be found. Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:43.988052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d848e47a-66a6-4630-ad21-d24380ffc726 could not be found. Sep 25 01:11:43.998790 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:44.011772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Returning 404 to user: Instance d848e47a-66a6-4630-ad21-d24380ffc726 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:44.020575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6cb03f9f-522b-4049-82af-01f0d08d4388 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726" status: 404 len: 111 microversion: 2.1 time: 0.138755 Sep 25 01:11:44.021223 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1150/2254] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:43 2022] GET /compute/v2.1/servers/d848e47a-66a6-4630-ad21-d24380ffc726 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:44.033980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a897b9dc-9fdc-4419-ac0f-713c94303f58 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '.version_select at 0x7f7bf3f2d040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:44.122174 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a897b9dc-9fdc-4419-ac0f-713c94303f58 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-111273034" status: 202 len: 0 microversion: 2.1 time: 0.095780 Sep 25 01:11:44.125259 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1105/2255] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-111273034 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:11:44.513702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:44.514809 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:44.531265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:44.532102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:44.532704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:44.536304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:44.536980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:44.538691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:44.844648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:44.845148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:44.869890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:44.870679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:44.873142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:44.886052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:44.887273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:44.888125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:45.020227 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:45.031157 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:45.044878 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-79d1c32f-26d5-479f-9e26-4368973bcdd8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1324 microversion: 2.1 time: 0.535841 Sep 25 01:11:45.045505 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1151/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:44 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:45.545354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:45.560360 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-97920895-fd0f-435c-8460-446ad58df9dc tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.722982 Sep 25 01:11:45.579322 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1106/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:44 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:46.078002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:46.079690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:46.101826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.102770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.105028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.106145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.107617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.109163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.584665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:46.585168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:46.601183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.610222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.610678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.611464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.611914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.615495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.712408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:46.732611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-71c27f74-3e49-430b-9473-d1d3c7f85d57 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.656109 Sep 25 01:11:46.733588 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1152/2258] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:46 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:46.766689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:46.770208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:46.794304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.795210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.801326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.804112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.804840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.805547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.058371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:47.070082 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6b9fdd1-0771-48cf-95d1-ee8a07a889f0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.311259 Sep 25 01:11:47.074816 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1153/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:46 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:47.099842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c0291d3-b8a7-401e-9c5f-8874ede39b10 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195911056", "metadata": {"": ""}}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c0291d3-b8a7-401e-9c5f-8874ede39b10 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action HTTP/1.1 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 106 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-195911056", "metadata": {"": ""}}} Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-195911056', 'metadata': {'': ''}}}} Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'': ''} Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:47.122916 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c0291d3-b8a7-401e-9c5f-8874ede39b10 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c0291d3-b8a7-401e-9c5f-8874ede39b10 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action" status: 400 len: 170 microversion: 2.1 time: 0.028934 Sep 25 01:11:47.129727 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1154/2260] 10.222.0.16 () {60 vars in 1279 bytes} [Sun Sep 25 01:11:47 2022] POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action => generated 170 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:47.136829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.150400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.207483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.208021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.208477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.212210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.214715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.215921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.456793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:47.466785 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46ac15c0-e43b-4290-9bb9-1a70bdb71230 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.886464 Sep 25 01:11:47.471685 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1107/2261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:46 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:47.494030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.494828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.512993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.514434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.515124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.518953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.519617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.520214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.561074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:47.678215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:47.697275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a26f6360-9c40-48bb-b554-bc0ee3d92e71 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.564232 Sep 25 01:11:47.714132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1155/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:47 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:47.722941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb501dc8-74fe-4cd5-8f01-b57f6c2ec440 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 204 len: 0 microversion: 2.1 time: 0.224870 Sep 25 01:11:47.722941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1108/2263] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:47 2022] DELETE /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:47.730001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.731449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.732178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.749757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.757939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.758406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.758938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.759667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.760177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.760579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.779297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.784697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.785816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.787317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.790947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.810856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:48.284323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:48.297869 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-39937090-7c41-4d7a-b91b-3b484a8d8856 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.572137 Sep 25 01:11:48.300663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1109/2264] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:47 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:48.307793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b9783c2-c1b2-4ef1-af75-f59962296832"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:48.310865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:48.319239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:48.320576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:48.321933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:48.323121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:48.324600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:48.325268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:48.340449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:48.345149 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:48.384410 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01d7d8fb-df65-4b7d-b085-10bfb300d390 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1484 microversion: 2.1 time: 0.650041 Sep 25 01:11:48.408164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1156/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:47 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1484 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:48.420282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0cdc4549-bce3-420b-9736-cdfe9d84a2f2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-637834675", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0cdc4549-bce3-420b-9736-cdfe9d84a2f2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action HTTP/1.1 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 618 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-637834675", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-637834675', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:11:48.425827 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 25 01:11:48.428443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:11:48.433060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0cdc4549-bce3-420b-9736-cdfe9d84a2f2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:48.434334 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0cdc4549-bce3-420b-9736-cdfe9d84a2f2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action" status: 400 len: 938 microversion: 2.1 time: 0.024684 Sep 25 01:11:48.435604 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1157/2266] 10.222.0.16 () {60 vars in 1279 bytes} [Sun Sep 25 01:11:48 2022] POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:48.445489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:48.447001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:48.459892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:48.461080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:48.462009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:48.463306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:48.464380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:48.465464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:49.027332 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f479d91-bee8-4167-9c4f-bdcdbff8479b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723448 Sep 25 01:11:49.030996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1110/2267] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:11:48 2022] POST /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:49.072808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:49.079422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:49.094439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:49.102578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:49.106181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:49.107320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:49.108206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:49.108975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:49.385170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:49.405944 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16eb62f5-ef0c-4c3a-9f9f-a5b80fcecf16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.965780 Sep 25 01:11:49.412695 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1158/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:48 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:49.426964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:49.429338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:49.449507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:49.449974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:49.450429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:49.451147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:49.451607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:49.457274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.170568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:50.179878 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f075d734-bc3d-4cf1-96c9-f6a58bb01ec4 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 1.145791 Sep 25 01:11:50.182948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1111/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:49 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:50.192002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:50.194535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:50.214398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.214906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.215326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.216037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.216983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.217386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.624014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:50.649377 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cafc3525-178f-4114-81ce-1fe28bc78652 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 200 len: 1484 microversion: 2.1 time: 1.235049 Sep 25 01:11:50.654218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1159/2270] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:49 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 1484 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:50.671937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-920ce321-e011-4267-a242-1f68805277c9 req-8ded7928-640c-49d5-a816-08abb2c2bdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59518b5d-19aa-4c65-bb04-07ee70ef436b", "name": "network-vif-deleted", "tag": "3c2d629b-52bf-4176-be1b-5bed48860c09"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:50.696618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-920ce321-e011-4267-a242-1f68805277c9 req-8ded7928-640c-49d5-a816-08abb2c2bdb5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.699076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-920ce321-e011-4267-a242-1f68805277c9 req-8ded7928-640c-49d5-a816-08abb2c2bdb5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.699567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-920ce321-e011-4267-a242-1f68805277c9 req-8ded7928-640c-49d5-a816-08abb2c2bdb5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.765642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-920ce321-e011-4267-a242-1f68805277c9 req-8ded7928-640c-49d5-a816-08abb2c2bdb5 service nova] Creating event network-vif-deleted:3c2d629b-52bf-4176-be1b-5bed48860c09 for instance 59518b5d-19aa-4c65-bb04-07ee70ef436b on n-h2-master-1 Sep 25 01:11:50.780121 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-920ce321-e011-4267-a242-1f68805277c9 req-8ded7928-640c-49d5-a816-08abb2c2bdb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123498 Sep 25 01:11:50.781950 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1160/2271] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:50.799126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-94cdb150-de65-4206-9fc2-4f555f9ccb01 req-2870f0f9-6714-479c-ae90-bd86fa602105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184e29ea-6342-4d3a-8bfc-8f05580d9eea", "name": "network-vif-plugged", "status": "completed", "tag": "4a1f387d-51bf-4e70-9c9a-d04a465c3d8a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:50.805749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:50.822356 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29c1583c-d143-464c-a592-548a607255a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.629466 Sep 25 01:11:50.823394 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1112/2272] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:50 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:50.871144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40b1e5a3-d420-4a68-ad4b-222f257c5568 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:50.872504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-94cdb150-de65-4206-9fc2-4f555f9ccb01 req-2870f0f9-6714-479c-ae90-bd86fa602105 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.873452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-94cdb150-de65-4206-9fc2-4f555f9ccb01 req-2870f0f9-6714-479c-ae90-bd86fa602105 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.875152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-94cdb150-de65-4206-9fc2-4f555f9ccb01 req-2870f0f9-6714-479c-ae90-bd86fa602105 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40b1e5a3-d420-4a68-ad4b-222f257c5568 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action HTTP/1.1 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 285 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:50.884736 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:11:50.888233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:50.896177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40b1e5a3-d420-4a68-ad4b-222f257c5568 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:50.897293 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40b1e5a3-d420-4a68-ad4b-222f257c5568 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action" status: 400 len: 619 microversion: 2.1 time: 0.051670 Sep 25 01:11:50.900728 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1113/2273] 10.222.0.16 () {60 vars in 1279 bytes} [Sun Sep 25 01:11:50 2022] POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action => generated 619 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:50.907813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:50.913355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:50.919625 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-94cdb150-de65-4206-9fc2-4f555f9ccb01 req-2870f0f9-6714-479c-ae90-bd86fa602105 service nova] Creating event network-vif-plugged:4a1f387d-51bf-4e70-9c9a-d04a465c3d8a for instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea on n-h1-master-1 Sep 25 01:11:50.932765 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-94cdb150-de65-4206-9fc2-4f555f9ccb01 req-2870f0f9-6714-479c-ae90-bd86fa602105 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146110 Sep 25 01:11:50.934252 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1161/2274] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:50.935850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.936755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.937642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.938674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.939280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.939864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.227356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:51.228037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:51.235146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.235751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.236306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.237080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.248938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.249753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.651492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:51.666069 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2fcf86e-83d8-4065-916a-488736f38bfb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.761863 Sep 25 01:11:51.666667 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1114/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:50 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:51.676747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:51.691169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 59518b5d-19aa-4c65-bb04-07ee70ef436b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:51.699311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.699944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.700393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.701113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.701597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.702026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.734077 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] HTTP exception thrown: Instance 59518b5d-19aa-4c65-bb04-07ee70ef436b could not be found. Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Request method failure captured: Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b HTTP/1.1 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iP4ofTHkE4O5aZjiuNuFNJ6bt2Gh6bXMVF6mosMMOiDhE5jzc2vYBx-_C7-L8xur-5jyu2p_V94gRmGdnNYIyhkzMQF_lTFM5iyVNnpj_JgnUSbh5WpoW_FgewxriV4CGO8CzAzkDjLKjg9PZWjAbAm5qd_5JbqN92Wj07-9e1NfM Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce74d459ddb341569f42818c99cbfcaa"}]}] Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: fe77600029ff40f8b738c097bf184495 Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 59518b5d-19aa-4c65-bb04-07ee70ef436b could not be found. Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '59518b5d-19aa-4c65-bb04-07ee70ef436b'} Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59518b5d-19aa-4c65-bb04-07ee70ef436b could not be found. Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59518b5d-19aa-4c65-bb04-07ee70ef436b could not be found. Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:51.735665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59518b5d-19aa-4c65-bb04-07ee70ef436b could not be found. Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Returning 404 to user: Instance 59518b5d-19aa-4c65-bb04-07ee70ef436b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05331a88-f3a1-4301-b363-327da40ababc tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b" status: 404 len: 111 microversion: 2.1 time: 0.064593 Sep 25 01:11:51.743617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1115/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:51 2022] GET /compute/v2.1/servers/59518b5d-19aa-4c65-bb04-07ee70ef436b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:11:51.744339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:51.745901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:51.765441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.766239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.766679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.767407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.768132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.769139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.849786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:51.859948 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e49c9155-1eea-4313-98c2-34693d55e215 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.651694 Sep 25 01:11:51.860609 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1162/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:51 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:51.883990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:51.884817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:51.907318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.913457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.914121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.915059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.915700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.916628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.988449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:52.177453 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e971707-5bde-4d19-a17d-f8a47c325fba tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 204 len: 0 microversion: 2.1 time: 0.315544 Sep 25 01:11:52.178339 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1163/2278] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:51 2022] DELETE /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:11:52.186719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:52.202076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:52.211466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.212132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.212729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.213690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.214564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.215174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.491701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:52.499482 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-299cb503-eb94-4af3-b2b0-70d230f20b1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.760555 Sep 25 01:11:52.500063 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1116/2279] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:51 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:52.533077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1079528817"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:52.539869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:52.561006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.563314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.564499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.567961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.570943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.571695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.744816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:52.755021 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9755e3cd-07be-4145-8456-e071b5820266 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1498 microversion: 2.1 time: 0.572364 Sep 25 01:11:52.758816 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1164/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:52 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1498 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:52.884632 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:52.887486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:52.910435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.913318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.926193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.929392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.930093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.931864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:53.127171 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f1d7210d-7ae4-4b55-813d-392fbb6df888 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action" status: 202 len: 0 microversion: 2.1 time: 0.608957 Sep 25 01:11:53.134218 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1117/2281] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:11:52 2022] POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 25 01:11:53.148412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1472195864"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:53.150996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:53.162168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:53.162663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:53.163100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:53.163821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:53.164313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:53.164698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:53.216266 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Cannot 'createImage' instance efb42563-a714-4865-b942-2cc08db50744 while it is in task_state image_snapshot_pending Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action HTTP/1.1 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 85 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1472195864"}} Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'createImage' instance efb42563-a714-4865-b942-2cc08db50744 while it is in task_state image_snapshot_pending Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1472195864'}}} Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efb42563-a714-4865-b942-2cc08db50744 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:11:53.226324 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance efb42563-a714-4865-b942-2cc08db50744 while it is in task_state image_snapshot_pending Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance efb42563-a714-4865-b942-2cc08db50744 while it is in task_state image_snapshot_pending Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:53.230172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 409 to user: Cannot 'createImage' instance efb42563-a714-4865-b942-2cc08db50744 while it is in task_state image_snapshot_pending {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:53.232759 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b14626d4-97d5-4cd2-af11-70d0a05717d7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action" status: 409 len: 167 microversion: 2.1 time: 0.096877 Sep 25 01:11:53.235298 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1118/2282] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:11:53 2022] POST /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744/action => generated 167 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:11:53.255989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6412fc7a-baa7-4733-b7a3-94b6aaf5a58a tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '.version_select at 0x7f7bf3fc7a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:53.612067 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6412fc7a-baa7-4733-b7a3-94b6aaf5a58a tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/images/92473294-b9d5-4454-908f-59bcb000a6b5" status: 204 len: 0 microversion: 2.1 time: 0.371057 Sep 25 01:11:53.614933 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1119/2283] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:53 2022] DELETE /compute/v2.1/images/92473294-b9d5-4454-908f-59bcb000a6b5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:11:53.619236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:53.626818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:53.630027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:53.632471 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c3ce4996-c7e7-48e4-850b-a6dcc2652491 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1317 microversion: 2.1 time: 0.749113 Sep 25 01:11:53.648666 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1165/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:52 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:53.651531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:53.652090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:53.655517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:53.656833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:53.657314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:53.657776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:53.783777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:53.785838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:53.806294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:53.806806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:53.812171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:53.813561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:53.814051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:53.814489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.224221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:54.244946 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a47bb617-8516-45de-9476-2c37c16c2c95 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1533 microversion: 2.1 time: 0.625138 Sep 25 01:11:54.250258 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1120/2285] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:53 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1533 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:54.659382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:54.662656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:54.698772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:54.699572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:54.702233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.703843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:54.704490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:54.705105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.721274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:54.735863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3fc60ca1-e33c-4430-ac8d-7cb96ed46f38 tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1498 microversion: 2.1 time: 0.957804 Sep 25 01:11:54.741827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1166/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:53 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1498 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:54.854237 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:55.279739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:55.280662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:55.305701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.306334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.306795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.307552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.308205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.309923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.524203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:55.541275 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2302d62-4e8a-4bc9-8929-6d761bd0469f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1506 microversion: 2.1 time: 0.887043 Sep 25 01:11:55.563245 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1121/2287] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:54 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1506 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:55.569292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:55.569951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:55.577115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.577639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.578073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.578860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.579310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.579735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.051088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:56.061268 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97239dfd-b8da-4f26-90d1-c4b2346c859e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1539 microversion: 2.1 time: 0.786804 Sep 25 01:11:56.072151 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1167/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:55 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1539 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:56.080022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-42075304-04f2-4c82-8ab8-073eaae52d6e req-2a69d2e9-f2d3-4f97-98bf-8ac4d12504f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ee4a8d-4967-43af-9593-6c2313fbfa31", "name": "network-vif-deleted", "tag": "3501c234-a011-456a-af52-2fa317ef4f4e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:56.100792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:56.110814 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a728fe15-dff5-4952-ac42-6f1510e26377 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1506 microversion: 2.1 time: 0.545727 Sep 25 01:11:56.117044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1122/2289] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:55 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:56.122112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:56.127504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:56.130515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-42075304-04f2-4c82-8ab8-073eaae52d6e req-2a69d2e9-f2d3-4f97-98bf-8ac4d12504f2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.131137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-42075304-04f2-4c82-8ab8-073eaae52d6e req-2a69d2e9-f2d3-4f97-98bf-8ac4d12504f2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.131589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-42075304-04f2-4c82-8ab8-073eaae52d6e req-2a69d2e9-f2d3-4f97-98bf-8ac4d12504f2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.135053 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:56.145150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.146095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.146722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.150785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.151523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.152119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.163072 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-42075304-04f2-4c82-8ab8-073eaae52d6e req-2a69d2e9-f2d3-4f97-98bf-8ac4d12504f2 service nova] Creating event network-vif-deleted:3501c234-a011-456a-af52-2fa317ef4f4e for instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 on n-h1-master-1 Sep 25 01:11:56.172626 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-42075304-04f2-4c82-8ab8-073eaae52d6e req-2a69d2e9-f2d3-4f97-98bf-8ac4d12504f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098902 Sep 25 01:11:56.178372 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1168/2290] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:56.195187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:56.198105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:56.205417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.206857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.208121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.209021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.209669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.212619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.273543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.274044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.274482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.274942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lazy-loading 'fault' on Instance uuid 90ee4a8d-4967-43af-9593-6c2313fbfa31 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:56.411974 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-368aaaba-c081-4201-adba-84ba5b9eac4e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "PUT /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1078 microversion: 2.1 time: 0.232084 Sep 25 01:11:56.415461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1169/2291] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:11:56 2022] PUT /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1078 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:56.416573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe77600029ff40f8b738c097bf184495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce74d459ddb341569f42818c99cbfcaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:56.430018 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ef1479a8-c71e-48c0-bacf-11c50d0b5deb tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 200 len: 1301 microversion: 2.1 time: 0.309299 Sep 25 01:11:56.431229 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1123/2292] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:56 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 1301 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:56.441630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:56.445445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:56.463051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.463804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.464477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.465353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.466113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.466745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.090495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:57.092040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:57.103927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.107596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.110774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.111694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.112403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.115238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.338715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:57.354680 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3eded78b-be39-4db4-9789-617b0558462a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1504 microversion: 2.1 time: 0.917997 Sep 25 01:11:57.355994 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1170/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:56 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1504 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:57.383837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:57.384872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:57.398944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.402725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.403488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.404491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.405213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.405935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.449288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:57.458847 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6fd04898-1ba9-4326-8ede-f9c3b167802d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1534 microversion: 2.1 time: 0.372096 Sep 25 01:11:57.491620 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1124/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:57 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1534 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:57.500214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:57.509313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] [instance: 90ee4a8d-4967-43af-9593-6c2313fbfa31] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:57.531804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.535906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.536670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.539426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.542049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.542664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.582350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] HTTP exception thrown: Instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 could not be found. Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Request method failure captured: Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 HTTP/1.1 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6iP4ofTHkE4O5aZjiuNuFNJ6bt2Gh6bXMVF6mosMMOiDhE5jzc2vYBx-_C7-L8xur-5jyu2p_V94gRmGdnNYIyhkzMQF_lTFM5iyVNnpj_JgnUSbh5WpoW_FgewxriV4CGO8CzAzkDjLKjg9PZWjAbAm5qd_5JbqN92Wj07-9e1NfM Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce74d459ddb341569f42818c99cbfcaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce74d459ddb341569f42818c99cbfcaa"}]}] Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ce74d459ddb341569f42818c99cbfcaa Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-LiveMigrationTest-1149156895 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: fe77600029ff40f8b738c097bf184495 Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-LiveMigrationTest-1149156895-project Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 could not be found. Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '90ee4a8d-4967-43af-9593-6c2313fbfa31'} Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 could not be found. Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 could not be found. Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:57.587293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 could not be found. Sep 25 01:11:57.591478 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:11:57.592816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] Returning 404 to user: Instance 90ee4a8d-4967-43af-9593-6c2313fbfa31 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:57.594454 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc031419-ab41-43ed-8dff-c3c3cbb4507d tempest-LiveMigrationTest-1149156895 tempest-LiveMigrationTest-1149156895-project] 10.222.0.16 "GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31" status: 404 len: 111 microversion: 2.1 time: 0.101451 Sep 25 01:11:57.596985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1125/2295] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:57 2022] GET /compute/v2.1/servers/90ee4a8d-4967-43af-9593-6c2313fbfa31 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:57.701388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:57.714850 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5424f140-1249-4207-a0a4-c2f3cae9af79 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1504 microversion: 2.1 time: 0.335467 Sep 25 01:11:57.718723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1171/2296] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:57 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:57.741335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:57.744166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:57.751043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.751745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.752323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.753823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.754464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.755034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.851595 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-375a3d53-096c-4721-9f7a-10a4bfd8e175 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "PUT /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1080 microversion: 2.1 time: 0.114165 Sep 25 01:11:57.866149 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1126/2297] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:11:57 2022] PUT /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1080 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:57.872866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:57.873778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:57.881724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.882505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.883100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:57.884089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:57.884692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:57.885256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.328154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:58.338788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fdcd088e-5928-4649-95ec-e4d913bdb31d tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1506 microversion: 2.1 time: 0.468229 Sep 25 01:11:58.343645 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1172/2298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:57 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:58.371744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:58.372584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:58.381265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.381932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.382494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.383316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.383879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.384409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.487750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:58.488678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:58.492446 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:58.505284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.505989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.508378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.509349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.511234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.514452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.845756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:58.858970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b9e93fa9-a480-4b8a-bc68-4fc92d47959e tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1506 microversion: 2.1 time: 0.487257 Sep 25 01:11:58.862285 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1127/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:58 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:58.884579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:58.885205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:58.898532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.899090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.899728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.900704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.901114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.901791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.911792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:58.924855 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86f4dda9-9eb3-4bca-aa04-83f8649a6dd3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1521 microversion: 2.1 time: 0.441179 Sep 25 01:11:58.939289 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1173/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:58 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:58.952010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:58.954524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:58.955469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:58.972271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.974184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.974755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.975704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:58.977001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:58.977560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:58.983021 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:59.035618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:59.129094 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbe4d682-ee7d-4fb1-888c-8c9b9e38701a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "DELETE /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 204 len: 0 microversion: 2.1 time: 0.248265 Sep 25 01:11:59.130181 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1128/2301] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:58 2022] DELETE /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:59.145589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:59.146464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:59.163300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:59.164054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:59.164650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:59.165585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:59.166198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:59.166782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:59.219931 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0688e3e0-4468-43f6-967a-08cf39e2a6bb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 204 len: 0 microversion: 2.1 time: 0.272452 Sep 25 01:11:59.226264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1174/2302] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:58 2022] DELETE /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:59.228082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:59.232976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:59.233726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:59.241465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:59.241963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:59.242398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:59.243104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:59.243654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:59.244722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:59.340897 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Instance is already in deleting state, ignoring this request Sep 25 01:11:59.341633 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-599798df-bedf-4589-86a7-93a46be47d09 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "DELETE /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 204 len: 0 microversion: 2.1 time: 0.201516 Sep 25 01:11:59.345175 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1129/2303] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:59 2022] DELETE /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:59.350705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:59.351330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:59.359443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:59.359945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:59.360388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:59.361107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:59.361593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:59.362072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:59.639312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:59.654994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c1971a96-5f46-47db-9a8f-acc5456db814 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1527 microversion: 2.1 time: 0.425989 Sep 25 01:11:59.677284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1175/2304] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:59 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1527 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:59.785662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:59.801221 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-66a462f9-90b4-4e85-a858-b995f320294b tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1512 microversion: 2.1 time: 0.454425 Sep 25 01:11:59.813437 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1130/2305] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:59 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:00.691629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:00.692921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:00.700697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-308528ec-a6a9-4258-b9a0-4f8521daa8d7 req-0086b663-93c1-42ff-97a5-f86baae71181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb42563-a714-4865-b942-2cc08db50744", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d6aea-af17-4cb2-bcf6-b7231e0117ee"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:00.701779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:00.702526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:00.704644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:00.707006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:00.708244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:00.709021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:00.720038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-308528ec-a6a9-4258-b9a0-4f8521daa8d7 req-0086b663-93c1-42ff-97a5-f86baae71181 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:00.720842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-308528ec-a6a9-4258-b9a0-4f8521daa8d7 req-0086b663-93c1-42ff-97a5-f86baae71181 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:00.722129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-308528ec-a6a9-4258-b9a0-4f8521daa8d7 req-0086b663-93c1-42ff-97a5-f86baae71181 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:00.748369 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-308528ec-a6a9-4258-b9a0-4f8521daa8d7 req-0086b663-93c1-42ff-97a5-f86baae71181 service nova] Creating event network-vif-plugged:eb6d6aea-af17-4cb2-bcf6-b7231e0117ee for instance efb42563-a714-4865-b942-2cc08db50744 on n-h1-master-1 Sep 25 01:12:00.760008 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-308528ec-a6a9-4258-b9a0-4f8521daa8d7 req-0086b663-93c1-42ff-97a5-f86baae71181 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062539 Sep 25 01:12:00.761256 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1131/2306] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:12:00.828609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:00.829325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:00.841217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:00.848758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:00.849522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:00.850303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:00.850783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:00.851220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:01.189120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:01.222831 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9de3d70-fd51-481e-bdae-c402ca451ad0 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1527 microversion: 2.1 time: 0.540867 Sep 25 01:12:01.225131 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1176/2307] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:00 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1527 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:01.352932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:01.368346 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfb2ea4f-73d5-4d8e-b1ab-2334f5a629fa tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1512 microversion: 2.1 time: 0.543747 Sep 25 01:12:01.368949 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1132/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:00 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:02.247798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:02.248405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:02.269289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:02.270119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:02.270760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:02.271703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:02.272359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:02.272966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:02.405759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:02.406999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:02.424051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:02.425672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:02.426354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:02.427228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:02.427832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:02.429618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:03.014913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:03.026330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cdd80a4-347e-42e6-b1a7-4dc028513934 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1512 microversion: 2.1 time: 0.624395 Sep 25 01:12:03.047198 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1133/2309] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:02 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1512 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:03.247388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:03.266966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8756295a-cf01-46fb-a296-188a569ad009 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1527 microversion: 2.1 time: 1.016481 Sep 25 01:12:03.273562 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1177/2310] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:02 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1527 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:04.054649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:04.056014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:04.066597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:04.066721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:04.067934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:04.069941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:04.070437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:04.070866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:04.298261 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:04.303108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:04.307263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:04.331429 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dea84b0b-628b-42d9-9067-ad4bb86cf121 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1470 microversion: 2.1 time: 0.279578 Sep 25 01:12:04.333630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:04.345421 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1134/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:04 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:04.345622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:04.345622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:04.345622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:04.345622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:04.345622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:04.528199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4430f70f-3bd1-4fb3-882d-adb86d664785 req-17cbbcc9-5fc1-4ce8-9ace-509b1b13ce96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184e29ea-6342-4d3a-8bfc-8f05580d9eea", "name": "network-vif-deleted", "tag": "4a1f387d-51bf-4e70-9c9a-d04a465c3d8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:04.548500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4430f70f-3bd1-4fb3-882d-adb86d664785 req-17cbbcc9-5fc1-4ce8-9ace-509b1b13ce96 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:04.548983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4430f70f-3bd1-4fb3-882d-adb86d664785 req-17cbbcc9-5fc1-4ce8-9ace-509b1b13ce96 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:04.559610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4430f70f-3bd1-4fb3-882d-adb86d664785 req-17cbbcc9-5fc1-4ce8-9ace-509b1b13ce96 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:04.612214 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4430f70f-3bd1-4fb3-882d-adb86d664785 req-17cbbcc9-5fc1-4ce8-9ace-509b1b13ce96 service nova] Creating event network-vif-deleted:4a1f387d-51bf-4e70-9c9a-d04a465c3d8a for instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea on n-h1-master-1 Sep 25 01:12:04.635711 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4430f70f-3bd1-4fb3-882d-adb86d664785 req-17cbbcc9-5fc1-4ce8-9ace-509b1b13ce96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111246 Sep 25 01:12:04.641352 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1135/2312] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:12:05.040330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:05.043549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dcfb7edc-5fb3-48d9-8b5a-43e034d01dd1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: .version_select at 0x7f7bf3eade50>, body: {"keypair": {"name": "tempest-keypair-540415353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0EBAAIwNyQBqCnXZP0q9ITcbevXDjVucOSzr2a2tf9WloxYdEsTRqQ0fGknp5QgNJw1yek/HNZplbR3STMmULN3tUqtk7zDHD+DF3UyOnVaF1wrSn21s1a/O/Eru0bnw=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:05.052621 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63692e45-ffe1-485b-a86a-ac1b2118fb75 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1527 microversion: 2.1 time: 0.762338 Sep 25 01:12:05.053353 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1178/2313] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:04 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1527 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:05.081028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dcfb7edc-5fb3-48d9-8b5a-43e034d01dd1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:05.087747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dcfb7edc-5fb3-48d9-8b5a-43e034d01dd1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:05.123779 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dcfb7edc-5fb3-48d9-8b5a-43e034d01dd1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083836 Sep 25 01:12:05.124545 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1136/2314] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:12:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:05.365320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:05.367539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:05.378441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:05.379190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:05.382138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:05.390665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:05.397752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:05.398667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:05.559953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:05.560686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:05.561909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:05.563038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lazy-loading 'fault' on Instance uuid 184e29ea-6342-4d3a-8bfc-8f05580d9eea {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:12:05.641438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3931162a615421f8843396650368870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e310970d7ec54c99a3d719824c6be1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:05.669906 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fc18890f-3254-4b32-87be-d8548c9b33cd tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 200 len: 1307 microversion: 2.1 time: 0.309747 Sep 25 01:12:05.706526 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1179/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:05 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:06.076770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:06.077702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:06.089786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.094242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.094932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.095963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.096626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.099020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.175124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.175834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.176480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.177155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lazy-loading 'fault' on Instance uuid efb42563-a714-4865-b942-2cc08db50744 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:12:06.260802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:06.270401 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-66c61472-fe34-4c7d-9508-7365c3159c1e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 200 len: 1314 microversion: 2.1 time: 0.197608 Sep 25 01:12:06.296850 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1180/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:06 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:06.390511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-23830be5-2678-4e7a-9837-e3205a218f0c req-40e7edec-fb94-48ee-a943-9d58be4ed393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb42563-a714-4865-b942-2cc08db50744", "name": "network-vif-deleted", "tag": "eb6d6aea-af17-4cb2-bcf6-b7231e0117ee"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:06.414356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-23830be5-2678-4e7a-9837-e3205a218f0c req-40e7edec-fb94-48ee-a943-9d58be4ed393 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.414954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-23830be5-2678-4e7a-9837-e3205a218f0c req-40e7edec-fb94-48ee-a943-9d58be4ed393 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.415590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-23830be5-2678-4e7a-9837-e3205a218f0c req-40e7edec-fb94-48ee-a943-9d58be4ed393 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.422167 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:06.457185 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-23830be5-2678-4e7a-9837-e3205a218f0c req-40e7edec-fb94-48ee-a943-9d58be4ed393 service nova] Creating event network-vif-deleted:eb6d6aea-af17-4cb2-bcf6-b7231e0117ee for instance efb42563-a714-4865-b942-2cc08db50744 on n-h1-master-1 Sep 25 01:12:06.470375 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-23830be5-2678-4e7a-9837-e3205a218f0c req-40e7edec-fb94-48ee-a943-9d58be4ed393 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.728838 Sep 25 01:12:06.471571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1137/2317] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:12:06.701212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:06.702987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 184e29ea-6342-4d3a-8bfc-8f05580d9eea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:06.718873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.724676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.725343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.726223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.726806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.727354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.765042 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] HTTP exception thrown: Instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea could not be found. Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Request method failure captured: Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea HTTP/1.1 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ou-nDGYvp_9bQw1EwDOEiM3Ga6233br5halyktdge0-1Uypofdr39Is6SQdUS7sm9SKDELLOV8BkXHCaiv-F2oVFM4MennRTAA-3SmXQVbJmNvvAXupVpIhWUv8ixZ_W5cLEFSHVVXAumU-0XBEKzG_U0rHJyxx71cMtoFN01CFqk Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e310970d7ec54c99a3d719824c6be1ee"}]}] Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f3931162a615421f8843396650368870 Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea could not be found. Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '184e29ea-6342-4d3a-8bfc-8f05580d9eea'} Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea could not be found. Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea could not be found. Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:06.771109 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea could not be found. Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.775700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Returning 404 to user: Instance 184e29ea-6342-4d3a-8bfc-8f05580d9eea could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:06.778382 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-402e9a85-7b9b-4c04-bd3f-577ef313345c tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea" status: 404 len: 111 microversion: 2.1 time: 0.080154 Sep 25 01:12:06.782233 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1181/2318] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:06 2022] GET /compute/v2.1/servers/184e29ea-6342-4d3a-8bfc-8f05580d9eea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:06.790329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:06.791087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:06.805731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.806487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.807040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.810225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.810819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.813219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.854202 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] HTTP exception thrown: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Request method failure captured: Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac HTTP/1.1 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6ou-nDGYvp_9bQw1EwDOEiM3Ga6233br5halyktdge0-1Uypofdr39Is6SQdUS7sm9SKDELLOV8BkXHCaiv-F2oVFM4MennRTAA-3SmXQVbJmNvvAXupVpIhWUv8ixZ_W5cLEFSHVVXAumU-0XBEKzG_U0rHJyxx71cMtoFN01CFqk Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e310970d7ec54c99a3d719824c6be1ee"}]}] Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f3931162a615421f8843396650368870 Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8837fcf1-fc71-4722-ab37-9235d38749ac'} Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:06.860063 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.864047 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.870945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Returning 404 to user: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:06.872106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-07e4cfdc-cb07-48dc-9c4b-9697f6458d3a tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 404 len: 111 microversion: 2.1 time: 0.087609 Sep 25 01:12:06.875754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1138/2319] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:06 2022] DELETE /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:06.885785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:06.886880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: 8837fcf1-fc71-4722-ab37-9235d38749ac] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:06.903062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.903820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.904508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.905558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.906315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.906987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.932717 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] HTTP exception thrown: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Request method failure captured: Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac HTTP/1.1 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ou-nDGYvp_9bQw1EwDOEiM3Ga6233br5halyktdge0-1Uypofdr39Is6SQdUS7sm9SKDELLOV8BkXHCaiv-F2oVFM4MennRTAA-3SmXQVbJmNvvAXupVpIhWUv8ixZ_W5cLEFSHVVXAumU-0XBEKzG_U0rHJyxx71cMtoFN01CFqk Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e310970d7ec54c99a3d719824c6be1ee"}]}] Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f3931162a615421f8843396650368870 Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '8837fcf1-fc71-4722-ab37-9235d38749ac'} Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:06.934853 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. Sep 25 01:12:06.938384 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:06.940771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Returning 404 to user: Instance 8837fcf1-fc71-4722-ab37-9235d38749ac could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:06.942983 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b6e9700-af08-43fa-9819-253a51a87574 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac" status: 404 len: 111 microversion: 2.1 time: 0.062020 Sep 25 01:12:06.944110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1182/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:06 2022] GET /compute/v2.1/servers/8837fcf1-fc71-4722-ab37-9235d38749ac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:06.951907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:06.952961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:06.962687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.963477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.964181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.965163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:06.970383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:06.972507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:06.994349 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] HTTP exception thrown: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Request method failure captured: Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 HTTP/1.1 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6ou-nDGYvp_9bQw1EwDOEiM3Ga6233br5halyktdge0-1Uypofdr39Is6SQdUS7sm9SKDELLOV8BkXHCaiv-F2oVFM4MennRTAA-3SmXQVbJmNvvAXupVpIhWUv8ixZ_W5cLEFSHVVXAumU-0XBEKzG_U0rHJyxx71cMtoFN01CFqk Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e310970d7ec54c99a3d719824c6be1ee"}]}] Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f3931162a615421f8843396650368870 Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e26f005f-46a7-4d44-be2b-b8afc7fad760'} Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:07.000611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.004748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.008490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Returning 404 to user: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:07.009614 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c983dc8f-774d-44fc-b27d-add19fa06b1f tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 404 len: 111 microversion: 2.1 time: 0.061664 Sep 25 01:12:07.012327 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1139/2321] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:06 2022] DELETE /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:07.021667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:07.022946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] [instance: e26f005f-46a7-4d44-be2b-b8afc7fad760] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:07.038627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:07.039741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:07.042520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:07.043777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:07.044382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:07.047136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:07.070974 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] HTTP exception thrown: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Request method failure captured: Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 HTTP/1.1 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6ou-nDGYvp_9bQw1EwDOEiM3Ga6233br5halyktdge0-1Uypofdr39Is6SQdUS7sm9SKDELLOV8BkXHCaiv-F2oVFM4MennRTAA-3SmXQVbJmNvvAXupVpIhWUv8ixZ_W5cLEFSHVVXAumU-0XBEKzG_U0rHJyxx71cMtoFN01CFqk Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e310970d7ec54c99a3d719824c6be1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e310970d7ec54c99a3d719824c6be1ee"}]}] Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: e310970d7ec54c99a3d719824c6be1ee Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-427326861 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f3931162a615421f8843396650368870 Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerDiskConfigTestJSON-427326861-project Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e26f005f-46a7-4d44-be2b-b8afc7fad760'} Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:07.072533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] Returning 404 to user: Instance e26f005f-46a7-4d44-be2b-b8afc7fad760 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a6b97db-72ab-40af-b02b-33b27d5dee48 tempest-ServerDiskConfigTestJSON-427326861 tempest-ServerDiskConfigTestJSON-427326861-project] 10.222.0.16 "GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760" status: 404 len: 111 microversion: 2.1 time: 0.057763 Sep 25 01:12:07.077019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1183/2322] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:07 2022] GET /compute/v2.1/servers/e26f005f-46a7-4d44-be2b-b8afc7fad760 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:07.304919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:07.305697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:07.312793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:07.325991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:07.326627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:07.327700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:07.327943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:07.328545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:07.356069 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 HTTP/1.1 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: exception: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744'} Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.360571 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:12:07.364916 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:07.367202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:07.373213 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dad11077-e477-4635-ac53-9379a401466d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 404 len: 111 microversion: 2.1 time: 0.073902 Sep 25 01:12:07.381829 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1140/2323] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:07 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:07.388547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f159d6b4-ddc1-4e71-af34-ebe9d62d7ec9 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'create', calling method: .version_select at 0x7f7bf3f63dc0>, body: {"keypair": {"name": "tempest-keypair-479273948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2wZ3xBY1d86d1rNrrsAp80dMWbwQfq86PYHai1ed0Tf3KaSUIsOI7+kCTOYRwp8Mg7HAgtM7ntmIXVwijHJhksi6wMBXgrYK0TDTQdkdet7xblPvM/jWJENK8BLAUctA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:07.436341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f159d6b4-ddc1-4e71-af34-ebe9d62d7ec9 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for project 56773bfde588477493c4d44b0d3e74b9. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:07.454643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f159d6b4-ddc1-4e71-af34-ebe9d62d7ec9 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for user 1cc384987bb247d88d0027e60d600ed1 and project 56773bfde588477493c4d44b0d3e74b9. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:07.497708 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f159d6b4-ddc1-4e71-af34-ebe9d62d7ec9 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113786 Sep 25 01:12:07.501123 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1184/2324] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:12:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:08.971623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-52488179", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e11de-11e2-49b9-9778-5d1ca46edda6"}], "security_groups": [{"name": "tempest-securitygroup--2038381844"}], "key_name": "tempest-keypair-540415353", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:09.146380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] validate_networks() for [('859e11de-11e2-49b9-9778-5d1ca46edda6', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:12:09.849909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:09.850300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:09.850786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:09.851206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:09.851623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:09.865831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:09.866326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:09.866767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:09.867506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:09.867964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:09.868400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:09.908610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:09.927158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:09.972718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:09.977133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:10.065869 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ddb4686f-4061-4ee9-b43d-7d6fbdecfbcc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.101103 Sep 25 01:12:10.072820 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1141/2325] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:12:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:12:10.081053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-269cd2e4-5b0e-4f12-adfe-bbe1c8a0f125 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:10.083170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-269cd2e4-5b0e-4f12-adfe-bbe1c8a0f125 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:10.396379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-269cd2e4-5b0e-4f12-adfe-bbe1c8a0f125 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:10.410628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-269cd2e4-5b0e-4f12-adfe-bbe1c8a0f125 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1239 microversion: 2.1 time: 0.336436 Sep 25 01:12:10.414564 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1185/2326] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:10 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1239 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:11.440683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:11.441936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:11.465363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:11.467734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:11.468573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:11.470728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:11.472228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:11.472832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:11.739390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:11.756279 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a6e95b3-5177-4f67-9e38-6c7e360cd993 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1291 microversion: 2.1 time: 0.321622 Sep 25 01:12:11.757491 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1142/2327] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:11 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1291 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:12.780818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:12.782425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:12.821584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:12.824735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:12.825926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:12.826851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:12.827512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:12.828135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:13.013781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:13.027672 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bbfea676-4d2d-4c51-8531-b27f607db27a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1297 microversion: 2.1 time: 0.251303 Sep 25 01:12:13.029087 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1186/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:12 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:14.058777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:14.059489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:14.085998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:14.090395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:14.091016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:14.092329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:14.092969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:14.093603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:14.306841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:14.326670 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a16d4dee-690d-4e70-96e6-253782f2e4bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1297 microversion: 2.1 time: 0.272129 Sep 25 01:12:14.330384 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1143/2329] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:14 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1297 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:15.029765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1447496551", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:15.130735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] validate_networks() for [('0301c1a5-7c3a-4965-960e-b2cc1b01b7f9', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:12:15.360331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:15.360331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:15.378848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:15.379334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:15.379775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:15.380498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:15.380956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:15.381386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:16.915000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:16.928348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c453c801-7f62-4736-bdc0-da3e8b6302dd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 1.573290 Sep 25 01:12:16.931499 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1144/2330] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:15 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:17.952711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:17.953253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:17.963002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:17.963504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:17.964386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:17.965288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:17.965927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:17.967238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:18.050249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:18.051327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:18.052000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:18.053293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:18.053889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:18.108754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:18.108754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:18.109110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:18.111460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:18.112522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:18.114605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:18.159385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for project 56773bfde588477493c4d44b0d3e74b9. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:18.169291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for user 1cc384987bb247d88d0027e60d600ed1 and project 56773bfde588477493c4d44b0d3e74b9. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:18.190627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:18.193525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:18.296681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e8f53e26-8539-4e92-a0ea-23c918db05e5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.271432 Sep 25 01:12:18.304012 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1187/2331] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:12:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:12:18.322577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dbdb39f9-a4c2-496a-994b-217f244f8eeb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:18.325025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dbdb39f9-a4c2-496a-994b-217f244f8eeb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:18.453262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dbdb39f9-a4c2-496a-994b-217f244f8eeb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:18.469370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dbdb39f9-a4c2-496a-994b-217f244f8eeb tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1225 microversion: 2.1 time: 0.158048 Sep 25 01:12:18.485029 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1188/2332] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:18 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1225 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:18.541315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:18.562437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ea46db6-c92e-43ed-a045-95e10aa5729e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.614345 Sep 25 01:12:18.563239 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1145/2333] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:17 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:19.113138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2dadc1b5-3fdd-4013-a332-0ea630b57a00 req-c14cb4a1-e9da-4d75-b67e-372122e63266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e709904a-78e9-4d39-ad67-c7e9ffca9762", "tag": "5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:19.141571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2dadc1b5-3fdd-4013-a332-0ea630b57a00 req-c14cb4a1-e9da-4d75-b67e-372122e63266 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:19.142066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2dadc1b5-3fdd-4013-a332-0ea630b57a00 req-c14cb4a1-e9da-4d75-b67e-372122e63266 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:19.153789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2dadc1b5-3fdd-4013-a332-0ea630b57a00 req-c14cb4a1-e9da-4d75-b67e-372122e63266 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:19.188178 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2dadc1b5-3fdd-4013-a332-0ea630b57a00 req-c14cb4a1-e9da-4d75-b67e-372122e63266 service nova] Creating event network-changed:5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06 for instance e709904a-78e9-4d39-ad67-c7e9ffca9762 on n-h2-master-1 Sep 25 01:12:19.207922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2dadc1b5-3fdd-4013-a332-0ea630b57a00 req-c14cb4a1-e9da-4d75-b67e-372122e63266 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099355 Sep 25 01:12:19.217807 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1189/2334] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:19.494768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:19.496030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:19.527096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:19.531824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:19.534209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:19.541697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:19.542047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:19.542824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:19.588898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:19.589622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:19.599267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:19.599767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:19.600214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:19.600933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:19.601394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:19.601850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:19.886438 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:19.939616 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:20.165083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:20.174457 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4402f85-748d-48ff-a35c-8d438e06ac1f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1221 microversion: 2.1 time: 0.684967 Sep 25 01:12:20.181810 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1146/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:19 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1221 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:21.206957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:21.212648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:21.230096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:21.231665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:21.232291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:21.234517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:21.235756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:21.238396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:21.432584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:21.461551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2560c1a-7fb7-4b52-8c46-6a08aed800e3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1283 microversion: 2.1 time: 0.262635 Sep 25 01:12:21.462603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1147/2336] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:21 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:21.606185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:21.623963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3a55fc1-0f67-417b-b39b-8e00daf876b5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 2.039943 Sep 25 01:12:21.624635 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1190/2337] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:19 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:22.491474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:22.492131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:22.509956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.511761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.513965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.516491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.520871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.521649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.598817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1024528572", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:22.708786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:22.714307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:22.714933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:22.715451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:22.715972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:22.738204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.738865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.739402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.740289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.744069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.744624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.746772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:22.762193 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f9eec6a-6946-4ff7-b17c-4fbdd251f7e2 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1283 microversion: 2.1 time: 0.274046 Sep 25 01:12:22.764710 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1191/2338] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:22 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:22.780218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:22.782044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:22.809392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.810835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.813085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.814189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.815409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.816307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.821297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Getting quotas for project 52871d02d6f348c78767e9f62627b539. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:22.839404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Getting quotas for user b1bc0ffad726490cb6501becbc822449 and project 52871d02d6f348c78767e9f62627b539. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:22.873499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:22.879005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:22.976304 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f80a86fd-1590-4aea-8b67-1ea79d0d1f2c tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.963810 Sep 25 01:12:22.977544 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1148/2339] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:12:22.993436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b997cc5-959a-42d0-9f31-0107e73943d5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:22.997366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b997cc5-959a-42d0-9f31-0107e73943d5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:23.019239 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:23.196301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b997cc5-959a-42d0-9f31-0107e73943d5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:23.208801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b997cc5-959a-42d0-9f31-0107e73943d5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:23.215353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b997cc5-959a-42d0-9f31-0107e73943d5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:23.221529 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b997cc5-959a-42d0-9f31-0107e73943d5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1278 microversion: 2.54 time: 0.236489 Sep 25 01:12:23.222187 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1149/2340] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:22 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:23.350773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:23.393332 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f92dcc13-19cd-49cd-a4c6-3c455d2c1bab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.626920 Sep 25 01:12:23.397744 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1192/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:22 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:23.791798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:23.793024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:23.808675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:23.813333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:23.814944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:23.817306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:23.818738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:23.819261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.171730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:24.193582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-413254c3-82a3-4855-bb13-c08742993ac5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.408131 Sep 25 01:12:24.211235 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1150/2342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:23 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:24.254229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:24.255856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:24.271731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.275492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.276129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.277237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.277657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.278095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.418377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:24.419005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:24.437248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.438588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.438588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.441931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.442621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.472621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.668617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:24.684008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:24.691559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:24.693535 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2ca08e1-e1f6-48fe-863a-e2913f496aca tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1282 microversion: 2.54 time: 0.444016 Sep 25 01:12:24.694560 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1193/2343] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:24 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:25.094518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:25.110371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75df9290-d6a0-45e0-b0d9-f934530e5bc5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.696662 Sep 25 01:12:25.111496 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1151/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:24 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:25.225036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:25.225770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:25.237663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:25.238887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:25.241874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:25.242887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:25.243378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:25.243825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:25.725152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:25.725802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:25.738488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:25.738996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:25.739431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:25.740258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:25.740729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:25.741142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:26.060585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:26.062954 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:26.083949 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-52e41d19-1c87-4f7e-befa-6756c3b5f4ee tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.862683 Sep 25 01:12:26.084560 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1194/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:25 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:26.136903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:26.147637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:26.149563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:26.151172 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4cd14c59-f9b0-49ad-9336-e385f7473049 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1348 microversion: 2.54 time: 0.430441 Sep 25 01:12:26.165540 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1152/2346] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:25 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1348 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:26.178061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d3e55fd9-4b94-4bc6-bcab-eacb522380d5 req-d4101103-18c6-4cde-9b48-13c004049818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f487a58-e979-4857-bad1-1f2723c5ee8b", "tag": "562e321e-2152-40dc-80d1-018f8b1069c5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:26.189787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d3e55fd9-4b94-4bc6-bcab-eacb522380d5 req-d4101103-18c6-4cde-9b48-13c004049818 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:26.190563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d3e55fd9-4b94-4bc6-bcab-eacb522380d5 req-d4101103-18c6-4cde-9b48-13c004049818 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:26.191180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d3e55fd9-4b94-4bc6-bcab-eacb522380d5 req-d4101103-18c6-4cde-9b48-13c004049818 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:26.203533 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d3e55fd9-4b94-4bc6-bcab-eacb522380d5 req-d4101103-18c6-4cde-9b48-13c004049818 service nova] Creating event network-changed:562e321e-2152-40dc-80d1-018f8b1069c5 for instance 7f487a58-e979-4857-bad1-1f2723c5ee8b on n-h1-master-1 Sep 25 01:12:26.210575 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d3e55fd9-4b94-4bc6-bcab-eacb522380d5 req-d4101103-18c6-4cde-9b48-13c004049818 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043693 Sep 25 01:12:26.211500 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1153/2347] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:26.217061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:26.218129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:26.225989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:26.226795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:26.228104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:26.229235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:26.229920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:26.230537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:26.435581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45d47d05-455e-4b88-aa3c-4b9ccaa5d689 tempest-FloatingIPDetailsNegativeTestJSON-708015622 tempest-FloatingIPDetailsNegativeTestJSON-708015622-project] Calling method '.version_select at 0x7f7bf4034700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:26.497537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:26.499286 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-45d47d05-455e-4b88-aa3c-4b9ccaa5d689 tempest-FloatingIPDetailsNegativeTestJSON-708015622 tempest-FloatingIPDetailsNegativeTestJSON-708015622-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 441b3662-e2f1-4968-b4b6-de0daeac0d8d could not be found", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:12:26.500050 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-45d47d05-455e-4b88-aa3c-4b9ccaa5d689 tempest-FloatingIPDetailsNegativeTestJSON-708015622 tempest-FloatingIPDetailsNegativeTestJSON-708015622-project] HTTP exception thrown: Floating IP not found for ID 441b3662-e2f1-4968-b4b6-de0daeac0d8d Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45d47d05-455e-4b88-aa3c-4b9ccaa5d689 tempest-FloatingIPDetailsNegativeTestJSON-708015622 tempest-FloatingIPDetailsNegativeTestJSON-708015622-project] Request method failure captured: Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-floating-ips/441b3662-e2f1-4968-b4b6-de0daeac0d8d HTTP/1.1 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6r5F1GFCIXEjf-F0F43xMXc4k6EI94F3hST_u7cNkf9pc_ew1j9Nk14mkpMVSMVP3fz_rskI7Gt_rI5zv5nkwC4Sdjjo1lsEcGiP7J6hBM4aAcFNX318UaR_X-44dCAtFF9Q1ff9ZeIPEB1ZwUFOaPg3DARhM8T1pbU1uzwf4dcFJw Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: becc007596364d5fac8bf17571458d83 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-708015622 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/becc007596364d5fac8bf17571458d83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/becc007596364d5fac8bf17571458d83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/becc007596364d5fac8bf17571458d83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_becc007596364d5fac8bf17571458d83"}]}] Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-708015622 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: becc007596364d5fac8bf17571458d83 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-708015622 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-708015622-project Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 829a6360f61f4d47afc21aac640b9c2e Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-708015622-project Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: exception: Floating IP not found for ID 441b3662-e2f1-4968-b4b6-de0daeac0d8d Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '441b3662-e2f1-4968-b4b6-de0daeac0d8d'} Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 441b3662-e2f1-4968-b4b6-de0daeac0d8d could not be found Sep 25 01:12:26.502952 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ebc7e5e-5e56-4970-b0f4-c587773c895e'] Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 441b3662-e2f1-4968-b4b6-de0daeac0d8d. Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 441b3662-e2f1-4968-b4b6-de0daeac0d8d Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 441b3662-e2f1-4968-b4b6-de0daeac0d8d Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:26.506614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45d47d05-455e-4b88-aa3c-4b9ccaa5d689 tempest-FloatingIPDetailsNegativeTestJSON-708015622 tempest-FloatingIPDetailsNegativeTestJSON-708015622-project] Returning 404 to user: Floating IP not found for ID 441b3662-e2f1-4968-b4b6-de0daeac0d8d {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:26.508597 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-45d47d05-455e-4b88-aa3c-4b9ccaa5d689 tempest-FloatingIPDetailsNegativeTestJSON-708015622 tempest-FloatingIPDetailsNegativeTestJSON-708015622-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/441b3662-e2f1-4968-b4b6-de0daeac0d8d" status: 404 len: 111 microversion: 2.1 time: 0.422448 Sep 25 01:12:26.515641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1195/2348] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:12:26 2022] GET /compute/v2.1/os-floating-ips/441b3662-e2f1-4968-b4b6-de0daeac0d8d => generated 111 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:26.519493 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d6ef6e2-6efe-4bb0-ac99-5defe3184257 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.306532 Sep 25 01:12:26.535201 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1154/2349] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:26 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:27.110922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:27.112445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:27.123386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.125054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.125914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.128975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.130007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.131784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.309795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27f250f1-0346-4eb8-ab7c-4bc4998e3a9a tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] Action: 'create', calling method: .version_select at 0x7f7bebf08700>, body: {"security_group": {"name": "tempest-securitygroup-840191373", "description": "tempest-description-833255733"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:27.622177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:27.637629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-65264934-da39-4302-9d3e-0b7271c1b3ce tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.533337 Sep 25 01:12:27.638384 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1155/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:27 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:27.649276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:27.649929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:27.666709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.667204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.672769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.674231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.677344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.678385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.821748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:27.833375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:27.840022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:27.842338 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e789e340-8aae-4c02-a86a-2fb321a4db96 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1336 microversion: 2.54 time: 0.201879 Sep 25 01:12:27.843095 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1156/2351] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:27 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1336 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:27.855078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:27.858639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:27.872559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.873724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.876092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.877273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.880769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.881455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:28.138385 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:28.389799 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27f250f1-0346-4eb8-ab7c-4bc4998e3a9a tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.595023 Sep 25 01:12:28.391086 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1196/2352] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:12:26 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:28.404970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fde8a39b-078f-4d7e-9973-e899eb48f4d0 tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] Action: 'create', calling method: .version_select at 0x7f7bf3fd9ca0>, body: {"security_group": {"name": "tempest-securitygroup-998849652", "description": "tempest-description-2045400939"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:28.458878 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=14 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:28.708724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:28.728353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1966e7b9-25de-4faa-bde2-e190ffd07ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.880564 Sep 25 01:12:28.728994 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1157/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:27 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:28.736394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:28.737275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:28.748375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:28.749149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:28.749799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:28.751144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:28.751993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:28.752904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.058133 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fde8a39b-078f-4d7e-9973-e899eb48f4d0 tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.656827 Sep 25 01:12:29.059501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1197/2354] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:12:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:29.081154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:29.083270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:29.086897 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:29.134557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.135603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.138837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.146440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.150611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.152992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.234224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:29.245515 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-54ea9bd5-b161-4a81-9ab2-3dbda924c4f7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.514387 Sep 25 01:12:29.246120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1158/2355] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:28 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:29.389080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:29.427543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:29.434553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:29.436263 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ea54785-fecb-4fb3-bd8a-759bf2718e6e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1336 microversion: 2.54 time: 0.375247 Sep 25 01:12:29.443148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1198/2356] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:29 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1336 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:29.560976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-02f510d2-bf00-4080-a30f-1e8e2aeefc80 req-17dfb637-bf59-4b84-8d68-535b9a692b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e709904a-78e9-4d39-ad67-c7e9ffca9762", "name": "network-vif-plugged", "status": "completed", "tag": "5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:29.582327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-02f510d2-bf00-4080-a30f-1e8e2aeefc80 req-17dfb637-bf59-4b84-8d68-535b9a692b35 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.582832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-02f510d2-bf00-4080-a30f-1e8e2aeefc80 req-17dfb637-bf59-4b84-8d68-535b9a692b35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.583276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-02f510d2-bf00-4080-a30f-1e8e2aeefc80 req-17dfb637-bf59-4b84-8d68-535b9a692b35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.614041 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-02f510d2-bf00-4080-a30f-1e8e2aeefc80 req-17dfb637-bf59-4b84-8d68-535b9a692b35 service nova] Creating event network-vif-plugged:5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06 for instance e709904a-78e9-4d39-ad67-c7e9ffca9762 on n-h2-master-1 Sep 25 01:12:29.626194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-02f510d2-bf00-4080-a30f-1e8e2aeefc80 req-17dfb637-bf59-4b84-8d68-535b9a692b35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071849 Sep 25 01:12:29.627993 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1199/2357] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 25 01:12:29.667607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-321d4e6a-9933-4750-8511-e761afd2ea36 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Action: 'create', calling method: .version_select at 0x7f7bf3f520d0>, body: {"security_group": {"name": "tempest-securitygroup-463178357", "description": "tempest-description-1517237318"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:29.753074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:29.753813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:29.765015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.773674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.775849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.780427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.783390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.785515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:30.499985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:30.514933 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f157ec6-32a3-423d-9e27-5883428369a8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.765241 Sep 25 01:12:30.516739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1200/2358] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:29 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:30.529683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:30.532725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:30.553506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:30.555441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:30.556091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:30.557954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:30.560318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:30.562144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:30.748040 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-321d4e6a-9933-4750-8511-e761afd2ea36 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.494515 Sep 25 01:12:30.748922 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1159/2359] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:12:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:30.754964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:30.755906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:30.772043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:30.775088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:30.775852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:30.779664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:30.782373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:30.786166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:31.270600 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:31.388326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:31.410989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:31.418992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:31.419675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:31.421210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cae2b1c6-c41e-43ba-8c55-7000ff205056 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1357 microversion: 2.54 time: 0.670493 Sep 25 01:12:31.435119 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1160/2360] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:30 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1357 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:31.435119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a948d79-8a5a-42b2-a9a3-75e7dda18b6c tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Action: 'create', calling method: .version_select at 0x7f7bf3f493a0>, body: {"security_group": {"name": "tempest-securitygroup-1787270115", "description": "tempest-description-1092046831"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:31.466189 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe581bc7-a9f2-45e9-95fa-52d2df35d376 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.944782 Sep 25 01:12:31.477623 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1201/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:30 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:31.493382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbeba308-b956-4a38-ae1a-cb855337e5c5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Action: 'create', calling method: .version_select at 0x7f7bf3fcb1f0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-369564019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZSetiUCYkISE+yORl8CBZMrQYiXUzMfLf/k/6QDdHtm0z8GXWBYsk8dJuvfwse9iKrGbzNJIRoJb0Iwb/9xoNIeoWz+5L87BwM+DHirx43AjueVXYmUTqw2w7STDr3nQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:31.512890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-fbeba308-b956-4a38-ae1a-cb855337e5c5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Getting quotas for project 52871d02d6f348c78767e9f62627b539. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:31.521720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-fbeba308-b956-4a38-ae1a-cb855337e5c5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Getting quotas for user b1bc0ffad726490cb6501becbc822449 and project 52871d02d6f348c78767e9f62627b539. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:31.558886 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbeba308-b956-4a38-ae1a-cb855337e5c5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.076820 Sep 25 01:12:31.559803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1202/2362] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:12:31 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:12:31.572711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:31.574192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:31.583139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:31.583895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:31.584658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:31.586049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:31.586700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:31.587290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:31.960406 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a948d79-8a5a-42b2-a9a3-75e7dda18b6c tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.535318 Sep 25 01:12:31.962125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1161/2363] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:12:31 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:31.984440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-369564019", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:32.012368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:32.025663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:32.039966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b91ca29-7457-4979-a793-7c77aaedfd68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1365 microversion: 2.1 time: 0.477394 Sep 25 01:12:32.043250 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1203/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:31 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:32.043396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.043982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.044439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.045199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.045742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.050993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.063323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Calling method '.version_select at 0x7f7bf4015310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:32.228679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:32.229111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:32.229635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:32.230049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:32.230478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:32.337335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:32.346848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.347858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.348526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.349536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.350215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.350861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.389941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfd9e3b6-9da6-48bc-8a42-0e03c0aa38ae tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "POST /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071/action" status: 202 len: 1139 microversion: 2.54 time: 0.426203 Sep 25 01:12:32.391820 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1162/2365] 10.222.0.16 () {62 vars in 1320 bytes} [Sun Sep 25 01:12:31 2022] POST /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071/action => generated 1139 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 25 01:12:32.421648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:32.422657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:32.435791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.436673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.439021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.440454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.444005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.445336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.764971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:32.775668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:32.780986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:32.785317 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0592e4c2-2266-4190-a600-3341121ca070 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.368985 Sep 25 01:12:32.790726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1163/2366] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:32 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:32.795949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:32.805135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:32.807365 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:32.813353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.814606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.815196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.815924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.822867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.827512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.201156 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:33.260169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:33.270656 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b006306d-4a61-42c7-ae96-3c4a9e295cb3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.478441 Sep 25 01:12:33.271905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1164/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:32 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:33.277328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-00499aea-6f8e-49e6-8ddc-1eb7816de322 req-cfb7ff1b-7f57-4573-b601-3c6c173ea8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f487a58-e979-4857-bad1-1f2723c5ee8b", "name": "network-vif-plugged", "status": "completed", "tag": "562e321e-2152-40dc-80d1-018f8b1069c5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:33.288940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-00499aea-6f8e-49e6-8ddc-1eb7816de322 req-cfb7ff1b-7f57-4573-b601-3c6c173ea8a5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.289805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-00499aea-6f8e-49e6-8ddc-1eb7816de322 req-cfb7ff1b-7f57-4573-b601-3c6c173ea8a5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.290402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-00499aea-6f8e-49e6-8ddc-1eb7816de322 req-cfb7ff1b-7f57-4573-b601-3c6c173ea8a5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.310981 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-00499aea-6f8e-49e6-8ddc-1eb7816de322 req-cfb7ff1b-7f57-4573-b601-3c6c173ea8a5 service nova] Creating event network-vif-plugged:562e321e-2152-40dc-80d1-018f8b1069c5 for instance 7f487a58-e979-4857-bad1-1f2723c5ee8b on n-h1-master-1 Sep 25 01:12:33.319602 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-00499aea-6f8e-49e6-8ddc-1eb7816de322 req-cfb7ff1b-7f57-4573-b601-3c6c173ea8a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046098 Sep 25 01:12:33.320828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1165/2368] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:33.327301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:33.328006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:33.339926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.340603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.341392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.342586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.343931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.344914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.742441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:33.751084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7703feeb-ced0-45dc-a75a-c657a2ba89b3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1555 microversion: 2.1 time: 0.428812 Sep 25 01:12:33.756046 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1166/2369] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:33 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1555 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:33.794505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:33.796215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:33.805495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.806307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.807095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.808108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.808756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.809574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.017625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3a75126-d393-477d-9c4c-ffc2304b8fd4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239062 Sep 25 01:12:34.018476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1167/2370] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:12:33 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:34.023721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:34.025728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:34.036193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.042993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.043460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.044225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.045734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.046177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.292298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:34.309874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:34.320863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:34.322532 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fabb6cfb-9f3b-41a1-bd5e-ec0c73667d50 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.302704 Sep 25 01:12:34.324332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1168/2371] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:34 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:34.336828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:34.337729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:34.355293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.356210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.358867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.370157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.370834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.373017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.763033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:34.775034 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f385b3b3-7495-4d95-be9f-5ac7d69fe1fd tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1325 microversion: 2.1 time: 0.448233 Sep 25 01:12:34.775636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1169/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:34 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:35.354552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:35.355260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:35.365204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.365724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.366318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.367019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.367462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.368031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.489503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:35.498573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:35.500120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:35.501485 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5594357b-70db-498e-a053-710dc923b423 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.150774 Sep 25 01:12:35.513429 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1170/2373] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:35 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:35.677602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:35.678114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:35.684288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.685057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.685518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.686392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.686843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.687470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.717112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:12:35.850243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73adaec7-917c-4eff-87ea-b3610f7fee82 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 204 len: 0 microversion: 2.1 time: 0.175499 Sep 25 01:12:35.853692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1171/2374] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:35 2022] DELETE /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:12:35.869141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:35.869883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:35.877034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.877899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.878523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.879549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.880256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.880842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.096669 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c26084c9-34fe-4aab-884d-81577d058b5f does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:12:36.097274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Neutron security group c26084c9-34fe-4aab-884d-81577d058b5f not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:12:36.097944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.security_groups [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Security Group ID c26084c9-34fe-4aab-884d-81577d058b5f does not exist {{(pid=122385) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 25 01:12:36.151065 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c26084c9-34fe-4aab-884d-81577d058b5f does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:12:36.151876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Neutron security group c26084c9-34fe-4aab-884d-81577d058b5f not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:12:36.152418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.security_groups [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Security Group ID c26084c9-34fe-4aab-884d-81577d058b5f does not exist {{(pid=122385) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 25 01:12:36.190054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:36.209150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83492986-15d1-4090-8818-5b445f5732ba tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1521 microversion: 2.1 time: 0.353838 Sep 25 01:12:36.210262 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1172/2375] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:35 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:36.216948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:36.218456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:36.225957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.227888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.229541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.230766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.231375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.232112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.491231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:36.499089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3175a4e0-c6f9-47a5-8a64-c10760776d1f tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1663 microversion: 2.1 time: 0.287607 Sep 25 01:12:36.513838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1173/2376] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:36 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1663 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:36.520836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:36.521951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:36.530041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.531329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.531997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.533665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.534350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.534987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.590357 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9811f9ca-501d-41ae-acdd-d80c0647b629 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10343 microversion: 2.1 time: 4.545086 Sep 25 01:12:36.591210 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1204/2377] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 25 01:12:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10343 bytes in 4547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:12:36.596868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8b276250-b33c-4fd8-a8c8-81e0fc69a771 req-76eb6a23-3163-469c-9790-27574b0fc769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e709904a-78e9-4d39-ad67-c7e9ffca9762", "tag": "5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:36.624895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8b276250-b33c-4fd8-a8c8-81e0fc69a771 req-76eb6a23-3163-469c-9790-27574b0fc769 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.634735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8b276250-b33c-4fd8-a8c8-81e0fc69a771 req-76eb6a23-3163-469c-9790-27574b0fc769 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.636514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8b276250-b33c-4fd8-a8c8-81e0fc69a771 req-76eb6a23-3163-469c-9790-27574b0fc769 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.662879 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8b276250-b33c-4fd8-a8c8-81e0fc69a771 req-76eb6a23-3163-469c-9790-27574b0fc769 service nova] Creating event network-changed:5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06 for instance e709904a-78e9-4d39-ad67-c7e9ffca9762 on n-h2-master-1 Sep 25 01:12:36.676548 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8b276250-b33c-4fd8-a8c8-81e0fc69a771 req-76eb6a23-3163-469c-9790-27574b0fc769 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083734 Sep 25 01:12:36.678366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1205/2378] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:36.698158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:36.699873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:36.721361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.725679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.726684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.727753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.728587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.729272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.808916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:36.827130 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59e25da1-3cff-4eb6-a9bc-a1bc059079e6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1521 microversion: 2.1 time: 0.310450 Sep 25 01:12:36.847694 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1174/2379] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:36 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:36.856349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f72ba794-4a59-4084-875b-59c3835e5b4b tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] Calling method '.version_select at 0x7f7bf3f49d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:36.888083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:36.906012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:36.909808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:36.911699 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-96f8fa51-4074-4e70-ab95-ea69542dfc0d tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.231182 Sep 25 01:12:36.932536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1206/2380] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:36 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:36.953491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2134875809"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:36.961937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:36.977724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.979867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.985743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:36.986774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:36.989562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:36.990349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:37.213458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f72ba794-4a59-4084-875b-59c3835e5b4b tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.364326 Sep 25 01:12:37.214300 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1175/2381] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 25 01:12:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:37.231847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15988410-7363-430d-9cfe-6853c8e97835 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Calling method '.version_select at 0x7f7bf408a160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:37.406306 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b6844ef1-7e69-4ab1-92b6-b44f170320af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b/action" status: 202 len: 0 microversion: 2.1 time: 0.467891 Sep 25 01:12:37.410520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1207/2382] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:12:36 2022] POST /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:12:37.438278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0398cc1-013c-4482-8b20-ffaadffc0ea7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '.version_select at 0x7f7bf40c39d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:37.751434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0398cc1-013c-4482-8b20-ffaadffc0ea7 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc" status: 204 len: 0 microversion: 2.1 time: 0.334516 Sep 25 01:12:37.752547 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1208/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:37 2022] DELETE /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:12:37.757812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:37.758894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:37.786655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:37.787152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:37.787599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:37.788331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:37.788789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:37.789222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:38.315406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:38.328843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1379a4d0-d95e-424d-a53b-83a8859e016a tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1663 microversion: 2.1 time: 0.575030 Sep 25 01:12:38.333356 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1209/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:37 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1663 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:38.345044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9620f7b-5bfd-48b5-80a3-f15dcecf2e05 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '.version_select at 0x7f7bf40c35e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:38.375906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15988410-7363-430d-9cfe-6853c8e97835 tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/65886a92-6905-4a27-85e1-5dcea7c114d7" status: 202 len: 0 microversion: 2.1 time: 1.150206 Sep 25 01:12:38.377650 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1176/2385] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:12:37 2022] DELETE /compute/v2.1/os-security-groups/65886a92-6905-4a27-85e1-5dcea7c114d7 => generated 0 bytes in 1153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:12:38.384448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:38.387085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:38.405358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:38.406133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:38.406581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:38.409714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:38.411470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:38.412007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:38.418244 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d9620f7b-5bfd-48b5-80a3-f15dcecf2e05 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Image not found. Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9620f7b-5bfd-48b5-80a3-f15dcecf2e05 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc HTTP/1.1 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '7843074b-0095-4910-8478-7d582cc133bc'} Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7843074b-0095-4910-8478-7d582cc133bc Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:12:38.420433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7843074b-0095-4910-8478-7d582cc133bc could not be found. Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9620f7b-5bfd-48b5-80a3-f15dcecf2e05 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9620f7b-5bfd-48b5-80a3-f15dcecf2e05 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc" status: 404 len: 62 microversion: 2.1 time: 0.086926 Sep 25 01:12:38.430908 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1210/2386] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:12:38 2022] GET /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:12:38.436948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4c889cc-6eed-4fbf-a686-de3c992e740c tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] Calling method '.version_select at 0x7f7bf0017a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:38.477219 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:38.887989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:38.905372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:38.909696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:38.915484 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d37c5e3c-1808-429c-b88a-bc2e64cd2108 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.534920 Sep 25 01:12:38.919149 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1177/2387] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:38 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:38.929428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:38.931034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:38.954060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:38.957451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:38.960422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:38.962332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:38.965762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:38.970286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:39.449951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4c889cc-6eed-4fbf-a686-de3c992e740c tempest-SecurityGroupsTestAdminJSON-1541181745 tempest-SecurityGroupsTestAdminJSON-1541181745-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/460310a2-0175-4195-904c-7b31d26b901c" status: 202 len: 0 microversion: 2.1 time: 1.025388 Sep 25 01:12:39.451481 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1211/2388] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:12:38 2022] DELETE /compute/v2.1/os-security-groups/460310a2-0175-4195-904c-7b31d26b901c => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:12:39.518967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:39.540403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4156f74f-f528-4387-8d43-ab54e0baecde tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1539 microversion: 2.1 time: 0.619648 Sep 25 01:12:39.559618 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1178/2389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:38 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1539 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:39.592726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:39.593638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:39.606011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:39.607741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:39.608400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:39.612094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:39.613232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:39.613679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:39.885517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1382612870", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:39.966392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:39.983767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:12:39.989792 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b16c174e-53e9-44c0-a5e9-ece1e7a60200 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1663 microversion: 2.1 time: 0.428203 Sep 25 01:12:39.990734 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1179/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:39 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1663 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:39.995622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af4ddfc5-b930-4915-9a91-2a1a48d3f702 tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] Calling method '.version_select at 0x7f7bf406e8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:40.673813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:40.674666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:40.674666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:40.674992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:40.675351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:40.700750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:40.701244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:40.714162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:40.715007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:40.715492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:40.715949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:40.774661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:40.784559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for user 5db19a97588e41d1858915c9ccc48620 and project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:40.819300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:40.821883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:40.873448 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af4ddfc5-b930-4915-9a91-2a1a48d3f702 tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/447df65e-6fb9-4943-a111-1ecf438e97a2" status: 202 len: 0 microversion: 2.1 time: 0.881300 Sep 25 01:12:40.874112 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1180/2391] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:12:39 2022] DELETE /compute/v2.1/os-security-groups/447df65e-6fb9-4943-a111-1ecf438e97a2 => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:12:40.881093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:40.883994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:40.904373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:40.906531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:40.909255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:40.910219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:40.911273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:40.919459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:40.933013 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-997969a7-d335-4547-9f07-8f6977fcde78 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480245 Sep 25 01:12:40.937035 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1212/2392] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:12:40.942947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:40.949686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:40.967228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:40.978230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:40.978992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:40.980078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:40.980697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:40.981286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:41.082754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:41.092428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:41.106018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:41.111122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b2b4387-8305-4261-a9e9-c52303646fed tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.235864 Sep 25 01:12:41.112142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1181/2393] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:40 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:41.137765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e5e7f6ce-99ff-42a7-b348-43d6a1cb2331 req-324bdb25-52b8-4947-be64-29bdb83ae27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18af2166-4a52-4cee-9e7f-12811ff94f11", "name": "network-vif-deleted", "tag": "a8ea4563-746c-4656-867c-082f12bdf9f6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:41.157487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5e7f6ce-99ff-42a7-b348-43d6a1cb2331 req-324bdb25-52b8-4947-be64-29bdb83ae27c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:41.168801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5e7f6ce-99ff-42a7-b348-43d6a1cb2331 req-324bdb25-52b8-4947-be64-29bdb83ae27c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:41.170022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5e7f6ce-99ff-42a7-b348-43d6a1cb2331 req-324bdb25-52b8-4947-be64-29bdb83ae27c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:41.207784 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e5e7f6ce-99ff-42a7-b348-43d6a1cb2331 req-324bdb25-52b8-4947-be64-29bdb83ae27c service nova] Creating event network-vif-deleted:a8ea4563-746c-4656-867c-082f12bdf9f6 for instance 18af2166-4a52-4cee-9e7f-12811ff94f11 on n-h2-master-1 Sep 25 01:12:41.228175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e5e7f6ce-99ff-42a7-b348-43d6a1cb2331 req-324bdb25-52b8-4947-be64-29bdb83ae27c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105422 Sep 25 01:12:41.230482 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1182/2394] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:41.241674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ed54afb-d463-42d5-8451-31dfbadfc8f1 tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] Calling method '.version_select at 0x7f7bf3f635e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:41.442525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:41.455829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d283faa1-c13d-4228-be56-b2433c277f16 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1534 microversion: 2.1 time: 0.517442 Sep 25 01:12:41.463670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1213/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:40 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1534 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:41.483362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe94b91a-d75e-44a5-aef8-f0fa2446c348 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:41.490033 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe94b91a-d75e-44a5-aef8-f0fa2446c348 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:41.696743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe94b91a-d75e-44a5-aef8-f0fa2446c348 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:41.707539 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe94b91a-d75e-44a5-aef8-f0fa2446c348 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1213 microversion: 2.1 time: 0.230873 Sep 25 01:12:41.710256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1214/2396] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:41 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1213 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:41.716936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:41.723931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:41.738174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:41.740000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:41.742000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:41.744417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:41.745064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:41.746448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:41.848382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:41.851299 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ed54afb-d463-42d5-8451-31dfbadfc8f1 tempest-SecurityGroupsTestAdminJSON-1836841061 tempest-SecurityGroupsTestAdminJSON-1836841061-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5cabaa26-0067-418f-944e-3b868444f03c" status: 202 len: 0 microversion: 2.1 time: 0.619262 Sep 25 01:12:41.851879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:41.852493 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1183/2397] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:12:41 2022] DELETE /compute/v2.1/os-security-groups/5cabaa26-0067-418f-944e-3b868444f03c => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:12:41.853506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:41.857670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lazy-loading 'fault' on Instance uuid 18af2166-4a52-4cee-9e7f-12811ff94f11 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:12:41.960128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8f4f941c504950b4f8217de48f3f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2767668c8f624a71b787a1334c9091da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:41.974400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-531fc899-331d-434a-877f-52150c3aed23 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 200 len: 1315 microversion: 2.1 time: 0.262520 Sep 25 01:12:41.976338 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1215/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:41 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:42.140205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:42.141629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:42.153687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:42.154203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:42.154664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:42.155378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:42.155833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:42.156262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:42.304604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:42.337314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:42.340294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:42.344049 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62e71c86-548a-49cc-9efa-b93f90a14cb0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.206067 Sep 25 01:12:42.345193 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1184/2399] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:42 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:42.488918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:42.489585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:42.503404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:42.504103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:42.507762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:42.508566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:42.509057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:42.509589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:42.733441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:42.734514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:42.759035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:42.759962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:42.761319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:42.763201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:42.766222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:42.768858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:42.980071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:43.005286 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1abfb407-25f7-43db-a063-d02c7be191df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1265 microversion: 2.1 time: 0.276153 Sep 25 01:12:43.031026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1185/2400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:42 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:43.053986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5b4faba9-da1e-4f06-ab45-2c6f98cbabc7 req-c716ded0-7159-460b-98f6-df7920f19c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f487a58-e979-4857-bad1-1f2723c5ee8b", "name": "network-vif-plugged", "status": "completed", "tag": "562e321e-2152-40dc-80d1-018f8b1069c5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:43.059548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:43.072247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bfe41d56-3beb-4a35-ac19-ee4dbe075372 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1521 microversion: 2.1 time: 0.588706 Sep 25 01:12:43.086336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5b4faba9-da1e-4f06-ab45-2c6f98cbabc7 req-c716ded0-7159-460b-98f6-df7920f19c4b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.086336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5b4faba9-da1e-4f06-ab45-2c6f98cbabc7 req-c716ded0-7159-460b-98f6-df7920f19c4b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.086336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5b4faba9-da1e-4f06-ab45-2c6f98cbabc7 req-c716ded0-7159-460b-98f6-df7920f19c4b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.087647 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1216/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:42 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:43.097332 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5b4faba9-da1e-4f06-ab45-2c6f98cbabc7 req-c716ded0-7159-460b-98f6-df7920f19c4b service nova] Creating event network-vif-plugged:562e321e-2152-40dc-80d1-018f8b1069c5 for instance 7f487a58-e979-4857-bad1-1f2723c5ee8b on n-h1-master-1 Sep 25 01:12:43.101182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:43.101844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] [instance: 18af2166-4a52-4cee-9e7f-12811ff94f11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:43.115678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5b4faba9-da1e-4f06-ab45-2c6f98cbabc7 req-c716ded0-7159-460b-98f6-df7920f19c4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065235 Sep 25 01:12:43.116297 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1186/2402] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:43.120233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.120967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.121548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:43.121794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.122140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:43.123247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.123876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.125025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.138923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.139413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.139847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.140558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.141114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.141446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.145570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] HTTP exception thrown: Instance 18af2166-4a52-4cee-9e7f-12811ff94f11 could not be found. Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Request method failure captured: Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 HTTP/1.1 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qaKrw7XwkAapb6cVDMUmMVMzaAZ2vOdAxDAqM9396esMgJLA-f8J0mq5rfbd2vo9d7MCMzsuLeUGhWKQZRF0a-rdQMUI7PhM8XznnjlJni7ixjAGABAlYu4FcLKsJGX2HDR4seP1y6N8LyM-P5BixDYQ5ZMD2vRR0IEdCjBiGxx4I Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 2767668c8f624a71b787a1334c9091da Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestFqdnHostnames-446942097 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2767668c8f624a71b787a1334c9091da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2767668c8f624a71b787a1334c9091da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2767668c8f624a71b787a1334c9091da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2767668c8f624a71b787a1334c9091da"}]}] Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestFqdnHostnames-446942097 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 2767668c8f624a71b787a1334c9091da Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-446942097 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestFqdnHostnames-446942097-project Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4a8f4f941c504950b4f8217de48f3f58 Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestFqdnHostnames-446942097-project Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 18af2166-4a52-4cee-9e7f-12811ff94f11 could not be found. Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '18af2166-4a52-4cee-9e7f-12811ff94f11'} Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18af2166-4a52-4cee-9e7f-12811ff94f11 could not be found. Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18af2166-4a52-4cee-9e7f-12811ff94f11 could not be found. Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:43.148626 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18af2166-4a52-4cee-9e7f-12811ff94f11 could not be found. Sep 25 01:12:43.153166 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:12:43.154995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Returning 404 to user: Instance 18af2166-4a52-4cee-9e7f-12811ff94f11 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:43.164054 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e311f9d7-1d34-47de-86dc-44e471244824 tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11" status: 404 len: 111 microversion: 2.1 time: 0.067580 Sep 25 01:12:43.165398 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1217/2403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:43 2022] GET /compute/v2.1/servers/18af2166-4a52-4cee-9e7f-12811ff94f11 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:43.177004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6cc6f0b9-3228-4b16-94b0-e236e7cc81da tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] Calling method '.version_select at 0x7f7bf0017f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:43.207899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6cc6f0b9-3228-4b16-94b0-e236e7cc81da tempest-ServersTestFqdnHostnames-446942097 tempest-ServersTestFqdnHostnames-446942097-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152594226" status: 202 len: 0 microversion: 2.1 time: 0.037164 Sep 25 01:12:43.210922 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1218/2404] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:12:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152594226 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:12:43.217995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:12:43.351514 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-454c8d3a-5ff0-4e00-82de-b84da2915e86 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 204 len: 0 microversion: 2.1 time: 0.233746 Sep 25 01:12:43.353062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1187/2405] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:43 2022] DELETE /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:12:43.365812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:43.366915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:43.381687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.382274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:43.382404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.384041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.384811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.385283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.385834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.395320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:43.409217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.411598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.420475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.422754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:43.425925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:43.426515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:43.581085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:43.599216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:43.604534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:43.607306 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-030b1eda-0082-482e-84eb-2ff4c784cf80 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.231321 Sep 25 01:12:43.613193 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1188/2406] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:43 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:43.717029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:43.729190 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b44c19d5-fa11-4748-be0a-67f6ac503993 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1527 microversion: 2.1 time: 0.369950 Sep 25 01:12:43.731612 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1219/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:43 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1527 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:44.038878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:44.039543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:44.052598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:44.053101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:44.053589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:44.061169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:44.061696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:44.062166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:44.251695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:44.268137 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20fc118f-01f2-4f81-aad1-7b32283c4bb6 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1273 microversion: 2.1 time: 0.231135 Sep 25 01:12:44.270004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1189/2408] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:44 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:44.639648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:44.640877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:44.648666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:44.649468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:44.650068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:44.650939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:44.651577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:44.652162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:44.759733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:44.760749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:44.783295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:44.783828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:44.786794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:44.790145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:44.791578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:44.792101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:45.110302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:45.131318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:45.139225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:45.142794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-949e2179-2ff7-4277-ac98-0b7657624be8 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.507010 Sep 25 01:12:45.158176 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1220/2409] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:44 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:45.292213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:45.293077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:45.307129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:45.308044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:45.308497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:45.310624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:45.311102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:45.311540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:45.329492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:45.343287 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-07792aa2-04a5-462b-bca5-b144cb1365ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1527 microversion: 2.1 time: 0.590862 Sep 25 01:12:45.348248 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1190/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:44 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1527 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:45.475134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:45.486939 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbfbac4b-fe2b-4020-8d97-a333e5184bed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1271 microversion: 2.1 time: 0.199103 Sep 25 01:12:45.489734 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1221/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:45 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:46.176679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:46.180487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:46.232074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.236836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.240269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.242613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.246018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.246533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.370389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:46.372763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:46.384603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.392235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.393987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.394916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.395547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.396272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.450164 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:46.468486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:46.492311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:46.494285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:46.495976 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-358d73e9-c499-42fd-b00a-5c5ccd331824 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.329938 Sep 25 01:12:46.497009 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1191/2412] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:46 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:46.513389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:46.514476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:46.536202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.537167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.537805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.538677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.539321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.539910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.768541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:46.776762 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6bc67c4-7b7d-4562-9fe0-54f5d4f248ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1271 microversion: 2.1 time: 0.267193 Sep 25 01:12:46.777721 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1192/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:46 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1271 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:46.804410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2d208de8-4795-4959-ba72-d54835c3c7b8 req-537174d9-d371-4a99-9c67-438dccdd2e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f487a58-e979-4857-bad1-1f2723c5ee8b", "name": "network-vif-unplugged", "status": "completed", "tag": "562e321e-2152-40dc-80d1-018f8b1069c5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:46.824556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d208de8-4795-4959-ba72-d54835c3c7b8 req-537174d9-d371-4a99-9c67-438dccdd2e88 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:46.825361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d208de8-4795-4959-ba72-d54835c3c7b8 req-537174d9-d371-4a99-9c67-438dccdd2e88 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:46.826071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d208de8-4795-4959-ba72-d54835c3c7b8 req-537174d9-d371-4a99-9c67-438dccdd2e88 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:46.840958 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2d208de8-4795-4959-ba72-d54835c3c7b8 req-537174d9-d371-4a99-9c67-438dccdd2e88 service nova] Creating event network-vif-unplugged:562e321e-2152-40dc-80d1-018f8b1069c5 for instance 7f487a58-e979-4857-bad1-1f2723c5ee8b on n-h1-master-1 Sep 25 01:12:46.851203 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2d208de8-4795-4959-ba72-d54835c3c7b8 req-537174d9-d371-4a99-9c67-438dccdd2e88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059990 Sep 25 01:12:46.852398 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1193/2414] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:47.087927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:47.123436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a4c8e1fa-253f-479a-8683-13a11db64362 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1527 microversion: 2.1 time: 0.756813 Sep 25 01:12:47.130557 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1222/2415] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:46 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1527 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:47.529755 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:47.530644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:47.543623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:47.551075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:47.551545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:47.552315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:47.552968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:47.554190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:47.582573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-aa0f4434-18c3-4fcc-9593-509649a3af93 req-c123a8c3-5621-45e5-ac90-873667c91465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f487a58-e979-4857-bad1-1f2723c5ee8b", "name": "network-vif-deleted", "tag": "562e321e-2152-40dc-80d1-018f8b1069c5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:47.630507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-aa0f4434-18c3-4fcc-9593-509649a3af93 req-c123a8c3-5621-45e5-ac90-873667c91465 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:47.631332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-aa0f4434-18c3-4fcc-9593-509649a3af93 req-c123a8c3-5621-45e5-ac90-873667c91465 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:47.631929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-aa0f4434-18c3-4fcc-9593-509649a3af93 req-c123a8c3-5621-45e5-ac90-873667c91465 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:47.682612 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-aa0f4434-18c3-4fcc-9593-509649a3af93 req-c123a8c3-5621-45e5-ac90-873667c91465 service nova] Creating event network-vif-deleted:562e321e-2152-40dc-80d1-018f8b1069c5 for instance 7f487a58-e979-4857-bad1-1f2723c5ee8b on n-h1-master-1 Sep 25 01:12:47.689932 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-aa0f4434-18c3-4fcc-9593-509649a3af93 req-c123a8c3-5621-45e5-ac90-873667c91465 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111684 Sep 25 01:12:47.691260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1223/2416] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:12:47.804383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:47.805232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:47.808420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:47.818404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:47.821373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:47.822150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:47.823311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:47.825240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:47.825929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:47.833060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:47.842636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:47.855252 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dcd610a2-9e77-43ff-b6c2-98dd1dbbf214 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.321077 Sep 25 01:12:47.856459 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1194/2417] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:47 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:48.335170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:48.358460 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a454f2ab-0d39-436e-a1f3-36bfc55df9b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.560574 Sep 25 01:12:48.373284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1224/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:47 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:48.373284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:48.373284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:48.401225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.403503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.404201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.404978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.405511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.405915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.435921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-28046251", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:48.488635 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:48.504087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.512892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.513385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.513902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lazy-loading 'fault' on Instance uuid 7f487a58-e979-4857-bad1-1f2723c5ee8b {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:12:48.568694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:48.569206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:48.569829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:48.570453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:48.571022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:48.587715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.588379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.589134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.590160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.590794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.591238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.612832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Getting quotas for project 934b22e1c24a45cc87d50b89a0540f46. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:48.619932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Getting quotas for user 3949c16e4fde47108c4242a3f99ec5df and project 934b22e1c24a45cc87d50b89a0540f46. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:48.634650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:48.638126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:48.694289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:48.704367 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f136cc63-7e2f-4754-9a5b-660b5c4d2b84 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.343115 Sep 25 01:12:48.707044 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1225/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:48 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:48.733038 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9680ee4c-f29b-44ee-ac68-f980ebf1951e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.868283 Sep 25 01:12:48.741562 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1195/2420] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:12:48.746704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3edbdd7a-68f4-418e-9b20-25cebcb8143b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:48.750030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3edbdd7a-68f4-418e-9b20-25cebcb8143b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:48.888762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:48.889395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:48.908519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.909662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.910209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.915259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:48.915850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:48.917141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:48.937444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3edbdd7a-68f4-418e-9b20-25cebcb8143b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:48.946611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3edbdd7a-68f4-418e-9b20-25cebcb8143b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:48.951855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3edbdd7a-68f4-418e-9b20-25cebcb8143b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:48.971186 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3edbdd7a-68f4-418e-9b20-25cebcb8143b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "PUT /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1357 microversion: 2.75 time: 0.225640 Sep 25 01:12:48.972688 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1226/2421] 10.222.0.16 () {62 vars in 1297 bytes} [Sun Sep 25 01:12:48 2022] PUT /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:48.997577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0790f2e3-f252-446f-9b03-82c583e37cbb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:48.998614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0790f2e3-f252-446f-9b03-82c583e37cbb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:49.163154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.163342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0790f2e3-f252-446f-9b03-82c583e37cbb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.171484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0790f2e3-f252-446f-9b03-82c583e37cbb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.176219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0790f2e3-f252-446f-9b03-82c583e37cbb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.182618 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:49.190562 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0790f2e3-f252-446f-9b03-82c583e37cbb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1357 microversion: 2.75 time: 0.196644 Sep 25 01:12:49.193749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.195318 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1227/2422] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:48 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:49.198922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.202165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1fa4b822-125e-4eed-9661-476bc008f935 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.317495 Sep 25 01:12:49.206435 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1196/2423] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:48 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:49.380941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:49.382070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:49.406311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:49.408482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:49.409141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:49.410130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:49.414347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:49.414927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:49.747649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:49.748534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:49.764288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:49.764897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:49.765441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:49.766343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:49.767796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:49.769351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:49.854682 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b HTTP/1.1 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7f487a58-e979-4857-bad1-1f2723c5ee8b'} Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:49.859135 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:12:49.864584 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:12:49.866556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:49.867455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:49.877185 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-db7c7332-7c4d-4d19-ad67-3f55eda12245 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 404 len: 111 microversion: 2.1 time: 0.143788 Sep 25 01:12:49.889175 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-472a6c81-b507-4a4d-a920-3aa37d4e55e0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.512330 Sep 25 01:12:49.892707 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1228/2424] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:49 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:49.904451 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1197/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:49 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:12:50.101482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-44320250", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:50.209305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] validate_networks() for [('0301c1a5-7c3a-4965-960e-b2cc1b01b7f9', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:12:50.407891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1432243261", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "ba1d1552-2aca-43ad-951c-8b9a18679b6d"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:50.508044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] validate_networks() for [('ba1d1552-2aca-43ad-951c-8b9a18679b6d', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:12:50.739403 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:51.718160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:51.718678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:51.719090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:51.719653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:51.720413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:51.732143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.732915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.733579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.734463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.735409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.736469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.752975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:51.753569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:51.754054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:51.754476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:51.754900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:51.759447 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:51.764358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for project 56773bfde588477493c4d44b0d3e74b9. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:51.770873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.772192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.772861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.774599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Getting quotas for user 1cc384987bb247d88d0027e60d600ed1 and project 56773bfde588477493c4d44b0d3e74b9. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:51.775038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.775857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.776561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.790501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:51.793605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:51.805117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Getting quotas for project 99bc91409fe24f088ae6a51eff7381e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:51.813107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Getting quotas for user 38e3ca9f263a437ab752007ef0588edc and project 99bc91409fe24f088ae6a51eff7381e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:51.831819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:51.835039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:51.868351 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d57f0646-d60f-4a86-b21d-5d2b95685fd5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.771280 Sep 25 01:12:51.870121 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1198/2426] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:12:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:12:51.876907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:51.878169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:51.886434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.887206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.887794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.888716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.889367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.890185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.930239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1d31d380-0c17-4250-a4aa-99f4e3be7b44 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.021408 Sep 25 01:12:51.936301 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1229/2427] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:12:51.952993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:51.956855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:51.979348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.981905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.982481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:51.983332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:51.988438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:51.989688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:52.274337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.277039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.286002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.291992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.294211 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a4ee2958-8f95-4409-aaff-4e1fe3708b79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.356635 Sep 25 01:12:52.299596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.299901 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1230/2428] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:51 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:52.303655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.308107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b393283f-69d9-4c71-985a-9127b44a9288 req-a3a95006-f340-403c-b80e-c658f2887569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affcce72-88eb-458b-ae3b-ebd111f5cfcb", "tag": "3e636bb7-2165-4a12-be1f-c66e562270f6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:52.336990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b393283f-69d9-4c71-985a-9127b44a9288 req-a3a95006-f340-403c-b80e-c658f2887569 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:52.338957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b393283f-69d9-4c71-985a-9127b44a9288 req-a3a95006-f340-403c-b80e-c658f2887569 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:52.341358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b393283f-69d9-4c71-985a-9127b44a9288 req-a3a95006-f340-403c-b80e-c658f2887569 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:52.346673 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0231831-1f50-4d8b-a752-da6bfe504ecb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1415 microversion: 2.75 time: 0.474866 Sep 25 01:12:52.348680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1199/2429] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:51 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1415 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:52.372052 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b393283f-69d9-4c71-985a-9127b44a9288 req-a3a95006-f340-403c-b80e-c658f2887569 service nova] Creating event network-changed:3e636bb7-2165-4a12-be1f-c66e562270f6 for instance affcce72-88eb-458b-ae3b-ebd111f5cfcb on n-h1-master-1 Sep 25 01:12:52.385432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b393283f-69d9-4c71-985a-9127b44a9288 req-a3a95006-f340-403c-b80e-c658f2887569 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082556 Sep 25 01:12:52.387613 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1231/2430] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:52.397033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:52.399191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:52.406310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fda05fe2-4c77-4563-9f3d-627e7d78e64b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:52.413277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fda05fe2-4c77-4563-9f3d-627e7d78e64b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:52.436108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:52.439889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:52.440553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:52.442684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:52.443602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:52.444195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:52.817807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fda05fe2-4c77-4563-9f3d-627e7d78e64b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:52.827841 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fda05fe2-4c77-4563-9f3d-627e7d78e64b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1223 microversion: 2.1 time: 0.437619 Sep 25 01:12:52.842164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1232/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:52 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1223 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:52.850842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7000bdb0-4073-49f5-8945-6c3af5245c7a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:52.851967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7000bdb0-4073-49f5-8945-6c3af5245c7a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:53.131646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7000bdb0-4073-49f5-8945-6c3af5245c7a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.140609 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7000bdb0-4073-49f5-8945-6c3af5245c7a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1216 microversion: 2.1 time: 0.297026 Sep 25 01:12:53.141597 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1233/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:52 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:53.196535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.211341 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0776009b-ae6c-44b0-9acc-fefb43be313b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.858314 Sep 25 01:12:53.211950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1200/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:52 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:53.331282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:53.332006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:53.348792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:53.348898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:53.350621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:53.360148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:53.361448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:53.361966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:53.379011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:53.379888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:53.391729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:53.391905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:53.392348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:53.393564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:53.401721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:53.408906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:53.568085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.584168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.588299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.593092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a00dfef2-e5dc-4f74-aadf-2bbb99d0dddc tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.267371 Sep 25 01:12:53.593749 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1234/2434] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:53 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:53.664037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.687570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.689719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:53.696350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eb176db4-c982-44f4-aac1-7ae965ecfc5e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1415 microversion: 2.75 time: 0.321565 Sep 25 01:12:53.697368 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1201/2435] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:53 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1415 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:53.853799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:53.854490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:53.863181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:53.863684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:53.864132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:53.866752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:53.868515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:53.869336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:53.998904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:54.008260 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eafeecd5-a1dc-479b-9548-9f40695de532 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1275 microversion: 2.1 time: 0.158386 Sep 25 01:12:54.009470 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1235/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:53 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:54.170207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:54.170355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:54.185216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.186283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.189316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.192007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.194161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.196831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.243173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:54.243846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:54.255040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.255542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.255977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.256684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.257484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.258084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.569352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:54.600453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-685386f0-c92b-4480-9c9a-085054b1dad2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1212 microversion: 2.1 time: 0.433243 Sep 25 01:12:54.604368 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1202/2437] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:54 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1212 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:54.626487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:54.627525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:54.648401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.648912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.649358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.650122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.650579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.651096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.869130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:54.876788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:54.894135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:54.901227 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90568dfd-37e7-46b3-ba7f-41630323ae44 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.661627 Sep 25 01:12:54.906255 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1236/2438] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:54 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:54.915155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:54.916891 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48d4ff76-ab16-4b2f-a4fc-7692b83745ec tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.296207 Sep 25 01:12:54.917695 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1203/2439] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:54 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:54.918674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:54.919407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:54.928298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.929055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.929616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:54.930586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:54.931342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:54.931969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.034495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:55.035323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:55.041497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.041997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.042648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.043372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.043835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.044271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.545663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:55.555669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:55.557743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:55.564205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-560ae033-65a6-49db-922d-4f2cc0a70915 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1436 microversion: 2.75 time: 0.655301 Sep 25 01:12:55.564800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1237/2440] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:54 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1436 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:55.592910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:55.598074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:55.606904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.607771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.608445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.610066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.611367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.612029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.632631 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:55.646050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-53987244-0f12-470c-9cc7-41d22ccf56a1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1281 microversion: 2.1 time: 0.615954 Sep 25 01:12:55.646758 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1204/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:55 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1281 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:55.665751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:55.670172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:55.685465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.685955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.695739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.696921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.700596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.701362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.797010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:55.798137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:55.798636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:55.799148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:55.799574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:55.885423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:55.902294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:55.908200 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83125e4f-6538-4412-93ee-3fbd11a75c8f tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1274 microversion: 2.1 time: 0.260175 Sep 25 01:12:55.909023 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1205/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:55 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:55.910910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.913644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.914098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.914819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.915275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.917907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.930376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:55.931010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:55.942960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.943493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.946214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:55.948301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:55.952959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:55.955683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.124789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.139855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.142320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.151853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d19334e-99f8-41b0-a200-982a4e7ca02b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "POST /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7/action" status: 202 len: 1493 microversion: 2.75 time: 0.563427 Sep 25 01:12:56.153709 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1238/2443] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:12:55 2022] POST /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7/action => generated 1493 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 25 01:12:56.163640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:56.165128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:56.174297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.175138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.175816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.176908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.177707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.179124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.358310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.377983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.380072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.382365 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f3102e0-09f0-4d7a-9f5e-9c1a8a6848f5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.226989 Sep 25 01:12:56.383260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1239/2444] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:56 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:56.399909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:56.401665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:56.411376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.419218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.419986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.422377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.423424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.424453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.490989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.506288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67b2c05a-e019-4384-8c33-0766ba14c006 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.580172 Sep 25 01:12:56.506903 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1206/2445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:55 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:56.589321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.602827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.609645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.626120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-09b5e8d3-d998-4831-8467-aacbb9e388ef tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.229576 Sep 25 01:12:56.628775 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1240/2446] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:56 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:56.676691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:56.678335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:56.688670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.690874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.691865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.693055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.695055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.699410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.843599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:56.858288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6697e913-6f3a-4d66-af8e-957465612be8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1281 microversion: 2.1 time: 0.191947 Sep 25 01:12:56.866920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1207/2447] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:56 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1281 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:56.934600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:56.936100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:56.946829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.948421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.950212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:56.951159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:56.952086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:56.952674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.059340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.068065 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4a14e27-bb90-41e0-9547-5e4c39c818a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1274 microversion: 2.1 time: 0.137930 Sep 25 01:12:57.068937 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1241/2448] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:56 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:57.418640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:57.419312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:57.428879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.429388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.434028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.435095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.435732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.438322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.530815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:57.531547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:57.546714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.549289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.556328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.557588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.558234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.558769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.588061 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:57.631240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.648589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.650818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.652741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8faa45dd-60f1-4953-8d71-c9df556ae3e1 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.244762 Sep 25 01:12:57.654252 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1208/2449] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:57 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:57.686277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:57.690684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:57.700025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.700771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.701484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.703566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.704991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.706309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.901934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.916823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.919487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:57.926362 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e18e060e-6c54-483c-a73c-2c3310fa9a61 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.269176 Sep 25 01:12:57.942558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1209/2450] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:57 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:57.955127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:57.956231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:57.964098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.965076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.966194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:57.967186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:57.968135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:57.969022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.247914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:58.258308 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-55417c30-2e14-4a6b-9fa7-e531fe5a1e2a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.731551 Sep 25 01:12:58.259168 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1242/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:57 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:12:58.264005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:58.264734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:58.272022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.272939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.274067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.275990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.276782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.277499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.403629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:58.412725 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b96130c-a406-4293-855a-feb796912b6f tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.468162 Sep 25 01:12:58.431319 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1210/2452] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:57 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:58.568394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-47799224-4d74-4686-b987-8f5e0f0683aa req-15b97505-1569-485d-b990-4d33575abdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affcce72-88eb-458b-ae3b-ebd111f5cfcb", "name": "network-vif-plugged", "status": "completed", "tag": "3e636bb7-2165-4a12-be1f-c66e562270f6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:58.597646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47799224-4d74-4686-b987-8f5e0f0683aa req-15b97505-1569-485d-b990-4d33575abdaa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.598239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47799224-4d74-4686-b987-8f5e0f0683aa req-15b97505-1569-485d-b990-4d33575abdaa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.598856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47799224-4d74-4686-b987-8f5e0f0683aa req-15b97505-1569-485d-b990-4d33575abdaa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.620048 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-47799224-4d74-4686-b987-8f5e0f0683aa req-15b97505-1569-485d-b990-4d33575abdaa service nova] Creating event network-vif-plugged:3e636bb7-2165-4a12-be1f-c66e562270f6 for instance affcce72-88eb-458b-ae3b-ebd111f5cfcb on n-h1-master-1 Sep 25 01:12:58.629921 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-47799224-4d74-4686-b987-8f5e0f0683aa req-15b97505-1569-485d-b990-4d33575abdaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068804 Sep 25 01:12:58.630980 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1211/2453] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:58.670881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:58.681719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:58.683739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:58.694442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.696061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.696829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.697609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.698249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.698742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40262165-1c13-4194-994f-2aac0fee8c98 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.438210 Sep 25 01:12:58.699192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.702114 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1243/2454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:58 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:58.827174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:58.841998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:58.845396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:58.848297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-27bbb0dd-5598-4209-95c4-fcc35785c632 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1408 microversion: 2.54 time: 0.171825 Sep 25 01:12:58.849532 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1212/2455] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:58 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:12:58.963822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:58.964542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:58.979002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.981981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.982834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:58.984409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:58.985975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:58.990234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:59.285168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:59.285847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:59.303293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:59.303805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:59.304253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:59.304982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:59.310306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:59.310909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:59.596318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:59.608694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:59.614527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:59.627051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e4fc7b1-0855-4264-b524-eb9b91a8e222 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.668610 Sep 25 01:12:59.645570 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1244/2456] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:12:58 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:12:59.650829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:59.652202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:59.662792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:59.667714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:59.670703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:59.673974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:59.675264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:59.677536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.109867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.122175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-278b2f2c-0532-4a22-8762-20dc3c1d4467 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1313 microversion: 2.1 time: 0.841748 Sep 25 01:13:00.148807 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1213/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:59 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1313 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:00.156578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:00.157738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:00.167514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.168303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.169011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.169833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.170639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.171306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.305280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.317178 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bdde6c2-efda-4930-890f-957eb0e2d7f5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.670119 Sep 25 01:13:00.317757 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1245/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:59 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:00.332012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-45a2087c-31f2-4324-9774-a565efaeabe3 req-8f65fd60-a79f-4c24-b794-de323e86dcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2304809-e1fd-4952-be6e-f6c794d10772", "tag": "c82f2c1e-afd7-4506-a99a-97fcb099444b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:00.365352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-45a2087c-31f2-4324-9774-a565efaeabe3 req-8f65fd60-a79f-4c24-b794-de323e86dcb0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.366095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-45a2087c-31f2-4324-9774-a565efaeabe3 req-8f65fd60-a79f-4c24-b794-de323e86dcb0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.366736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-45a2087c-31f2-4324-9774-a565efaeabe3 req-8f65fd60-a79f-4c24-b794-de323e86dcb0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.387177 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-45a2087c-31f2-4324-9774-a565efaeabe3 req-8f65fd60-a79f-4c24-b794-de323e86dcb0 service nova] Creating event network-changed:c82f2c1e-afd7-4506-a99a-97fcb099444b for instance e2304809-e1fd-4952-be6e-f6c794d10772 on n-h2-master-1 Sep 25 01:13:00.394037 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-45a2087c-31f2-4324-9774-a565efaeabe3 req-8f65fd60-a79f-4c24-b794-de323e86dcb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073721 Sep 25 01:13:00.394860 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1246/2459] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:00.400627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:00.402036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:00.410099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.410826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.411431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.413356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.415234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.415925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.560130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.576750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.578890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.581333 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a8824036-4b48-48e6-9fea-12ec2376d3e5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1414 microversion: 2.54 time: 0.185024 Sep 25 01:13:00.582145 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1247/2460] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:00 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1414 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:00.589707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.606834 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-214910cd-b7a6-42eb-871c-592339a75c23 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.455304 Sep 25 01:13:00.611350 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1214/2461] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:00 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:00.662825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:00.663762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:00.678184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.679518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.680182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.681100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:00.681929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:00.682568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:00.819880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.837801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.840233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:00.849714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f311a60a-7c79-444c-b92c-d9f6a43eca4e tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.195616 Sep 25 01:13:00.865437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1248/2462] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:00 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:01.153674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:01.155068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:01.164018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.168041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.171731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.173320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.176492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.178360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.225807 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:01.340818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:01.341781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:01.358927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.359753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.360408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.361208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.361902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.362337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.473331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:01.497904 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a26bb084-5605-4492-b746-351d1fdf20c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1462 microversion: 2.1 time: 0.348023 Sep 25 01:13:01.498674 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1215/2463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:01 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1462 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:01.671398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:01.685441 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17671111-47bd-4367-a8ca-f142e8e2355b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.348677 Sep 25 01:13:01.691752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1249/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:01 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:01.703420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:01.703879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:01.719826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.722156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.724148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.725918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.727132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.727752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.748283 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:01.786202 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=12 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:01.793504 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:01.840677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:01.861516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:01.864685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:01.866562 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d58000b-fa47-41a6-9ef3-1c6550820301 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1414 microversion: 2.54 time: 0.173772 Sep 25 01:13:01.867153 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1250/2465] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:01 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:01.874995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:01.882970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:01.896249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.898325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.900131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.903329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.905730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.906187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.958226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:01.958958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:01.971201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.972725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.973263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:01.974979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:01.976815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:01.977351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.469040 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:02.480843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b317f8c-ba74-4e73-8acc-d6b79be5fa62 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.612452 Sep 25 01:13:02.482190 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1251/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:01 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:02.500545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:02.501908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:02.522583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.527949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.528547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.529659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.531153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.534736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.673313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:02.688398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:02.697861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:02.709723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-499ffe35-24ba-4624-8e21-50dab443e145 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.223481 Sep 25 01:13:02.726006 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1252/2467] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:02 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:02.741667 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c521dff6-db5e-404d-bb41-4d60e3f2a8a0 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1613 microversion: 2.1 time: 1.219785 Sep 25 01:13:02.744292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9b4bc9b6-cfff-46fc-9291-aacae89adf36 req-14bb4c1d-6ad8-4af6-8172-a8e7d82c293a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373dbe21-3de6-46db-b8c0-7ed93a3619f3", "tag": "34688680-1299-4e28-a06a-1e699af803ba"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:02.754522 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1216/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:01 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1613 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:02.771066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9b4bc9b6-cfff-46fc-9291-aacae89adf36 req-14bb4c1d-6ad8-4af6-8172-a8e7d82c293a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.771943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9b4bc9b6-cfff-46fc-9291-aacae89adf36 req-14bb4c1d-6ad8-4af6-8172-a8e7d82c293a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.772668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9b4bc9b6-cfff-46fc-9291-aacae89adf36 req-14bb4c1d-6ad8-4af6-8172-a8e7d82c293a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.776252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:02.777179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:02.785331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.786161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.787440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.790925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.791656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.792497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.820338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9b4bc9b6-cfff-46fc-9291-aacae89adf36 req-14bb4c1d-6ad8-4af6-8172-a8e7d82c293a service nova] Creating event network-changed:34688680-1299-4e28-a06a-1e699af803ba for instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 on n-h2-master-1 Sep 25 01:13:02.830837 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9b4bc9b6-cfff-46fc-9291-aacae89adf36 req-14bb4c1d-6ad8-4af6-8172-a8e7d82c293a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103230 Sep 25 01:13:02.831462 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1253/2469] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:02.846197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:02.846874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:02.863456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.863956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.864406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.865190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:02.865713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:02.866150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:02.996808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '231418d4fb2246adb38aaeefb031655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7569ed03c4fc4fd5a6e987cf82ea14fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:02.997470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] flavor_id is None. Assuming migration. {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 25 01:13:02.997951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:13:03.118727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:03.127782 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7ac522d-f706-40fa-9e11-5f4b8fda45d6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.357128 Sep 25 01:13:03.128387 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1217/2470] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:02 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:03.133158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:03.142353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:03.143176 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=26 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:03.152457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:03.152957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:03.153423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:03.159045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:03.161303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:03.162962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:03.520004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:03.536008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:03.542649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:03.543956 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d5130ea-3331-4488-b7b5-eca99a8ca5a5 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1414 microversion: 2.54 time: 0.414593 Sep 25 01:13:03.546638 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1218/2471] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:03 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1414 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:03.558327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:03.563889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:03.576422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:03.580619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:03.583094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:03.584223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:03.584909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:03.587620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:03.728240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b061ea77-f9fb-47f1-bb0e-4e5a8757ba96 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb/action" status: 202 len: 0 microversion: 2.1 time: 0.889792 Sep 25 01:13:03.730231 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1254/2472] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:13:02 2022] POST /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:13:03.749781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:03.751180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:03.763871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:03.764616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:03.765909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:03.768696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:03.772201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:03.772842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.265388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.286373 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-da2a62e8-c339-4669-a604-a74608c88ca2 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.737864 Sep 25 01:13:04.289182 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1219/2473] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:03 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:04.302888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:04.305550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:04.324880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:04.325987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:04.329975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.335152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:04.338431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:04.343865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.463500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.486090 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9daa027f-49b1-4c06-82c6-c95054206246 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1471 microversion: 2.1 time: 0.750860 Sep 25 01:13:04.505373 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1255/2474] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:03 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1471 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:04.522675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:04.528801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:04.543123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:04.546758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:04.548394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.552082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:04.552856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:04.553671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.630108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.644203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.658042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.680677 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23996168-057c-40b7-9e2a-12f9843738f0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.389146 Sep 25 01:13:04.681790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1220/2475] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:04 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:04.715461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:04.715461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:04.715817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:04.716323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:04.716773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.717511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:04.718083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:04.718630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:04.864652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.884589 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-87b161dd-2471-4677-83a1-4c418088ebb8 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.377773 Sep 25 01:13:04.894364 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1256/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:04 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:04.904172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.913774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.915500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:04.917017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c52f03ab-c794-46a2-8582-f8c431d103c0 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1399 microversion: 2.54 time: 0.221042 Sep 25 01:13:04.917875 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1221/2477] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:04 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1399 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:04.944470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-086ad668-eb59-46d1-b97c-86ed5c1d572e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '.version_select at 0x7f7bf40ca1f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:04.978768 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-086ad668-eb59-46d1-b97c-86ed5c1d572e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-369564019" status: 204 len: 0 microversion: 2.54 time: 0.038134 Sep 25 01:13:04.979646 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1257/2478] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-369564019 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:13:04.997105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:04.998268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:05.009097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.010296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.011086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.011833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.012286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.012908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.057330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:13:05.106101 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:05.146325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e49e7d16-2f7f-41a0-b080-254145c9057e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Action: 'create', calling method: .version_select at 0x7f7beb903940>, body: {"keypair": {"name": "tempest-keypair-606197051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpfdqTiaYmoGMDQ7tWtHjdmdkTL9X6CdZVmZ+8yJE+0Lv5wR5Xwtzsit6KKMgt5g+xVoikt+fKDm1rMV14D03DZkcNoWCvCfI84Wc6J8vOYcc1qZddrGV/WaIz+QdLDww=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:05.165274 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:05.179572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-56d34e88-70d5-4f84-97dc-9b8e170ef59e tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 204 len: 0 microversion: 2.54 time: 0.189725 Sep 25 01:13:05.180305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e49e7d16-2f7f-41a0-b080-254145c9057e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Getting quotas for project 51f36d0acd3e457cbb8fc3d10b486ad1. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:05.183475 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1258/2479] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:13:04 2022] DELETE /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:13:05.193781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:05.195098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:05.195818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e49e7d16-2f7f-41a0-b080-254145c9057e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Getting quotas for user 4c25e53535f348718d8bf85e020ec15d and project 51f36d0acd3e457cbb8fc3d10b486ad1. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:05.204642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.205300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.205926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.206735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.207305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.207791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.216643 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:05.230218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e49e7d16-2f7f-41a0-b080-254145c9057e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.257383 Sep 25 01:13:05.231993 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1222/2480] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:05.310597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.316429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:05.317045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:05.323008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.325983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.327740 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb864c92-74f6-48a2-ace0-4f19763bdeac tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1405 microversion: 2.54 time: 0.141016 Sep 25 01:13:05.328744 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1259/2481] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:05 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:13:05.330355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.331268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.332565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.333482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.334346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.334908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.527616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:05.528346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:05.545282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.546424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.546424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.547274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.557144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.558518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.712436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.726874 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec5315b3-0ac9-4bcb-8428-0beba98e5379 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.414251 Sep 25 01:13:05.729337 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1223/2482] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:05 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:05.742720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:05.758764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:05.774544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.775370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.776182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.779204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.779878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.782712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.844649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.853338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a70dee30-1b6f-4879-b07c-eaa8cf65b9ff tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1471 microversion: 2.1 time: 0.344844 Sep 25 01:13:05.864099 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1260/2483] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:05 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:05.919492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:05.920187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:05.928959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.929492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.929946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.936203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:05.937074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:05.937265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:05.946655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.989240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:05.996558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:06.026161 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0495a3ab-8be5-4bf5-b19f-21d091e2f31f tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.293061 Sep 25 01:13:06.028499 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1224/2484] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:05 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:06.119701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:06.130586 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-759abefb-0ee9-4fa4-ba1a-24a166ad6854 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.214915 Sep 25 01:13:06.133465 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1261/2485] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:05 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:06.356700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:06.357456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:06.377608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:06.378473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:06.379158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:06.380290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:06.380755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:06.381188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:06.503348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:06.512433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:06.513960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:06.515210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33205400-7e34-4a22-aaab-cbda7f16c97a tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1405 microversion: 2.54 time: 0.163020 Sep 25 01:13:06.515823 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1225/2486] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:06 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:06.752570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:06.753878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:06.761147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:06.761663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:06.762111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:06.763016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:06.763482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:06.763912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:06.887331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:06.887977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:06.896649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:06.897623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:06.898249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:06.899145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:06.899610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:06.900038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:07.708225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:07.725041 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cfb84467-ba00-448f-9d2a-02fab59a54dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.976794 Sep 25 01:13:07.726475 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1262/2487] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:06 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:07.733518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:07.734721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:07.745314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:07.746078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:07.746884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:07.747869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:07.748734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:07.749780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:07.839464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:07.881309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1cac8528-4945-476c-9b4f-38fa45828588 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1471 microversion: 2.1 time: 0.998004 Sep 25 01:13:07.885008 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1226/2488] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:06 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1471 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:07.904113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:07.908115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:07.926427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:07.926990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:07.927454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:07.928211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:07.928678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:07.929109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:07.936524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:07.952069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:07.954510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:07.969777 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc82982f-8b6e-4c11-aa9d-da57908ed758 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.241269 Sep 25 01:13:07.972794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1263/2489] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:07 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:07.977663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:07.978286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:07.997526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:07.998037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:07.998487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:07.999223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:07.999661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:08.005973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:08.132694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:08.146379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:08.155269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:08.156665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e7e548f-4058-4316-a404-8d1e7229fb79 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1405 microversion: 2.54 time: 0.182849 Sep 25 01:13:08.157365 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1264/2490] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:07 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:08.295174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:08.308175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d33d4ff6-05bd-4de0-b76d-53f5a46d5240 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.419517 Sep 25 01:13:08.310548 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1227/2491] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:07 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:08.606234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-538898573", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "55437cb5-e9a5-4bac-a954-95c58ed596a6"}], "security_groups": [{"name": "tempest-securitygroup--1824350748"}], "key_name": "tempest-keypair-606197051", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:08.746153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] validate_networks() for [('55437cb5-e9a5-4bac-a954-95c58ed596a6', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:13:08.749325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:08.749838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:08.765132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:08.765707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:08.771893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:08.774643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:08.775147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:08.775631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.058743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.068755 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-419ae19f-f992-4627-9d0b-34518f233f65 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.323755 Sep 25 01:13:09.072833 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1228/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:08 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:09.086107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:09.087272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:09.099105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.099615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.100104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.100774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.101258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.108201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.375564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.393680 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a645ce65-6236-4a0b-ac98-829453c5f10f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.318548 Sep 25 01:13:09.394355 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1229/2493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:09 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:09.409113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:09.416483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:09.438485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.439608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.440458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.441713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.442461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.443060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.537829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Getting quotas for project 51f36d0acd3e457cbb8fc3d10b486ad1. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:09.554069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Getting quotas for user 4c25e53535f348718d8bf85e020ec15d and project 51f36d0acd3e457cbb8fc3d10b486ad1. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:09.584134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:13:09.584845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:13:09.585836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:13:09.586469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:13:09.587660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:13:09.598181 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.604280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.604782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.605224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.606046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.606503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.606930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.608050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.609595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.623703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d468217-12cb-4831-9962-8619430140c8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.226022 Sep 25 01:13:09.627026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1230/2494] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:09 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:09.633645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:09.634532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:09.637293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Getting quotas for project 51f36d0acd3e457cbb8fc3d10b486ad1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:09.645110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Getting quotas for user 4c25e53535f348718d8bf85e020ec15d and project 51f36d0acd3e457cbb8fc3d10b486ad1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:09.653050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.653571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.660702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:13:09.661897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.662660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.663137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.663570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.665665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:13:09.730521 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1e2aaf2-73c2-4639-bfa1-7922f2c0a556 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.128925 Sep 25 01:13:09.732407 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1265/2495] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:13:08 2022] POST /compute/v2.1/servers => generated 407 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:13:09.739710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:09.742629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:09.753318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.754851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.755501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.757455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.758120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.759527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.819795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.844800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.847279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.848962 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60047721-3a25-4719-9a94-f948a272d23f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1405 microversion: 2.54 time: 0.220714 Sep 25 01:13:09.850490 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1231/2496] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:09 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:09.858642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2b998f3-b5ce-44c4-8168-5c295acb7fc2 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:09.866823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2b998f3-b5ce-44c4-8168-5c295acb7fc2 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:09.979276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2b998f3-b5ce-44c4-8168-5c295acb7fc2 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.984841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.987479 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2b998f3-b5ce-44c4-8168-5c295acb7fc2 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1268 microversion: 2.1 time: 0.134777 Sep 25 01:13:09.988070 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1232/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:09 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1268 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:09.994359 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2356a2af-2427-4ea2-b3cd-08169dfc42c5 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.260668 Sep 25 01:13:10.009927 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1266/2498] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:09 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:10.096825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:10.097507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:10.107616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.110331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.110964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.111856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.113294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.113964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.389897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.400511 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bccd8dfd-b463-4fe3-84c5-5e74a19d1ee5 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.308043 Sep 25 01:13:10.414002 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1233/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:10 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:10.425614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:10.426348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:10.438697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.441053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.441737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.442760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.444392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.446791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.617621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.626420 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c78f023-b675-4ab4-a651-a43cd76a2455 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.205937 Sep 25 01:13:10.629624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1267/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:10 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:10.656758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:10.657727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:10.664662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.665145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.665605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.666531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.667198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.667845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.675642 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:10.743483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.754046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.755530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.761600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0aaf8396-dbaa-4c1e-b778-9edd4d17b2b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.109370 Sep 25 01:13:10.762425 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1234/2501] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:10 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:10.878774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:10.879391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:10.886470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.886941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.887378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.888076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.888530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.888954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.961323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.971486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.973748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:10.975323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d2d83b6-dac7-41be-b0a4-90713ab04977 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1405 microversion: 2.54 time: 0.100707 Sep 25 01:13:10.975928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1268/2502] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:10 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:11.010801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:11.011687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:11.018403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:11.019265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.019427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:11.020081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.020687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.021829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.022555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.023157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.025363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.025932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.026373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.027089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.027556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.028382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.106819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:11.116002 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd0f90c6-ca2f-492e-996a-8a6d8b413cb8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1320 microversion: 2.1 time: 0.109085 Sep 25 01:13:11.130586 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1235/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:11 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1320 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:11.373812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:11.388256 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-857c0d17-dc63-4839-b179-0e81cbd91bae tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.374865 Sep 25 01:13:11.389596 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1269/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:11 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:11.432611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:11.435346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:11.448171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.450100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.450813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.452160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.452859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.468753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.660937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:11.662263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:11.673032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.674679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.675409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.676373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.677054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.677739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.904199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:11.914416 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c0ce7aa-5d9d-4866-b9fd-9197c7e09a48 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.492092 Sep 25 01:13:11.915501 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1236/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:11 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:11.920532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:11.921235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:11.932391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.933759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.934437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.935648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:11.936887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:11.937675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.102210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.113369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.116551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.126913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c12e8fc7-a7a7-43d5-b891-013aeb88f999 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.209978 Sep 25 01:13:12.129422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1237/2506] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:11 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:12.137437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:12.138916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:12.147620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.149860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.150659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.152497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.153962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.154674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.258151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.274206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f221d2af-5487-4a65-8bd1-9bb6c16dbc45 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.625932 Sep 25 01:13:12.285758 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1270/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:11 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:12.285871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.285871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.285871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.286262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lazy-loading 'fault' on Instance uuid ddc1b0c5-8efe-4634-8e4b-f1e615634071 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:12.293252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:12.293927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:12.307155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.307920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.308551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.309473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.310284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.310958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.350504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.367565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.370575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1bc0ffad726490cb6501becbc822449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52871d02d6f348c78767e9f62627b539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.371803 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62a77a83-9f68-48ba-a1e8-3356b3aa2c00 tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 200 len: 1410 microversion: 2.54 time: 0.240638 Sep 25 01:13:12.373200 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1238/2508] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:12 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 1410 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:12.396904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c3bc80ff-5fb4-4702-b128-ac6ff7f9b5e7 req-54beed10-fa0b-46b4-b648-6bcfd7896a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2304809-e1fd-4952-be6e-f6c794d10772", "name": "network-vif-plugged", "status": "completed", "tag": "c82f2c1e-afd7-4506-a99a-97fcb099444b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:12.412342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c3bc80ff-5fb4-4702-b128-ac6ff7f9b5e7 req-54beed10-fa0b-46b4-b648-6bcfd7896a01 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.413134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c3bc80ff-5fb4-4702-b128-ac6ff7f9b5e7 req-54beed10-fa0b-46b4-b648-6bcfd7896a01 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.414321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c3bc80ff-5fb4-4702-b128-ac6ff7f9b5e7 req-54beed10-fa0b-46b4-b648-6bcfd7896a01 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.419232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.429687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d08271f-ebae-4da9-bc3e-91114887a760 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1326 microversion: 2.1 time: 0.149020 Sep 25 01:13:12.429970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c3bc80ff-5fb4-4702-b128-ac6ff7f9b5e7 req-54beed10-fa0b-46b4-b648-6bcfd7896a01 service nova] Creating event network-vif-plugged:c82f2c1e-afd7-4506-a99a-97fcb099444b for instance e2304809-e1fd-4952-be6e-f6c794d10772 on n-h2-master-1 Sep 25 01:13:12.430279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1271/2509] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:12 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:12.435858 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c3bc80ff-5fb4-4702-b128-ac6ff7f9b5e7 req-54beed10-fa0b-46b4-b648-6bcfd7896a01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061065 Sep 25 01:13:12.436981 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1239/2510] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:12.437379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:12.438057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:12.446498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.447051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.447502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.448210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.448668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.449091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.788732 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.799242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e06bc9b-0ddf-4e6e-bc34-6504bda9557e tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.367893 Sep 25 01:13:12.799840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1272/2511] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:12 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:12.944338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:12.946541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:12.954924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.955409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.955848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.956608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.957072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.957526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.132381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.150732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2792fc93-d418-4391-b39d-f9b1a0ba5e0c tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.212540 Sep 25 01:13:13.151752 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1240/2512] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:12 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:13.159188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:13.160084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:13.172870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.174049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.174501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.175663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.176300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.176900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.253935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.264326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.266666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.273827 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-66baa1bb-2c89-441b-b392-b656eb1f46c2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.119709 Sep 25 01:13:13.274425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1273/2513] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:13 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:13.302106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:13.303273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:13.309607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.310304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.310974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.311699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.312335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.313474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.405647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:13.406756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] [instance: ddc1b0c5-8efe-4634-8e4b-f1e615634071] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:13.419523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.420389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.421119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.422345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.422984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.423607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.439936 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] HTTP exception thrown: Instance ddc1b0c5-8efe-4634-8e4b-f1e615634071 could not be found. Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Request method failure captured: Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 HTTP/1.1 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6r1-OWvM2HRespoeLqHtpqUzjabL437yfLumfTPr70Jgrtd4d6JSj3b2BRpL0ble92G2BFr7uKyK_WIenS3p8RMf8vCua0QJmFxlHer_3ZOaFG9_JyKGSS6BzV9DQlLmMc9nxRPuPVCsWvPReJYSI5PuBAQusebELFfs9gVidEMrKY Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.54 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 52871d02d6f348c78767e9f62627b539 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerShowV254Test-1909637260 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/52871d02d6f348c78767e9f62627b539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52871d02d6f348c78767e9f62627b539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52871d02d6f348c78767e9f62627b539"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_52871d02d6f348c78767e9f62627b539"}]}] Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerShowV254Test-1909637260 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 52871d02d6f348c78767e9f62627b539 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerShowV254Test-1909637260 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerShowV254Test-1909637260-project Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b1bc0ffad726490cb6501becbc822449 Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerShowV254Test-1909637260-project Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ddc1b0c5-8efe-4634-8e4b-f1e615634071 could not be found. Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ddc1b0c5-8efe-4634-8e4b-f1e615634071'} Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc1b0c5-8efe-4634-8e4b-f1e615634071 could not be found. Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc1b0c5-8efe-4634-8e4b-f1e615634071 could not be found. Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:13.441938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc1b0c5-8efe-4634-8e4b-f1e615634071 could not be found. Sep 25 01:13:13.448612 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:13.450722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] Returning 404 to user: Instance ddc1b0c5-8efe-4634-8e4b-f1e615634071 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:13.451775 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4565102-b433-46f3-8ec2-6428804a608f tempest-ServerShowV254Test-1909637260 tempest-ServerShowV254Test-1909637260-project] 10.222.0.16 "GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071" status: 404 len: 111 microversion: 2.54 time: 0.052601 Sep 25 01:13:13.456841 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1274/2514] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:13 2022] GET /compute/v2.1/servers/ddc1b0c5-8efe-4634-8e4b-f1e615634071 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:13:13.464239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:13.465244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:13.473954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.474628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.475226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.476094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.477121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.477603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.544011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.565961 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a15ea148-2768-4860-b9b1-321b187b6c76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.267958 Sep 25 01:13:13.569061 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1241/2515] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:13 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:13.714851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.727909 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a67981ab-1396-46d8-abf2-cf106bc126f6 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.269634 Sep 25 01:13:13.728689 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1275/2516] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:13 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:13.824273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:13.827758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:13.842159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.844911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.846465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.847481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.848161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.849183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.873886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ef933224-f70a-4c13-abc7-fc0b30e5d46a req-eb3c091c-4c8a-4801-89e1-5d5aa5d095ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc784286-e6a9-44ff-b7b3-9a6781600174", "tag": "f073cdf7-498d-472a-9d2a-60c83b7759d3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:13.888922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ef933224-f70a-4c13-abc7-fc0b30e5d46a req-eb3c091c-4c8a-4801-89e1-5d5aa5d095ea service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.889674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ef933224-f70a-4c13-abc7-fc0b30e5d46a req-eb3c091c-4c8a-4801-89e1-5d5aa5d095ea service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.890298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ef933224-f70a-4c13-abc7-fc0b30e5d46a req-eb3c091c-4c8a-4801-89e1-5d5aa5d095ea service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.895133 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:13.904866 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ef933224-f70a-4c13-abc7-fc0b30e5d46a req-eb3c091c-4c8a-4801-89e1-5d5aa5d095ea service nova] Creating event network-changed:f073cdf7-498d-472a-9d2a-60c83b7759d3 for instance bc784286-e6a9-44ff-b7b3-9a6781600174 on n-h1-master-1 Sep 25 01:13:13.910074 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ef933224-f70a-4c13-abc7-fc0b30e5d46a req-eb3c091c-4c8a-4801-89e1-5d5aa5d095ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039804 Sep 25 01:13:13.910903 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1276/2517] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:13:14.088171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:14.107494 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df80d5e7-2aca-4692-8d11-22d4cfdd40aa tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1323 microversion: 2.1 time: 0.287835 Sep 25 01:13:14.122833 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1242/2518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:13 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:14.177263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:14.178001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:14.184482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.184974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.185690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.186607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.187298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.188629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.304916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:14.306248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:14.316490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.317456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.318124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.319074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.319861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.320494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.443431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:14.454751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:14.457513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:14.465472 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7e94b2aa-397c-4577-be8b-8c604d219d08 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.166337 Sep 25 01:13:14.466804 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1243/2519] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:14 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:14.504614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8da68cd7-d652-4892-8424-71acf74b45f3 req-cb5d308a-65d0-4ee4-8722-494b7351aad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373dbe21-3de6-46db-b8c0-7ed93a3619f3", "name": "network-vif-plugged", "status": "completed", "tag": "34688680-1299-4e28-a06a-1e699af803ba"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:14.518191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8da68cd7-d652-4892-8424-71acf74b45f3 req-cb5d308a-65d0-4ee4-8722-494b7351aad8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.518982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8da68cd7-d652-4892-8424-71acf74b45f3 req-cb5d308a-65d0-4ee4-8722-494b7351aad8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.519598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8da68cd7-d652-4892-8424-71acf74b45f3 req-cb5d308a-65d0-4ee4-8722-494b7351aad8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.533661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8da68cd7-d652-4892-8424-71acf74b45f3 req-cb5d308a-65d0-4ee4-8722-494b7351aad8 service nova] Creating event network-vif-plugged:34688680-1299-4e28-a06a-1e699af803ba for instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 on n-h2-master-1 Sep 25 01:13:14.538831 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8da68cd7-d652-4892-8424-71acf74b45f3 req-cb5d308a-65d0-4ee4-8722-494b7351aad8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044205 Sep 25 01:13:14.539457 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1244/2520] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:13:14.598572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:14.599434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:14.609424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.610009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.610525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.611256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.611720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.612186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.904175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:14.912746 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16d1b091-1096-42ac-aa69-273c31a14a80 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.741681 Sep 25 01:13:14.913545 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1277/2521] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:14 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:14.935185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:14.935806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:14.942856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.943328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.943762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.944655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.945440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.946033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.061709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.070941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a123a7d-0656-49d7-bab7-da130d72bc93 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.477514 Sep 25 01:13:15.071788 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1245/2522] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:14 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:15.137334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:15.137964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:15.149846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.152310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.152963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.154053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.154681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.155281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.180545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.193453 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5ca6956-d87e-45a3-ba41-605d8fc5ff6f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.264760 Sep 25 01:13:15.194860 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1278/2523] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:14 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:15.304650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.312449 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b791683-87eb-46c8-a406-a6d428e3a526 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1520 microversion: 2.1 time: 0.183840 Sep 25 01:13:15.313770 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1246/2524] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:15 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:15.339025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:15.339538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:15.347146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.347646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.348241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.348931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.349621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.350319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.382017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:13:15.503749 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbdd50ad-be0d-426d-a584-0816928f65cf tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 204 len: 0 microversion: 2.1 time: 0.168236 Sep 25 01:13:15.505877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:15.506551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1279/2525] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:13:15 2022] DELETE /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:13:15.507888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:15.518552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.519432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.521116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.522262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.523154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.523793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.525920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:15.527171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:15.541195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.541808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.548246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.549578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.553279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.553949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.608257 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.618363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.621835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.630860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f03d758-370b-4bbc-815e-e345b31fcedb tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.135489 Sep 25 01:13:15.632942 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1247/2526] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:15 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:15.794678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.809213 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85e6f2d3-73c1-4d6e-a6f5-e07199af65e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1526 microversion: 2.1 time: 0.297853 Sep 25 01:13:15.822399 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1280/2527] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:15 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1526 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:15.940512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:15.941676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:15.954542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.957382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.958110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.959087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.959765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.960432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.096517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:16.097366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:16.105543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.106043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.106488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.107217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.107676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.108102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.275865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:16.289175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7cb4a7d0-2db2-45d6-bc10-08ecce6b62a6 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1316 microversion: 2.1 time: 0.352709 Sep 25 01:13:16.290381 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1248/2528] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:15 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:16.297370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:16.298503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:16.308442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.309550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.310153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.311385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.312011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.314904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.347983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:16.361499 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53ab4a1f-f913-49ad-a1ca-bd96e88b841e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.269483 Sep 25 01:13:16.362675 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1281/2529] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:16 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:16.528892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:16.543349 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b52585a-4a09-4174-bbb0-7257f2ef629e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.251557 Sep 25 01:13:16.557731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1249/2530] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:16 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:16.667992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:16.668728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:16.682911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.683748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.684634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.692342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.693513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.694347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.776075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:16.792021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:16.794256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:16.800713 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f33bb2e-b463-4b5c-b727-5b1c3d1fc8e7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.140404 Sep 25 01:13:16.801311 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1282/2531] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:16 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:16.834346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:16.835323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:16.842949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.843752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.845008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.846294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.846918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.847558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.044029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:17.058838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1176d4de-9453-47b1-9568-22b679e9ecb4 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1526 microversion: 2.1 time: 0.228954 Sep 25 01:13:17.059441 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1250/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:16 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:17.318026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:17.319109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:17.328206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.329017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.329489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.330209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.330718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.331131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.389493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:17.390863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:17.402177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.404638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.407407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.409899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.413675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.418809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.780300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:17.791652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-caa30a8a-addb-4c47-b662-8611802295ce tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1505 microversion: 2.1 time: 0.479012 Sep 25 01:13:17.792552 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1283/2533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:17 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:17.824219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:17.829804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:17.838628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.839377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.839949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.840808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.841268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.843276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.856529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:17.860634 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:17.868802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5675c17d-1287-4723-a296-f4b311d757cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.484677 Sep 25 01:13:17.873549 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1251/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:17 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:17.894196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:17.896518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:17.917710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.921159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.927096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.937195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:17.939346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:17.941743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.026839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:13:18.197877 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c7ea7a7c-a392-4590-92f2-4d8a882b13fb tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "DELETE /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 204 len: 0 microversion: 2.1 time: 0.316661 Sep 25 01:13:18.198869 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1252/2535] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:13:17 2022] DELETE /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:13:18.206937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:18.206937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:18.214088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.214766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.215145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.215873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.216335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.216824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.291750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.312424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2abb9d65-8143-4ca1-8e86-3b119e402463 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.489325 Sep 25 01:13:18.315084 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1284/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:17 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:18.327570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:18.331228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:18.368293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.369593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.370408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.371458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.376160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.376809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.415462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.431615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.433515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.439198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a50c2432-25f8-4520-b2fd-b43b82ef58ec tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.239063 Sep 25 01:13:18.440318 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1253/2537] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:18 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:18.461663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:18.462602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:18.473510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.474372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.475285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.476024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.476533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.476978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.862685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.878221 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f7fba622-694f-4015-825e-b9080dde15ea tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1526 microversion: 2.1 time: 0.561098 Sep 25 01:13:18.896770 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1285/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:18 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1526 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:18.896929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.903633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:18.904779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:18.905865 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b183271-2a2b-43a0-869e-1cefd3513fd9 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1511 microversion: 2.1 time: 0.464290 Sep 25 01:13:18.907388 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1254/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:18 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:18.914671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.915803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.916830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.918408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.919068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.919640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.344108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:19.344770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:19.358014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.358892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.361253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.362865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.363730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.365612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.429002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:19.447051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3894db28-3fd4-4ae3-a1ba-55f5b57832b3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.548158 Sep 25 01:13:19.447884 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1286/2540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:18 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:19.452650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cf4dd1b3-94f5-4424-86fd-1c2749993270 req-f879215d-f63a-40df-ad14-a0932727bec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2304809-e1fd-4952-be6e-f6c794d10772", "name": "network-vif-deleted", "tag": "c82f2c1e-afd7-4506-a99a-97fcb099444b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:19.488275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cf4dd1b3-94f5-4424-86fd-1c2749993270 req-f879215d-f63a-40df-ad14-a0932727bec7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.488554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cf4dd1b3-94f5-4424-86fd-1c2749993270 req-f879215d-f63a-40df-ad14-a0932727bec7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.489171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cf4dd1b3-94f5-4424-86fd-1c2749993270 req-f879215d-f63a-40df-ad14-a0932727bec7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.506139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cf4dd1b3-94f5-4424-86fd-1c2749993270 req-f879215d-f63a-40df-ad14-a0932727bec7 service nova] Creating event network-vif-deleted:c82f2c1e-afd7-4506-a99a-97fcb099444b for instance e2304809-e1fd-4952-be6e-f6c794d10772 on n-h2-master-1 Sep 25 01:13:19.519859 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cf4dd1b3-94f5-4424-86fd-1c2749993270 req-f879215d-f63a-40df-ad14-a0932727bec7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069828 Sep 25 01:13:19.520993 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1287/2541] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:19.529250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:19.530255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:19.541374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.541904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.542617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.544020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.544488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.544992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.628616 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:19.654154 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:19.673152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:19.684309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:19.684788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:19.685934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:19.693573 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b431308-e462-43b8-95c1-9a92310d524a tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.170845 Sep 25 01:13:19.696173 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea714a67-f847-4d80-b98c-95ebe9d7f22f tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.357822 Sep 25 01:13:19.713526 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1255/2542] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:19 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:19.720762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1288/2543] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:19 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:19.904022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:19.904901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:19.914777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.915710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.916769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.917882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.919141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.920079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.930899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:19.931779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:19.933870 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:19.940304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.950317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.952091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.956013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.957860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.958771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.976792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.977760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.979059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.979872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lazy-loading 'fault' on Instance uuid e2304809-e1fd-4952-be6e-f6c794d10772 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:19.986051 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:20.193516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc384987bb247d88d0027e60d600ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56773bfde588477493c4d44b0d3e74b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:20.217196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-269b4e8f-d3ef-430e-8389-40af8d37fce3 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 200 len: 1313 microversion: 2.1 time: 0.316414 Sep 25 01:13:20.221443 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1256/2544] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:19 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:20.471588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:20.472350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:20.479709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.480289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.480804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.481614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.482149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.482647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.892193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:20.901246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef411b3a-ac1d-45d5-8319-8aec6e5caa1a tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1511 microversion: 2.1 time: 0.974118 Sep 25 01:13:20.901881 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1289/2545] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:19 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1511 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:20.907070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5762d8e5-e912-4f09-b6aa-d52e421a24bb req-199afe01-a851-49c6-8d41-efb477c6ba48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc784286-e6a9-44ff-b7b3-9a6781600174", "name": "network-vif-plugged", "status": "completed", "tag": "f073cdf7-498d-472a-9d2a-60c83b7759d3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:20.917738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5762d8e5-e912-4f09-b6aa-d52e421a24bb req-199afe01-a851-49c6-8d41-efb477c6ba48 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.918248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5762d8e5-e912-4f09-b6aa-d52e421a24bb req-199afe01-a851-49c6-8d41-efb477c6ba48 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.918694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5762d8e5-e912-4f09-b6aa-d52e421a24bb req-199afe01-a851-49c6-8d41-efb477c6ba48 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.930465 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5762d8e5-e912-4f09-b6aa-d52e421a24bb req-199afe01-a851-49c6-8d41-efb477c6ba48 service nova] Creating event network-vif-plugged:f073cdf7-498d-472a-9d2a-60c83b7759d3 for instance bc784286-e6a9-44ff-b7b3-9a6781600174 on n-h1-master-1 Sep 25 01:13:20.935515 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5762d8e5-e912-4f09-b6aa-d52e421a24bb req-199afe01-a851-49c6-8d41-efb477c6ba48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Sep 25 01:13:20.936303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1290/2546] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:20.942233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:20.942940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:20.949141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.949608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.950055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.950760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.951213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.951671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:20.952126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.961714 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6edf869d-758f-417a-9bb3-e574c638ac49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.494678 Sep 25 01:13:20.978605 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1257/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:20 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:20.985746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:20.986796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:20.994001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.994760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.005859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.009061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.010116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.011039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.168178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:21.177398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:21.178964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:21.184526 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:21.186364 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36417c5f-39c8-4980-aa6a-ed5fb62f3761 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.206469 Sep 25 01:13:21.205633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1258/2548] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:20 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:21.243489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.244969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: e2304809-e1fd-4952-be6e-f6c794d10772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:21.253501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.254113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.254448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.255166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.255623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.256051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.272711 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance e2304809-e1fd-4952-be6e-f6c794d10772 could not be found. Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 HTTP/1.1 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e2304809-e1fd-4952-be6e-f6c794d10772 could not be found. Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e2304809-e1fd-4952-be6e-f6c794d10772'} Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2304809-e1fd-4952-be6e-f6c794d10772 could not be found. Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2304809-e1fd-4952-be6e-f6c794d10772 could not be found. Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.274429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2304809-e1fd-4952-be6e-f6c794d10772 could not be found. Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance e2304809-e1fd-4952-be6e-f6c794d10772 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-179b3962-8f2e-4f47-8549-0ca92e017eb6 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772" status: 404 len: 111 microversion: 2.1 time: 0.036752 Sep 25 01:13:21.283162 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1259/2549] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:21 2022] GET /compute/v2.1/servers/e2304809-e1fd-4952-be6e-f6c794d10772 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:13:21.285108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5c48ea8-78ad-46d1-bfeb-b44bd7825d92 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '.version_select at 0x7f7beb98fdc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.310503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d5c48ea8-78ad-46d1-bfeb-b44bd7825d92 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Image not found. Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5c48ea8-78ad-46d1-bfeb-b44bd7825d92 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc HTTP/1.1 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7843074b-0095-4910-8478-7d582cc133bc'} Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7843074b-0095-4910-8478-7d582cc133bc to delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7843074b-0095-4910-8478-7d582cc133bc could not be found. Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.313019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5c48ea8-78ad-46d1-bfeb-b44bd7825d92 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:21.316832 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5c48ea8-78ad-46d1-bfeb-b44bd7825d92 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc" status: 404 len: 62 microversion: 2.1 time: 0.034110 Sep 25 01:13:21.319390 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1260/2550] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:21 2022] DELETE /compute/v2.1/images/7843074b-0095-4910-8478-7d582cc133bc => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:13:21.324158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.324829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:21.332975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.333505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.333952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.334669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.335129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.335722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.350265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b HTTP/1.1 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7f487a58-e979-4857-bad1-1f2723c5ee8b'} Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:21.352032 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6db5c8f1-f770-4eec-a359-87e75e5914e1 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 404 len: 111 microversion: 2.1 time: 0.033390 Sep 25 01:13:21.356265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1261/2551] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:13:21 2022] DELETE /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:21.363737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.364939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: 7f487a58-e979-4857-bad1-1f2723c5ee8b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:21.371679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.372433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.373062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.374116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.375338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.375972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.392816 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b HTTP/1.1 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7f487a58-e979-4857-bad1-1f2723c5ee8b'} Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.394704 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance 7f487a58-e979-4857-bad1-1f2723c5ee8b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:21.398411 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-31bc7514-4958-4bf4-884d-d7c40c44249b tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b" status: 404 len: 111 microversion: 2.1 time: 0.037548 Sep 25 01:13:21.400125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1262/2552] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:21 2022] GET /compute/v2.1/servers/7f487a58-e979-4857-bad1-1f2723c5ee8b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:21.403963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:21.405121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d92079cf-c1b9-4999-8da1-a64fa364f9af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '.version_select at 0x7f7bebcdd1f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.415559 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af9acf2f-163a-438d-bd03-80b002b7972c tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.477999 Sep 25 01:13:21.428198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d92079cf-c1b9-4999-8da1-a64fa364f9af tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479273948" status: 202 len: 0 microversion: 2.1 time: 0.026765 Sep 25 01:13:21.429154 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1263/2553] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479273948 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:13:21.449010 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1291/2554] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:20 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:21.597791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-334f70ea-8657-4b71-8f39-c6e6934a8610 req-4f8b8e00-a7a9-4c14-8d1e-e1584f9b599b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373dbe21-3de6-46db-b8c0-7ed93a3619f3", "name": "network-vif-deleted", "tag": "34688680-1299-4e28-a06a-1e699af803ba"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:21.623062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-334f70ea-8657-4b71-8f39-c6e6934a8610 req-4f8b8e00-a7a9-4c14-8d1e-e1584f9b599b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.634220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-334f70ea-8657-4b71-8f39-c6e6934a8610 req-4f8b8e00-a7a9-4c14-8d1e-e1584f9b599b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.635001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-334f70ea-8657-4b71-8f39-c6e6934a8610 req-4f8b8e00-a7a9-4c14-8d1e-e1584f9b599b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.660359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-334f70ea-8657-4b71-8f39-c6e6934a8610 req-4f8b8e00-a7a9-4c14-8d1e-e1584f9b599b service nova] Creating event network-vif-deleted:34688680-1299-4e28-a06a-1e699af803ba for instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 on n-h2-master-1 Sep 25 01:13:21.668519 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-334f70ea-8657-4b71-8f39-c6e6934a8610 req-4f8b8e00-a7a9-4c14-8d1e-e1584f9b599b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090082 Sep 25 01:13:21.675279 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1264/2555] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:21.925391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.925988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:21.938887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.939399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.939895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.940855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.941516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.942106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.986847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.987789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:21.999848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.002570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.003224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.004614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.006721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.007988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.008236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.010193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.010744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.011309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lazy-loading 'fault' on Instance uuid 373dbe21-3de6-46db-b8c0-7ed93a3619f3 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:22.127229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e3ca9f263a437ab752007ef0588edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99bc91409fe24f088ae6a51eff7381e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.134591 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:22.151817 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb2cdad4-0c7a-4268-9fe1-4d71c2e839ff tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 200 len: 1306 microversion: 2.1 time: 0.231482 Sep 25 01:13:22.152419 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1292/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:21 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 1306 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:22.216992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.218017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:22.232837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.233344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.235459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.236407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.236919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.237518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.482867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.506057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.506221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.508049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.518413 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1527aaa9-7a83-49aa-8607-33c412e5eb8f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.536383 Sep 25 01:13:22.521120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50ff1eff-b1e1-4899-8768-bf4874fafba1 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1445 microversion: 2.75 time: 0.308493 Sep 25 01:13:22.522508 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1293/2557] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:22 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1445 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:22.529017 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1265/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:21 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:22.537129 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.539520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:22.542431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ca2d0a5-cd52-4f7c-89ba-8d5e65212471 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '.version_select at 0x7f7bebcdd9d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.555883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.558779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.559266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.560011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.561874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.563315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.589920 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2ca2d0a5-cd52-4f7c-89ba-8d5e65212471 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Image not found. Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ca2d0a5-cd52-4f7c-89ba-8d5e65212471 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/92473294-b9d5-4454-908f-59bcb000a6b5 HTTP/1.1 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '92473294-b9d5-4454-908f-59bcb000a6b5'} Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 92473294-b9d5-4454-908f-59bcb000a6b5 to delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92473294-b9d5-4454-908f-59bcb000a6b5 could not be found. Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.592410 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ca2d0a5-cd52-4f7c-89ba-8d5e65212471 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ca2d0a5-cd52-4f7c-89ba-8d5e65212471 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/images/92473294-b9d5-4454-908f-59bcb000a6b5" status: 404 len: 62 microversion: 2.1 time: 0.061746 Sep 25 01:13:22.596954 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1266/2559] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:22 2022] DELETE /compute/v2.1/images/92473294-b9d5-4454-908f-59bcb000a6b5 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:13:22.604702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.609785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:22.619334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.619990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.620434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.621149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.621625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.622058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.652731 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 HTTP/1.1 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: exception: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744'} Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:22.655217 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8eb34fc6-c1f2-442f-94ba-91621188a806 tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 404 len: 111 microversion: 2.1 time: 0.058211 Sep 25 01:13:22.659723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1267/2560] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:13:22 2022] DELETE /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:22.666752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.667694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] [instance: efb42563-a714-4865-b942-2cc08db50744] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:22.676791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.677292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.677818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.679915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.680403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.681032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.709704 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] HTTP exception thrown: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Request method failure captured: Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 HTTP/1.1 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6q-kZUf0xhXPrBXnVTzr9sn-ZR2VWLTCRsG52BXiMGz_VcnGcWTpnultlDPcld1jrHnn2lKxpcYZj5xtfb7Z-eRWr9clAA0FC1vgX_YnuQX1m6e4ztsf1V2GjC_u-4FDAJsQRsrQusTuH-K9daX9Y83q-iYnlkhsQEIUB-_G6DHol8 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56773bfde588477493c4d44b0d3e74b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56773bfde588477493c4d44b0d3e74b9"}]}] Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 56773bfde588477493c4d44b0d3e74b9 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1cc384987bb247d88d0027e60d600ed1 Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1641599248-project Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: exception: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'efb42563-a714-4865-b942-2cc08db50744'} Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.711172 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] Returning 404 to user: Instance efb42563-a714-4865-b942-2cc08db50744 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3543132-aac1-46d5-bca8-6a874a99e30d tempest-ImagesOneServerNegativeTestJSON-1641599248 tempest-ImagesOneServerNegativeTestJSON-1641599248-project] 10.222.0.16 "GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744" status: 404 len: 111 microversion: 2.1 time: 0.050508 Sep 25 01:13:22.715130 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1268/2561] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:22 2022] GET /compute/v2.1/servers/efb42563-a714-4865-b942-2cc08db50744 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:22.938405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.951165 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5be9a76b-238e-4a3e-b803-02b693f20714 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1394 microversion: 2.1 time: 0.427173 Sep 25 01:13:22.965930 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1294/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:22 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1394 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:23.178742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:23.179355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:23.192491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.192963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.193496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.194115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.194567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.195170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.213288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 HTTP/1.1 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '373dbe21-3de6-46db-b8c0-7ed93a3619f3'} Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.227315 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.231849 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.238644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.240310 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae4f6e07-c111-43f4-9533-be39e9e58359 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 404 len: 111 microversion: 2.1 time: 0.064886 Sep 25 01:13:23.241476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1269/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:23 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.250538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1016872615", "metadata": {"image_type": "test"}}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:23.253236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:23.277069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.278612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.279737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.280702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.285921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.287049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.323232 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3/action HTTP/1.1 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 112 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1016872615", "metadata": {"image_type": "test"}}} Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '373dbe21-3de6-46db-b8c0-7ed93a3619f3', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1016872615', 'metadata': {'image_type': 'test'}}}} Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:13:23.328262 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.332227 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.337039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.338133 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-acd5725d-afb4-4528-a7f8-5933f6d47387 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "POST /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3/action" status: 404 len: 111 microversion: 2.1 time: 0.092336 Sep 25 01:13:23.353874 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1295/2564] 10.222.0.16 () {60 vars in 1279 bytes} [Sun Sep 25 01:13:23 2022] POST /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.355427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7027e81-fbd0-464f-aab2-4db1564332dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1579409211", "metadata": {"image_type": "test"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:23.358078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c7027e81-fbd0-464f-aab2-4db1564332dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Failed to fetch instance by id tempest-invalid-1741083140 {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:13:23.358672 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c7027e81-fbd0-464f-aab2-4db1564332dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance tempest-invalid-1741083140 could not be found. Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7027e81-fbd0-464f-aab2-4db1564332dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/tempest-invalid-1741083140/action HTTP/1.1 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 112 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1579409211", "metadata": {"image_type": "test"}}} Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: exception: Instance tempest-invalid-1741083140 could not be found. Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'tempest-invalid-1741083140', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1579409211', 'metadata': {'image_type': 'test'}}}} Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1741083140 could not be found. Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.361021 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1741083140 could not be found. Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1741083140 could not be found. Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.365317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7027e81-fbd0-464f-aab2-4db1564332dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance tempest-invalid-1741083140 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.367082 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c7027e81-fbd0-464f-aab2-4db1564332dd tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-1741083140/action" status: 404 len: 101 microversion: 2.1 time: 0.014377 Sep 25 01:13:23.369982 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1270/2565] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 25 01:13:23 2022] POST /compute/v2.1/servers/tempest-invalid-1741083140/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.380289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2f35ef9-2af5-4ea8-86f7-7d0ae58e7460 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1361224602"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:23.382639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2f35ef9-2af5-4ea8-86f7-7d0ae58e7460 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:13:23.383140 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e2f35ef9-2af5-4ea8-86f7-7d0ae58e7460 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2f35ef9-2af5-4ea8-86f7-7d0ae58e7460 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 57 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: {"createImage": {"name": "tempest-test-snap-1361224602"}} Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1361224602'}}} Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.388978 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.393848 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.397757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2f35ef9-2af5-4ea8-86f7-7d0ae58e7460 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.398790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2f35ef9-2af5-4ea8-86f7-7d0ae58e7460 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022889 Sep 25 01:13:23.407548 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1296/2566] 10.222.0.16 () {60 vars in 1275 bytes} [Sun Sep 25 01:13:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.411082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd9acc96-aa9a-40f7-92e4-98e4304331b3 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1018125156"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:23.413618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd9acc96-aa9a-40f7-92e4-98e4304331b3 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:13:23.414381 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-dd9acc96-aa9a-40f7-92e4-98e4304331b3 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd9acc96-aa9a-40f7-92e4-98e4304331b3 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 57 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: {"createImage": {"name": "tempest-test-snap-1018125156"}} Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1018125156'}}} Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.419574 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 25 01:13:23.424639 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.426361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd9acc96-aa9a-40f7-92e4-98e4304331b3 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.427591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd9acc96-aa9a-40f7-92e4-98e4304331b3 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021428 Sep 25 01:13:23.436734 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1271/2567] 10.222.0.16 () {60 vars in 1281 bytes} [Sun Sep 25 01:13:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.448060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:23.448673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:23.465894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.467363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.468995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.471342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.471977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.472894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.493627 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 HTTP/1.1 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '373dbe21-3de6-46db-b8c0-7ed93a3619f3'} Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.496101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.500340 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-738c337c-3264-4d51-b09c-4da22deba273 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "DELETE /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 404 len: 111 microversion: 2.1 time: 0.056207 Sep 25 01:13:23.504458 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1297/2568] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:13:23 2022] DELETE /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.510810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:23.511720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] [instance: 373dbe21-3de6-46db-b8c0-7ed93a3619f3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:23.524984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.525762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.526456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.527440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.528065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.533128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.553314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:23.554103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:23.561793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] HTTP exception thrown: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Request method failure captured: Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 HTTP/1.1 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sR6__CGDQDtMbDlThmGjcC6yKdEfqSN9Y-FsaoDOhq3acjc29HrECM1HGFvW548V_IQDoUWnNiTnPxnp7bpuDAGOxYuWqkVubvlj0mig6piv1Ltnr1bOKaLogzNUKSUIwzurnreWxrhe2L5KxkdzxNQVhK78bBAik2In6BOqgQTP8 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99bc91409fe24f088ae6a51eff7381e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99bc91409fe24f088ae6a51eff7381e1"}]}] Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 99bc91409fe24f088ae6a51eff7381e1 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-929693833 Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 38e3ca9f263a437ab752007ef0588edc Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesNegativeTestJSON-929693833-project Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '373dbe21-3de6-46db-b8c0-7ed93a3619f3'} Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:23.566530 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. Sep 25 01:13:23.570545 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:23.571921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.572447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.575329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] Returning 404 to user: Instance 373dbe21-3de6-46db-b8c0-7ed93a3619f3 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:23.575594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.576955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a96bee4-8a96-40e5-9435-b34d248bd186 tempest-ImagesNegativeTestJSON-929693833 tempest-ImagesNegativeTestJSON-929693833-project] 10.222.0.16 "GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3" status: 404 len: 111 microversion: 2.1 time: 0.070959 Sep 25 01:13:23.577103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.581450 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1272/2569] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:23 2022] GET /compute/v2.1/servers/373dbe21-3de6-46db-b8c0-7ed93a3619f3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:23.585179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.600413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:23.601505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:23.602668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.622955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.623475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.623922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.628916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:23.629900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:23.630012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.886616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:23.909310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:23.912161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:23.929117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51acef30-e85e-4e79-b4c0-9fdf281887c7 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1463 microversion: 2.75 time: 0.346033 Sep 25 01:13:23.930543 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1273/2570] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:23 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1463 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:23.990434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:23.992795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:24.002428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.003296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.003959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:24.004888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.005661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.006304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:24.325599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:24.340136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30c5284f-cd05-4c4f-a166-7f441d549977 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.791954 Sep 25 01:13:24.343446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1298/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:23 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:24.529456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:24.538833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b21e1503-1e77-4ee2-8060-23ce901266cf tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1575 microversion: 2.1 time: 0.564775 Sep 25 01:13:24.539422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1274/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:23 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1575 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:24.566749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:24.567460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:24.575074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.576102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.576716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:24.577696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.578322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.579405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:24.956674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:24.958016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:24.974738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.975821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.978243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:24.988873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.989754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.990434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:25.199161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:25.208724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:25.211154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:25.223860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55270d4b-d5db-4d53-b3aa-0c8b93a17896 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1451 microversion: 2.75 time: 0.271497 Sep 25 01:13:25.226060 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1275/2573] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:24 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1451 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:13:25.231276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f565230b-d817-410d-b133-576f48297347 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.668957 Sep 25 01:13:25.232080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1299/2574] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:13:24 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174/os-interface => generated 284 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:25.369114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:25.369931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:25.378587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:25.379480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:25.380334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:25.381282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:25.381978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:25.383030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:25.771047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:25.774687 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:25.780089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cfdcc4b-0b8a-4742-8f57-7589490189cc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.416075 Sep 25 01:13:25.796177 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1276/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:25 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:26.265099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:26.270100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:26.345637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:26.346450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:26.355647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:26.357677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:26.358461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:26.359718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:26.588363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:26.606307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:26.611063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:26.622684 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-906a6ee5-b275-4920-ba3c-56c8f481ade8 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1436 microversion: 2.75 time: 0.363704 Sep 25 01:13:26.623831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1300/2576] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:26 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1436 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:26.803888 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:26.805506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:26.821531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:26.831643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:26.833998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:26.835071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:26.835963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:26.838061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.251428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:27.254875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:27.283437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.285338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.292741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.294232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:27.308089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-918ab484-9bd8-4897-a96b-fe8fd8316ad8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.503856 Sep 25 01:13:27.309032 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1301/2577] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:26 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:27.317593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.318520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.318986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.498070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:13:27.500112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:13:27.501014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:13:27.502428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:13:27.504959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:13:27.532585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:27.533705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:27.542470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.543264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.543928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.544918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.545917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.546657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.670782 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:27.701816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.703301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.704929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.707616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.709193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.712241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.873692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:27.892630 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-597358ab-7ff3-4a72-9a48-c7ab0b722980 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1575 microversion: 2.1 time: 0.362207 Sep 25 01:13:27.896241 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1302/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:27 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1575 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:27.914558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4454a632-39b0-4d80-be60-b756abe5d35b req-c21efb9b-39e8-484b-a450-0a9354a94512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc784286-e6a9-44ff-b7b3-9a6781600174", "tag": "f073cdf7-498d-472a-9d2a-60c83b7759d3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:27.940934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4454a632-39b0-4d80-be60-b756abe5d35b req-c21efb9b-39e8-484b-a450-0a9354a94512 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:27.941999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4454a632-39b0-4d80-be60-b756abe5d35b req-c21efb9b-39e8-484b-a450-0a9354a94512 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:27.947922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4454a632-39b0-4d80-be60-b756abe5d35b req-c21efb9b-39e8-484b-a450-0a9354a94512 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:27.973235 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4454a632-39b0-4d80-be60-b756abe5d35b req-c21efb9b-39e8-484b-a450-0a9354a94512 service nova] Creating event network-changed:f073cdf7-498d-472a-9d2a-60c83b7759d3 for instance bc784286-e6a9-44ff-b7b3-9a6781600174 on n-h1-master-1 Sep 25 01:13:28.005344 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4454a632-39b0-4d80-be60-b756abe5d35b req-c21efb9b-39e8-484b-a450-0a9354a94512 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106017 Sep 25 01:13:28.016547 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1303/2579] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:28.335133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:28.337496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:28.351039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:28.354251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:28.355014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:28.357350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:28.358158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:28.360468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:28.573299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:28.608115 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82352ac2-dc7f-4433-b7c0-7bf49b8a71b2 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7/action" status: 202 len: 1938 microversion: 2.75 time: 1.960872 Sep 25 01:13:28.608839 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1277/2580] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:13:26 2022] POST /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7/action => generated 1938 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 25 01:13:28.640359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:28.641982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:28.660232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:28.662150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:28.664217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:28.667660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:28.671056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:28.674413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:29.211198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:29.262581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-434c99be-e0c4-4b54-815b-f3a5a4378347 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.626563 Sep 25 01:13:29.263151 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1278/2581] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:28 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:29.432822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:29.458154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8a04dd22-0ec1-4151-a861-2bb0139218a9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 1.127470 Sep 25 01:13:29.462897 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1304/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:28 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:30.294555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:30.295187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:30.305599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:30.318369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:30.320959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:30.321978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:30.323724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:30.324347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:30.487601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:30.488221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:30.537840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:30.542961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:30.545692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:30.546221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:30.549273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:30.549782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:30.550217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:30.604839 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dce93b3c-0c9c-4b81-a2fb-c9c6808f6222 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.314377 Sep 25 01:13:30.605842 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1279/2583] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:30 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:30.866510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:30.877162 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1d98d6be-73fe-443f-a5ba-92e0571fe679 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.394584 Sep 25 01:13:30.880985 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1305/2584] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:30 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:31.636023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:31.637097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:31.652066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:31.652942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:31.658414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:31.659556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:31.660239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:31.660881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:31.808903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:31.835343 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7da0d17f-2e91-46c5-b526-7c8fbf1ae50b tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.203411 Sep 25 01:13:31.845440 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1280/2585] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:31 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:31.903673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:31.904743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:31.919739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:31.925315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:31.925704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:31.935254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:31.935986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:31.939031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:32.604740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:32.618555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-937ae96d-54b1-4356-ac55-bf8029a1f468 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1476 microversion: 2.1 time: 0.718916 Sep 25 01:13:32.623282 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1306/2586] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:31 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1476 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:32.870489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:32.871357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:32.899018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:32.900075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:32.900755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:32.902142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:32.907331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:32.908182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:33.114086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:33.159443 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc36bc0c-1168-414a-bf29-a0bf930fbd0e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.293196 Sep 25 01:13:33.182349 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1281/2587] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:32 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:33.537324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affcce72-88eb-458b-ae3b-ebd111f5cfcb", "name": "network-vif-unplugged", "status": "completed", "tag": "3e636bb7-2165-4a12-be1f-c66e562270f6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:33.558070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:33.559967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:33.567368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:33.595451 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] Creating event network-vif-unplugged:3e636bb7-2165-4a12-be1f-c66e562270f6 for instance affcce72-88eb-458b-ae3b-ebd111f5cfcb on n-h2-master-1 Sep 25 01:13:33.611078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:13:33.635151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7cc30c67-2052-4007-9177-603fbb4d0d84 req-c16deacb-bd63-4eb4-839d-8a8524e4cc51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113083 Sep 25 01:13:33.636072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1307/2588] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:33.649575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:33.650215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:33.659117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:33.660705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:33.662390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:33.665450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:33.665950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:33.666398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:34.167033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:34.180448 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f2da04f-cb97-473c-b1f7-13b2e3b74211 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1475 microversion: 2.1 time: 0.533974 Sep 25 01:13:34.185760 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1282/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:33 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1475 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:34.196509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:34.197861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:34.211272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:34.212033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:34.212807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:34.213703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:34.214637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:34.215145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:34.427585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:34.453810 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-edd85fe9-798a-4e26-afdc-9b5aaac307a3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.267901 Sep 25 01:13:34.455624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1308/2590] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:34 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:35.211318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:35.211942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:35.224162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:35.224668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:35.225208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:35.225860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:35.226440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:35.226735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:35.486292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:35.488355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:35.512351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:35.513201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:35.513970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:35.515701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:35.516493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:35.517227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:35.793796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:35.822029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b8331956-d475-4d80-bf21-a19b2b4d103d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1475 microversion: 2.1 time: 0.614300 Sep 25 01:13:35.824551 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1283/2591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:35 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1475 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:35.837021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affcce72-88eb-458b-ae3b-ebd111f5cfcb", "tag": "3e636bb7-2165-4a12-be1f-c66e562270f6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:35.904929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:35.914566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:35.915354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:35.940043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:35.980570 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] Creating event network-changed:3e636bb7-2165-4a12-be1f-c66e562270f6 for instance affcce72-88eb-458b-ae3b-ebd111f5cfcb on n-h2-master-1 Sep 25 01:13:36.017068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:13:36.032274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-421244d5-76e8-4988-8734-864586490a0f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.552233 Sep 25 01:13:36.037427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1309/2592] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:35 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:36.051869 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e3b2ed5a-f146-4679-bdb8-fa05ff7e6111 req-971e8bb9-9767-48a0-991e-d4dc76a1fbfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219982 Sep 25 01:13:36.055455 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1284/2593] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:36.879697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:36.885722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:36.927064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:36.927889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:36.929829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:36.931262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:36.932061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:36.932813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:37.076964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:37.078090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:37.104745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:37.105577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:37.107259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:37.111341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:37.113724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:37.115012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:37.375974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:37.431381 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86ccd7e7-de76-4909-af64-80b7af409f6e tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.367712 Sep 25 01:13:37.432632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1285/2594] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:37 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:37.628537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:37.642901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92e5495b-d62c-4528-aa96-50cc70e74e6f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1473 microversion: 2.1 time: 0.775519 Sep 25 01:13:37.664280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1310/2595] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:36 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1473 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:38.464305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:38.465365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:38.477562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:38.477881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:38.478317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:38.479026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:38.479478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:38.479898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:38.731520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:38.794998 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ca79c71-96a3-44c5-a598-3ff5fa2094e5 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.334567 Sep 25 01:13:38.798555 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1311/2596] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:38 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:13:38.816378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:38.822116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:38.836749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:38.837192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:38.837638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:38.846949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:38.851236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:38.856718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:38.875958 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:38.970744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f20f1a9-3f0b-43f3-942a-50921725a7bc tempest-ListImageFiltersNegativeTestJSON-1578897571 tempest-ListImageFiltersNegativeTestJSON-1578897571-project] Calling method '.version_select at 0x7f7bebf1d430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:39.001307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4f20f1a9-3f0b-43f3-942a-50921725a7bc tempest-ListImageFiltersNegativeTestJSON-1578897571 tempest-ListImageFiltersNegativeTestJSON-1578897571-project] HTTP exception thrown: Image not found. Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f20f1a9-3f0b-43f3-942a-50921725a7bc tempest-ListImageFiltersNegativeTestJSON-1578897571 tempest-ListImageFiltersNegativeTestJSON-1578897571-project] Request method failure captured: Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/images/0fb050fc-d1ae-4c87-8156-394fd64bcc5a HTTP/1.1 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tC4apShAEJ0B8i1Br4A8z27e9ETvRkDyKc9-2GmM_yRHJ-33BPwtup30w4sPruUYgfTmnG-uS1qPx4GcVax5NnYlnXYx09YoS26sBEPqbdpG58cHuo5DCq3kfQ-JnACYcmFKkQSGdtswrS-9ZxyWUhBQalJLr3fMTa1llLXl4ue3E Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: a97421bd12f74bb49bb3fb8f61ca6e15 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1578897571 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a97421bd12f74bb49bb3fb8f61ca6e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97421bd12f74bb49bb3fb8f61ca6e15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a97421bd12f74bb49bb3fb8f61ca6e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a97421bd12f74bb49bb3fb8f61ca6e15"}]}] Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1578897571 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: a97421bd12f74bb49bb3fb8f61ca6e15 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1578897571 Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListImageFiltersNegativeTestJSON-1578897571-project Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 832a1af87d2b490692389af891b790ae Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1578897571-project Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '0fb050fc-d1ae-4c87-8156-394fd64bcc5a'} Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0fb050fc-d1ae-4c87-8156-394fd64bcc5a Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:13:39.003833 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fb050fc-d1ae-4c87-8156-394fd64bcc5a could not be found. Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f20f1a9-3f0b-43f3-942a-50921725a7bc tempest-ListImageFiltersNegativeTestJSON-1578897571 tempest-ListImageFiltersNegativeTestJSON-1578897571-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:39.012299 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f20f1a9-3f0b-43f3-942a-50921725a7bc tempest-ListImageFiltersNegativeTestJSON-1578897571 tempest-ListImageFiltersNegativeTestJSON-1578897571-project] 10.222.0.16 "GET /compute/v2.1/images/0fb050fc-d1ae-4c87-8156-394fd64bcc5a" status: 404 len: 62 microversion: 2.1 time: 0.640987 Sep 25 01:13:39.022025 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1286/2597] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:13:38 2022] GET /compute/v2.1/images/0fb050fc-d1ae-4c87-8156-394fd64bcc5a => generated 62 bytes in 658 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:13:39.835707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:39.836703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:39.844195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:39.844989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:39.845640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:39.846592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:39.847953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:39.848565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:40.063697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:40.078660 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f1e7d67-9f69-42e0-931e-1606ae8a23ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1473 microversion: 2.1 time: 1.277328 Sep 25 01:13:40.094523 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1312/2598] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:38 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1473 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:40.180540 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:40.242322 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc583f79-6fd7-48a9-8961-6ef684162798 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.417468 Sep 25 01:13:40.243518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1287/2599] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:39 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:41.108469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:41.110159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:41.149756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:41.154415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:41.160099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:41.161874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:41.173861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:41.177514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:41.291860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-553031419", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "e2b625b0-9f7b-4b8d-b0a1-e09eaa3ee1a3"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:41.420581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] validate_networks() for [('e2b625b0-9f7b-4b8d-b0a1-e09eaa3ee1a3', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:13:41.994019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:42.017096 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ff5652e-fea6-4298-9ef9-fc8009d00892 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1470 microversion: 2.1 time: 0.902127 Sep 25 01:13:42.017096 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1288/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:41 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1470 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:42.032190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:42.033130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:42.057543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:42.058045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:42.058521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:42.059209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:42.059663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:42.060086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:42.317740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:42.325500 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:42.378880 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29ed88c2-e6ee-42e5-8808-2e133595041f tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.361800 Sep 25 01:13:42.394380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1289/2601] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:42 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:42.406087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:42.406711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:42.428554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:42.429042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:42.429506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:42.430213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:42.431075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:42.431679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:42.503250 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-061e32c6-78de-4b93-8a6f-b7d8f3d3279c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/ips" status: 200 len: 149 microversion: 2.1 time: 0.107639 Sep 25 01:13:42.504065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1290/2602] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:13:42 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/ips => generated 149 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:42.516431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:42.517316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:42.524480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:42.525348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:42.526027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:42.526993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:42.527675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:42.528611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:42.665334 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d8d418f7-c62c-400a-beff-3603c9a7c976 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb/action" status: 204 len: 0 microversion: 2.1 time: 0.153218 Sep 25 01:13:42.668637 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1291/2603] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:13:42 2022] POST /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb/action => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:13:43.154297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6900fa45-9ab0-4817-8e39-f0c10c4067b4 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bebf034c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjPUI4wmiFN5uqlTnTJRWRiNBqVoyPR7ikX6q/Hi6sqmryvE4E+z7DtD/iXCQbV5q0aV8dt7Ez0KOHLlk/GAYcq/5scTFO5jDjneUHzLkks7dZai4bVXIHfdiaG3zTFig=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6900fa45-9ab0-4817-8e39-f0c10c4067b4 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 257 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjPUI4wmiFN5uqlTnTJRWRiNBqVoyPR7ikX6q/Hi6sqmryvE4E+z7DtD/iXCQbV5q0aV8dt7Ez0KOHLlk/GAYcq/5scTFO5jDjneUHzLkks7dZai4bVXIHfdiaG3zTFig=="}} Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjPUI4wmiFN5uqlTnTJRWRiNBqVoyPR7ikX6q/Hi6sqmryvE4E+z7DtD/iXCQbV5q0aV8dt7Ez0KOHLlk/GAYcq/5scTFO5jDjneUHzLkks7dZai4bVXIHfdiaG3zTFig=='}}} Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 25 01:13:43.161484 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 25 01:13:43.165755 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.173663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6900fa45-9ab0-4817-8e39-f0c10c4067b4 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:43.174947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6900fa45-9ab0-4817-8e39-f0c10c4067b4 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.504974 Sep 25 01:13:43.180992 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1292/2604] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:42 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 512 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:13:43.190279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b9783c2-c1b2-4ef1-af75-f59962296832"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:43.194896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:43.214782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.215677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.217039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.224664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.225459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.226219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.283554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:13:43.284575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:13:43.285246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:13:43.285892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:13:43.287696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:13:43.306756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.311153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.315137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.316359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.317069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.319477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.389239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Getting quotas for project fd4027e26a844b0dbd34ac452b22b3ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:43.395644 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Invalid volume: volume 3b9783c2-c1b2-4ef1-af75-f59962296832 is already attached to instances: 77babc4e-c612-45ee-8bd0-f477b4329ccd Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/os-volume_attachments HTTP/1.1 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 74 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: {"volumeAttachment": {"volumeId": "3b9783c2-c1b2-4ef1-af75-f59962296832"}} Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid volume: volume 3b9783c2-c1b2-4ef1-af75-f59962296832 is already attached to instances: 77babc4e-c612-45ee-8bd0-f477b4329ccd Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': 'e709904a-78e9-4d39-ad67-c7e9ffca9762', 'body': {'volumeAttachment': {'volumeId': '3b9783c2-c1b2-4ef1-af75-f59962296832'}}} Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b9783c2-c1b2-4ef1-af75-f59962296832 is already attached to instances: 77babc4e-c612-45ee-8bd0-f477b4329ccd Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:43.406210 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b9783c2-c1b2-4ef1-af75-f59962296832 is already attached to instances: 77babc4e-c612-45ee-8bd0-f477b4329ccd Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b9783c2-c1b2-4ef1-af75-f59962296832 is already attached to instances: 77babc4e-c612-45ee-8bd0-f477b4329ccd Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.411033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 400 to user: Invalid volume: volume 3b9783c2-c1b2-4ef1-af75-f59962296832 is already attached to instances: 77babc4e-c612-45ee-8bd0-f477b4329ccd {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:43.413496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Getting quotas for user b984b9717fe94a6fb6c62a78af17f7aa and project fd4027e26a844b0dbd34ac452b22b3ae. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:43.413668 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f76da816-5974-456d-b78e-c512c06a114b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.223863 Sep 25 01:13:43.413668 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1293/2605] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:13:43 2022] POST /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762/os-volume_attachments => generated 174 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:13:43.439094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:43.444311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:43.444512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:13:43.451176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:13:43.469538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.470353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.472100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.474591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.476085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.478862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.522057 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f7a6957-7cc8-4971-96af-373491051a6d tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.937735 Sep 25 01:13:43.523308 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1313/2606] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:13:43.531533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bebd44ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1151922354", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:43.560378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:43.573852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for user 6dbd1ce0900b45f7a853ceac99df932b and project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:43.605814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 2167 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1151922354", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:13:43.625904 n-d-master-1 devstack@n-api.service[122385]: exception: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1151922354', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:43.628534 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0a61e53-71e9-46a8-b5a5-81a70bad814a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103032 Sep 25 01:13:43.633339 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1314/2607] 10.222.0.16 () {60 vars in 1160 bytes} [Sun Sep 25 01:13:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:43.636987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:43.636987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:43.700648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.704253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.705537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.707866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:43.709937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:43.710721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:43.933738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:43.988188 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1667f160-7bef-4816-bd97-6c1f5e4e3190 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.358682 Sep 25 01:13:43.993859 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1315/2608] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:43 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:44.013461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:44.014199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:44.041274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:44.044798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:44.046769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:44.047947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:44.051266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:44.051970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:44.121389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:13:44.243407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:44.258479 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8200ed87-dba3-4141-8f01-3ed515ed5342 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1470 microversion: 2.1 time: 0.846471 Sep 25 01:13:44.260353 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1294/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:43 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1470 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:44.292044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8dc790a8-d10c-4519-9cd0-cf9b8fb3e5b1 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:44.295861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8dc790a8-d10c-4519-9cd0-cf9b8fb3e5b1 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:44.323890 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4eaaac2-e672-42de-95d8-a0ff42a4e2eb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 204 len: 0 microversion: 2.1 time: 0.328568 Sep 25 01:13:44.328138 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1316/2610] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:13:43 2022] DELETE /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:13:44.344202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-693ecd9c-7efd-4971-8bdb-88443a5b95f0 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bf0860ee0>, body: {"keypair": {"name": "tempest-keypair-1553701761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6tLXB0NxEIihCt94qc6/MKnEr6BQQZnjEt5VB6HRvkGAykmlWm9cVyUYi04ru+TQjbvlZkTAwj0hQtbSrvYunRYRUXEGywzSiIXvgUGeEG+bh9/jGmKUcP1OKo10jM1g=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:44.402907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-693ecd9c-7efd-4971-8bdb-88443a5b95f0 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:44.413100 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:44.429863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-693ecd9c-7efd-4971-8bdb-88443a5b95f0 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for user 6dbd1ce0900b45f7a853ceac99df932b and project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:44.457160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8dc790a8-d10c-4519-9cd0-cf9b8fb3e5b1 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:44.466469 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8dc790a8-d10c-4519-9cd0-cf9b8fb3e5b1 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1227 microversion: 2.1 time: 0.201645 Sep 25 01:13:44.468549 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1295/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:44 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1227 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:44.486886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:44.488020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:44.496620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:44.503375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:44.505772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:44.506574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:44.508623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:44.509063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:44.515188 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-693ecd9c-7efd-4971-8bdb-88443a5b95f0 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181001 Sep 25 01:13:44.516519 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1317/2612] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:44.535162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bf02bb1f0>, body: {"keypair": {"name": "tempest-keypair-1553701761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5VQgib7UAob0rVZfMAZPTBEEgGJMNAohqBVF8yzJeqqLZ+HxzHp3XmWwIM3uzjKBysgSBfmC/+fCXycG2KJRm6gynC3FUheayUUj0GsPbrbs1V4Wgvvf8N3rlgDG0YWw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:44.587897 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:44.596769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for user 6dbd1ce0900b45f7a853ceac99df932b and project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:44.663723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] HTTP exception thrown: Key pair 'tempest-keypair-1553701761' already exists. Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 273 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: {"keypair": {"name": "tempest-keypair-1553701761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5VQgib7UAob0rVZfMAZPTBEEgGJMNAohqBVF8yzJeqqLZ+HxzHp3XmWwIM3uzjKBysgSBfmC/+fCXycG2KJRm6gynC3FUheayUUj0GsPbrbs1V4Wgvvf8N3rlgDG0YWw=="}} Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: exception: Key pair 'tempest-keypair-1553701761' already exists. Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1553701761', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5VQgib7UAob0rVZfMAZPTBEEgGJMNAohqBVF8yzJeqqLZ+HxzHp3XmWwIM3uzjKBysgSBfmC/+fCXycG2KJRm6gynC3FUheayUUj0GsPbrbs1V4Wgvvf8N3rlgDG0YWw=='}}} Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result.read() Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '6dbd1ce0900b45f7a853ceac99df932b-tempest-keypair-1553701761' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 25 01:13:44.676044 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi session.flush() Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result.read() Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 25 01:13:44.680071 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '6dbd1ce0900b45f7a853ceac99df932b-tempest-keypair-1553701761' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 25, 1, 13, 44, 646469), 'updated_at': None, 'name': 'tempest-keypair-1553701761', 'user_id': '6dbd1ce0900b45f7a853ceac99df932b', 'fingerprint': 'cd:a1:70:8d:95:ed:f0:a7:50:70:09:6a:75:b1:a2:e5', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5VQgib7UAob0rVZfMAZPTBEEgGJMNAohqBVF8yzJeqqLZ+HxzHp3XmWwIM3uzjKBysgSBfmC/+fCXycG2KJRm6gynC3FUheayUUj0GsPbrbs1V4Wgvvf8N3rlgDG0YWw==', 'type': 'ssh'}] Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi keypair.create() Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._create() Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1553701761' already exists. Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 25 01:13:44.688355 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1553701761' already exists. Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1553701761' already exists. Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 409 to user: Key pair 'tempest-keypair-1553701761' already exists. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c90befa-22c7-4e42-9e55-0aed964f1fb8 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.151608 Sep 25 01:13:44.696461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1318/2613] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:44 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:13:44.699791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4335aa90-3c14-4d4b-bda8-5a58c32bca21 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Calling method '.version_select at 0x7f7bf0028d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:44.751479 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4335aa90-3c14-4d4b-bda8-5a58c32bca21 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553701761" status: 202 len: 0 microversion: 2.1 time: 0.064715 Sep 25 01:13:44.753816 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1319/2614] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553701761 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:13:44.773736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dead4b2b-a957-4603-9423-684802a6988a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bf02bb310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjGsyO5u5p71CkDHDbsHEUJekmlzCpNFHD6IP/qXcYCA6nEMU1j6vTrBhEQo/c7/Az00fXyGlQ4SMR6/F2CMODvhdE3cyQIbfSOILsIP+6p/dHh4nYJEN/+Iko2A9gaKA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dead4b2b-a957-4603-9423-684802a6988a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 247 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjGsyO5u5p71CkDHDbsHEUJekmlzCpNFHD6IP/qXcYCA6nEMU1j6vTrBhEQo/c7/Az00fXyGlQ4SMR6/F2CMODvhdE3cyQIbfSOILsIP+6p/dHh4nYJEN/+Iko2A9gaKA=="}} Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjGsyO5u5p71CkDHDbsHEUJekmlzCpNFHD6IP/qXcYCA6nEMU1j6vTrBhEQo/c7/Az00fXyGlQ4SMR6/F2CMODvhdE3cyQIbfSOILsIP+6p/dHh4nYJEN/+Iko2A9gaKA=='}}} Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi '' Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:13:44.783750 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dead4b2b-a957-4603-9423-684802a6988a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dead4b2b-a957-4603-9423-684802a6988a tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023872 Sep 25 01:13:44.788483 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1320/2615] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:44 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:13:44.807090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bebd44310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1306277117", "public_key": " "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:44.853043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:44.861516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for user 6dbd1ce0900b45f7a853ceac99df932b and project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:44.907525 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 95 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1306277117", "public_key": " "}} Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: exception: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1306277117', 'public_key': ' '}}} Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.909484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92ea24e9-241b-4ac4-a1b7-4b8c66c57914 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114882 Sep 25 01:13:44.913708 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1321/2616] 10.222.0.16 () {60 vars in 1158 bytes} [Sun Sep 25 01:13:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:44.934003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affcce72-88eb-458b-ae3b-ebd111f5cfcb", "name": "network-vif-plugged", "status": "completed", "tag": "3e636bb7-2165-4a12-be1f-c66e562270f6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:44.956791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:44.957284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:44.957756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:44.988992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] Creating event network-vif-plugged:3e636bb7-2165-4a12-be1f-c66e562270f6 for instance affcce72-88eb-458b-ae3b-ebd111f5cfcb on n-h2-master-1 Sep 25 01:13:45.007508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:13:45.034429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3eb362fe-6fdf-4445-a221-60a60d3a778b req-15ae318d-7b66-4b16-bc11-8cc483faeaad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119945 Sep 25 01:13:45.035106 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1322/2617] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:45.043165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd48a745-7e73-4c68-9a9a-3d635d1ec6e6 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bebd44430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+QmFGWiBe/zpeOF51Hm4ky0ZfEA5cloQiyUzTBXpET1SGQ1NxrfZuChEAjOhdB3DLDm99sQkcY4tLCqEJIXa0PXMMUnzXMII/vBjCPj8UZKbL1EDBRe32IYag37ING5w=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd48a745-7e73-4c68-9a9a-3d635d1ec6e6 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 507 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+QmFGWiBe/zpeOF51Hm4ky0ZfEA5cloQiyUzTBXpET1SGQ1NxrfZuChEAjOhdB3DLDm99sQkcY4tLCqEJIXa0PXMMUnzXMII/vBjCPj8UZKbL1EDBRe32IYag37ING5w=="}} Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+QmFGWiBe/zpeOF51Hm4ky0ZfEA5cloQiyUzTBXpET1SGQ1NxrfZuChEAjOhdB3DLDm99sQkcY4tLCqEJIXa0PXMMUnzXMII/vBjCPj8UZKbL1EDBRe32IYag37ING5w=='}}} Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 25 01:13:45.047683 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd48a745-7e73-4c68-9a9a-3d635d1ec6e6 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:45.050665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd48a745-7e73-4c68-9a9a-3d635d1ec6e6 tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011327 Sep 25 01:13:45.063727 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1323/2618] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:45 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:13:45.071389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:45.072409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:45.085079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:45.085802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:45.086294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:45.087028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:45.087495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:45.087927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:45.465086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:45.515291 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-afcf9c9b-eeb9-44ad-9fdc-b6b63013ba9a tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.449795 Sep 25 01:13:45.518305 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1324/2619] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:45 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:45.534971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Action: 'create', calling method: .version_select at 0x7f7bf04d68b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-154277474", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:45.573295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:45.581460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Getting quotas for user 6dbd1ce0900b45f7a853ceac99df932b and project 63c254bcf66542ae9c5bdeb70c07245d. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:45.606015 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 117 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-154277474", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: exception: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-154277474', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 25 01:13:45.614218 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 25 01:13:45.618809 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:45.623372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:45.626127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ceb5556d-df66-4ea4-8e6b-d4af2b12849d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103773 Sep 25 01:13:45.626341 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1325/2620] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:13:45.646454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:45.650008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:45.673564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:45.674844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:45.676787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:45.678254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:45.680988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:45.681742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:45.735737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:45.748294 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17ca5858-7c0f-4cfa-8b60-34006725d42c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1679 microversion: 2.1 time: 1.277053 Sep 25 01:13:45.750466 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1296/2621] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:44 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1679 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:45.770062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:45.770980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:45.807374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:45.809567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:45.810213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:45.813595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:45.814537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:45.815056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:46.013129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:46.025258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b6df21bb-329f-4c45-89f2-0b254165794b tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1223 microversion: 2.1 time: 0.268655 Sep 25 01:13:46.027359 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1297/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:45 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1223 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:46.041926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63be042e-2e67-4dd9-9bda-184ef462e38d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Calling method '.version_select at 0x7f7bf05d9a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:46.078538 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-63be042e-2e67-4dd9-9bda-184ef462e38d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-73182522 not found for user 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63be042e-2e67-4dd9-9bda-184ef462e38d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Request method failure captured: Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-73182522 HTTP/1.1 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tGCts36KwlYJ425fB3v-yhPFXyNhXBKcq-q7Msnyuhmblqanh_40wyqmM7e9fK3pIeMP9CRGDuo9vpLbEoPOOuiWKegrf8nGG4HmsY9n-tHuG6OvBp8Vw0T3E-0kDjv3itiYnBnPkAkE4Om-XJASmdqDil4vix2wYddaOsxcjz1t0 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63c254bcf66542ae9c5bdeb70c07245d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63c254bcf66542ae9c5bdeb70c07245d"}]}] Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 63c254bcf66542ae9c5bdeb70c07245d Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1493711942 Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1493711942-project Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: exception: Keypair tempest-keypair-non-existent-73182522 not found for user 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'tempest-keypair-non-existent-73182522'} Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise self.value Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-73182522 not found for user 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:46.081009 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-73182522 not found for user 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-73182522 not found for user 6dbd1ce0900b45f7a853ceac99df932b Sep 25 01:13:46.085706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:46.101832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63be042e-2e67-4dd9-9bda-184ef462e38d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] Returning 404 to user: Keypair tempest-keypair-non-existent-73182522 not found for user 6dbd1ce0900b45f7a853ceac99df932b {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:46.102852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63be042e-2e67-4dd9-9bda-184ef462e38d tempest-KeyPairsNegativeTestJSON-1493711942 tempest-KeyPairsNegativeTestJSON-1493711942-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-73182522" status: 404 len: 143 microversion: 2.1 time: 0.074384 Sep 25 01:13:46.106005 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1298/2623] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-73182522 => generated 143 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:46.300749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:46.316680 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad97837e-0212-40ef-a197-7f55416d0dc4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1470 microversion: 2.1 time: 0.682508 Sep 25 01:13:46.333304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1326/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:45 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1470 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:46.550047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:46.551375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:46.560110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:46.560896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:46.562180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:46.563118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:46.563675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:46.564358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:46.714322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:46.776940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:46.779208 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:46.797063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:46.797687 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a1b829e-e299-4062-a56b-4ff31e621597 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.245692 Sep 25 01:13:46.806018 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1299/2625] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:46 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:46.835685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:46.836519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:46.837109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:46.843247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:46.845681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:46.846397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:47.049595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:47.050465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:47.061233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:47.062141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:47.062972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:47.063349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:47.063784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:47.064213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:47.353004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:47.367154 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3240f346-6c0f-4115-af3a-5ce808f1057c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1285 microversion: 2.1 time: 0.321816 Sep 25 01:13:47.370510 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1300/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:47 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1285 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:47.396852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:47.400958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:47.409352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:47.410742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:47.412050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:47.415094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:47.415785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:47.416573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:47.599029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:47.609139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ed707fe-45be-4e59-b9cd-b31b92c768e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1679 microversion: 2.1 time: 0.838105 Sep 25 01:13:47.612374 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1327/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:46 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1679 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:47.839531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:47.840240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:47.854002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:47.856032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:47.856655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:47.857592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:47.858319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:47.858923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:48.086873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:48.130013 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4056a2f-20bf-46d7-af34-8a099b89f282 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.297250 Sep 25 01:13:48.130626 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1328/2628] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:47 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:48.147079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:48.178743 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c89692af-7eef-45e9-b615-121a330d8ab5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1462 microversion: 2.1 time: 0.806877 Sep 25 01:13:48.185042 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1301/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:47 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1462 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:48.210132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:48.210971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:48.219295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:48.219695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:48.220211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:48.221045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:48.221888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:48.222435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:48.397833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:48.398546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:48.407075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:48.407571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:48.411227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:48.415075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:48.416066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:48.418462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:48.618222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:48.632031 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e00ca79-5a0e-4866-aff8-ba69c030e81f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1285 microversion: 2.1 time: 0.239905 Sep 25 01:13:48.632621 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1302/2630] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:48 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:48.659159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:48.660098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:48.670292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:48.673368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:48.688123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:48.690139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:48.690945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:48.691932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:49.345374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:49.358068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-792701ea-fc2a-4c3f-92c9-c9d5d489f9bb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1611 microversion: 2.1 time: 0.709423 Sep 25 01:13:49.359195 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1303/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:48 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1611 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:49.382418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:49.395692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:49.407209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:49.407975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:49.409823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:49.418657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:49.419644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:49.422890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:49.454901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-becf65d3-9b07-40a2-96e6-87f0397f5582 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1613 microversion: 2.1 time: 1.246477 Sep 25 01:13:49.455894 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1329/2632] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:48 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1613 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:49.485944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e6cbd3f-9ee3-4b9c-9be9-f176fdbbd7a7 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '.version_select at 0x7f7bf035dca0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:49.489709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e6cbd3f-9ee3-4b9c-9be9-f176fdbbd7a7 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:49.491250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e6cbd3f-9ee3-4b9c-9be9-f176fdbbd7a7 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:49.491888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e6cbd3f-9ee3-4b9c-9be9-f176fdbbd7a7 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:49.501929 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e6cbd3f-9ee3-4b9c-9be9-f176fdbbd7a7 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.020242 Sep 25 01:13:49.519550 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1330/2633] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:13:49 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:13:49.660098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:49.662438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:49.676748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:49.678183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:49.678941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:49.681323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:49.682203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:49.683512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:49.698457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:49.757047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-afbc099c-203d-4ed1-bdcd-730acb221cc3 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.394551 Sep 25 01:13:49.757971 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1304/2634] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:49 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:49.764905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-527322234", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:49.857722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:13:50.030742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:50.042284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-735b9bdb-1393-4a54-a19b-f0556533283e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1285 microversion: 2.1 time: 0.386654 Sep 25 01:13:50.042880 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1331/2635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:49 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1285 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:50.386693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:50.387539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:50.399011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:50.400514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:50.404654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:50.406556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:50.410212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:50.410935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:50.795703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:50.809449 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ede82cd5-1cb2-400f-b06f-7729315847c9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 200 len: 1611 microversion: 2.1 time: 0.430160 Sep 25 01:13:50.813437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1332/2636] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:50 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 1611 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:50.826287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-16a7d3e6-c8c2-46ab-a70a-1296cb24dae6 req-fe85b424-dfa7-4d42-9f44-a35ec5c15ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e709904a-78e9-4d39-ad67-c7e9ffca9762", "name": "network-vif-deleted", "tag": "5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:50.854360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-16a7d3e6-c8c2-46ab-a70a-1296cb24dae6 req-fe85b424-dfa7-4d42-9f44-a35ec5c15ba6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:50.855399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-16a7d3e6-c8c2-46ab-a70a-1296cb24dae6 req-fe85b424-dfa7-4d42-9f44-a35ec5c15ba6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:50.857984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-16a7d3e6-c8c2-46ab-a70a-1296cb24dae6 req-fe85b424-dfa7-4d42-9f44-a35ec5c15ba6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:50.897256 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-16a7d3e6-c8c2-46ab-a70a-1296cb24dae6 req-fe85b424-dfa7-4d42-9f44-a35ec5c15ba6 service nova] Creating event network-vif-deleted:5bc0ac0b-6806-42ad-a4e6-7f56b12c7e06 for instance e709904a-78e9-4d39-ad67-c7e9ffca9762 on n-h2-master-1 Sep 25 01:13:50.907438 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-16a7d3e6-c8c2-46ab-a70a-1296cb24dae6 req-fe85b424-dfa7-4d42-9f44-a35ec5c15ba6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092382 Sep 25 01:13:50.916725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1333/2637] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:50.928605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:50.932193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:50.946323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:50.950089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:50.954492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:50.955399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:50.956161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:50.956857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.052767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:13:51.053833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:13:51.054684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:13:51.055291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:13:51.056017 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:13:51.082068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:51.082887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:51.083555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.084500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:51.085149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:51.085867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.127155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:51.134504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for user 5db19a97588e41d1858915c9ccc48620 and project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:51.167825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:13:51.178795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:13:51.271033 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81365055-ff51-4f39-bf4e-ab8206f91ae5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511809 Sep 25 01:13:51.278888 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1305/2638] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:13:51.285465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:51.292313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:51.323886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:51.339892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:51.341422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.344678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:51.346992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:51.347555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.521356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:51.623046 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bf6980f0-f6bc-483f-aa85-c1c95b9f9b51 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.704407 Sep 25 01:13:51.623678 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1334/2639] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:50 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:51.645597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-411173e5-5cda-4806-8893-8b6d8a41934a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:51.646213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-411173e5-5cda-4806-8893-8b6d8a41934a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:51.883387 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-411173e5-5cda-4806-8893-8b6d8a41934a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:51.895051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-411173e5-5cda-4806-8893-8b6d8a41934a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1212 microversion: 2.1 time: 0.264479 Sep 25 01:13:51.919850 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1335/2640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:51 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1212 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:51.936013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:51.937063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:51.948666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:51.948666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:51.948931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.949632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:51.950329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:51.950871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:51.978364 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 HTTP/1.1 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e709904a-78e9-4d39-ad67-c7e9ffca9762'} Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:51.980454 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1e914d0e-be1f-4d5d-bf35-d41622ec8621 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 404 len: 111 microversion: 2.1 time: 0.060104 Sep 25 01:13:51.985516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1336/2641] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:51 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:13:52.015269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2d2b707-dedb-4e9b-a525-4c20e3b07725 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '.version_select at 0x7f7bf07805e0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:52.102451 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2d2b707-dedb-4e9b-a525-4c20e3b07725 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540415353" status: 202 len: 0 microversion: 2.1 time: 0.109246 Sep 25 01:13:52.103064 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1337/2642] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:13:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540415353 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:13:52.283271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:52.299722 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84ace160-bf91-41f2-bac5-6c2b52e88983 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 1.018781 Sep 25 01:13:52.309337 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1306/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:51 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:52.657242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:52.657905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:52.668073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:52.673531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:52.674762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:52.676541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:52.678299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:52.679331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:52.923794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:52.924553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:52.939509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:52.940017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:52.940465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:52.943633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:52.944127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:52.946375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:53.065155 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:53.078735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:53.095299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:53.109779 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59c24b5e-1c48-489c-8c2b-968b273ef907 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1264 microversion: 2.1 time: 0.190393 Sep 25 01:13:53.125291 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1307/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:52 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:53.140491 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-baecfb50-f3a8-4bff-a1d5-431fd5c13986 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.486827 Sep 25 01:13:53.141125 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1338/2645] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:52 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:53.333498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:53.334794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:53.348066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:53.348592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:53.349043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:53.349807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:53.350271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:53.350698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:54.134084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:54.136838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:54.140430 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:54.151297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:54.152334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:54.153057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:54.154456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:54.155465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:54.156449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:54.444510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:54.456653 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b8fe7f2-09e9-4d90-a81e-838743d11327 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1270 microversion: 2.1 time: 0.327330 Sep 25 01:13:54.457487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1339/2646] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:54 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1270 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:54.463934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:54.464833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:54.485280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:54.487265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:54.488178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:54.489370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:54.490583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:54.491640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:54.628059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:54.630423 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:54.642736 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd0c5a92-365b-486f-847b-2d3de248a338 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 1.314189 Sep 25 01:13:54.646251 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1308/2647] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:53 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:54.820984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:54.866249 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d395208-f0af-4f7c-b118-ad1bd0c77dae tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.407851 Sep 25 01:13:54.867609 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1340/2648] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:54 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:54.957196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2aa3266b-7319-40fe-b182-75beb84298fd tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bf406e160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1118583481", "description": "tempest-description-677127567"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:55.483936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:55.485337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:55.496845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:55.501745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:55.502469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:55.503400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:55.512102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:55.512851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:55.744977 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2aa3266b-7319-40fe-b182-75beb84298fd tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.980598 Sep 25 01:13:55.754174 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1309/2649] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:13:54 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:55.754174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:55.754174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:55.761589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:55.767597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:55.768393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:55.770859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:55.771428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:55.777084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:55.779506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:55.791333 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2bfa47c-eaee-4fe7-871e-0e315cb6a6ca tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1270 microversion: 2.1 time: 0.313022 Sep 25 01:13:55.793110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1341/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:55 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1270 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:55.804436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3c6de55-280a-41d0-83bd-f951ea86d442 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bebd44af0>, body: {"security_group_rule": {"parent_group_id": "ff55a6a2-9b0a-4543-8029-85f027df17d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:56.472230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:56.500831 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92fa46bf-cfd7-42e5-ba4a-3aaefbbe70d9 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.753385 Sep 25 01:13:56.501759 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1310/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:55 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:56.515809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:56.520767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:56.538098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:56.538885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:56.539500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:56.540389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:56.541010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:56.541771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:56.839748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:56.889706 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b7a4e1c-95e3-4e09-b0d7-2d75d4fa4105 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.384795 Sep 25 01:13:56.914961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1311/2652] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:56 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:56.924609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8e274c0c-68b6-441e-9652-5709480c24fa req-6a767a93-a9d0-4c4b-a634-7476b4566ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5265387-5cfb-415f-af52-f666e3d4ee84", "tag": "5ed4410c-8a7e-489f-a23f-0384cbfcafb4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:56.955064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8e274c0c-68b6-441e-9652-5709480c24fa req-6a767a93-a9d0-4c4b-a634-7476b4566ace service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:56.957619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8e274c0c-68b6-441e-9652-5709480c24fa req-6a767a93-a9d0-4c4b-a634-7476b4566ace service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:56.958333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8e274c0c-68b6-441e-9652-5709480c24fa req-6a767a93-a9d0-4c4b-a634-7476b4566ace service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:56.985637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8e274c0c-68b6-441e-9652-5709480c24fa req-6a767a93-a9d0-4c4b-a634-7476b4566ace service nova] Creating event network-changed:5ed4410c-8a7e-489f-a23f-0384cbfcafb4 for instance a5265387-5cfb-415f-af52-f666e3d4ee84 on n-h2-master-1 Sep 25 01:13:56.995963 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8e274c0c-68b6-441e-9652-5709480c24fa req-6a767a93-a9d0-4c4b-a634-7476b4566ace service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078369 Sep 25 01:13:57.007118 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1312/2653] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:57.031414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:57.034234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:57.041296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.042488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.043239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.044239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.045018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.046331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.236735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lazy-loading 'services' on Instance uuid 77babc4e-c612-45ee-8bd0-f477b4329ccd {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:57.289998 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3c6de55-280a-41d0-83bd-f951ea86d442 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.495090 Sep 25 01:13:57.291901 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1342/2654] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:13:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:57.297487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:57.298347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:57.314198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.317044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.317747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.318668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.319678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.330181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.403645 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b32d55c-bd5b-46dd-ab3f-920fe52312c6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments/3b9783c2-c1b2-4ef1-af75-f59962296832" status: 202 len: 0 microversion: 2.1 time: 0.393827 Sep 25 01:13:57.404783 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1313/2655] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:13:57 2022] DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments/3b9783c2-c1b2-4ef1-af75-f59962296832 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:13:57.413174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13d6afd2-bdc7-4dbc-8e37-ed59f575f129 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bf005edc0>, body: {"security_group_rule": {"parent_group_id": "ff55a6a2-9b0a-4543-8029-85f027df17d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:57.555814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:57.575142 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fefd6da-108d-4ad5-85ac-ddfb9623ccdf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1270 microversion: 2.1 time: 0.278765 Sep 25 01:13:57.575808 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1343/2656] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:57 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1270 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:57.595425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:57.609144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:57.634245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.634754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.635235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.638895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.639444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.639957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.695275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1547689-d746-4f3c-9865-d9a4e4d0d900 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118339 Sep 25 01:13:57.701437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1344/2657] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:13:57 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:57.708070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:57.709519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:57.719114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.720536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.722048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:57.723156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:57.723775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:57.724381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:58.001241 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-13d6afd2-bdc7-4dbc-8e37-ed59f575f129 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: This rule already exists in group ff55a6a2-9b0a-4543-8029-85f027df17d3 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13d6afd2-bdc7-4dbc-8e37-ed59f575f129 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 138 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: {"security_group_rule": {"parent_group_id": "ff55a6a2-9b0a-4543-8029-85f027df17d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: exception: This rule already exists in group ff55a6a2-9b0a-4543-8029-85f027df17d3 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ff55a6a2-9b0a-4543-8029-85f027df17d3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group ff55a6a2-9b0a-4543-8029-85f027df17d3 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group ff55a6a2-9b0a-4543-8029-85f027df17d3 Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:13:58.002998 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group ff55a6a2-9b0a-4543-8029-85f027df17d3 Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13d6afd2-bdc7-4dbc-8e37-ed59f575f129 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 400 to user: This rule already exists in group ff55a6a2-9b0a-4543-8029-85f027df17d3 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13d6afd2-bdc7-4dbc-8e37-ed59f575f129 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.598537 Sep 25 01:13:58.007243 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1314/2658] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:13:57 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 600 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:13:58.015803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:58.018536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:58.044406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:58.049312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:58.051116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:58.052507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:58.057812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:58.058342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:58.343405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:58.408743 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c20a9779-13ab-4234-a071-3f48bd878c02 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.402234 Sep 25 01:13:58.409348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1315/2659] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:58 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:58.421207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33a98949-a86c-423e-9cfc-bec051eb27a3 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7beb96d3a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:58.484844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:58.497248 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e69dcef4-474c-4c94-9404-07ad8278f5ec tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.792602 Sep 25 01:13:58.510361 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1345/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:57 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:58.609194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:58.610942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:58.621538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:58.622304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:58.622962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:58.626519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:58.627227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:58.627843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:59.444418 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33a98949-a86c-423e-9cfc-bec051eb27a3 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/67cb5993-fc03-455c-a780-bf7ff3a02fb2" status: 202 len: 0 microversion: 2.1 time: 1.033748 Sep 25 01:13:59.446363 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1316/2661] 10.222.0.16 () {58 vars in 1287 bytes} [Sun Sep 25 01:13:58 2022] DELETE /compute/v2.1/os-security-group-rules/67cb5993-fc03-455c-a780-bf7ff3a02fb2 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:13:59.453737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:59.478481 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa75f00c-5aac-4044-be93-6911b013ec17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.876566 Sep 25 01:13:59.479640 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1346/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:58 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:59.485506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:59.488098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:59.512689 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:59.515085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:59.515640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:59.516093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:59.518677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:59.519582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:59.525498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:59.612972 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e258687-ba71-47fa-a25b-671fd893e388 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132175 Sep 25 01:13:59.615890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1347/2663] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:13:59 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:59.628391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:59.629013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:59.649260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:59.650206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:59.650822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:59.651699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:59.652695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:59.655760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:59.771535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:13:59.818339 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b187dee0-6c1b-451b-b559-2da99857f1cb tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1925 microversion: 2.75 time: 0.199490 Sep 25 01:13:59.819710 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1348/2664] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:13:59 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1925 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:13:59.825585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e2c4e7a-6d8d-4f83-8faa-0bd6d13132ba tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bf4003b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1781729360", "description": "tempest-description-1047796984"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:59.870190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b70091bf-a773-42f9-b4f0-d2ab560eac07 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Action: 'create', calling method: .version_select at 0x7f7bebba01f0>, body: {"keypair": {"name": "tempest-keypair-1992395302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+ye4VEPD2ibEYcUP9OKcal+KOT2Saa8/0KaJGXZB4o9FhtiY/pRAnTGWurgcaux7rDaNTrNTs0jwdJpqB0JiwS0rxLP1S7zWAB5v/rmhktBOPEsq39IB6rbbd0WdDT6g=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:59.910195 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b70091bf-a773-42f9-b4f0-d2ab560eac07 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Getting quotas for project b730f5960b50450b9f6e724945ae8613. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:59.917199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b70091bf-a773-42f9-b4f0-d2ab560eac07 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Getting quotas for user 88a8086a0ed34e4898db9e4d4a632a97 and project b730f5960b50450b9f6e724945ae8613. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:59.965548 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b70091bf-a773-42f9-b4f0-d2ab560eac07 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.509319 Sep 25 01:13:59.966901 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1317/2665] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:13:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:59.984246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:59.988103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:00.001242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:00.004697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:00.006314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:00.007918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:00.013210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:00.015391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:00.425048 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1e2c4e7a-6d8d-4f83-8faa-0bd6d13132ba tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.602949 Sep 25 01:14:00.425825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1349/2666] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:13:59 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:00.441594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-293b4db0-6c60-472f-b32b-112c2b6f60b0 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bebd74040>, body: {"security_group_rule": {"parent_group_id": "0d5bb11f-d93e-4c1e-997f-a7b2b305cfa0", "ip_protocol": "tcp", "from_port": 1459014143, "to_port": 22}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:00.598814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-293b4db0-6c60-472f-b32b-112c2b6f60b0 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Invalid port range 1459014143:22. Former value cannot be greater than the later Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-293b4db0-6c60-472f-b32b-112c2b6f60b0 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 146 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: {"security_group_rule": {"parent_group_id": "0d5bb11f-d93e-4c1e-997f-a7b2b305cfa0", "ip_protocol": "tcp", "from_port": 1459014143, "to_port": 22}} Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid port range 1459014143:22. Former value cannot be greater than the later Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0d5bb11f-d93e-4c1e-997f-a7b2b305cfa0', 'ip_protocol': 'tcp', 'from_port': 1459014143, 'to_port': 22}}} Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1459014143:22. Former value cannot be greater than the later Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1459014143:22. Former value cannot be greater than the later Sep 25 01:14:00.600374 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1459014143:22. Former value cannot be greater than the later Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-293b4db0-6c60-472f-b32b-112c2b6f60b0 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 400 to user: Invalid port range 1459014143:22. Former value cannot be greater than the later {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-293b4db0-6c60-472f-b32b-112c2b6f60b0 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.166433 Sep 25 01:14:00.605021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1350/2667] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:14:00 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:14:00.615686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:00.616328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:00.631090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:00.631859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:00.632486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:00.632690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:00.637236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:00.637760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:00.638703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:00.659770 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d601051-504b-4796-9f50-528f4153b93a tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.686461 Sep 25 01:14:00.661134 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1318/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:59 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:00.672861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7c46ce3-1e6a-467e-a6a3-43cd99ae9fdc tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7beba460d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-622771273", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:00.678602 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d7c46ce3-1e6a-467e-a6a3-43cd99ae9fdc tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Security group id should be uuid Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7c46ce3-1e6a-467e-a6a3-43cd99ae9fdc tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 130 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-622771273", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: exception: Security group id should be uuid Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-622771273', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:00.681289 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:00.686293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 25 01:14:00.686293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:00.690747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7c46ce3-1e6a-467e-a6a3-43cd99ae9fdc tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 400 to user: Security group id should be uuid {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:00.692180 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d7c46ce3-1e6a-467e-a6a3-43cd99ae9fdc tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.029101 Sep 25 01:14:00.692999 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1319/2669] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:14:00 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:00.705661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:00.712306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:00.722539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:00.723408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:00.724110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:00.725106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:00.726265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:00.731615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:00.812295 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d5a9cd2-fddd-4066-b3ba-27454870fdb5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103667 Sep 25 01:14:00.814142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1320/2670] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:14:00 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:00.825493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e3ec80e-7f19-4abb-8050-8b337ae45732 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7beba463a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-632144885", "description": "tempest-description-1064403041"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:01.094730 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:01.249831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:01.270865 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3ee07c6-2b8e-4ee7-a45e-f74b89cff675 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.666038 Sep 25 01:14:01.293890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1351/2671] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:00 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:01.302069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-440ccd77-b76d-4dd4-89c1-c3779e385f76 req-6952640a-bbd8-40bf-8402-8366865d6b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:01.331322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-440ccd77-b76d-4dd4-89c1-c3779e385f76 req-6952640a-bbd8-40bf-8402-8366865d6b92 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:01.335449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-440ccd77-b76d-4dd4-89c1-c3779e385f76 req-6952640a-bbd8-40bf-8402-8366865d6b92 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:01.336086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-440ccd77-b76d-4dd4-89c1-c3779e385f76 req-6952640a-bbd8-40bf-8402-8366865d6b92 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:01.370985 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-440ccd77-b76d-4dd4-89c1-c3779e385f76 req-6952640a-bbd8-40bf-8402-8366865d6b92 service nova] Creating event network-changed:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h2-master-1 Sep 25 01:14:01.374838 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-440ccd77-b76d-4dd4-89c1-c3779e385f76 req-6952640a-bbd8-40bf-8402-8366865d6b92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077338 Sep 25 01:14:01.375846 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1352/2672] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:01.383853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:01.384697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:01.395536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:01.396114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:01.396710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:01.397942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:01.398490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:01.398992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:01.612395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:14:01.660641 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-47a1b33a-8b78-493a-86ac-be5b899dfd04 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1931 microversion: 2.75 time: 0.283398 Sep 25 01:14:01.664893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1353/2673] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:01 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1931 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:14:01.688872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:01.689777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:01.710514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:01.711575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:01.712361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:01.713563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:01.714977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:01.717068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:01.894078 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=28 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:02.094558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e3ec80e-7f19-4abb-8050-8b337ae45732 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.274541 Sep 25 01:14:02.095179 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1321/2674] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:14:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:02.100027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:02.102249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:02.137546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:02.138038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:02.141681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:02.142681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:02.143657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:02.145880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:02.223376 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20f43f57-29b9-467b-a088-a9d4fbb64ed7 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114218 Sep 25 01:14:02.249044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1322/2675] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:14:02 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:02.276154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac5cb806-9dff-4585-ae70-2c2fcf5dda0d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bf05c0f70>, body: {"security_group_rule": {"parent_group_id": "c89d5c44-c767-4466-8946-f9a9b11b64f9", "ip_protocol": "tempest-999-1966276664", "from_port": 22, "to_port": 22}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:02.521047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:02.531677 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fce7ee46-35de-4a00-9a7f-86febb0dea2c tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.847644 Sep 25 01:14:02.536260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1354/2676] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:01 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:02.553489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:02.554572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:02.569521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:02.570277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:02.572666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:02.574207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:02.582154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:02.585274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:02.965349 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ac5cb806-9dff-4585-ae70-2c2fcf5dda0d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Invalid IP protocol tempest-999-1966276664. Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac5cb806-9dff-4585-ae70-2c2fcf5dda0d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 157 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: {"security_group_rule": {"parent_group_id": "c89d5c44-c767-4466-8946-f9a9b11b64f9", "ip_protocol": "tempest-999-1966276664", "from_port": 22, "to_port": 22}} Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid IP protocol tempest-999-1966276664. Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c89d5c44-c767-4466-8946-f9a9b11b64f9', 'ip_protocol': 'tempest-999-1966276664', 'from_port': 22, 'to_port': 22}}} Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1966276664. Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1966276664. Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:02.967747 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1966276664. Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:02.972723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac5cb806-9dff-4585-ae70-2c2fcf5dda0d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 400 to user: Invalid IP protocol tempest-999-1966276664. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:02.976077 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac5cb806-9dff-4585-ae70-2c2fcf5dda0d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.717846 Sep 25 01:14:02.976077 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1323/2677] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:14:02 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 726 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:14:02.981616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:02.985601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:03.002692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.003967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.010277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.011209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.012931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.013653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.215519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] Lazy-loading 'services' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:14:03.250857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37d00dee-a5aa-42f8-84dd-73acb285c8c4 tempest-ServersAdmin275Test-717299199 tempest-ServersAdmin275Test-717299199-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1916 microversion: 2.75 time: 0.273472 Sep 25 01:14:03.269081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:03.280106 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1324/2678] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:02 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1916 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:14:03.290627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a4398a3-9eaf-445c-b7dd-b627037020ef tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7beb96d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-246606256", "description": "tempest-description-1246205787"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:03.294321 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb6cea51-a4ee-4ce9-acb7-bfdc2b4bd301 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.753898 Sep 25 01:14:03.299652 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1355/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:02 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:03.305976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:03.308582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:03.316208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.316942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.317840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.318992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.319783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.320389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.365498 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-915228d3-2c95-427b-a12d-cddeaab42238 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063206 Sep 25 01:14:03.366754 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1356/2680] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:14:03 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:03.372682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:03.374202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:03.381510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.382278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.382895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.383776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.391463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.392430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.452853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:14:03.456293 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:03.619739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22ec627d-c6d6-49cb-8756-c6016619d1b2 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 204 len: 0 microversion: 2.75 time: 0.249599 Sep 25 01:14:03.621006 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1357/2681] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:14:03 2022] DELETE /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:14:03.636586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:03.642857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:03.671328 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a4398a3-9eaf-445c-b7dd-b627037020ef tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.391018 Sep 25 01:14:03.672409 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1325/2682] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:14:03 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:03.677587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:03.678426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:03.687605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.688137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.689797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.691012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.691614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.691901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.693552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.694397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.695022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.698733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:03.699447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:03.700054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:03.933266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:03.955380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:03.981317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:03.985964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:03.996331 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-199090bb-4de6-4e93-b0dc-697d9d4ca72e tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.369284 Sep 25 01:14:03.997751 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1358/2683] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:03 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:04.003741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a365e51-5963-4785-86f1-a897207827e0 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1442 microversion: 2.75 time: 0.330070 Sep 25 01:14:04.007930 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1326/2684] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:03 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1442 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:14:04.013930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4d03722-a414-4737-a485-cba0a30efe9f tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bebdd15e0>, body: {"security_group_rule": {"parent_group_id": "7366cad6-8c71-4ecc-9774-c52e361fac79", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:04.033928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:04.055515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:04.058467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Searching by: {'deleted': False, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:14:04.074808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.082853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.083907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:04.089014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.098209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.101091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:04.141430 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b4d03722-a414-4737-a485-cba0a30efe9f tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4d03722-a414-4737-a485-cba0a30efe9f tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 138 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: {"security_group_rule": {"parent_group_id": "7366cad6-8c71-4ecc-9774-c52e361fac79", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7366cad6-8c71-4ecc-9774-c52e361fac79', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 25 01:14:04.144368 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 25 01:14:04.148973 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:04.157980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4d03722-a414-4737-a485-cba0a30efe9f tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:04.164205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4d03722-a414-4737-a485-cba0a30efe9f tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.162158 Sep 25 01:14:04.173311 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1359/2685] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:14:03 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:14:04.190084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:14:04.195922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b1674b09-bc63-41b8-9f43-8bfe4ea389af tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bebd06ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-641541507", "description": "tempest-description-989209738"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:04.290273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-667a05a4-b04a-40ef-9ca1-5918fe5afd5e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.279665 Sep 25 01:14:04.298837 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1327/2686] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:14:04 2022] GET /compute/v2.1/servers => generated 333 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:04.313972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:04.323812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:04.329499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Searching by: {'deleted': False, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:14:04.340282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.342985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.345860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:04.346947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.348945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.349670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:04.550654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:14:04.650648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:04.658273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.659008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.659587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:04.693314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b1674b09-bc63-41b8-9f43-8bfe4ea389af tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.512519 Sep 25 01:14:04.694974 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1360/2687] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:14:04 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:04.701113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:04.704052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:04.716446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.719995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.727332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:04.745373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:04.749959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:04.751365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.067614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:05.078835 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4c8a9ea-3eb7-4d20-87e9-291e01efb9f5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.382744 Sep 25 01:14:05.082369 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1361/2688] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:04 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:05.089629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ede4d69-2d70-4ea4-90ba-ca8b4eadfe97 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.784723 Sep 25 01:14:05.090484 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1328/2689] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:14:04 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:05.098405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-55983e1e-2180-45d6-9d2f-75155293e940 req-2bf96961-5095-406f-b813-ea0e6d7815aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5265387-5cfb-415f-af52-f666e3d4ee84", "name": "network-vif-plugged", "status": "completed", "tag": "5ed4410c-8a7e-489f-a23f-0384cbfcafb4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:05.108503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.111381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:05.121012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55983e1e-2180-45d6-9d2f-75155293e940 req-2bf96961-5095-406f-b813-ea0e6d7815aa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.121831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55983e1e-2180-45d6-9d2f-75155293e940 req-2bf96961-5095-406f-b813-ea0e6d7815aa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.123335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55983e1e-2180-45d6-9d2f-75155293e940 req-2bf96961-5095-406f-b813-ea0e6d7815aa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.130399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.132115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.134845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.136394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.137112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.138573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.153415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-55983e1e-2180-45d6-9d2f-75155293e940 req-2bf96961-5095-406f-b813-ea0e6d7815aa service nova] Creating event network-vif-plugged:5ed4410c-8a7e-489f-a23f-0384cbfcafb4 for instance a5265387-5cfb-415f-af52-f666e3d4ee84 on n-h2-master-1 Sep 25 01:14:05.166104 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-55983e1e-2180-45d6-9d2f-75155293e940 req-2bf96961-5095-406f-b813-ea0e6d7815aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073725 Sep 25 01:14:05.167331 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1329/2690] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:05.175328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c47f4b2-aeb2-4493-a887-c1c61c85666d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7beb96dd30>, body: {"security_group_rule": {"parent_group_id": "62b03ba7-10b8-4988-9951-10e7c3435f5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 615390959}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:05.239255 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4c47f4b2-aeb2-4493-a887-c1c61c85666d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Invalid port range 22:615390959. Valid TCP ports should be between 1-65535 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c47f4b2-aeb2-4493-a887-c1c61c85666d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 145 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: {"security_group_rule": {"parent_group_id": "62b03ba7-10b8-4988-9951-10e7c3435f5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 615390959}} Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid port range 22:615390959. Valid TCP ports should be between 1-65535 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'security_group_rule': {'parent_group_id': '62b03ba7-10b8-4988-9951-10e7c3435f5c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 615390959}}} Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:615390959. Valid TCP ports should be between 1-65535 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:615390959. Valid TCP ports should be between 1-65535 Sep 25 01:14:05.240925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:615390959. Valid TCP ports should be between 1-65535 Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c47f4b2-aeb2-4493-a887-c1c61c85666d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 400 to user: Invalid port range 22:615390959. Valid TCP ports should be between 1-65535 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c47f4b2-aeb2-4493-a887-c1c61c85666d tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.074284 Sep 25 01:14:05.245532 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1330/2691] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:14:05 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:14:05.246399 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ca925be-4ecb-4c03-9a35-d4bd00410e9c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161283 Sep 25 01:14:05.253149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.253149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:05.253388 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1362/2692] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:14:05 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:05.259904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.260417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.260834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.261713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.262244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.262673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.265351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.267532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:05.285476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.285971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.286412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.287110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.287562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.287982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.469434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:05.500511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:05.505994 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:05.508861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:05.516265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b6cc2c9-1133-485d-aff1-78e93bcf70b6 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.271060 Sep 25 01:14:05.518066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a8da14f6-6752-4ed0-a58b-341dbff81611 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1442 microversion: 2.75 time: 0.262998 Sep 25 01:14:05.519521 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1331/2693] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:05 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:05.528856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-586ec337-bb33-4bb6-8c63-d8558985303e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.536173 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1363/2694] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:05 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1442 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:14:05.543876 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-586ec337-bb33-4bb6-8c63-d8558985303e tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022951 Sep 25 01:14:05.544731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1332/2695] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:14:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:05.557500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Action: 'create', calling method: .version_select at 0x7f7bebd06040>, body: {"security_group_rule": {"parent_group_id": "b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:05.587860 n-d-master-1 devstack@n-api.service[122385]: DEBUG neutronclient.v2_0.client [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist", "detail": ""}} {{(pid=122385) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:14:05.587860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Neutron security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 not found {{(pid=122385) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:14:05.589246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.589246 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 138 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: {"security_group_rule": {"parent_group_id": "b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: exception: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:14:05.591504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] Sep 25 01:14:05.596611 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.599669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 404 to user: Security group b44ba7e5-0cbf-457f-a9cb-6ee5ff687f65 does not exist Sep 25 01:14:05.599669 n-d-master-1 devstack@n-api.service[122385]: Neutron server returns request_ids: ['req-b54789b5-4549-47a7-8de3-a743fba71842'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:05.609685 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2dbeb736-7952-4f23-83cf-c255fa9af93e tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.070607 Sep 25 01:14:05.620650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7bebaed8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.626080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1364/2696] 10.222.0.16 () {60 vars in 1195 bytes} [Sun Sep 25 01:14:05 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:14:05.678949 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:14:05.679650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Neutron security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b not found {{(pid=122384) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 25 01:14:05.680265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] HTTP exception thrown: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.680265 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Request method failure captured: Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-group-rules/ef895ace-03f4-4eaf-b986-89d4cf1ef55b HTTP/1.1 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tSi--MBgXhIXePfi4IfSFD07sWmH8-53UEod6djaVoYlfqOl9y4k8XLsupatSN-MdykkW57jQFWDxxray9JlbIRty57-suPslVV7T4HrppFqJHJE9BcMeo97v9AfZ7MUwiOn-Xq8_gI1o2rS21CM0YJTu_7mb6hX1glOxdS-PLIQE Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd6170549f94a59898b65f2383e5d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd6170549f94a59898b65f2383e5d1e"}]}] Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ecd6170549f94a59898b65f2383e5d1e Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ad359d9027834039a45d3904d5afa0a2 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-318649107-project Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: exception: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ef895ace-03f4-4eaf-b986-89d4cf1ef55b'} Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:14:05.682643 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Returning 404 to user: Security group rule ef895ace-03f4-4eaf-b986-89d4cf1ef55b does not exist Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-0a0a08a1-11e4-4572-a35f-213b62deb400'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:05.688086 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87b69e88-8129-40fc-ba25-13324a89b773 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/ef895ace-03f4-4eaf-b986-89d4cf1ef55b" status: 404 len: 199 microversion: 2.1 time: 0.069344 Sep 25 01:14:05.698812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-481d4d40-babe-4ac7-b1df-c62d1fcab705 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7bebd371f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.704856 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1333/2697] 10.222.0.16 () {58 vars in 1287 bytes} [Sun Sep 25 01:14:05 2022] DELETE /compute/v2.1/os-security-group-rules/ef895ace-03f4-4eaf-b986-89d4cf1ef55b => generated 199 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:14:05.880380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:05.880913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:05.897728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.898396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.899161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.900035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:05.900488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:05.900910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:05.956844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:14:05.979909 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:06.137068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-41b0cc1b-dad9-443c-9671-9cb5786969b8 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 204 len: 0 microversion: 2.1 time: 0.263827 Sep 25 01:14:06.137981 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1334/2698] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:14:05 2022] DELETE /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:14:06.145296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.146402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:06.153898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.155422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.156557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.157612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.158309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.159162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.302755 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-481d4d40-babe-4ac7-b1df-c62d1fcab705 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/62b03ba7-10b8-4988-9951-10e7c3435f5c" status: 202 len: 0 microversion: 2.1 time: 0.609113 Sep 25 01:14:06.303362 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1365/2699] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:14:05 2022] DELETE /compute/v2.1/os-security-groups/62b03ba7-10b8-4988-9951-10e7c3435f5c => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:14:06.311331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.312323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:06.321944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.322382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.323014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.323897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.324340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.324910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.454089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:06.467594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-30394a2c-446d-49aa-b70d-d09cf0c83483 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.324788 Sep 25 01:14:06.468337 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1335/2700] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:06 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:06.490723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.495011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:06.510770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.511712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.512517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.513620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.515271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.516524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.578456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a03f708-b095-48d5-b63f-0d4ea6b4bafb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108953 Sep 25 01:14:06.579140 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1336/2701] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:14:06 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:14:06.583893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f78cc899-a541-47b7-be08-1b461ade64c4 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7bebce6d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.606130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:06.615030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30fd6078-1dab-4fdd-9183-b9360138df6a tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1700 microversion: 2.1 time: 0.307639 Sep 25 01:14:06.620032 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1366/2702] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:06 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1700 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:06.624898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.625558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:06.646857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.647299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.647748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.648468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.648928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.649381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.882969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:06.898636 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b1d6e9f1-170e-4f43-8601-3a8d978c2b3f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1327 microversion: 2.1 time: 0.277439 Sep 25 01:14:06.899633 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1367/2703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:06 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1327 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:06.905506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.906409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:06.916220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.917866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.918801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.919807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.921270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.921955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.922203 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f78cc899-a541-47b7-be08-1b461ade64c4 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7366cad6-8c71-4ecc-9774-c52e361fac79" status: 202 len: 0 microversion: 2.1 time: 0.341931 Sep 25 01:14:06.923203 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1337/2704] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:14:06 2022] DELETE /compute/v2.1/os-security-groups/7366cad6-8c71-4ecc-9774-c52e361fac79 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:14:06.930050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:06.930556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:06.944170 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:06.949165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.952289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.954184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.956732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.957797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.958317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.971570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:06.973279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:06.974046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:06.974621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lazy-loading 'fault' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:14:06.998109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:14:07.091232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:07.102988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:07.106621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:07.119806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f09981b-851b-4502-8566-938b54f7a647 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1447 microversion: 2.75 time: 0.218979 Sep 25 01:14:07.120519 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1368/2705] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:06 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:14:07.138609 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c545dd9-bd14-488d-a21a-fa61a60acaf1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 204 len: 0 microversion: 2.1 time: 0.213686 Sep 25 01:14:07.140223 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1338/2706] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:14:06 2022] DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:14:07.148802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7868be40-ae78-423b-9e27-d8e853804921 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7bebcff820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:07.151121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:07.151960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:07.165096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:07.165669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:07.166287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:07.167286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:07.167975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:07.168851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:07.832239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:07.843078 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9915b33a-33f7-4a2f-9fa7-40b9b4541fc1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1683 microversion: 2.1 time: 0.696102 Sep 25 01:14:07.844342 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1339/2707] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:07 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1683 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:07.849358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:07.850632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:07.858139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:07.858627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:07.859063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:07.859932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:07.860384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:07.861594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.104876 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7868be40-ae78-423b-9e27-d8e853804921 tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c89d5c44-c767-4466-8946-f9a9b11b64f9" status: 202 len: 0 microversion: 2.1 time: 0.982956 Sep 25 01:14:08.105939 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1369/2708] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:14:07 2022] DELETE /compute/v2.1/os-security-groups/c89d5c44-c767-4466-8946-f9a9b11b64f9 => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:14:08.113911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.116157 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:08.127036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.135526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.136031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.136712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.136980 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3016aad2-6199-49df-812a-6174f42cf823 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.291443 Sep 25 01:14:08.137462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.137604 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1340/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:07 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:08.138591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.139903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.157664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.158838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:08.166619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.167458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.168238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.172276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.172957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.173606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.448092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.454019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.460275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8a49c026-2449-4f75-a52d-15a543d424be tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1700 microversion: 2.1 time: 0.352882 Sep 25 01:14:08.461593 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1370/2710] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:08 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1700 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:08.462522 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d883fd0c-80e6-4673-8cdd-64150eac9a1f tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1526 microversion: 2.1 time: 0.311917 Sep 25 01:14:08.468603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-66bc4869-9cb6-41dc-bf8d-a769b9bb624c tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7bebc59e50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.485380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1341/2711] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:08 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1526 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:08.493230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.494132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:08.501871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.502876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.503312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.504079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.504531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.504948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.561111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.562218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.563433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.564255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lazy-loading 'fault' on Instance uuid f37eca7c-7c31-4441-a5a9-68211e3976b7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:14:08.624884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.642518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.646702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3949c16e4fde47108c4242a3f99ec5df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934b22e1c24a45cc87d50b89a0540f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.655825 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5b19396-f5a0-4def-9970-9973947ce928 tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 200 len: 1447 microversion: 2.75 time: 0.168304 Sep 25 01:14:08.656541 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1342/2712] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:08 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:14:08.671306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.672196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:08.681099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.682462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.683157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.684131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.684961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.685885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.723605 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-66bc4869-9cb6-41dc-bf8d-a769b9bb624c tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0d5bb11f-d93e-4c1e-997f-a7b2b305cfa0" status: 202 len: 0 microversion: 2.1 time: 0.259721 Sep 25 01:14:08.727775 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1371/2713] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:14:08 2022] DELETE /compute/v2.1/os-security-groups/0d5bb11f-d93e-4c1e-997f-a7b2b305cfa0 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:14:08.733639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d8a099f-69f7-4625-88e5-6233f2581c9a tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] Calling method '.version_select at 0x7f7bebcff820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.954568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:08.967099 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfeddc68-30ea-4c60-967e-ce1c2afded44 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1526 microversion: 2.1 time: 0.309147 Sep 25 01:14:08.967920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1343/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:08 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1526 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:08.972813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:08.973483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:08.979903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.980492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.980930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:08.981685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:08.982143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:08.982604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.104880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d8a099f-69f7-4625-88e5-6233f2581c9a tempest-SecurityGroupRulesNegativeTestJSON-318649107 tempest-SecurityGroupRulesNegativeTestJSON-318649107-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ff55a6a2-9b0a-4543-8029-85f027df17d3" status: 202 len: 0 microversion: 2.1 time: 0.375778 Sep 25 01:14:09.110526 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1372/2715] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:14:08 2022] DELETE /compute/v2.1/os-security-groups/ff55a6a2-9b0a-4543-8029-85f027df17d3 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:14:09.207883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:09.226886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-670880cb-e9b1-4661-9aed-642cf0e8343f tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1683 microversion: 2.1 time: 0.257561 Sep 25 01:14:09.237579 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1344/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:08 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:09.255810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:09.257644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:09.274919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.276042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.276717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.277740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.278457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.279113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.554080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:09.554432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:09.569652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.570407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.571230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.572205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.572885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.573257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.605900 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] HTTP exception thrown: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Request method failure captured: Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 HTTP/1.1 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6tEXpNCIvlXrW-D5uXyYS3UNtgXrXu54uQLQvl4TEs6mHzQoMPDGxQzMkKDMa27oze68tTcszjW-bkxfM_k2eVBxkpPp2wrNAgs_WJH3CwrKWl8tagzwy1Rlai96FjUVDvu5L8P3y0nr7t9N7WJAJAWCjNLvH8qS9sYUOwUDwmSm3I Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 153e3aa4f1ab42319781e527a271bd6a Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-545995942 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/153e3aa4f1ab42319781e527a271bd6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/153e3aa4f1ab42319781e527a271bd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/153e3aa4f1ab42319781e527a271bd6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_153e3aa4f1ab42319781e527a271bd6a"}]}] Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-545995942 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 153e3aa4f1ab42319781e527a271bd6a Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-545995942 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestMultiTenantJSON-545995942-project Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f85a366f989648c7a62880578c0ea947 Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-545995942-project Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: exception: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'a5265387-5cfb-415f-af52-f666e3d4ee84'} Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:14:09.608588 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:09.612504 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:09.613179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:09.616185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Returning 404 to user: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:09.620187 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-28abaee7-f7d7-4113-9df6-a931638234e0 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 404 len: 111 microversion: 2.1 time: 0.508531 Sep 25 01:14:09.623800 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21e08159-52d7-48e2-9473-13f921c2dd1b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.380328 Sep 25 01:14:09.624902 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1373/2717] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:14:09 2022] DELETE /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 111 bytes in 514 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:14:09.632439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:09.635680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:09.639771 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1345/2718] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:09 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:09.644956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:09.645619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:09.646263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.646923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.647545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.648426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.649055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.649776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.652966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.653497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.653945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.655201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:09.655661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:09.656087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:09.994380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:10.008180 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6216fd6c-4720-424f-90e8-92781c19d6d9 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1700 microversion: 2.1 time: 0.381911 Sep 25 01:14:10.009778 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1374/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:09 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1700 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:10.033651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:10.037230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] [instance: f37eca7c-7c31-4441-a5a9-68211e3976b7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:10.043226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:10.051835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.052832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.053562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.054995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.055950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.056638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.057978 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7ef0784-345c-4bcf-96e8-7f07be3c8e31 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1526 microversion: 2.1 time: 0.416849 Sep 25 01:14:10.059039 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1346/2720] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:09 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1526 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:10.088996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Action: 'update', calling method: >, body: {"server": {"name": "a5265387-5cfb-415f-af52-f666e3d4ee84_new"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:10.092117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:10.098517 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] HTTP exception thrown: Instance f37eca7c-7c31-4441-a5a9-68211e3976b7 could not be found. Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Request method failure captured: Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 HTTP/1.1 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6sOiVrnhAUOpqYUoROsuFGVVFNK729uxQLOKhq0DE4nny1rWbkHDWg1L_7vz10O2SNnexOlIkQhqEBG8cMFjsl-npyB_w0uDWVzJFLZ8HAInoNy0fa34dpsGrjB3ufZN9LJgq1P3JCilfhe0P2-kdShYHZmm5ZI1b6DWeCCY1_4EYc Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.75 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 934b22e1c24a45cc87d50b89a0540f46 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdmin275Test-375084607 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934b22e1c24a45cc87d50b89a0540f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934b22e1c24a45cc87d50b89a0540f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934b22e1c24a45cc87d50b89a0540f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934b22e1c24a45cc87d50b89a0540f46"}]}] Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdmin275Test-375084607 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 934b22e1c24a45cc87d50b89a0540f46 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdmin275Test-375084607 Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdmin275Test-375084607-project Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3949c16e4fde47108c4242a3f99ec5df Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdmin275Test-375084607-project Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f37eca7c-7c31-4441-a5a9-68211e3976b7 could not be found. Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f37eca7c-7c31-4441-a5a9-68211e3976b7'} Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37eca7c-7c31-4441-a5a9-68211e3976b7 could not be found. Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37eca7c-7c31-4441-a5a9-68211e3976b7 could not be found. Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:10.100670 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37eca7c-7c31-4441-a5a9-68211e3976b7 could not be found. Sep 25 01:14:10.106081 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.106621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.109479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] Returning 404 to user: Instance f37eca7c-7c31-4441-a5a9-68211e3976b7 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:10.111389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d0b7699d-38a1-4180-a421-be003aff190b tempest-ServersAdmin275Test-375084607 tempest-ServersAdmin275Test-375084607-project] 10.222.0.16 "GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7" status: 404 len: 111 microversion: 2.75 time: 0.100263 Sep 25 01:14:10.111904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.112576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.113700 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1375/2721] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:14:10 2022] GET /compute/v2.1/servers/f37eca7c-7c31-4441-a5a9-68211e3976b7 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:14:10.118630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.120583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.121043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.145783 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] HTTP exception thrown: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Request method failure captured: Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 HTTP/1.1 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 64 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tEXpNCIvlXrW-D5uXyYS3UNtgXrXu54uQLQvl4TEs6mHzQoMPDGxQzMkKDMa27oze68tTcszjW-bkxfM_k2eVBxkpPp2wrNAgs_WJH3CwrKWl8tagzwy1Rlai96FjUVDvu5L8P3y0nr7t9N7WJAJAWCjNLvH8qS9sYUOwUDwmSm3I Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 153e3aa4f1ab42319781e527a271bd6a Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-545995942 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/153e3aa4f1ab42319781e527a271bd6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/153e3aa4f1ab42319781e527a271bd6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/153e3aa4f1ab42319781e527a271bd6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_153e3aa4f1ab42319781e527a271bd6a"}]}] Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-545995942 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 153e3aa4f1ab42319781e527a271bd6a Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-545995942 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestMultiTenantJSON-545995942-project Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: f85a366f989648c7a62880578c0ea947 Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-545995942-project Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "a5265387-5cfb-415f-af52-f666e3d4ee84_new"}} Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: exception: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'a5265387-5cfb-415f-af52-f666e3d4ee84', 'body': {'server': {'name': 'a5265387-5cfb-415f-af52-f666e3d4ee84_new'}}} Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:14:10.152351 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:10.156706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:10.165835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] Returning 404 to user: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:10.166916 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59e213bd-bd1c-4072-928f-81b12c66df32 tempest-ServersNegativeTestMultiTenantJSON-545995942 tempest-ServersNegativeTestMultiTenantJSON-545995942-project] 10.222.0.16 "PUT /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 404 len: 111 microversion: 2.1 time: 0.082066 Sep 25 01:14:10.167980 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1347/2722] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:14:10 2022] PUT /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:14:10.178498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:10.179076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:10.193860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.196567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.199679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.202798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.203311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.207041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.260082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:10.260971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:10.276989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.277819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.278406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.279993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.280820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.281394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.319908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:14:10.555640 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c244b8ac-8a3b-4a8b-9356-50aafc443a87 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 204 len: 0 microversion: 2.1 time: 0.378776 Sep 25 01:14:10.561130 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1376/2723] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:14:10 2022] DELETE /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:14:10.571519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8ea25d29-1f36-40c5-9728-e6876a696141 req-5c7b5359-6449-4c77-9ac5-56385a923403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "name": "network-vif-plugged", "status": "completed", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:10.595540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8ea25d29-1f36-40c5-9728-e6876a696141 req-5c7b5359-6449-4c77-9ac5-56385a923403 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.596724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8ea25d29-1f36-40c5-9728-e6876a696141 req-5c7b5359-6449-4c77-9ac5-56385a923403 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.597436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8ea25d29-1f36-40c5-9728-e6876a696141 req-5c7b5359-6449-4c77-9ac5-56385a923403 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.619930 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8ea25d29-1f36-40c5-9728-e6876a696141 req-5c7b5359-6449-4c77-9ac5-56385a923403 service nova] Creating event network-vif-plugged:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h2-master-1 Sep 25 01:14:10.630242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8ea25d29-1f36-40c5-9728-e6876a696141 req-5c7b5359-6449-4c77-9ac5-56385a923403 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065127 Sep 25 01:14:10.631304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1377/2724] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:10.637673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:10.638640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:10.649175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.649781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.650366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.651275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.651844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.652709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.929208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:10.938456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7481247-71fe-4db8-b611-d66599871f67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1683 microversion: 2.1 time: 0.682829 Sep 25 01:14:10.939040 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1348/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:10 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1683 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:10.959049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:10.960606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:10.980809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.983472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.985319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:10.986809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:10.988172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:10.989143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:11.406800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:11.446995 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c59cd8b-3586-4125-9316-47472e5c61f2 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1532 microversion: 2.1 time: 0.813588 Sep 25 01:14:11.447963 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1378/2726] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:10 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1532 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:11.474383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:11.476682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:11.501573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:11.502769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:11.503778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:11.505277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:11.506996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:11.508368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:11.655235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:11.659479 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:11.680107 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aba7494c-04c7-4e9b-962b-eacf4c9b5366 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 0.739960 Sep 25 01:14:11.682029 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1349/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:10 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:11.710783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c25e53535f348718d8bf85e020ec15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f36d0acd3e457cbb8fc3d10b486ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:11.713357 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:11.733795 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bc171cc-fc49-4501-8e0c-57dfc6e63254 tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 200 len: 1632 microversion: 2.1 time: 0.279786 Sep 25 01:14:11.737073 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1379/2728] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:11 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 1632 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:11.980377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:11.984116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:12.007611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.008362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.009161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:12.010185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.010836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.011431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:12.358347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:12.373881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b66397f2-c2f4-4543-a6cf-92c66c63b455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1615 microversion: 2.1 time: 0.395321 Sep 25 01:14:12.378906 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1350/2729] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:11 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1615 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:12.433566 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-857c2a66-b495-4b96-afc5-281accaaf176 req-6ad5466f-2252-4300-bac2-f00e543da6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc784286-e6a9-44ff-b7b3-9a6781600174", "name": "network-vif-deleted", "tag": "f073cdf7-498d-472a-9d2a-60c83b7759d3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:12.468159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-857c2a66-b495-4b96-afc5-281accaaf176 req-6ad5466f-2252-4300-bac2-f00e543da6fa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.477001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:12.478432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:12.492566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.493944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-857c2a66-b495-4b96-afc5-281accaaf176 req-6ad5466f-2252-4300-bac2-f00e543da6fa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.495723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.496237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:12.497050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-857c2a66-b495-4b96-afc5-281accaaf176 req-6ad5466f-2252-4300-bac2-f00e543da6fa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:12.502143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.502860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.505223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:12.550643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-857c2a66-b495-4b96-afc5-281accaaf176 req-6ad5466f-2252-4300-bac2-f00e543da6fa service nova] Creating event network-vif-deleted:f073cdf7-498d-472a-9d2a-60c83b7759d3 for instance bc784286-e6a9-44ff-b7b3-9a6781600174 on n-h1-master-1 Sep 25 01:14:12.574738 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-857c2a66-b495-4b96-afc5-281accaaf176 req-6ad5466f-2252-4300-bac2-f00e543da6fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147696 Sep 25 01:14:12.575955 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1380/2730] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:12.706969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:12.707688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:12.714528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.715312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.715938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:12.716847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:12.720592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:12.721348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:13.733523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:13.743983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2824b18a-446c-4e9d-b144-e51a792799fd tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1532 microversion: 2.1 time: 1.271523 Sep 25 01:14:13.747203 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1351/2731] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:12 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1532 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:13.764401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:13.771854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] [instance: bc784286-e6a9-44ff-b7b3-9a6781600174] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:13.788268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:13.788802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:13.789253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:13.790007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:13.790480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:13.790919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:13.808597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:13.825239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-059ad890-61e2-49de-9f58-b41c6df3f7de tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1312 microversion: 2.1 time: 1.122502 Sep 25 01:14:13.829002 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1381/2732] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:12 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1312 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:13.843376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:13.844847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:13.855655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] HTTP exception thrown: Instance bc784286-e6a9-44ff-b7b3-9a6781600174 could not be found. Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Request method failure captured: Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 HTTP/1.1 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sgcHlldrHIiYZCgyRPjTEJUzuqvqZTG5_oUGo_3hg_7acY9hPsI5VKTsqaiv5do6eepmwx3Yz2iUrJ0pM3M_q-NyaeUpyPanfghFyVIdejwgcXk6l-v8lUlidaNvgDYkO0LG57ERpnCl3TgCEGl_t0R27gN-KYqOadwLxY6EWqb8M Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 51f36d0acd3e457cbb8fc3d10b486ad1 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-1912105176 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/51f36d0acd3e457cbb8fc3d10b486ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51f36d0acd3e457cbb8fc3d10b486ad1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51f36d0acd3e457cbb8fc3d10b486ad1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_51f36d0acd3e457cbb8fc3d10b486ad1"}]}] Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-1912105176 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 51f36d0acd3e457cbb8fc3d10b486ad1 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-1912105176 Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-1912105176-project Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4c25e53535f348718d8bf85e020ec15d Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-1912105176-project Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: exception: Instance bc784286-e6a9-44ff-b7b3-9a6781600174 could not be found. Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'bc784286-e6a9-44ff-b7b3-9a6781600174'} Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc784286-e6a9-44ff-b7b3-9a6781600174 could not be found. Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc784286-e6a9-44ff-b7b3-9a6781600174 could not be found. Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:13.857427 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc784286-e6a9-44ff-b7b3-9a6781600174 could not be found. Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Returning 404 to user: Instance bc784286-e6a9-44ff-b7b3-9a6781600174 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:13.861339 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f2989e6e-0491-44ed-817c-ad9702247adc tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174" status: 404 len: 111 microversion: 2.1 time: 0.106363 Sep 25 01:14:13.868616 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1352/2733] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:13 2022] GET /compute/v2.1/servers/bc784286-e6a9-44ff-b7b3-9a6781600174 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:14:13.869596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:13.870967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:13.874345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:13.875308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-448d9243-8fe0-413b-9099-ec2880570bcb tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] Calling method '.version_select at 0x7f7beb950e50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:13.875717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:13.877228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:13.879537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:13.919650 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-448d9243-8fe0-413b-9099-ec2880570bcb tempest-ServersTestJSON-1912105176 tempest-ServersTestJSON-1912105176-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606197051" status: 202 len: 0 microversion: 2.1 time: 0.049768 Sep 25 01:14:13.927451 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1353/2734] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606197051 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:14:13.991182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:13.992147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:13.994665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:13.996212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lazy-loading 'fault' on Instance uuid 77babc4e-c612-45ee-8bd0-f477b4329ccd {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:14:14.607940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:14.617713 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b1db399c-c22e-48ec-af62-e89ccf8302d8 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 200 len: 1331 microversion: 2.1 time: 0.787302 Sep 25 01:14:14.621803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1382/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:13 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 1331 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:14.651644 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:14.652850 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:14.657874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a4fe624d-763f-400d-ab5f-51d3783f81ee req-1af9c4c4-9f95-4d5c-ba88-3591412c6917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77babc4e-c612-45ee-8bd0-f477b4329ccd", "name": "network-vif-deleted", "tag": "475f3c24-db7c-44b9-b1ac-deaaf6cbc268"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:14.689222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a4fe624d-763f-400d-ab5f-51d3783f81ee req-1af9c4c4-9f95-4d5c-ba88-3591412c6917 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:14.693303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a4fe624d-763f-400d-ab5f-51d3783f81ee req-1af9c4c4-9f95-4d5c-ba88-3591412c6917 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:14.694025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a4fe624d-763f-400d-ab5f-51d3783f81ee req-1af9c4c4-9f95-4d5c-ba88-3591412c6917 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:14.728969 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a4fe624d-763f-400d-ab5f-51d3783f81ee req-1af9c4c4-9f95-4d5c-ba88-3591412c6917 service nova] Creating event network-vif-deleted:475f3c24-db7c-44b9-b1ac-deaaf6cbc268 for instance 77babc4e-c612-45ee-8bd0-f477b4329ccd on n-h1-master-1 Sep 25 01:14:14.741761 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a4fe624d-763f-400d-ab5f-51d3783f81ee req-1af9c4c4-9f95-4d5c-ba88-3591412c6917 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090945 Sep 25 01:14:14.742377 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1354/2736] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:14.776131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:14.776558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:14.788567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:14.793482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:14.794001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:14.794839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:14.795825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:14.796282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:14.855222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:14.855935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:14.884094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:14.890637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:14.891616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:14.894407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:14.905889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:14.923005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:15.053636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:15.063173 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4da1480d-19a4-4121-b491-e498e0e61857 tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1490 microversion: 2.1 time: 0.291164 Sep 25 01:14:15.063768 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1383/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:14 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1490 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:15.110317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-675d3c04-6ccf-4d59-a607-5dba1a0cb6d6 req-47665484-3a67-489f-8cc4-6e4ff771fe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5265387-5cfb-415f-af52-f666e3d4ee84", "name": "network-vif-deleted", "tag": "5ed4410c-8a7e-489f-a23f-0384cbfcafb4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:15.123500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-675d3c04-6ccf-4d59-a607-5dba1a0cb6d6 req-47665484-3a67-489f-8cc4-6e4ff771fe80 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:15.133132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-675d3c04-6ccf-4d59-a607-5dba1a0cb6d6 req-47665484-3a67-489f-8cc4-6e4ff771fe80 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:15.133546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-675d3c04-6ccf-4d59-a607-5dba1a0cb6d6 req-47665484-3a67-489f-8cc4-6e4ff771fe80 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:15.179098 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-675d3c04-6ccf-4d59-a607-5dba1a0cb6d6 req-47665484-3a67-489f-8cc4-6e4ff771fe80 service nova] Creating event network-vif-deleted:5ed4410c-8a7e-489f-a23f-0384cbfcafb4 for instance a5265387-5cfb-415f-af52-f666e3d4ee84 on n-h2-master-1 Sep 25 01:14:15.195088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-675d3c04-6ccf-4d59-a607-5dba1a0cb6d6 req-47665484-3a67-489f-8cc4-6e4ff771fe80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088660 Sep 25 01:14:15.198375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1384/2738] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:14:15.646317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:15.647567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:15.671927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:15.673000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:15.674544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:15.683953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:15.684767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:15.685224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:15.691649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:15.704335 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-740d30ae-4e99-4939-9eef-4a9625739b17 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1461 microversion: 2.1 time: 0.853414 Sep 25 01:14:15.704940 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1355/2739] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:14 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1461 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:15.733588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:15.749646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:15.765582 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:14:15.771907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:15.772411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:15.772856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:15.773626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:15.774068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:15.774512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd HTTP/1.1 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '77babc4e-c612-45ee-8bd0-f477b4329ccd'} Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:15.776287 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:14:15.780773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:15.782120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa6dfe28-dc98-4347-a300-58070518fc64 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 404 len: 111 microversion: 2.1 time: 0.139581 Sep 25 01:14:15.786212 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1385/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:15 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:14:15.803395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14e0acdc-a6d4-4631-807e-11ff7eec695c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '.version_select at 0x7f7bebd06700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:15.864207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14e0acdc-a6d4-4631-807e-11ff7eec695c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676953441" status: 202 len: 0 microversion: 2.1 time: 0.072370 Sep 25 01:14:15.868520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1386/2741] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676953441 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:14:16.087840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:16.088489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:16.096780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:16.104045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:16.104601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:16.110699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:16.111193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:16.111637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:16.223288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:16.223791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:16.224236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:16.224700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lazy-loading 'fault' on Instance uuid a5265387-5cfb-415f-af52-f666e3d4ee84 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:14:16.316771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b984b9717fe94a6fb6c62a78af17f7aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4027e26a844b0dbd34ac452b22b3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:16.326822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ac82099-05ce-4e9c-a2e3-6d5399be64ae tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 200 len: 1317 microversion: 2.1 time: 0.243506 Sep 25 01:14:16.331321 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1387/2742] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:16 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:16.683589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:16.690510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Old instance type m1.heat2, new instance type m1.heat {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:14:16.709269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:14:16.712210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:14:16.714947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:14:16.718185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:14:16.718681 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:14:17.164965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ecd1fa79-2122-43cc-a4d2-d7a94b1383b7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216/action" status: 202 len: 0 microversion: 2.1 time: 1.434193 Sep 25 01:14:17.168700 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1356/2743] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:14:15 2022] POST /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216/action => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:14:17.176436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:17.177064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:17.209327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:17.212618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:17.213101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:17.215524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:17.216035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:17.216506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:17.356577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:17.357304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] [instance: a5265387-5cfb-415f-af52-f666e3d4ee84] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:17.380768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:17.384877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:17.390569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:17.396454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:17.398840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:17.400530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:17.464778 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] HTTP exception thrown: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Request method failure captured: Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 HTTP/1.1 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6s1w3h-PW1ZByAdSewKVWbN7yc5bVz2ztJedtvP8MoQMtQWjMDzvEmwd1Ba2GgjtL7rgZ9dg5AJ-Up9EkgkCGDAEqXye0mHoKmHaf_W2RPuxs_C5dwxWgTIYxuDPwegPE_BzOr6Hj_K_EDUINxo3mmuVQ9ISPaSOUEK7kN6FtDfESg Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fd4027e26a844b0dbd34ac452b22b3ae Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2040019352 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd4027e26a844b0dbd34ac452b22b3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd4027e26a844b0dbd34ac452b22b3ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd4027e26a844b0dbd34ac452b22b3ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd4027e26a844b0dbd34ac452b22b3ae"}]}] Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2040019352 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fd4027e26a844b0dbd34ac452b22b3ae Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2040019352 Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2040019352-project Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b984b9717fe94a6fb6c62a78af17f7aa Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2040019352-project Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: exception: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'a5265387-5cfb-415f-af52-f666e3d4ee84'} Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:17.466990 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. Sep 25 01:14:17.471207 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:14:17.474844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] Returning 404 to user: Instance a5265387-5cfb-415f-af52-f666e3d4ee84 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:14:17.476017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cda2cf94-9d47-457a-986e-7c91e4fde7eb tempest-ServersNegativeTestMultiTenantJSON-2040019352 tempest-ServersNegativeTestMultiTenantJSON-2040019352-project] 10.222.0.16 "GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84" status: 404 len: 111 microversion: 2.1 time: 0.124257 Sep 25 01:14:17.480763 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1357/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:17 2022] GET /compute/v2.1/servers/a5265387-5cfb-415f-af52-f666e3d4ee84 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:14:18.046360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:18.070999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc50831b-1e67-469c-8a5e-fdd89b183113 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: .version_select at 0x7f7beb92a9d0>, body: {"keypair": {"name": "tempest-keypair-1025212359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkOMXMop19u3IWYTG/OKyRLN2MUdN3L1vAX0kzg5PF7iP8AqrDlOzvqnottBoyXGxgywd8xTfY/QbMw6oejjOnrhXoIVg6hUMYfmI4tvLZrn5osO52ryA9FoTpL9X8IMA=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:18.071687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bfe44002-5d53-439f-a322-3008d82d6875 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1470 microversion: 2.1 time: 0.896412 Sep 25 01:14:18.075062 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1388/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:17 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1470 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:18.136927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-bc50831b-1e67-469c-8a5e-fdd89b183113 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:18.161084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-bc50831b-1e67-469c-8a5e-fdd89b183113 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:18.212943 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc50831b-1e67-469c-8a5e-fdd89b183113 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150222 Sep 25 01:14:18.224986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1358/2746] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:14:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:19.112484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:19.113832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:19.139615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:19.140117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:19.140562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:19.151613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:19.152513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:19.153196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:19.630351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:19.645957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88033326-6a77-4d3f-b9ef-4ab3cbcaa05d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1470 microversion: 2.1 time: 0.538396 Sep 25 01:14:19.647740 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1389/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:19 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:20.677372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:20.678035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:20.693898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:20.694406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:20.696028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:20.700126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:20.702507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:20.720907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:21.636559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:21.658543 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74090555-272e-4192-ac07-186a90486032 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1470 microversion: 2.1 time: 0.981096 Sep 25 01:14:21.674498 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1359/2748] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:20 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1470 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:22.686887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:22.687509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:22.709192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:22.709800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:22.710264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:22.713367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:22.714442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:22.715645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:23.232299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:23.243026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a7f2a7d-0af3-4e17-981a-d4f3bd208efb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1470 microversion: 2.1 time: 0.560517 Sep 25 01:14:23.245742 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1390/2749] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:22 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1470 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:24.271358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:24.271975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:24.290370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:24.294284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:24.295056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:24.297429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:24.300131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:24.300790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:25.322836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:25.336316 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df070b20-6ad2-46bd-bc08-110bbf160cd8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 1.067978 Sep 25 01:14:25.339192 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1360/2750] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:24 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:25.387656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-476157834", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e11de-11e2-49b9-9778-5d1ca46edda6"}], "security_groups": [{"name": "tempest-securitygroup--1612070879"}], "key_name": "tempest-keypair-1025212359", "user_data": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:26.075464 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] validate_networks() for [('859e11de-11e2-49b9-9778-5d1ca46edda6', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:14:26.363922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:26.364603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:26.374512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:26.375007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:26.375441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:26.376147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:26.376596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:26.377015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:27.300168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:27.309243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0c90a6c-ca65-4e06-a64a-27886cf2e666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.949893 Sep 25 01:14:27.311077 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1361/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:26 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:27.826475 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:28.336055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:28.337213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:28.340483 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:28.352704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:28.356172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:28.359332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:28.360276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:28.360895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:28.361499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:28.526636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:14:28.527479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:14:28.528100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:14:28.528838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:14:28.529468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:14:28.549367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:28.550010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:28.550773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:28.551763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:28.552433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:28.556600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:28.600687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:28.620531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:28.635169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:14:28.637678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:14:28.692951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2ac34c42-3780-44aa-998d-d8021efd42c5 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.309647 Sep 25 01:14:28.693932 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1391/2752] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:14:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 3311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:14:28.706906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-600c1925-0048-403b-9042-4dc1b06ee773 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:28.707889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-600c1925-0048-403b-9042-4dc1b06ee773 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:28.918539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-600c1925-0048-403b-9042-4dc1b06ee773 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:28.926080 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-600c1925-0048-403b-9042-4dc1b06ee773 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1241 microversion: 2.1 time: 0.224247 Sep 25 01:14:28.929890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1392/2753] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:28 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:29.003978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:29.016497 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a842695-0ade-4488-9502-2b1c472d0426 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.681093 Sep 25 01:14:29.026453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1362/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:28 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:29.950956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:29.952565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:29.971923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:29.972679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:29.973342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:29.974317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:29.975004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:29.975685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:30.051537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:30.052161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:30.065933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:30.066691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:30.067427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:30.069320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:30.073427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:30.074095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:30.532633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:30.546274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6807e03f-955b-4c9f-bc58-91023c96bc10 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1293 microversion: 2.1 time: 0.601633 Sep 25 01:14:30.557375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1393/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:29 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1293 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:31.089876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:31.103412 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-108a4e15-95a5-4324-b6bb-915fd3be7eed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 1.055623 Sep 25 01:14:31.120557 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1363/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:30 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:31.578663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:31.579408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:31.591627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:31.598823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:31.605784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:31.613491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:31.614262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:31.614651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:31.974220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:31.985934 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15956ee1-a56a-4391-9579-e8f6c857e090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1299 microversion: 2.1 time: 0.411777 Sep 25 01:14:31.993966 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1394/2757] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:31 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:32.130058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:32.131450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:32.146723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:32.148204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:32.152622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:32.155632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:32.160237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:32.160968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:32.957756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:32.971321 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-631396c3-e587-4f59-89ac-313cc48d21d2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.845722 Sep 25 01:14:32.990814 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1364/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:32 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:33.016017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:33.016790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:33.042719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:33.043214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:33.043649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:33.047380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:33.049520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:33.050198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:33.347480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:33.362422 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce61c8fc-d92a-4582-9234-9fefe41ce12b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1299 microversion: 2.1 time: 0.351760 Sep 25 01:14:33.365727 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1395/2759] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:33 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1299 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:33.996083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:33.996868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:34.010586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:34.011489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:34.012234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:34.015267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:34.016031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:34.019226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:34.415655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:34.417703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:34.432812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:34.438021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:34.438685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:34.442543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:34.443416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:34.444138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:34.549219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:34.578074 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ca6344ef-10a6-4499-bb6e-9ffe9b660ffb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.583966 Sep 25 01:14:34.580195 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1365/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:33 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:34.722580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:34.738075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-39e715fc-29ce-4280-9bec-63363a976e50 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1299 microversion: 2.1 time: 0.346131 Sep 25 01:14:34.739158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1396/2761] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:34 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1299 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:35.090954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1657878073", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4241000e-1468-4a1f-8de8-6e7e1495dae9"}], "security_groups": [{"name": "tempest-securitygroup--2127809778"}], "key_name": "tempest-keypair-1992395302", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a07a3069-6752-4a07-8144-5f5189febea2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:35.609001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:35.611073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:35.620944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:35.621345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:35.621836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:35.623123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:35.623592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:35.624217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:35.955199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] validate_networks() for [('4241000e-1468-4a1f-8de8-6e7e1495dae9', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:14:36.181165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:36.196136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76f1ada3-afa2-49e6-a807-a4ee84589e50 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.595720 Sep 25 01:14:36.202170 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1397/2762] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:35 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:36.211771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:36.213454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:36.227745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:36.228514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:36.229089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:36.229990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:36.232829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:36.234890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:36.972114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:36.991728 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61c3a542-a71f-4f69-a7b4-b0cf7c45dfcb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.787837 Sep 25 01:14:37.007895 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1398/2763] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:36 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:37.228038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:37.228931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:37.237088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:37.237890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:37.239069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:37.240177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:37.241830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:37.242639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:37.567301 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:37.599123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Getting quotas for project b730f5960b50450b9f6e724945ae8613. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:37.603472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:37.619756 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2dd481b-b8f5-46f5-9305-3cce1799199a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.394721 Sep 25 01:14:37.624052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Getting quotas for user 88a8086a0ed34e4898db9e4d4a632a97 and project b730f5960b50450b9f6e724945ae8613. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:37.640533 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1399/2764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:37 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:37.683111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:14:37.684183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:14:37.685645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:14:37.693219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:14:37.694134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:14:37.722129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:37.724247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:37.724988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:37.726162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:37.726864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:37.728363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:37.753042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Getting quotas for project b730f5960b50450b9f6e724945ae8613. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:37.760097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Getting quotas for user 88a8086a0ed34e4898db9e4d4a632a97 and project b730f5960b50450b9f6e724945ae8613. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:37.874356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:14:37.880242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a07a3069-6752-4a07-8144-5f5189febea2',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:14:38.043244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:38.043870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:38.061241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:38.061764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:38.064487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:38.067073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:38.067785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:38.068632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:38.126804 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:38.212019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc5cdb1b-3490-454d-92ac-55904ea8cff9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.125771 Sep 25 01:14:38.219011 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1366/2765] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:14:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 3133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:14:38.230675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-423eb55b-9aa2-43c8-9aa9-613fb1347f13 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:38.232339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-423eb55b-9aa2-43c8-9aa9-613fb1347f13 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:38.437275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-423eb55b-9aa2-43c8-9aa9-613fb1347f13 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:38.448939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-423eb55b-9aa2-43c8-9aa9-613fb1347f13 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1122 microversion: 2.1 time: 0.223105 Sep 25 01:14:38.468064 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1367/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:38 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1122 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:38.542425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:38.574557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a30b9ee1-1dc5-4a89-8ceb-4ebf0bcff61c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.528711 Sep 25 01:14:38.604656 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1400/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:38 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:38.652567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:38.655051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:38.668137 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:38.677834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:38.678616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:38.679088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:38.680784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:38.682632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:38.685581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:38.924698 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:39.014944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1536440415", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "e0a2d659-a909-4cc9-8950-f95844d9dc25"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:39.138481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] validate_networks() for [('e0a2d659-a909-4cc9-8950-f95844d9dc25', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:14:39.366239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:39.374501 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ae4aaff-e74d-423c-8824-22a6c18cdc76 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.729076 Sep 25 01:14:39.395323 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1401/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:38 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:39.477155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f63573a-bb91-477e-bb36-8475b737e75a tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:39.477872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f63573a-bb91-477e-bb36-8475b737e75a tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:39.720373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8f63573a-bb91-477e-bb36-8475b737e75a tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:39.743522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f63573a-bb91-477e-bb36-8475b737e75a tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1122 microversion: 2.1 time: 0.271301 Sep 25 01:14:39.744235 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1402/2769] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:39 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1122 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:39.749632 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:39.763915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:39.786863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:39.789989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:39.790664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:39.791511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:39.794589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:39.812195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:40.537560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:40.548673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7cfec7ce-3ae3-4c68-b54c-dfe04f3c3f77 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.802945 Sep 25 01:14:40.571015 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1403/2770] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:39 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:40.584688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:40.585335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:40.614385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:40.614804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:40.615632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:40.617286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:40.618144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:40.618771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:40.857326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:14:40.858086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:14:40.858255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:14:40.859062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:14:40.859993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:14:40.875079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:40.875485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:40.877004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:40.881443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:40.882258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:40.882902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:40.930527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Getting quotas for project 744c3c67433f4d268891a810016366cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:40.938665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Getting quotas for user 95b7650e677d47ab9576bc3cb6ea07e7 and project 744c3c67433f4d268891a810016366cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:40.956921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:14:40.959902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:14:41.003510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:41.014549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9d964a3-3f82-44cd-8b5d-0e73454ce3cf tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.441529 Sep 25 01:14:41.019501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1404/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:40 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:41.036687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:41.044786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:41.050056 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a20ca7f-ded7-4f64-8604-a2c690384b7f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.571398 Sep 25 01:14:41.056674 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1368/2772] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:14:41.061670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-322529dc-cde2-467d-b6fd-801385cdd56e req-36430bfa-1cc2-458e-a321-7061b16ef7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7980033e-52a8-4fa2-b2d8-05bea9732bf3", "tag": "9f078b6d-051a-44e2-a5fc-1055cf064df2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:41.073829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:41.074632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:41.097988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-322529dc-cde2-467d-b6fd-801385cdd56e req-36430bfa-1cc2-458e-a321-7061b16ef7df service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:41.099188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-322529dc-cde2-467d-b6fd-801385cdd56e req-36430bfa-1cc2-458e-a321-7061b16ef7df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:41.101226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-322529dc-cde2-467d-b6fd-801385cdd56e req-36430bfa-1cc2-458e-a321-7061b16ef7df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:41.110118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:41.111297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:41.117030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:41.117770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:41.127763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-322529dc-cde2-467d-b6fd-801385cdd56e req-36430bfa-1cc2-458e-a321-7061b16ef7df service nova] Creating event network-changed:9f078b6d-051a-44e2-a5fc-1055cf064df2 for instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 on n-h1-master-1 Sep 25 01:14:41.149832 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-322529dc-cde2-467d-b6fd-801385cdd56e req-36430bfa-1cc2-458e-a321-7061b16ef7df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093189 Sep 25 01:14:41.153915 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1369/2773] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:41.171853 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dce662e4-6a6e-45fd-82bd-5d1dc3e9f59b tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:41.172615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dce662e4-6a6e-45fd-82bd-5d1dc3e9f59b tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:41.323039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:41.335229 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d7db9636-fb0e-45b9-8b62-18681e3e4ce2 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1238 microversion: 2.1 time: 0.311695 Sep 25 01:14:41.339827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1405/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:41 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1238 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:41.368926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dce662e4-6a6e-45fd-82bd-5d1dc3e9f59b tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:41.381015 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dce662e4-6a6e-45fd-82bd-5d1dc3e9f59b tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1224 microversion: 2.1 time: 0.225241 Sep 25 01:14:41.381649 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1370/2775] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:41 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1224 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:41.576256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:41.577064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:41.588272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:41.588886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:41.589460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:41.590522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:41.592860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:41.593621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.048170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:42.049960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:42.069869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:42.071030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:42.073388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.074608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:42.078065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:42.079557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.164016 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:42.310037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:42.320284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cdfd47c9-07d1-498a-b8b1-adbc5652aa57 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.747895 Sep 25 01:14:42.327288 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1406/2776] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:41 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:42.359584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:42.360567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:42.370642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:42.371634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:42.372600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.373613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:42.374373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:42.374959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.583148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:42.592385 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f493600-b173-498a-bed3-f20687a4fe3c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1238 microversion: 2.1 time: 0.236804 Sep 25 01:14:42.613582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1407/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:42 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1238 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:42.623450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:42.626071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:42.638058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:42.639681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:42.640417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.641422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:42.644322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:42.648810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:42.659547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:42.678841 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6329a7e5-3cf6-4e41-9bdd-8e73864f8a70 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.635879 Sep 25 01:14:42.680404 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1371/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:42 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:42.904051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:42.917002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f897ea2c-ff55-4290-9ebd-d92aeb5209a1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1276 microversion: 2.1 time: 0.300670 Sep 25 01:14:42.941165 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1408/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:42 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1276 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:43.357617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:43.358416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:43.371043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:43.373538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:43.375121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:43.379773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:43.393802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:43.394542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:43.639074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:43.640811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:43.670634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:43.672600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:43.673744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:43.678873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:43.679766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:43.687283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:43.958293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:43.969927 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c36915d-f61c-479f-a030-4470893e0391 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1238 microversion: 2.1 time: 0.340236 Sep 25 01:14:43.991802 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1409/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:43 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1238 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:44.007125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:44.008259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:44.025600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:44.058841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:44.061119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:44.062188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:44.066523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:44.067747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:44.283659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:44.297945 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ef3b667-c98e-4daa-8044-7ce97c19dd01 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.944405 Sep 25 01:14:44.299338 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1372/2781] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:43 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:44.305937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:44.306799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:44.314474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:44.315346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:44.320032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:44.321949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:44.327038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:44.327772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:44.423491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:44.438691 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c56236e0-f711-41fd-92b9-61ef8ff96035 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1282 microversion: 2.1 time: 0.137539 Sep 25 01:14:44.440089 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1373/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:44 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:44.573614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:44.595517 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13622685-cf1e-4515-9020-5b7072b749fb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.602011 Sep 25 01:14:44.597231 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1410/2783] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:43 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:45.008119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:45.009687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:45.020004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.020866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.021872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.023122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.024255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.025050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.225501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:45.251106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-98438ed8-ab5b-4234-bef6-6ec48de68966 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1238 microversion: 2.1 time: 0.247553 Sep 25 01:14:45.251725 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1374/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:45 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1238 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:45.323735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:45.326030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:45.335180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.336103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.336841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.337866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.338859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.339455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.463324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:45.464574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:45.472641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.473521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.474131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.475015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.475631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.476243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.629435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:45.638950 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a192ad0-fc73-4b2c-b9c2-555b8460f75e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1282 microversion: 2.1 time: 0.179228 Sep 25 01:14:45.640165 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1375/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:45 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:45.645486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:45.646281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:45.652518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.653255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.653943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.654889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:45.655729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:45.656715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:45.796646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:45.814283 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03ff4054-6924-4951-93c6-5d16cc7a4809 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.496151 Sep 25 01:14:45.818659 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1411/2786] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:45 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:46.066898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:46.078632 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b3445b6-adb7-4bc0-9f2d-5f2ce25636bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1475 microversion: 2.1 time: 0.437136 Sep 25 01:14:46.079269 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1376/2787] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:45 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:46.275416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:46.276317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:46.287581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:46.288093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:46.288535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:46.289263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:46.289754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:46.290188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:46.662614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:46.666660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:46.684218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:46.687917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:46.690719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:46.692300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:46.692792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:46.693239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:47.407016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:47.431013 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-552c1bba-af05-479a-b2ca-bad90a2ba891 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1306 microversion: 2.1 time: 1.159683 Sep 25 01:14:47.458177 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1412/2788] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:46 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1306 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:47.465818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:47.467711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:47.492235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:47.494785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:47.495621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:47.496687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:47.498320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:47.499794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:47.709032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:47.717507 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0de25a4d-84da-4d03-9190-aec7fe7534cf tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1324 microversion: 2.1 time: 1.058923 Sep 25 01:14:47.718086 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1377/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:46 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1324 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:14:47.738520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:47.738520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:47.747349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:47.750085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:47.750721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:47.751651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:47.758546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:47.759474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:48.134535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:48.143128 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eacbcf06-20b9-4a9f-95ec-bb2e5141a02d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.683213 Sep 25 01:14:48.144002 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1413/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:47 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:48.291478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-892558171", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4384ba07-5bb2-48c6-90d6-24086be5612f"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:48.389224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] validate_networks() for [('4384ba07-5bb2-48c6-90d6-24086be5612f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:14:48.627465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:48.636678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2394b432-0a66-40ab-9b0c-0255c3257822 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1474 microversion: 2.1 time: 0.917521 Sep 25 01:14:48.637274 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1378/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:47 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1474 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:48.660937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:48.664770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:48.676416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:48.676924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:48.677363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:48.681558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:48.682260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:48.682869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:49.311129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:49.320054 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10fa3f4d-79b3-4a71-a6a1-00c6e4fbb7f1 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1306 microversion: 2.1 time: 0.674601 Sep 25 01:14:49.320663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1379/2792] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:48 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1306 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:49.340633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:49.341375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:49.373012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:49.373859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:49.374477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:49.378717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:49.382040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:49.382700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:49.731496 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:50.901426 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:51.008191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:51.018831 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0866aae9-00de-4b5c-994b-852b391c392f tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1324 microversion: 2.1 time: 1.696826 Sep 25 01:14:51.035590 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1380/2793] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:49 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1324 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:51.068500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:51.071537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:51.089150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:51.089968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:51.091187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:51.092508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:51.093196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:51.093811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:51.380255 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=20 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:51.909192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:51.921073 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59bb3aa8-e4bd-4196-8783-48f0f0761b80 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.883262 Sep 25 01:14:51.923356 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1381/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:51 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:51.929139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:14:51.929653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:14:51.930080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:14:51.930492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:14:51.930903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:14:51.947122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:51.949440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:51.950572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:51.952821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:51.953956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:51.955428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:51.955905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:51.960980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:51.965264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:51.967663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:51.968278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:51.970337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:51.972064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:51.975841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:52.010346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Getting quotas for project 68f6dd104c6c4f5b856d5ea62a769c14. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:52.031270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Getting quotas for user 09320560cb2d48228041e62efe9fa018 and project 68f6dd104c6c4f5b856d5ea62a769c14. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:52.055929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:14:52.058332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:14:52.125569 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43a8d857-13a4-41be-b46c-62d5a193b29b tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.961692 Sep 25 01:14:52.126233 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1414/2795] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:14:52.133783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:52.134731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:52.145508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:52.146230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:52.146906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:52.147767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:52.148378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:52.149008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:52.693097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:52.722992 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-227f1905-f38e-40ea-a150-b4bb269d7d38 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1474 microversion: 2.1 time: 0.798342 Sep 25 01:14:52.735877 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1382/2796] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:51 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1474 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:52.748478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "name": "network-vif-unplugged", "status": "completed", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:52.791337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:52.791916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:52.797677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:52.827458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] Creating event network-vif-unplugged:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h1-master-1 Sep 25 01:14:52.835688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:52.849746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:14:52.852643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9dfa3f56-6369-4fb0-80bb-e984d507b11c tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 0.725159 Sep 25 01:14:52.859836 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1415/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:52 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:52.864711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:52.868178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:52.889227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:52.890147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:52.890825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:52.891791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:52.893715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:52.894027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:52.897809 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ab40cdb2-6ffe-4854-8dd4-7df43c8984c6 req-a2c1bb28-44c3-49a8-9e43-f1f87a91857d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159782 Sep 25 01:14:52.901487 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1383/2798] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:52.916162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92bcf7bd-1bf3-4e36-a122-e9d965ce99f1 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:52.916963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92bcf7bd-1bf3-4e36-a122-e9d965ce99f1 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:53.202833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92bcf7bd-1bf3-4e36-a122-e9d965ce99f1 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:53.214483 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92bcf7bd-1bf3-4e36-a122-e9d965ce99f1 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1216 microversion: 2.1 time: 0.311630 Sep 25 01:14:53.237455 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1384/2799] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:52 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1216 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:53.246072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-da210bd7-4de5-4981-ac92-11912a9a69cf req-c55864f2-d06f-4d9d-8b4a-7c48c0e11249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97969ff-afac-48e5-b5bc-b67c2cbffea2", "tag": "63d143cb-1526-4494-81c7-8146c931ac4c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:53.279114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-da210bd7-4de5-4981-ac92-11912a9a69cf req-c55864f2-d06f-4d9d-8b4a-7c48c0e11249 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:53.279858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-da210bd7-4de5-4981-ac92-11912a9a69cf req-c55864f2-d06f-4d9d-8b4a-7c48c0e11249 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:53.285148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-da210bd7-4de5-4981-ac92-11912a9a69cf req-c55864f2-d06f-4d9d-8b4a-7c48c0e11249 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:53.308268 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-da210bd7-4de5-4981-ac92-11912a9a69cf req-c55864f2-d06f-4d9d-8b4a-7c48c0e11249 service nova] Creating event network-changed:63d143cb-1526-4494-81c7-8146c931ac4c for instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 on n-h1-master-1 Sep 25 01:14:53.325899 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-da210bd7-4de5-4981-ac92-11912a9a69cf req-c55864f2-d06f-4d9d-8b4a-7c48c0e11249 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094301 Sep 25 01:14:53.326842 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1385/2800] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:53.338524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:53.340982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:53.355508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:53.362583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:53.364791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:53.367040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:53.370048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:53.370727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:53.464717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:53.476911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-707e6e45-9b05-46c5-bc79-af9468aaff70 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1324 microversion: 2.1 time: 0.615805 Sep 25 01:14:53.477825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1416/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:52 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:53.754794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:53.755735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:53.768707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:53.769204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:53.769674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:53.770391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:53.770851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:53.771278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:54.074780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:54.088431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a05caadf-24e8-44f4-a53e-9a1ca87a7a9b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.760081 Sep 25 01:14:54.090903 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1386/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:53 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:54.111707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-648833dd-7557-4bd9-a2c7-e3f6ba7bbf35 req-a09813bc-bf2f-4280-95a3-4bc829dc353b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7980033e-52a8-4fa2-b2d8-05bea9732bf3", "name": "network-vif-plugged", "status": "completed", "tag": "9f078b6d-051a-44e2-a5fc-1055cf064df2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:54.123931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-648833dd-7557-4bd9-a2c7-e3f6ba7bbf35 req-a09813bc-bf2f-4280-95a3-4bc829dc353b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:54.124718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-648833dd-7557-4bd9-a2c7-e3f6ba7bbf35 req-a09813bc-bf2f-4280-95a3-4bc829dc353b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:54.133030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-648833dd-7557-4bd9-a2c7-e3f6ba7bbf35 req-a09813bc-bf2f-4280-95a3-4bc829dc353b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:54.171999 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-648833dd-7557-4bd9-a2c7-e3f6ba7bbf35 req-a09813bc-bf2f-4280-95a3-4bc829dc353b service nova] Creating event network-vif-plugged:9f078b6d-051a-44e2-a5fc-1055cf064df2 for instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 on n-h1-master-1 Sep 25 01:14:54.189948 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-648833dd-7557-4bd9-a2c7-e3f6ba7bbf35 req-a09813bc-bf2f-4280-95a3-4bc829dc353b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095312 Sep 25 01:14:54.191723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1387/2803] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:54.201153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:54.202862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:54.215070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:54.217317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:54.219114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:54.222293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:54.223165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:54.223614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:55.178650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:55.196629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f41ade3-fcc0-4e01-879d-7346b0c010aa tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1474 microversion: 2.1 time: 1.448634 Sep 25 01:14:55.201108 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1417/2804] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:53 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1474 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:55.212791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:55.217291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:55.234830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:55.235346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:55.235786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:55.236511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:55.240053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:55.242204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:55.381806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:55.385603 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:55.399974 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6622419-6997-4d23-b428-b23bb08e222c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1274 microversion: 2.1 time: 0.197223 Sep 25 01:14:55.401287 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1418/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:55 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:55.411023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:55.417527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:55.427267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:55.430173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:55.432264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:55.435841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:55.436715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:55.437755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:55.438389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:55.444310 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f499b94-53aa-4680-acd4-a3326c2ec585 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 1.250790 Sep 25 01:14:55.445289 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1388/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:54 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:55.729430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-170219216", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:55.805281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:14:56.211133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:56.221589 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03ae4e88-faf2-4582-8e5a-a3b68efeb4c0 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1324 microversion: 2.1 time: 0.815427 Sep 25 01:14:56.236022 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1419/2807] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:55 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1324 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:56.266917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}, {"name": "network-changed", "server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:14:56.294807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:56.295411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:56.296002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:56.333233 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Creating event network-changed:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h1-master-1 Sep 25 01:14:56.333788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Creating event network-changed:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:14:56.357607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:14:56.395030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-907550ba-cda5-4b0f-90a0-124582ee9bf1 req-3b9258f7-de4d-4ea8-90d4-221ae0fc8c39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.156169 Sep 25 01:14:56.398721 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1420/2808] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:14:56.433616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:56.434919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:56.460374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:56.460872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:56.468889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:56.471443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:56.472306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:56.472955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:57.271936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:57.296475 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ee958a83-9e0d-43c2-956f-4d46642437e6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1367 microversion: 2.1 time: 0.896353 Sep 25 01:14:57.302105 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1421/2809] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:56 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1367 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:57.307512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:57.308415 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:57.321903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:57.322687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:57.323354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:57.324292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:57.325631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:57.326765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:57.928457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:14:57.929026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:14:57.935008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:14:57.935583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:14:57.936185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:14:57.991609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:57.992712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:57.998257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:57.999771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:58.002230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:58.007797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:58.074720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:14:58.080366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:14:58.110074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:14:58.112411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:14:58.134009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:58.147628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-464d8e8a-441a-4611-bfd5-608429c73edd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1472 microversion: 2.1 time: 0.844002 Sep 25 01:14:58.150825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1422/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:57 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1472 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:58.160624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:58.163704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:58.179690 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:58.182140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:58.183515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:58.187095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:58.188132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:58.190719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:58.192283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:58.232696 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:58.279233 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-263b7da4-851f-4f04-80bd-4923d4eb3f62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.832424 Sep 25 01:14:58.287411 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1389/2811] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:14:58.293299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:58.294361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:58.304442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:58.305309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:58.306348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:58.307689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:58.308369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:58.308995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:59.280741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:59.294578 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a694f3a4-f782-4620-8b37-ca2cfb06fcbc tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 1.004319 Sep 25 01:14:59.307907 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1390/2812] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:58 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:59.326582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:59.327424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:59.343662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:59.345897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:59.346597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:59.347630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:59.351065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:59.351947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:59.356712 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:14:59.444111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:14:59.456317 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 1.304108 Sep 25 01:14:59.476189 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1423/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:58 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:14:59.477706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:59.482890 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91fcaf83-dc99-4ead-b5f8-e05afd43d7dc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005464 Sep 25 01:14:59.483930 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1424/2814] 10.222.0.16 () {56 vars in 886 bytes} [Sun Sep 25 01:14:59 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 25 01:14:59.491069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:14:59.492515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:14:59.521325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:59.523701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:59.526101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:14:59.527178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:14:59.530821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:14:59.531559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:00.186576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:00.194697 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-004cea33-860f-4253-b204-0bdb6894f6eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1210 microversion: 2.1 time: 0.709486 Sep 25 01:15:00.195562 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1425/2815] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:59 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1210 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:00.214929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:00.216409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:00.226725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:00.227318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:00.227835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:00.228651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:00.229330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:00.230059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:00.486995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:00.507723 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1594470d-8543-4934-bf8b-0b832426d705 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1324 microversion: 2.1 time: 1.198417 Sep 25 01:15:00.509756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1391/2816] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:14:59 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1324 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:00.516533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:00.522024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:00.531466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:00.532297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:00.533205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:00.534283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:00.534992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:00.535629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:00.748161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:00.760742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7bdf5234-9dac-4575-9baa-cb34912f40ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1557 microversion: 2.1 time: 0.563132 Sep 25 01:15:00.763541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1426/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:00 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1557 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:00.775686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:00.777171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:00.820967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:00.821557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:00.821824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:00.822550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:00.822994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:00.823419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:01.408437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:01.422116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be88e804-b86f-45a8-934a-2eab26d136ea tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1469 microversion: 2.1 time: 0.910197 Sep 25 01:15:01.422828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1392/2818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:00 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1469 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:01.454805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:01.455445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:01.475089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:01.475602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:01.479138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:01.481104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:01.481983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:01.484806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:01.997666 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:02.021371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:02.036579 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5016c0f8-3773-4f3b-a5a8-b57848e49da8 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 1.271325 Sep 25 01:15:02.061314 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1427/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:00 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:02.069976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-402525b1-e3cb-44c7-9e1b-f10772b166d9 req-120e695b-8557-4a79-8eb4-328106309a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "name": "network-vif-plugged", "status": "completed", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:02.091143 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:02.099627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-402525b1-e3cb-44c7-9e1b-f10772b166d9 req-120e695b-8557-4a79-8eb4-328106309a47 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.101315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-402525b1-e3cb-44c7-9e1b-f10772b166d9 req-120e695b-8557-4a79-8eb4-328106309a47 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.102606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-402525b1-e3cb-44c7-9e1b-f10772b166d9 req-120e695b-8557-4a79-8eb4-328106309a47 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.121708 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-402525b1-e3cb-44c7-9e1b-f10772b166d9 req-120e695b-8557-4a79-8eb4-328106309a47 service nova] Creating event network-vif-plugged:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:15:02.128693 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-402525b1-e3cb-44c7-9e1b-f10772b166d9 req-120e695b-8557-4a79-8eb4-328106309a47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064750 Sep 25 01:15:02.129860 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1428/2820] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:02.135463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:02.136336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:02.145457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.146528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.147321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.148053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.148513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.148941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.380312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:02.394729 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa846a2a-8503-40e9-bdb4-c05ccf53571c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.970217 Sep 25 01:15:02.400578 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1393/2821] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:01 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:02.417572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:02.420507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:02.427531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.428239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.428832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.430176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.430798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.431380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.451103 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ab67b5d-ac5a-4e36-aaa4-0c0838e1d98e tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319798 Sep 25 01:15:02.451711 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1429/2822] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:15:02 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:02.458974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:02.459775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:02.473048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.477022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.477701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.478628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.479146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.479533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.560659 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f4e26aa1-eb59-424e-ba25-fd065fbb496d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216/action" status: 204 len: 0 microversion: 2.1 time: 0.107242 Sep 25 01:15:02.563314 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1430/2823] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:02 2022] POST /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216/action => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:15:02.570428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:02.571630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:02.581089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.581996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.582910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:02.584035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:02.584819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:02.585515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:03.489252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:03.497213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:03.513391 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cac44692-f06d-4e42-bc32-498d71535477 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 1.111323 Sep 25 01:15:03.518999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-732bd374-fd57-4949-8d4a-96955a9f1fa9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1324 microversion: 2.1 time: 0.952747 Sep 25 01:15:03.519926 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1431/2824] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:02 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1324 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:03.522128 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1394/2825] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:02 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:03.542945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:03.545024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:03.552375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:03.553142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:03.553683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:03.555497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:03.556243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:03.556755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:03.826400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c77b29b-0404-4dcc-84e1-aa19e7c73137 tempest-ExtensionsTest-2014093075 tempest-ExtensionsTest-2014093075-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:03.829174 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c77b29b-0404-4dcc-84e1-aa19e7c73137 tempest-ExtensionsTest-2014093075 tempest-ExtensionsTest-2014093075-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.307687 Sep 25 01:15:03.830955 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1432/2826] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:15:03 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:03.836359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:03.837234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:03.845593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:03.846355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:03.847051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:03.849743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:03.862902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:03.863862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.092475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:04.103519 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-53b8b81d-0454-422e-8fca-68c35982de30 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1469 microversion: 2.1 time: 0.580037 Sep 25 01:15:04.117573 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1395/2827] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:03 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1469 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:04.117573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:04.117573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:04.134617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.135274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.135816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.136683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.137564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.138118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.502919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:04.515854 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fe93be5-2b2b-43e0-8a6b-10355f3ddf11 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 0.683222 Sep 25 01:15:04.517095 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1433/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:03 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:04.523684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9a788d7f-97a7-42af-951c-7dd378a354a0 req-95c1fec9-19f4-4bc4-890d-8dcb36f10932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e2e1e6-8550-4e12-a80a-d1730f185f83", "tag": "8fbd313a-624d-4f45-a5ef-46d93a04f19f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:04.536471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a788d7f-97a7-42af-951c-7dd378a354a0 req-95c1fec9-19f4-4bc4-890d-8dcb36f10932 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.537246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a788d7f-97a7-42af-951c-7dd378a354a0 req-95c1fec9-19f4-4bc4-890d-8dcb36f10932 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.537941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a788d7f-97a7-42af-951c-7dd378a354a0 req-95c1fec9-19f4-4bc4-890d-8dcb36f10932 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.555770 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9a788d7f-97a7-42af-951c-7dd378a354a0 req-95c1fec9-19f4-4bc4-890d-8dcb36f10932 service nova] Creating event network-changed:8fbd313a-624d-4f45-a5ef-46d93a04f19f for instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 on n-h2-master-1 Sep 25 01:15:04.564005 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9a788d7f-97a7-42af-951c-7dd378a354a0 req-95c1fec9-19f4-4bc4-890d-8dcb36f10932 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044995 Sep 25 01:15:04.565322 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1434/2829] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:04.571564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f6d7bd6-5cb2-4957-a92d-31cf90e14af7 tempest-ExtensionsTest-2014093075 tempest-ExtensionsTest-2014093075-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:04.574029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f6d7bd6-5cb2-4957-a92d-31cf90e14af7 tempest-ExtensionsTest-2014093075 tempest-ExtensionsTest-2014093075-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007284 Sep 25 01:15:04.597120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:04.599246 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1435/2830] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:15:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:15:04.610887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "name": "network-vif-plugged", "status": "completed", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:04.630851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.631436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.632070 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ddf1b62-d763-4aa0-a215-0a2c1d838b97 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.515071 Sep 25 01:15:04.632354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.638000 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1396/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:04 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:04.646928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:04.650388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:04.659884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.661656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.662279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.663249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.664186 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] Creating event network-vif-plugged:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h1-master-1 Sep 25 01:15:04.665477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.666213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.675146 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:15:04.689620 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6ab967f5-399b-4061-b455-a1bfb65171d3 req-2d5f3ee8-ddf7-4310-9978-f88c22117b3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087657 Sep 25 01:15:04.690771 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1436/2832] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:04.698498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:04.699968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:04.708480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.709152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.709801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:04.710862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:04.711434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:04.713285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:05.382514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:05.423163 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f51e350-532d-4b7d-b9bf-2e79f4762ad1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 0.730935 Sep 25 01:15:05.432190 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1437/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:04 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:05.443536 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:05.444506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:05.455005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:05.455771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:05.458579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:05.459619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:05.460373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:05.461059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:05.555659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:05.566083 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-abb11a94-07ff-4106-92cc-565237188368 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1521 microversion: 2.1 time: 0.924094 Sep 25 01:15:05.566971 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1397/2834] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:04 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1521 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:05.582232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8905523b-efac-453e-84cf-2e74ed53f10b req-d641f210-77af-4402-b368-9ab663be38d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff126d3-3f79-4fe2-8a59-b53795308c5a", "tag": "a7071933-f79d-457b-a070-d3de344147c7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:05.604542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8905523b-efac-453e-84cf-2e74ed53f10b req-d641f210-77af-4402-b368-9ab663be38d8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:05.605236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8905523b-efac-453e-84cf-2e74ed53f10b req-d641f210-77af-4402-b368-9ab663be38d8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:05.605472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8905523b-efac-453e-84cf-2e74ed53f10b req-d641f210-77af-4402-b368-9ab663be38d8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:05.641116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8905523b-efac-453e-84cf-2e74ed53f10b req-d641f210-77af-4402-b368-9ab663be38d8 service nova] Creating event network-changed:a7071933-f79d-457b-a070-d3de344147c7 for instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a on n-h1-master-1 Sep 25 01:15:05.647629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8905523b-efac-453e-84cf-2e74ed53f10b req-d641f210-77af-4402-b368-9ab663be38d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077229 Sep 25 01:15:05.648585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1398/2835] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:05.655287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:05.655996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:05.672988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:05.673519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:05.680054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:05.680966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:05.681474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:05.681934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:05.927848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:05.938750 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dcb4f43e-3276-438a-b088-c301bc5e95f1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1469 microversion: 2.1 time: 0.502530 Sep 25 01:15:05.940992 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1438/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:05 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1469 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:05.945443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76d77331-841a-4d23-bacb-20ca3eb2e14e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'create', calling method: .version_select at 0x7f7bebab3040>, body: {"pool": null} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:06.182127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:06.194175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7c109ae9-c872-4794-9eb0-277b361395af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 0.543965 Sep 25 01:15:06.194851 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1399/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:05 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:06.211909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:06.212654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:06.223728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:06.224859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:06.225490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:06.227031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:06.227779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:06.228429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:06.932381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:06.952047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c4621ab-b4ad-4981-886a-0518b6cf5866 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.755429 Sep 25 01:15:06.956980 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1400/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:06 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:06.968765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:06.982969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:06.989169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:06.991316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:06.995681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:06.999489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:06.999943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:07.000479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:07.479551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:07.493123 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f92b0ad1-01be-47bf-82e1-369aa1bfc2a5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 0.532979 Sep 25 01:15:07.497927 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1401/2839] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:06 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:07.503607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-27f1470e-cf6e-47b8-b6be-eca120dc3a66 req-d673de7d-46ca-4aa2-8e1c-b531e0e45511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97969ff-afac-48e5-b5bc-b67c2cbffea2", "name": "network-vif-plugged", "status": "completed", "tag": "63d143cb-1526-4494-81c7-8146c931ac4c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:07.537606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-27f1470e-cf6e-47b8-b6be-eca120dc3a66 req-d673de7d-46ca-4aa2-8e1c-b531e0e45511 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:07.538462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-27f1470e-cf6e-47b8-b6be-eca120dc3a66 req-d673de7d-46ca-4aa2-8e1c-b531e0e45511 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:07.542161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-27f1470e-cf6e-47b8-b6be-eca120dc3a66 req-d673de7d-46ca-4aa2-8e1c-b531e0e45511 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:07.562594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-27f1470e-cf6e-47b8-b6be-eca120dc3a66 req-d673de7d-46ca-4aa2-8e1c-b531e0e45511 service nova] Creating event network-vif-plugged:63d143cb-1526-4494-81c7-8146c931ac4c for instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 on n-h1-master-1 Sep 25 01:15:07.568541 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-27f1470e-cf6e-47b8-b6be-eca120dc3a66 req-d673de7d-46ca-4aa2-8e1c-b531e0e45511 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069023 Sep 25 01:15:07.570020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1402/2840] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:07.576167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-eae44449-57b1-43ca-bd87-84c1a5524866 req-6110b26b-7737-44f0-a2e4-6517f3e1a55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7980033e-52a8-4fa2-b2d8-05bea9732bf3", "tag": "9f078b6d-051a-44e2-a5fc-1055cf064df2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:07.597727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eae44449-57b1-43ca-bd87-84c1a5524866 req-6110b26b-7737-44f0-a2e4-6517f3e1a55a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:07.598684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eae44449-57b1-43ca-bd87-84c1a5524866 req-6110b26b-7737-44f0-a2e4-6517f3e1a55a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:07.599133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eae44449-57b1-43ca-bd87-84c1a5524866 req-6110b26b-7737-44f0-a2e4-6517f3e1a55a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:07.613776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-eae44449-57b1-43ca-bd87-84c1a5524866 req-6110b26b-7737-44f0-a2e4-6517f3e1a55a service nova] Creating event network-changed:9f078b6d-051a-44e2-a5fc-1055cf064df2 for instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 on n-h1-master-1 Sep 25 01:15:07.621466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-eae44449-57b1-43ca-bd87-84c1a5524866 req-6110b26b-7737-44f0-a2e4-6517f3e1a55a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049784 Sep 25 01:15:07.623045 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1403/2841] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:07.628446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:07.629449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:07.636893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:07.637968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:07.638601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:07.639500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:07.640109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:07.640689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:08.046261 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:08.098141 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:08.250837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:08.266291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a813615a-1f57-4e74-b706-fe3c1c1ae19d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1469 microversion: 2.1 time: 0.641506 Sep 25 01:15:08.267076 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1404/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:07 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1469 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:08.277036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:08.278348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:08.289598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:08.290686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:08.291513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:08.292445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:08.293190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:08.293866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:08.753395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:08.773903 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64180be5-ae43-4bc6-9216-ac66091ad408 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1294 microversion: 2.1 time: 0.502860 Sep 25 01:15:08.775913 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1405/2843] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:08 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1294 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:08.796082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:08.796881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:08.804149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:08.805253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:08.805919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:08.806793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:08.807413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:08.808002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:09.259737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:09.284521 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29610e77-ddd1-4dde-a7ec-ec7ecd191f71 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.505275 Sep 25 01:15:09.286447 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1406/2844] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:08 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:09.297705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:09.301946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:09.314342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:09.315108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:09.316272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:09.317778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:09.318542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:09.319286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:09.727291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:09.751378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f29b63bd-07fb-4ef9-9d3f-917a9eea22c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 0.463585 Sep 25 01:15:09.760751 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76d77331-841a-4d23-bacb-20ca3eb2e14e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.819721 Sep 25 01:15:09.762165 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1439/2845] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:15:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:09.767786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:09.769010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:09.769580 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1407/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:09 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:09.776746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:09.778030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:09.778973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:09.780294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:09.780873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:09.781419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:09.804250 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:09.946340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3fd9fee6-0456-4de8-80d5-bb40302b3f0f tempest-ComputeTenantNetworksTest-50354231 tempest-ComputeTenantNetworksTest-50354231-project] Calling method '.version_select at 0x7f7beb962e50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:10.485125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:10.496788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8308e955-ddaa-4c66-b5b3-2f144137a28e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1461 microversion: 2.1 time: 0.733039 Sep 25 01:15:10.498627 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1440/2847] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:09 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1461 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:10.503923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:10.504946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:10.512519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:10.513198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:10.513830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:10.514700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:10.515319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:10.515930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:10.532911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3fd9fee6-0456-4de8-80d5-bb40302b3f0f tempest-ComputeTenantNetworksTest-50354231 tempest-ComputeTenantNetworksTest-50354231-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.761289 Sep 25 01:15:10.539571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1408/2848] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:15:09 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:10.540194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-723319516", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "e0a2d659-a909-4cc9-8950-f95844d9dc25"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:10.612832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] validate_networks() for [('e0a2d659-a909-4cc9-8950-f95844d9dc25', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:15:10.835613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:10.847151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-897c1cc9-c9d8-43e1-9ae9-098c67dc9bd9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1484 microversion: 2.1 time: 0.347096 Sep 25 01:15:10.847739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1441/2849] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:10 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1484 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:10.853176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:10.854031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:10.860608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:10.861101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:10.861638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:10.862558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:10.863188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:10.864054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.104549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:11.112607 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-277a7730-cb6f-458c-bff6-9fa01ac97ff9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.263606 Sep 25 01:15:11.113461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1442/2850] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:10 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:11.118829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:11.119723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:11.128730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.129583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.130282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.131216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.131906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.132544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.256984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:15:11.257354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:15:11.257856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:15:11.258261 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:15:11.258662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:15:11.271745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.272473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.273104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.274079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.275956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.277127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.298055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Getting quotas for project 744c3c67433f4d268891a810016366cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:15:11.303304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Getting quotas for user 95b7650e677d47ab9576bc3cb6ea07e7 and project 744c3c67433f4d268891a810016366cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:15:11.314800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:11.316423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:15:11.318952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:15:11.323538 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-848124bd-5817-4a82-9d13-a2dff1c7dc4a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1461 microversion: 2.1 time: 0.208845 Sep 25 01:15:11.341817 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1443/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:11 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1461 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:11.349115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-befa5813-2863-49d8-97d7-d64fd8ff5f3e tempest-ComputeTenantNetworksTest-50354231 tempest-ComputeTenantNetworksTest-50354231-project] Calling method '.version_select at 0x7f7bebd06550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:11.368227 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-418f02b2-6eac-4778-89ea-3597a8d5b890 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833135 Sep 25 01:15:11.369966 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1409/2852] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:15:11.381138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-dad9eaad-f270-4c69-932f-ce9ec18d0ee5 req-3035cc42-3ba8-4463-9d85-4fce835a10ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e2e1e6-8550-4e12-a80a-d1730f185f83", "name": "network-vif-plugged", "status": "completed", "tag": "8fbd313a-624d-4f45-a5ef-46d93a04f19f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:11.404021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dad9eaad-f270-4c69-932f-ce9ec18d0ee5 req-3035cc42-3ba8-4463-9d85-4fce835a10ca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.404678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dad9eaad-f270-4c69-932f-ce9ec18d0ee5 req-3035cc42-3ba8-4463-9d85-4fce835a10ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.405269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dad9eaad-f270-4c69-932f-ce9ec18d0ee5 req-3035cc42-3ba8-4463-9d85-4fce835a10ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.428640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dad9eaad-f270-4c69-932f-ce9ec18d0ee5 req-3035cc42-3ba8-4463-9d85-4fce835a10ca service nova] Creating event network-vif-plugged:8fbd313a-624d-4f45-a5ef-46d93a04f19f for instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 on n-h2-master-1 Sep 25 01:15:11.438935 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-dad9eaad-f270-4c69-932f-ce9ec18d0ee5 req-3035cc42-3ba8-4463-9d85-4fce835a10ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067146 Sep 25 01:15:11.445905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1410/2853] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:11.454155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:11.455844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:11.466114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.466901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.467554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.469303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.470097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.470728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.473579 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-befa5813-2863-49d8-97d7-d64fd8ff5f3e tempest-ComputeTenantNetworksTest-50354231 tempest-ComputeTenantNetworksTest-50354231-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/54651226-b9a5-4ded-bb9b-97e25f884501" status: 200 len: 138 microversion: 2.1 time: 0.129586 Sep 25 01:15:11.474356 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1444/2854] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:15:11 2022] GET /compute/v2.1/os-tenant-networks/54651226-b9a5-4ded-bb9b-97e25f884501 => generated 138 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:11.479530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:11.479948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:11.501443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.501943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.502631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.503700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:11.504351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:11.506075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:11.629620 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6828b1df-eba1-4ad9-93d9-4cd000077c16 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154148 Sep 25 01:15:11.630232 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1445/2855] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:15:11 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:11.639534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67d0d092-bb79-450c-9906-04d4d2fbfc1c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'create', calling method: .version_select at 0x7f7bebab3e50>, body: {"keypair": {"name": "tempest-keypair-1306024107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGneKddw9JNROmvhdTHVVMordzHOyZCwt7ovseCz7ecPEbw3XH7PY30bGlxk+sa3665QIWZZRI4KMBnb1hur5uXdZqcrSMREI06tw+4Fxv+b50yFZahV3DtDTb/JAeZeAg=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:11.660999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-67d0d092-bb79-450c-9906-04d4d2fbfc1c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:15:11.666519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-67d0d092-bb79-450c-9906-04d4d2fbfc1c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for user 5db19a97588e41d1858915c9ccc48620 and project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:15:11.698584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67d0d092-bb79-450c-9906-04d4d2fbfc1c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063028 Sep 25 01:15:11.701630 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1446/2856] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:15:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:11.708549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31fb9fcd-ff95-45d5-9e6a-7fafcc062c83 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:11.709615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31fb9fcd-ff95-45d5-9e6a-7fafcc062c83 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:11.848447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:11.857932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34860d81-9999-483e-8e27-1a766162f272 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 0.409380 Sep 25 01:15:11.858568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31fb9fcd-ff95-45d5-9e6a-7fafcc062c83 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:11.874129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31fb9fcd-ff95-45d5-9e6a-7fafcc062c83 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1223 microversion: 2.1 time: 0.166370 Sep 25 01:15:11.875721 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1411/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:11 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:11.883083 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1447/2858] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:11 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:12.149663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:12.149663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:12.152648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:12.153523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:12.154178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:12.155159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:12.155870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:12.156727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:12.162772 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:12.422509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:12.437476 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-72224203-4f40-4471-aff8-b549bc95a10c tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.303797 Sep 25 01:15:12.438217 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1412/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:12 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:12.886962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:12.888277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:12.899049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:12.900419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:12.908859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:12.911726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:12.917268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:12.918602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:12.919035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:12.920014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:12.920755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:12.921397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:12.925034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:12.925755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:12.929261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:12.929949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.123203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:13.133751 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9dd36985-7c43-48a2-bc43-161ea36c05e9 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1227 microversion: 2.1 time: 0.238415 Sep 25 01:15:13.155542 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1413/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:12 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1227 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:13.294675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:13.295640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:13.310737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:13.311946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:13.312790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:13.313489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.316577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:13.317953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:13.321760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ee7b5a45-fedd-4f55-a2c6-ecb8c2fc28ce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 0.440707 Sep 25 01:15:13.322022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.330005 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1448/2861] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:12 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:13.344241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-02f894ca-60e3-4496-a313-9fb475b4e376 req-befc22fb-f255-42a4-9505-a45a694be999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97969ff-afac-48e5-b5bc-b67c2cbffea2", "tag": "63d143cb-1526-4494-81c7-8146c931ac4c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:13.359006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-02f894ca-60e3-4496-a313-9fb475b4e376 req-befc22fb-f255-42a4-9505-a45a694be999 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:13.359780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-02f894ca-60e3-4496-a313-9fb475b4e376 req-befc22fb-f255-42a4-9505-a45a694be999 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:13.362465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-02f894ca-60e3-4496-a313-9fb475b4e376 req-befc22fb-f255-42a4-9505-a45a694be999 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.387779 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-02f894ca-60e3-4496-a313-9fb475b4e376 req-befc22fb-f255-42a4-9505-a45a694be999 service nova] Creating event network-changed:63d143cb-1526-4494-81c7-8146c931ac4c for instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 on n-h1-master-1 Sep 25 01:15:13.408650 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-02f894ca-60e3-4496-a313-9fb475b4e376 req-befc22fb-f255-42a4-9505-a45a694be999 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075553 Sep 25 01:15:13.411200 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1449/2862] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:13.468020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:13.469190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:13.480988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:13.482098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:13.482850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.483929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:13.491256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:13.492018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.890971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:13.903257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae7806f0-3cb6-4f18-aea9-381cd671c0af tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1484 microversion: 2.1 time: 0.612598 Sep 25 01:15:13.912645 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1414/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:13 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1484 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:13.921291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8bf529bf-013d-4462-92e7-d8cdd17322ca req-1edece8a-ea0e-4084-a83b-f2c089e95466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff126d3-3f79-4fe2-8a59-b53795308c5a", "name": "network-vif-plugged", "status": "completed", "tag": "a7071933-f79d-457b-a070-d3de344147c7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:13.947674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8bf529bf-013d-4462-92e7-d8cdd17322ca req-1edece8a-ea0e-4084-a83b-f2c089e95466 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:13.948551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8bf529bf-013d-4462-92e7-d8cdd17322ca req-1edece8a-ea0e-4084-a83b-f2c089e95466 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:13.949776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8bf529bf-013d-4462-92e7-d8cdd17322ca req-1edece8a-ea0e-4084-a83b-f2c089e95466 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:13.974949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:13.985915 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8bf529bf-013d-4462-92e7-d8cdd17322ca req-1edece8a-ea0e-4084-a83b-f2c089e95466 service nova] Creating event network-vif-plugged:a7071933-f79d-457b-a070-d3de344147c7 for instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a on n-h1-master-1 Sep 25 01:15:13.988771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab4744f8-9e37-4e44-a29c-5f985c7f3b77 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1316 microversion: 2.1 time: 0.526034 Sep 25 01:15:13.998067 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1450/2864] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:13 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:14.019498 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8bf529bf-013d-4462-92e7-d8cdd17322ca req-1edece8a-ea0e-4084-a83b-f2c089e95466 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100382 Sep 25 01:15:14.021241 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1415/2865] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:14.163247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:14.164218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:14.180012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:14.182037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:14.184228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:14.186386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:14.192031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:14.192541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:14.354938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:14.360389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:14.362797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:14.373958 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1275 microversion: 2.1 time: 0.214647 Sep 25 01:15:14.423449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1451/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:14 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:14.425697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:14.426659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:14.429429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:14.430537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:14.432121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:14.434545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:14.817319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:14.818771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001829 Sep 25 01:15:14.827714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1452/2867] 10.222.0.16 () {56 vars in 886 bytes} [Sun Sep 25 01:15:14 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 25 01:15:14.832886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:14.834259 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001905 Sep 25 01:15:14.843663 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1453/2868] 10.222.0.16 () {54 vars in 1035 bytes} [Sun Sep 25 01:15:14 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 25 01:15:14.845909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:14.847155 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Sep 25 01:15:14.854879 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1454/2869] 10.222.0.16 () {54 vars in 1041 bytes} [Sun Sep 25 01:15:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:14.862231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:14.863484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc90d8ff-c8a5-4cb2-93bb-92231d00b7d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001761 Sep 25 01:15:14.864476 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1455/2870] 10.222.0.16 () {56 vars in 886 bytes} [Sun Sep 25 01:15:14 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 25 01:15:14.906952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:14.919989 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-07846082-3e26-4a89-95b9-63a00628aaf0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1314 microversion: 2.1 time: 0.571081 Sep 25 01:15:14.929754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1416/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:14 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:15.024446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.025116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:15.041124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.041969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.042670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.044254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.049289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.050024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.141895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0f62572-6376-4bde-b336-c728ef96ccbc tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '.version_select at 0x7f7bebaedd30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.146402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f62572-6376-4bde-b336-c728ef96ccbc tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.148796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f62572-6376-4bde-b336-c728ef96ccbc tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.149391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0f62572-6376-4bde-b336-c728ef96ccbc tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.164650 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0f62572-6376-4bde-b336-c728ef96ccbc tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.027191 Sep 25 01:15:15.175954 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1417/2872] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:15.219028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d95c99ac-1d19-47a2-a978-0047b3e21062 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.230566 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d95c99ac-1d19-47a2-a978-0047b3e21062 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022060 Sep 25 01:15:15.239785 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1418/2873] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:15.248032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0260c79f-470c-410c-8580-2de46b9362be tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2040946739", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:15.278334 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0260c79f-470c-410c-8580-2de46b9362be tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.034972 Sep 25 01:15:15.286351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1419/2874] 10.222.0.16 () {60 vars in 1146 bytes} [Sun Sep 25 01:15:15 2022] POST /compute/v2.1/flavors => generated 499 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:15.293931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b73eec9e-03d3-4cb2-860f-3eed6a69bc30 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.312806 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b73eec9e-03d3-4cb2-860f-3eed6a69bc30 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023747 Sep 25 01:15:15.322687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1420/2875] 10.222.0.16 () {58 vars in 1182 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:15:15.366625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:15.378675 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-35bf1315-ceed-4f8b-83e9-d0bad9a7a631 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1504 microversion: 2.1 time: 0.358083 Sep 25 01:15:15.379378 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1456/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:15.412841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.413915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:15.420973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.427793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.428514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:15.431772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.432642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.434635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.438007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.443613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.444993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.445893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.447327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.468349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.470365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.471031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.549742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:15.550749 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a65a713-d1ec-4ed6-b853-bc1d3c6b639d tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83/os-instance-actions/req-43a8d857-13a4-41be-b46c-62d5a193b29b" status: 200 len: 313 microversion: 2.1 time: 0.141989 Sep 25 01:15:15.577915 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1421/2877] 10.222.0.16 () {58 vars in 1419 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83/os-instance-actions/req-43a8d857-13a4-41be-b46c-62d5a193b29b => generated 313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:15.592354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:15.594682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:15.614446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.614944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.615384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.616085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.620580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.623310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.630677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:15.646046 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be200ac6-2747-4764-9a54-b8e2a36724b1 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1281 microversion: 2.1 time: 0.222073 Sep 25 01:15:15.647670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1457/2878] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:15.660077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1872095636", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "10dbf8bf-d643-47d6-ad0d-86c8d404be46"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:15.757772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:15:15.767590 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9459ebf-dc29-40d7-8c0d-150fef73ddb8 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "POST /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83/action" status: 202 len: 0 microversion: 2.1 time: 0.187588 Sep 25 01:15:15.774093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1422/2879] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:15 2022] POST /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:15:15.783402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:15.784777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:15.793244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.794144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.794807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:15.795711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:15.796324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:15.796950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:16.369439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:16.378437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d855171-fb2f-451c-89a9-fe1fb146dfff tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1506 microversion: 2.1 time: 0.602339 Sep 25 01:15:16.379036 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1423/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:15 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:16.401680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:16.403127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:16.423211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:16.423940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:16.424563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:16.425714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:16.426356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:16.427159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.046130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:15:17.047237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:15:17.047750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:15:17.051569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:15:17.051867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:15:17.082921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.084070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.084594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.085354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.088575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.089309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.131297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:15:17.139111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for user 5db19a97588e41d1858915c9ccc48620 and project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:15:17.154859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:15:17.157378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:15:17.238895 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a818db95-2a7c-401d-bbc5-13325d309544 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590124 Sep 25 01:15:17.252383 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1458/2881] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:15:17.266181 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:17.267098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:17.278784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:17.295685 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e95d0648-bad2-407b-afe2-18ae323078b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1501 microversion: 2.1 time: 0.898574 Sep 25 01:15:17.296691 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1424/2882] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:16 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1501 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:17.297011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.298263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.298953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.299860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.301749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.302370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.304112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2afbd76-2166-43d9-ac16-c84bd366be18 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:17.305111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2afbd76-2166-43d9-ac16-c84bd366be18 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:17.458294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e2afbd76-2166-43d9-ac16-c84bd366be18 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:17.473324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2afbd76-2166-43d9-ac16-c84bd366be18 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1279 microversion: 2.1 time: 0.174109 Sep 25 01:15:17.475660 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1425/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:17 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:17.504200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:17.505931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:17.523577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.525236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.526075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.527467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.528106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.528728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.565901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:15:17.698306 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c05182c9-fbfd-4ef2-bdef-67a4a28e8bdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 204 len: 0 microversion: 2.1 time: 0.217786 Sep 25 01:15:17.699967 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1426/2884] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:15:17 2022] DELETE /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:15:17.706966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e03e4637-258d-4452-864b-b839f46b99b2 req-8f76db98-4cb9-4209-b289-6e96be8a34b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d208e8-428f-4cc4-bc6b-0dc8f2673a98", "tag": "93025688-9c58-48e3-9eb3-5977bca6b2f4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:17.720433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e03e4637-258d-4452-864b-b839f46b99b2 req-8f76db98-4cb9-4209-b289-6e96be8a34b6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.721670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e03e4637-258d-4452-864b-b839f46b99b2 req-8f76db98-4cb9-4209-b289-6e96be8a34b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.722409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e03e4637-258d-4452-864b-b839f46b99b2 req-8f76db98-4cb9-4209-b289-6e96be8a34b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.738286 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e03e4637-258d-4452-864b-b839f46b99b2 req-8f76db98-4cb9-4209-b289-6e96be8a34b6 service nova] Creating event network-changed:93025688-9c58-48e3-9eb3-5977bca6b2f4 for instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 on n-h2-master-1 Sep 25 01:15:17.745144 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e03e4637-258d-4452-864b-b839f46b99b2 req-8f76db98-4cb9-4209-b289-6e96be8a34b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043330 Sep 25 01:15:17.747539 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1427/2885] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:17.748158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:17.756032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:17.757138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:17.761869 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64a9244c-1483-4496-ae0c-cb3e0e9b640c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.507707 Sep 25 01:15:17.779667 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1459/2886] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:17 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:17.779667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:17.779667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:17.784668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.785532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.786826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.787779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.788594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.789243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.797264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.798058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.798334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:17.802826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:17.803364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:17.803837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:18.175384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:18.188254 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e76ca10d-d0d5-4947-b906-f3719c2ee3b2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1507 microversion: 2.1 time: 0.416749 Sep 25 01:15:18.189483 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1460/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:17 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:18.227473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:18.238769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3b6b9f4-b0b0-4440-a805-a4aee167a6a7 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1506 microversion: 2.1 time: 0.488924 Sep 25 01:15:18.239785 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1428/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:17 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:18.499163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:18.499828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:18.506252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:18.507028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:18.507627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:18.508630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:18.509253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:18.509991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:18.630063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:18.644030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-33179a95-9ac5-4788-8f09-a58aa780b9ef tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1283 microversion: 2.1 time: 0.145561 Sep 25 01:15:18.644782 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1461/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:18 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1283 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:18.790186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:18.792535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:18.796072 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:18.805926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:18.807085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:18.807751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:18.809372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:18.810082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:18.810755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:19.126191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:19.138588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cb5062f8-9805-47f8-8924-e5bd1c40f264 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.356343 Sep 25 01:15:19.141062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1429/2890] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:18 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:19.213289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:19.216877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:19.240942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:19.242965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:19.245343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:19.249768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:19.250647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:19.253476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:19.445660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f58fed0d-9b69-49e7-8bac-4ebdd344eccf tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Action: 'create', calling method: .version_select at 0x7f7bebc084c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-393593527", "metadata": {"Type": "work"}}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:19.701466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:19.714752 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d24ad36-bf33-473e-b062-a2bd690aa14b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1507 microversion: 2.1 time: 0.506449 Sep 25 01:15:19.715841 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1430/2891] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:19 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:19.722956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:19.723812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:19.731798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:19.732714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:19.733333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:19.734372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:19.735005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:19.735588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.017295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:20.029240 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33bf4ac7-c9b6-4eb9-8a23-d290c1b43965 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1504 microversion: 2.1 time: 0.311980 Sep 25 01:15:20.031165 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1431/2892] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:19 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:20.041025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.048889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:20.059856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f58fed0d-9b69-49e7-8bac-4ebdd344eccf tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.992656 Sep 25 01:15:20.065840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1462/2893] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:15:19 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1000 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 25 01:15:20.068754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.069385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.071430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '.version_select at 0x7f7bebbf8940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.071996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.072124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:20.076027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.076875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.081564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.092143 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:20.113340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.114108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.114769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.115696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.117397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.118478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.207589 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-607d64b8-5264-4099-8c76-6c88a6879ba0 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.140189 Sep 25 01:15:20.208611 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1463/2894] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 25 01:15:20 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83/os-instance-actions => generated 611 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:20.220080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30f67c41-efb7-4940-af24-2e34fa295389 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebb01550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.233372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:20.242472 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8d6376e0-dbaf-41da-b9f8-1229126feef5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1331 microversion: 2.1 time: 0.210087 Sep 25 01:15:20.243062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1432/2895] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:20 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:20.269344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.271164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:20.290681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.291246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.291689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.294835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.295313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.295754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.350314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30f67c41-efb7-4940-af24-2e34fa295389 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 352 microversion: 2.1 time: 0.140295 Sep 25 01:15:20.351148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1464/2896] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:20 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:20.356373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.357498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:20.373814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.374747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.375463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.380704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.381791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.382513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.451185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:15:20.561553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:20.574763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86252758-3368-4478-9609-2fe4ef9b3465 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.326712 Sep 25 01:15:20.575692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1433/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:20 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:20.622544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a351f389-7a07-49b2-86ab-942ac0553694 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 204 len: 0 microversion: 2.1 time: 0.269519 Sep 25 01:15:20.624678 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1465/2898] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:15:20 2022] DELETE /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:15:20.632617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.633238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:20.656645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.657313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.657898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.664206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.664832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.665283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.756816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:20.762440 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:20.776722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.778133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.779236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.783149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:20.786263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:20.786895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:20.819147 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:21.142830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:21.155616 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74fd7ec4-f11c-4093-abac-57c47a7dd591 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 200 len: 1465 microversion: 2.1 time: 0.415287 Sep 25 01:15:21.158338 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1466/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:20 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 1465 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:21.190291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1cb1a31d-9537-4758-afa2-2e89c399396d req-19f495b3-c9fd-4734-89bb-4eec86702154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff126d3-3f79-4fe2-8a59-b53795308c5a", "name": "network-vif-deleted", "tag": "a7071933-f79d-457b-a070-d3de344147c7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:21.192603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:21.204682 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e787e13-1345-472b-b4e7-fd591e615bfc tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1510 microversion: 2.1 time: 0.575240 Sep 25 01:15:21.205711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1434/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:20 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1510 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:21.225630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1cb1a31d-9537-4758-afa2-2e89c399396d req-19f495b3-c9fd-4734-89bb-4eec86702154 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:21.226037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1cb1a31d-9537-4758-afa2-2e89c399396d req-19f495b3-c9fd-4734-89bb-4eec86702154 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:21.226487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1cb1a31d-9537-4758-afa2-2e89c399396d req-19f495b3-c9fd-4734-89bb-4eec86702154 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:21.252498 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1cb1a31d-9537-4758-afa2-2e89c399396d req-19f495b3-c9fd-4734-89bb-4eec86702154 service nova] Creating event network-vif-deleted:a7071933-f79d-457b-a070-d3de344147c7 for instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a on n-h1-master-1 Sep 25 01:15:21.265524 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1cb1a31d-9537-4758-afa2-2e89c399396d req-19f495b3-c9fd-4734-89bb-4eec86702154 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081752 Sep 25 01:15:21.266399 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1467/2901] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:21.275677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:21.276305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:21.295836 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:21.298721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:21.302500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:21.303075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:21.306657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:21.307347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:21.307791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:21.366797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41cd344e-d24f-440e-82f8-0081bd8978ae tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebbd4ca0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:21.500561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:21.510182 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41cd344e-d24f-440e-82f8-0081bd8978ae tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 352 microversion: 2.1 time: 0.147354 Sep 25 01:15:21.512317 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1468/2902] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:21 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:21.527389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9cc193a3-1aa2-4079-ab0d-996e7a10a4ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1337 microversion: 2.1 time: 0.259720 Sep 25 01:15:21.528743 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1435/2903] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:21 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1337 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:21.599213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:21.599964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:21.602035 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:21.618036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:21.618925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:21.619655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:21.620517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:21.621396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:21.623117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:21.857545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:21.870031 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-328dcb3e-c796-471b-b15f-27dd61cd80d7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.274544 Sep 25 01:15:21.870794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1469/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:21 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:22.198365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:22.200615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:22.209140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:22.210417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:22.211749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:22.213053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:22.213940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:22.220419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:22.232189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:22.233113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:22.241014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:22.241790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:22.242422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:22.243303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:22.244035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:22.244623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:22.264460 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a HTTP/1.1 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5ff126d3-3f79-4fe2-8a59-b53795308c5a'} Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:22.267469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4dcf4a54-81a9-4ba9-8234-7ed545ac705f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 404 len: 111 microversion: 2.1 time: 0.076846 Sep 25 01:15:22.272619 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1436/2905] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:22 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:15:22.426863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1524178055", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:22.441888 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:22.452326 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5fdc014e-2630-41b6-8b93-d23655ec8e99 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1510 microversion: 2.1 time: 0.223994 Sep 25 01:15:22.452958 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1470/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:22 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:22.502150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:15:22.526045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73a33b31-6e82-483e-8e79-7a8890f8c401 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebbd4a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:22.622055 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73a33b31-6e82-483e-8e79-7a8890f8c401 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 353 microversion: 2.1 time: 0.099694 Sep 25 01:15:22.631168 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1471/2907] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:22 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:22.631168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:22.631168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:22.644487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:22.645396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:22.646047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:22.646966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:22.647770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:22.648828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.191418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:23.206255 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ebc16137-7b9d-4696-a27b-689f161ad15b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 0.582511 Sep 25 01:15:23.206853 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1472/2908] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:22 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:23.225686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84f046d9-6495-4aa4-978e-8e796f95629e tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebb860d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:23.377467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84f046d9-6495-4aa4-978e-8e796f95629e tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 353 microversion: 2.1 time: 0.169484 Sep 25 01:15:23.388362 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1473/2909] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:23 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:23.388362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:23.388362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:23.395767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:23.396519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:23.397152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.398309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:23.399444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:23.401313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.535719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:15:23.536312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:15:23.536637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:15:23.537047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:15:23.537549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:15:23.558534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:23.559029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:23.559480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.560215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:23.560674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:23.561103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.607497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:15:23.618435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:15:23.649775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:15:23.658194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:15:23.760812 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e763a79-8710-4089-9fb3-aecb8825eecf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337695 Sep 25 01:15:23.762055 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1437/2910] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:15:23.766995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be280c90-2be9-448f-8cbe-fffb0aa64dfc tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7beb247700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:23.890695 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be280c90-2be9-448f-8cbe-fffb0aa64dfc tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 202 len: 0 microversion: 2.1 time: 0.127359 Sep 25 01:15:23.891268 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1438/2911] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:15:23 2022] DELETE /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:15:23.897119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:23.898030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:23.913378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:23.916174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:23.922376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.923424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:23.924055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:23.924780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:23.997638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:24.021089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1efc432-3114-4536-a83a-429c30d451ce tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.641505 Sep 25 01:15:24.021715 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1474/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:23 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:24.056785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41a1fdee-1c1b-4bd7-83a0-0ffa6323c814 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:24.061925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-41a1fdee-1c1b-4bd7-83a0-0ffa6323c814 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:24.318648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-41a1fdee-1c1b-4bd7-83a0-0ffa6323c814 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:24.331930 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41a1fdee-1c1b-4bd7-83a0-0ffa6323c814 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1215 microversion: 2.1 time: 0.294633 Sep 25 01:15:24.341493 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1475/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:24 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:24.347474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-095f2e3d-472c-4a43-8a24-d4c87a923b26 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebab3160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:24.466915 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-095f2e3d-472c-4a43-8a24-d4c87a923b26 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 352 microversion: 2.1 time: 0.132683 Sep 25 01:15:24.468148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1476/2914] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:24 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:24.473245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:24.474173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:24.488848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:24.492031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:24.492667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:24.494893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:24.496414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:24.497092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:24.741231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09320560cb2d48228041e62efe9fa018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f6dd104c6c4f5b856d5ea62a769c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:24.752412 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-68ad774b-2119-4b1f-93f9-47bad12ce0cd tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 200 len: 1510 microversion: 2.1 time: 0.859643 Sep 25 01:15:24.756043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1439/2915] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:23 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 1510 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:24.860408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c3d12c22-9885-40ca-9be2-d6e104531a67 req-3f1cee51-8349-4f7d-ace6-aad71a472c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e2e1e6-8550-4e12-a80a-d1730f185f83", "name": "network-vif-deleted", "tag": "8fbd313a-624d-4f45-a5ef-46d93a04f19f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:24.873148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c3d12c22-9885-40ca-9be2-d6e104531a67 req-3f1cee51-8349-4f7d-ace6-aad71a472c4e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:24.874052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c3d12c22-9885-40ca-9be2-d6e104531a67 req-3f1cee51-8349-4f7d-ace6-aad71a472c4e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:24.874735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c3d12c22-9885-40ca-9be2-d6e104531a67 req-3f1cee51-8349-4f7d-ace6-aad71a472c4e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:24.888911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c3d12c22-9885-40ca-9be2-d6e104531a67 req-3f1cee51-8349-4f7d-ace6-aad71a472c4e service nova] Creating event network-vif-deleted:8fbd313a-624d-4f45-a5ef-46d93a04f19f for instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 on n-h2-master-1 Sep 25 01:15:24.897427 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c3d12c22-9885-40ca-9be2-d6e104531a67 req-3f1cee51-8349-4f7d-ace6-aad71a472c4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042170 Sep 25 01:15:24.898343 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1440/2916] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:25.003057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7a1929cd-831e-469f-8d10-5de4d1a67c58 req-041fe933-9293-4ab7-857e-1d12e5b48a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:25.020279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7a1929cd-831e-469f-8d10-5de4d1a67c58 req-041fe933-9293-4ab7-857e-1d12e5b48a3e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.020763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7a1929cd-831e-469f-8d10-5de4d1a67c58 req-041fe933-9293-4ab7-857e-1d12e5b48a3e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.021302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7a1929cd-831e-469f-8d10-5de4d1a67c58 req-041fe933-9293-4ab7-857e-1d12e5b48a3e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.059814 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7a1929cd-831e-469f-8d10-5de4d1a67c58 req-041fe933-9293-4ab7-857e-1d12e5b48a3e service nova] Creating event network-changed:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:15:25.071734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:25.086725 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48691af7-7ad6-4b2c-9da5-857ac01d2b7f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 0.616896 Sep 25 01:15:25.088730 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1477/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:24 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:25.097296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:25.098173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:25.103265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7a1929cd-831e-469f-8d10-5de4d1a67c58 req-041fe933-9293-4ab7-857e-1d12e5b48a3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076706 Sep 25 01:15:25.108257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.109124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.110031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.110937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.112466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.113254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.118296 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1441/2918] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:25.360905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:25.362173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:25.377787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.382182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.382944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.384675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.385379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.386003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.486798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:25.498583 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9ae1322e-4202-49b5-8b41-7670f6cfe479 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.407383 Sep 25 01:15:25.521394 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1478/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:25 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:25.535722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85767ab8-fbe1-4007-8862-6b34f14a6163 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebb86af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:25.611803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:25.627185 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8eb56c3-95ad-40bc-98f1-c0da84bb94f2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1267 microversion: 2.1 time: 0.273366 Sep 25 01:15:25.629478 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1442/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:25 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:25.699833 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85767ab8-fbe1-4007-8862-6b34f14a6163 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 352 microversion: 2.1 time: 0.173011 Sep 25 01:15:25.700632 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1479/2921] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:25 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:25.789908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:25.791230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] [instance: 09e2e1e6-8550-4e12-a80a-d1730f185f83] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:25.812262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.813223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.814773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.817085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:25.818450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:25.820699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:25.839552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] HTTP exception thrown: Instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 could not be found. Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Request method failure captured: Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 HTTP/1.1 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uHPGborCRAiE5eVx-aJXUathtYDI9Mtn2V1jeM40N48JCWIioI7MpzhTtcGYnzAYwQeq9P2mVaXr-K-boqkAfPVCuGBvnqmZoAjFlX5bQ_bA8JnLc33SMFeuHU8U8o34QVXhJwiBB1yCCwCn56e5ABh_sBoRaotfgCCKRBrbRa6l4 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 68f6dd104c6c4f5b856d5ea62a769c14 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceActionsTestJSON-956444723 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68f6dd104c6c4f5b856d5ea62a769c14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68f6dd104c6c4f5b856d5ea62a769c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68f6dd104c6c4f5b856d5ea62a769c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68f6dd104c6c4f5b856d5ea62a769c14"}]}] Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceActionsTestJSON-956444723 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 68f6dd104c6c4f5b856d5ea62a769c14 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceActionsTestJSON-956444723 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceActionsTestJSON-956444723-project Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 09320560cb2d48228041e62efe9fa018 Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceActionsTestJSON-956444723-project Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 could not be found. Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '09e2e1e6-8550-4e12-a80a-d1730f185f83'} Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 could not be found. Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 could not be found. Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:25.841984 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 could not be found. Sep 25 01:15:25.846908 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:25.848709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] Returning 404 to user: Instance 09e2e1e6-8550-4e12-a80a-d1730f185f83 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:25.849941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67ad7fb0-72e7-4ac0-a700-8144ebc669d9 tempest-InstanceActionsTestJSON-956444723 tempest-InstanceActionsTestJSON-956444723-project] 10.222.0.16 "GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83" status: 404 len: 111 microversion: 2.1 time: 0.071156 Sep 25 01:15:25.856483 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1443/2922] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:25 2022] GET /compute/v2.1/servers/09e2e1e6-8550-4e12-a80a-d1730f185f83 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:15:26.115242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:26.115878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:26.124908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:26.125432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:26.137734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:26.138799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:26.140204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:26.140828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:26.307465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7f915cfe-9b82-44c2-af36-e11cd7d1c7a8 req-f7415a38-24f7-488a-abdb-5acaa636b918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d208e8-428f-4cc4-bc6b-0dc8f2673a98", "name": "network-vif-plugged", "status": "completed", "tag": "93025688-9c58-48e3-9eb3-5977bca6b2f4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:26.326445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f915cfe-9b82-44c2-af36-e11cd7d1c7a8 req-f7415a38-24f7-488a-abdb-5acaa636b918 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:26.326935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f915cfe-9b82-44c2-af36-e11cd7d1c7a8 req-f7415a38-24f7-488a-abdb-5acaa636b918 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:26.327350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f915cfe-9b82-44c2-af36-e11cd7d1c7a8 req-f7415a38-24f7-488a-abdb-5acaa636b918 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:26.349239 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7f915cfe-9b82-44c2-af36-e11cd7d1c7a8 req-f7415a38-24f7-488a-abdb-5acaa636b918 service nova] Creating event network-vif-plugged:93025688-9c58-48e3-9eb3-5977bca6b2f4 for instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 on n-h2-master-1 Sep 25 01:15:26.364004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7f915cfe-9b82-44c2-af36-e11cd7d1c7a8 req-f7415a38-24f7-488a-abdb-5acaa636b918 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060397 Sep 25 01:15:26.370523 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1444/2923] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:26.525061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:26.526284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:26.539307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:26.540209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:26.540928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:26.542004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:26.542659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:26.543337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:26.979238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:26.995413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e8e7bc7e-3b32-4341-b8ef-92a1bedc96f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 0.883154 Sep 25 01:15:26.997218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1480/2924] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:26 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:27.002763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:27.003752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:27.013701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:27.014584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:27.015523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:27.016584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:27.017498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:27.018158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:27.115257 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:27.247554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:27.257310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97259a75-d15a-4f1f-90fc-dfd454cba3eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1273 microversion: 2.1 time: 0.258427 Sep 25 01:15:27.257956 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1481/2925] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:26 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:27.280947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f310ddb3-8c23-4a2b-8aee-f384942875ec tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bebab3ee0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:27.328102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:27.344690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f994a53-7a02-4b84-b2f1-c02328e46fcb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.822656 Sep 25 01:15:27.364517 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1445/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:26 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:27.364976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f310ddb3-8c23-4a2b-8aee-f384942875ec tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 200 len: 352 microversion: 2.1 time: 0.096371 Sep 25 01:15:27.372439 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1482/2927] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:27 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:28.022995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:28.023989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:28.038567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:28.039409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:28.040070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:28.042934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:28.045388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:28.046100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:28.287795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:28.289102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:28.299932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:28.300732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:28.301397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:28.302500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:28.303153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:28.303766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:28.602351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:28.612508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:28.617224 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce538e7d-30ff-413e-a4c9-2b26baa83ebe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1273 microversion: 2.1 time: 0.334886 Sep 25 01:15:28.627829 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1483/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:28 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:28.629260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95ae0488-7ab3-4669-beeb-b57e035920f3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 0.610287 Sep 25 01:15:28.630337 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1446/2929] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:28 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:28.633082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:28.633865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:28.641180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8d44783-8c61-4d82-973a-a0b47c801d17 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Calling method '.version_select at 0x7f7bf0d08160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:28.645089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:28.645625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:28.646068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:28.652003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:28.652690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:28.653511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:28.703760 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a8d44783-8c61-4d82-973a-a0b47c801d17 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] HTTP exception thrown: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8d44783-8c61-4d82-973a-a0b47c801d17 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Request method failure captured: Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf HTTP/1.1 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6um7KbpfSDONvEg-jwajLidoJV11j8_v592K3tLjwRJGRt_Q79YV588KIuxtvBs789Yl1NMJlANX3IGpeuQ7I9OOwtmYIqtxNuxVxK9FMCk6mN5v-9MHSzIiXqPPI5vXa7KA5g_pFKBlXzCaQjcwK78dN4DmjkgUz2cPTSk9ODjViQ Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 5b0e0dcc1ebd4d86b73985558a7ec17f Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesGetTestJSON-1178247582 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b0e0dcc1ebd4d86b73985558a7ec17f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b0e0dcc1ebd4d86b73985558a7ec17f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b0e0dcc1ebd4d86b73985558a7ec17f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b0e0dcc1ebd4d86b73985558a7ec17f"}]}] Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesGetTestJSON-1178247582 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 5b0e0dcc1ebd4d86b73985558a7ec17f Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesGetTestJSON-1178247582 Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesGetTestJSON-1178247582-project Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: eb9dae9153254b83b63660ce0c895c7a Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesGetTestJSON-1178247582-project Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: exception: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf'} Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. (HTTP 404) (Request-ID: req-878cc386-2192-4aee-8fbf-67e32e31e85c) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:15:28.705948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8d44783-8c61-4d82-973a-a0b47c801d17 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] Returning 404 to user: Volume 8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:28.710234 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8d44783-8c61-4d82-973a-a0b47c801d17 tempest-VolumesGetTestJSON-1178247582 tempest-VolumesGetTestJSON-1178247582-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf" status: 404 len: 109 microversion: 2.1 time: 0.075927 Sep 25 01:15:28.713999 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1447/2930] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:15:28 2022] GET /compute/v2.1/os-volumes/8e8bc980-ac22-4cb7-8c9f-dc5de55a9ddf => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:15:29.102706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:29.119733 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-34beffda-4192-4b80-8bb5-fabce6966616 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1323 microversion: 2.1 time: 0.490604 Sep 25 01:15:29.124057 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1484/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:28 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:29.667395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:29.668033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:29.670023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:29.672552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:29.694608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:29.695109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:29.696127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:29.696639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:29.697078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:29.698010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:29.699816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:29.700298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:29.700733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:29.701814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:29.702754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:29.703195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:30.439189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:30.451470 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5acf0359-8225-4fb2-acba-0a143a4fdba4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 0.801166 Sep 25 01:15:30.453438 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1448/2932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:29 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:30.460485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:30.461259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:30.469156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:30.471407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:30.473908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:30.474919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:30.475929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:30.476626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:30.477283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:30.486889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5e6c08e-3c04-4662-8103-f28612535070 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 0.833986 Sep 25 01:15:30.500452 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1485/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:29 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:31.331447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:31.355002 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbdf6f9d-5144-4720-8bf4-29b4ee8c1ccd tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 200 len: 1520 microversion: 2.1 time: 0.899571 Sep 25 01:15:31.358004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1449/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:30 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 1520 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:31.380997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.105"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:31.385300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:31.396428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:31.397163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:31.397817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:31.398699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:31.399978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:31.400594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:31.432487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:15:31.434533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquired lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:15:31.476925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:31.479066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:31.487753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:31.488798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:31.489618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:31.490625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:31.493164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:31.494055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:32.100075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:32.112913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24a3ef28-2cd6-47dd-885f-cadd91eeeeef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 0.642359 Sep 25 01:15:32.113458 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1450/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:31 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:32.132378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:32.133012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:32.143838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:32.144339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:32.144779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:32.145518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:32.145976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:32.146404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:32.926169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:32.935253 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3982eb92-39e8-4187-a9df-6aea164c30ba tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 0.818259 Sep 25 01:15:32.935844 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1451/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:32 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:32.941105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a9041d6b-fc0a-468f-9241-104eadaf2e9a req-a36618c6-279f-4f8b-8dc8-c77669bbbcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "name": "network-vif-plugged", "status": "completed", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:32.952140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9041d6b-fc0a-468f-9241-104eadaf2e9a req-a36618c6-279f-4f8b-8dc8-c77669bbbcc8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:32.952659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9041d6b-fc0a-468f-9241-104eadaf2e9a req-a36618c6-279f-4f8b-8dc8-c77669bbbcc8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:32.953096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9041d6b-fc0a-468f-9241-104eadaf2e9a req-a36618c6-279f-4f8b-8dc8-c77669bbbcc8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:32.967403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a9041d6b-fc0a-468f-9241-104eadaf2e9a req-a36618c6-279f-4f8b-8dc8-c77669bbbcc8 service nova] Creating event network-vif-plugged:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:15:32.972325 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a9041d6b-fc0a-468f-9241-104eadaf2e9a req-a36618c6-279f-4f8b-8dc8-c77669bbbcc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Sep 25 01:15:32.972939 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1452/2937] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:32.979532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7eb0a591-7e59-4b99-93c1-023f1d62769b req-ae22195f-66a6-4dfb-8277-d2566246db64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c", "tag": "d4239403-3f55-4b83-9485-1dec99b684c4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:32.989844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7eb0a591-7e59-4b99-93c1-023f1d62769b req-ae22195f-66a6-4dfb-8277-d2566246db64 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:32.990253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7eb0a591-7e59-4b99-93c1-023f1d62769b req-ae22195f-66a6-4dfb-8277-d2566246db64 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:32.990689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7eb0a591-7e59-4b99-93c1-023f1d62769b req-ae22195f-66a6-4dfb-8277-d2566246db64 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:33.002980 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7eb0a591-7e59-4b99-93c1-023f1d62769b req-ae22195f-66a6-4dfb-8277-d2566246db64 service nova] Creating event network-changed:d4239403-3f55-4b83-9485-1dec99b684c4 for instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c on n-h1-master-1 Sep 25 01:15:33.007843 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7eb0a591-7e59-4b99-93c1-023f1d62769b req-ae22195f-66a6-4dfb-8277-d2566246db64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033167 Sep 25 01:15:33.008607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1453/2938] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:33.138791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:33.140059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:33.156905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:33.157856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:33.160117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:33.161021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:33.161631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:33.162386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:33.570347 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:33.639070 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:33.764369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:33.785039 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29c8522b-92cd-473d-a91a-0fb10f0fef96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 0.652358 Sep 25 01:15:33.801349 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1454/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:33 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:33.962105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:33.962720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:33.972646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:33.973358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:33.977050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:33.979062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:33.980295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:33.983037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:34.323143 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=14 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:35.176564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:35.208146 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4bd25de3-4de5-4b2a-bf41-d3bf2ebdc596 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1379 microversion: 2.1 time: 1.238495 Sep 25 01:15:35.211560 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1455/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:33 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1379 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:35.252440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:35.253301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:35.279501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:35.280353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:35.282478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:35.283429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:35.284055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:35.284659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:35.291874 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:35.598068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:35.618228 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6c4f26bf-730f-43e8-8b27-2ad39fd968f5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 0.404954 Sep 25 01:15:35.619550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1456/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:35 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:35.728012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Building network info cache for instance {{(pid=122385) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:15:35.738866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-29c28af8-1917-4542-b1ca-6928310d654b req-0a6eca9a-bac1-477e-bbe7-024c27fd7210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:35.767134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29c28af8-1917-4542-b1ca-6928310d654b req-0a6eca9a-bac1-477e-bbe7-024c27fd7210 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:35.767631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29c28af8-1917-4542-b1ca-6928310d654b req-0a6eca9a-bac1-477e-bbe7-024c27fd7210 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:35.768118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29c28af8-1917-4542-b1ca-6928310d654b req-0a6eca9a-bac1-477e-bbe7-024c27fd7210 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:35.793930 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-29c28af8-1917-4542-b1ca-6928310d654b req-0a6eca9a-bac1-477e-bbe7-024c27fd7210 service nova] Creating event network-changed:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:15:35.801911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-29c28af8-1917-4542-b1ca-6928310d654b req-0a6eca9a-bac1-477e-bbe7-024c27fd7210 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066471 Sep 25 01:15:35.804666 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1457/2942] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:36.243890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:36.244620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:36.259638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:36.261734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:36.264795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:36.266583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:36.268454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:36.270135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:37.102374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:37.123363 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1ae3ebf-e7d5-4c26-a5e3-f0adea1c871c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1528 microversion: 2.1 time: 0.887083 Sep 25 01:15:37.137961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1458/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:36 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1528 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:37.143178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:37.144076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:37.167759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:37.169441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:37.170583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:37.172874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:37.175403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:37.178650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:38.780047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:38.805072 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6730abb-320f-4086-a423-5b679b967475 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 1.675011 Sep 25 01:15:38.809350 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1459/2944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:37 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:38.827214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:38.829250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:38.866918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:38.873122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:38.874183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:38.878978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:38.880051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:38.880821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:39.089173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Updating instance_info_cache with network_info: [{"id": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f", "address": "fa:16:3e:d8:c0:cc", "network": {"id": "e0a2d659-a909-4cc9-8950-f95844d9dc25", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1438026077-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "744c3c67433f4d268891a810016366cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9783be42-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122385) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:15:39.106677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Releasing lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:15:39.107646 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29d8201a-f3cf-409c-9ef2-8e49ed3bd86c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action" status: 202 len: 0 microversion: 2.1 time: 7.730747 Sep 25 01:15:39.110641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1486/2945] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:31 2022] POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action => generated 0 bytes in 7734 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:15:39.674282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:39.674685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:39.682479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:39.684235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:39.685142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:39.686163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:39.686853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:39.687507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:39.726011 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d96efc8b-e623-423c-9bdd-6b2963a05370 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/ips" status: 200 len: 150 microversion: 2.1 time: 0.613644 Sep 25 01:15:39.726801 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1487/2946] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:15:39 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/ips => generated 150 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:39.732406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.105"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:39.735744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:39.743918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:39.744798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:39.746572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:39.747419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:39.748021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:39.748988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:39.749583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:39.762754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d51d7c1e-5a38-48af-b712-9554e7624c1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1528 microversion: 2.1 time: 0.949773 Sep 25 01:15:39.764748 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1460/2947] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:38 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1528 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:39.781066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "refresh_cache-41d208e8-428f-4cc4-bc6b-0dc8f2673a98" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:15:39.782085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquired lock "refresh_cache-41d208e8-428f-4cc4-bc6b-0dc8f2673a98" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:15:39.786768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e50083c-08a3-44a8-9eaf-7ab209cd6483 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:39.828017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e50083c-08a3-44a8-9eaf-7ab209cd6483 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/10dbf8bf-d643-47d6-ad0d-86c8d404be46" status: 202 len: 0 microversion: 2.1 time: 0.044892 Sep 25 01:15:39.838223 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1461/2948] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:15:39 2022] DELETE /compute/v2.1/flavors/10dbf8bf-d643-47d6-ad0d-86c8d404be46 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:15:39.850972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:39.858524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:39.877302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:39.878911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:39.880113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:39.881681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:39.882331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:39.886467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:40.247280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:40.265357 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-108da947-f687-4560-83df-5cd5f024a9f7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 0.423725 Sep 25 01:15:40.271720 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1462/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:39 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:40.295214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e2292a2-d52a-4e84-9ab1-9d330caa95ea tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:40.344181 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e2292a2-d52a-4e84-9ab1-9d330caa95ea tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067887 Sep 25 01:15:40.345204 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1463/2950] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:15:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:40.378606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:40.385062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:40.406889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:40.409003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:40.409796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:40.411597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:40.412068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:40.414267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:40.467923 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:40.475712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Old instance type tempest-test_resize_flavor_-2040946739, new instance type m1.heat {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:15:40.485262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:15:40.486016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:15:40.486758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:15:40.487722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:15:40.488373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:15:40.681670 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3cb2216-a129-475a-8de8-b0dea801cbee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23/action" status: 202 len: 0 microversion: 2.1 time: 0.314613 Sep 25 01:15:40.685669 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1464/2951] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:40 2022] POST /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:15:40.703452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:40.704105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:40.722107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:40.722107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:40.722107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:40.723611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:40.724156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:40.724607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:41.046712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:41.056434 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b639cfe-dd73-48c7-99f1-9ae74a8de015 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1537 microversion: 2.1 time: 0.369188 Sep 25 01:15:41.057030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1465/2952] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:40 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1537 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:41.446981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64366fbb-9b6a-4dc0-a681-87bf3e674d63 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1981225073", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:41.450617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-64366fbb-9b6a-4dc0-a681-87bf3e674d63 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] HTTP exception thrown: min_count must be <= max_count Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64366fbb-9b6a-4dc0-a681-87bf3e674d63 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Request method failure captured: Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 184 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6u8S-tqkM-tMpZoTlwrP9jr9fHZNaDMlKhdDlnFlxqblEO7f_Cfhuob__W3fJpsQ1vlnuCYfjDPP8-skRCahf-K0rl2Wo9IqTA60YlxXsnJQJgz2yyS56eKSNBhTR06y1R-86kIyw3N7-2DMfoS807WnfByMZygS2krjI8DpVIKK1s Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6abc3d488644783b602df7b193d10c4"}]}] Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e51b184054f54546b1ba12f799acf04e Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1981225073", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: exception: min_count must be <= max_count Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1981225073', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 25 01:15:41.452173 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.466857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64366fbb-9b6a-4dc0-a681-87bf3e674d63 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Returning 400 to user: min_count must be <= max_count {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:41.467776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64366fbb-9b6a-4dc0-a681-87bf3e674d63 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.402714 Sep 25 01:15:41.468456 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1466/2953] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:41 2022] POST /compute/v2.1/servers => generated 74 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:15:41.499316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:41.499938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:41.538163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:41.538971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:41.541220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:41.545498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:41.546842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:41.547472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:41.843576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:41.880307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-16fcd1ca-3e92-4203-b25f-17b890827435 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 0.397301 Sep 25 01:15:41.883345 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1467/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:41 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:41.889528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0752a30f-7039-4b3b-8298-dac26e9d6659 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1158493793", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "max_count": 0}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0752a30f-7039-4b3b-8298-dac26e9d6659 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Request method failure captured: Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 168 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6u8S-tqkM-tMpZoTlwrP9jr9fHZNaDMlKhdDlnFlxqblEO7f_Cfhuob__W3fJpsQ1vlnuCYfjDPP8-skRCahf-K0rl2Wo9IqTA60YlxXsnJQJgz2yyS56eKSNBhTR06y1R-86kIyw3N7-2DMfoS807WnfByMZygS2krjI8DpVIKK1s Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6abc3d488644783b602df7b193d10c4"}]}] Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e51b184054f54546b1ba12f799acf04e Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1158493793", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "max_count": 0}} Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1158493793', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'max_count': 0}}} Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 0 Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:15:41.906806 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 25 01:15:41.912044 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:41.918519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0752a30f-7039-4b3b-8298-dac26e9d6659 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:41.919391 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0752a30f-7039-4b3b-8298-dac26e9d6659 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034786 Sep 25 01:15:41.919984 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1468/2955] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:15:42.013656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7ae8214-74c8-41a2-8999-c0436baf59c7 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936437828", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "max_count": 2.5}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7ae8214-74c8-41a2-8999-c0436baf59c7 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Request method failure captured: Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 170 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6u8S-tqkM-tMpZoTlwrP9jr9fHZNaDMlKhdDlnFlxqblEO7f_Cfhuob__W3fJpsQ1vlnuCYfjDPP8-skRCahf-K0rl2Wo9IqTA60YlxXsnJQJgz2yyS56eKSNBhTR06y1R-86kIyw3N7-2DMfoS807WnfByMZygS2krjI8DpVIKK1s Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6abc3d488644783b602df7b193d10c4"}]}] Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e51b184054f54546b1ba12f799acf04e Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936437828", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "max_count": 2.5}} Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1936437828', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'max_count': 2.5}}} Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 2.5 Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:15:42.017780 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7ae8214-74c8-41a2-8999-c0436baf59c7 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:42.023566 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b7ae8214-74c8-41a2-8999-c0436baf59c7 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009904 Sep 25 01:15:42.036555 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1469/2956] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:15:42.084150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:42.084912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:42.102687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:42.103208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:42.103652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:42.104455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:42.105568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:42.106144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:42.383006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:42.394968 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2f8f465-e8be-4f2b-87cc-1718a9b1f711 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1537 microversion: 2.1 time: 0.315771 Sep 25 01:15:42.395563 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1470/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:42 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1537 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:15:42.400216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b699d58b-1647-43fd-bdb2-3525451026a6 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1154233238", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 0}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b699d58b-1647-43fd-bdb2-3525451026a6 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Request method failure captured: Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 168 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6u8S-tqkM-tMpZoTlwrP9jr9fHZNaDMlKhdDlnFlxqblEO7f_Cfhuob__W3fJpsQ1vlnuCYfjDPP8-skRCahf-K0rl2Wo9IqTA60YlxXsnJQJgz2yyS56eKSNBhTR06y1R-86kIyw3N7-2DMfoS807WnfByMZygS2krjI8DpVIKK1s Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6abc3d488644783b602df7b193d10c4"}]}] Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e51b184054f54546b1ba12f799acf04e Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1154233238", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 0}} Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1154233238', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'min_count': 0}}} Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 0 Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:15:42.411878 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b699d58b-1647-43fd-bdb2-3525451026a6 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:42.416807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b699d58b-1647-43fd-bdb2-3525451026a6 tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.019456 Sep 25 01:15:42.421968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1471/2958] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:15:42.427252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c58ee3a2-b523-467f-b205-56404f474e76 req-73107c60-f7ee-4e31-b5a4-48c3dbc7a86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c", "name": "network-vif-plugged", "status": "completed", "tag": "d4239403-3f55-4b83-9485-1dec99b684c4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:42.461444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c58ee3a2-b523-467f-b205-56404f474e76 req-73107c60-f7ee-4e31-b5a4-48c3dbc7a86b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:42.461947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c58ee3a2-b523-467f-b205-56404f474e76 req-73107c60-f7ee-4e31-b5a4-48c3dbc7a86b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:42.462386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c58ee3a2-b523-467f-b205-56404f474e76 req-73107c60-f7ee-4e31-b5a4-48c3dbc7a86b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:42.485201 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c58ee3a2-b523-467f-b205-56404f474e76 req-73107c60-f7ee-4e31-b5a4-48c3dbc7a86b service nova] Creating event network-vif-plugged:d4239403-3f55-4b83-9485-1dec99b684c4 for instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c on n-h1-master-1 Sep 25 01:15:42.495524 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c58ee3a2-b523-467f-b205-56404f474e76 req-73107c60-f7ee-4e31-b5a4-48c3dbc7a86b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067203 Sep 25 01:15:42.496914 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1472/2959] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:42.505542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6035880-afc0-46a2-9d6c-4ff44a65d69e tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1696032254", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 2.5}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6035880-afc0-46a2-9d6c-4ff44a65d69e tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Request method failure captured: Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 170 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6u8S-tqkM-tMpZoTlwrP9jr9fHZNaDMlKhdDlnFlxqblEO7f_Cfhuob__W3fJpsQ1vlnuCYfjDPP8-skRCahf-K0rl2Wo9IqTA60YlxXsnJQJgz2yyS56eKSNBhTR06y1R-86kIyw3N7-2DMfoS807WnfByMZygS2krjI8DpVIKK1s Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b6abc3d488644783b602df7b193d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b6abc3d488644783b602df7b193d10c4"}]}] Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b6abc3d488644783b602df7b193d10c4 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-956615666 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: e51b184054f54546b1ba12f799acf04e Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-956615666-project Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1696032254", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 2.5}} Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1696032254', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'min_count': 2.5}}} Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 2.5 Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:15:42.526287 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 25 01:15:42.531980 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:42.540139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6035880-afc0-46a2-9d6c-4ff44a65d69e tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:42.541567 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b6035880-afc0-46a2-9d6c-4ff44a65d69e tempest-MultipleCreateNegativeTestJSON-956615666 tempest-MultipleCreateNegativeTestJSON-956615666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042963 Sep 25 01:15:42.542430 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1473/2960] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:15:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:15:42.710452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b33e3e56-96c1-4d3e-ae0e-1eb5491d4848"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:42.720010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:42.734862 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:42.738527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:42.739757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:42.740765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:42.743548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:42.744587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:42.747806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:43.954020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6563b05a-500d-4e23-826c-919d95e16101 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.255463 Sep 25 01:15:43.955444 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1474/2961] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:15:42 2022] POST /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 194 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:43.965166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:43.967528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:43.976167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:43.977547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:43.978664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:43.979971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:43.980735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:43.981507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:45.162836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:45.171987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2acac482-5454-4b33-ba68-a81d77173cb2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1315 microversion: 2.1 time: 1.214632 Sep 25 01:15:45.172578 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1475/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:43 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:45.188238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:45.188872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:45.196011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:45.196758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:45.197505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:45.199113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:45.200432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:45.201069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:45.471394 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.neutron [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] re-assign floating IP 172.35.6.105 from instance d709f02c-216a-4a1e-9b87-6e10ebae65df Sep 25 01:15:45.597699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:45.614897 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa2e9ee5-abc5-4040-9457-c3666e4170cd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1537 microversion: 2.1 time: 0.441219 Sep 25 01:15:45.619048 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1476/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:45 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1537 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:45.626964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4b192984-318b-4bf6-94c2-d02f77b76bcf req-37c57a28-8c5e-4c52-835d-0f257a441300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:45.670882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4b192984-318b-4bf6-94c2-d02f77b76bcf req-37c57a28-8c5e-4c52-835d-0f257a441300 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:45.675607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4b192984-318b-4bf6-94c2-d02f77b76bcf req-37c57a28-8c5e-4c52-835d-0f257a441300 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:45.676077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4b192984-318b-4bf6-94c2-d02f77b76bcf req-37c57a28-8c5e-4c52-835d-0f257a441300 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:45.679979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Building network info cache for instance {{(pid=122385) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:15:45.716512 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4b192984-318b-4bf6-94c2-d02f77b76bcf req-37c57a28-8c5e-4c52-835d-0f257a441300 service nova] Creating event network-changed:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:15:45.735955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4b192984-318b-4bf6-94c2-d02f77b76bcf req-37c57a28-8c5e-4c52-835d-0f257a441300 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113750 Sep 25 01:15:45.736527 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1477/2964] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:46.200754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:46.208216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:46.226644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:46.230513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:46.231276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:46.234430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:46.236149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:46.237009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:46.980271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:46.995775 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8675e5c9-8f5a-4f68-9c5b-d2f0805c84b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1502 microversion: 2.1 time: 0.799289 Sep 25 01:15:46.996789 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1478/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:46 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1502 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:47.013190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:47.014785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:47.055295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:47.058820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:47.059560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:47.063926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:47.064748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:47.065690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:47.074579 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:47.550895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Updating instance_info_cache with network_info: [{"id": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f", "address": "fa:16:3e:d8:c0:cc", "network": {"id": "e0a2d659-a909-4cc9-8950-f95844d9dc25", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1438026077-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "744c3c67433f4d268891a810016366cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9783be42-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122385) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:15:47.569980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Building network info cache for instance {{(pid=122385) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:15:47.571986 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:48.137720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:48.150014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5dea9ac-97a2-4b7c-a959-3de4aac55960 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1537 microversion: 2.1 time: 1.148554 Sep 25 01:15:48.151591 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1479/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:46 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1537 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:48.497583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-998472910", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:48.682150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:15:48.687588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:15:48.689196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:15:48.693000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:15:48.694621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:15:48.736659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:48.739501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:48.741942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:48.746147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:48.749061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:48.749700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:48.805164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Getting quotas for project 936e54ee92b84e5c96db824056728d1a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:15:48.818803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Getting quotas for user 907d7867b6484e6c9470ffc137e98a91 and project 936e54ee92b84e5c96db824056728d1a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:15:48.843130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:15:48.846566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:15:48.917494 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02cabd07-7101-486c-9b76-15b40617ddd7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.762669 Sep 25 01:15:48.921795 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1480/2967] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:15:48.926905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-83d813bb-7e2f-4383-9f13-9a78c5cc78bd req-5ab2c9ee-b467-4ed1-aeb0-c9f9990587ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d208e8-428f-4cc4-bc6b-0dc8f2673a98", "tag": "93025688-9c58-48e3-9eb3-5977bca6b2f4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:48.983973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-83d813bb-7e2f-4383-9f13-9a78c5cc78bd req-5ab2c9ee-b467-4ed1-aeb0-c9f9990587ce service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:48.984547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-83d813bb-7e2f-4383-9f13-9a78c5cc78bd req-5ab2c9ee-b467-4ed1-aeb0-c9f9990587ce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:48.984902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-83d813bb-7e2f-4383-9f13-9a78c5cc78bd req-5ab2c9ee-b467-4ed1-aeb0-c9f9990587ce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:49.007953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-83d813bb-7e2f-4383-9f13-9a78c5cc78bd req-5ab2c9ee-b467-4ed1-aeb0-c9f9990587ce service nova] Creating event network-changed:93025688-9c58-48e3-9eb3-5977bca6b2f4 for instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 on n-h2-master-1 Sep 25 01:15:49.023788 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-83d813bb-7e2f-4383-9f13-9a78c5cc78bd req-5ab2c9ee-b467-4ed1-aeb0-c9f9990587ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100382 Sep 25 01:15:49.024302 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1481/2968] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:49.036170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19131c56-0231-43ac-93b2-702cb02cb13e tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:49.038677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19131c56-0231-43ac-93b2-702cb02cb13e tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:49.744744 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=31 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:49.794842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19131c56-0231-43ac-93b2-702cb02cb13e tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:49.812580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19131c56-0231-43ac-93b2-702cb02cb13e tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:49.814336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19131c56-0231-43ac-93b2-702cb02cb13e tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:49.816235 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19131c56-0231-43ac-93b2-702cb02cb13e tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1280 microversion: 2.47 time: 0.790803 Sep 25 01:15:49.849462 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1482/2969] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:15:49 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1280 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:15:49.868827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd684616-1d46-423c-96d5-7ca1027b8631"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:49.878082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:49.895891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:49.896425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:49.904525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:49.905487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:49.905989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:49.906442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.504535 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6565e4e-434d-4f80-9c24-b72fa369679a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655895 Sep 25 01:15:50.507177 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1483/2970] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:15:49 2022] POST /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:50.523109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:50.527504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:50.543600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.545528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.548056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.549880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.551776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.553089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.862990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Updating instance_info_cache with network_info: [{"id": "93025688-9c58-48e3-9eb3-5977bca6b2f4", "address": "fa:16:3e:9e:cd:da", "network": {"id": "e0a2d659-a909-4cc9-8950-f95844d9dc25", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1438026077-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "744c3c67433f4d268891a810016366cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93025688-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122385) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:15:50.873188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Releasing lock "refresh_cache-41d208e8-428f-4cc4-bc6b-0dc8f2673a98" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:15:50.874515 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22f98725-6edb-4112-876c-30cdb2f93942 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98/action" status: 202 len: 0 microversion: 2.1 time: 11.146361 Sep 25 01:15:50.876001 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1488/2971] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:39 2022] POST /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98/action => generated 0 bytes in 11148 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:15:50.887534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:50.889074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:50.896553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.897463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.898157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.899288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.899984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.918612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:51.118585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:51.138062 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7773aede-6b1b-4161-a97e-6e1d5d1c29c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.625866 Sep 25 01:15:51.143198 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1484/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:50 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:51.165680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.105"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:51.215092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:51.226376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:51.228311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:51.230549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ca322e5-f053-4d0d-811b-ae88360dfc16 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1332 microversion: 2.47 time: 0.348185 Sep 25 01:15:51.232095 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1489/2973] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:15:50 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1332 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:15:51.399347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:51.407595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:51.408351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:51.420987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:51.422311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:51.422898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:51.424303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:51.858644 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] HTTP exception thrown: Floating IP 172.35.6.105 is not associated with instance d709f02c-216a-4a1e-9b87-6e10ebae65df. Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Request method failure captured: Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action HTTP/1.1 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 49 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6t-x1NzHvj9d3gUEHA8DhwjO9S16W3qDwjxHMdUHOE1whlM7ijgKosXipj-v8-JNS9Dc3Y2Dj3ovrJ_foj5T-Gge8oE4dwiJe5Kizp_ZpiPzi40u5wmWqJp31EVvJkGmzO2J6ki8cLgem4hRqOeTHoch6zCS0v2iIDi8rYWRgh7UrI Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/744c3c67433f4d268891a810016366cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_744c3c67433f4d268891a810016366cc"}]}] Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 95b7650e677d47ab9576bc3cb6ea07e7 Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: {"removeFloatingIp": {"address": "172.35.6.105"}} Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: exception: Floating IP 172.35.6.105 is not associated with instance d709f02c-216a-4a1e-9b87-6e10ebae65df. Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'd709f02c-216a-4a1e-9b87-6e10ebae65df', 'body': {'removeFloatingIp': {'address': '172.35.6.105'}}} Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.6.105 is not associated with instance d709f02c-216a-4a1e-9b87-6e10ebae65df. Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.6.105 is not associated with instance d709f02c-216a-4a1e-9b87-6e10ebae65df. Sep 25 01:15:51.860265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:15:51.864867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Returning 409 to user: Floating IP 172.35.6.105 is not associated with instance d709f02c-216a-4a1e-9b87-6e10ebae65df. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:15:51.864867 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1cf1b61e-c3ea-41c6-aa54-25a75a5cefc7 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action" status: 409 len: 146 microversion: 2.1 time: 0.717292 Sep 25 01:15:51.864867 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1485/2974] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:51 2022] POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action => generated 146 bytes in 719 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:15:51.871954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.105"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:51.943565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:51.956296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:51.960096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Searching by: {'deleted': False, 'project_id': 'b730f5960b50450b9f6e724945ae8613'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:15:51.972401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:51.973663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:51.974486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:51.975948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:51.976802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:51.977636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.015983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:15:52.091512 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-efa5ebe7-ec14-471a-b4e9-94260da317d4 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.144071 Sep 25 01:15:52.093342 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1486/2975] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:15:51 2022] GET /compute/v2.1/servers => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:15:52.116610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:52.126774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:52.129312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Searching by: {'deleted': False, 'project_id': 'b730f5960b50450b9f6e724945ae8613'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:15:52.145801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.146577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.147173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.148118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.149109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.151925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.216811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:15:52.223524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:52.230992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.231793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.232425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.235921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.236607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.237212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.315749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:52.327913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.328440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.329038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.752563 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9529acad-9900-4d7d-aff0-0cab05da9226 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.644455 Sep 25 01:15:52.753109 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1487/2976] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:15:52 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:52.767811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:52.768932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:52.780474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.781774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.783215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:52.784411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:52.785564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:52.787394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:53.014666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "refresh_cache-41d208e8-428f-4cc4-bc6b-0dc8f2673a98" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:15:53.015679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquired lock "refresh_cache-41d208e8-428f-4cc4-bc6b-0dc8f2673a98" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:15:53.117430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:53.128371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e24d7c9-7843-4218-978e-53ec64d54b4c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.374167 Sep 25 01:15:53.130024 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1488/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:52 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:53.147703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:53.149383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:53.163184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:53.164058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:53.164499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:53.168283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:53.168824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:53.169269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:53.379584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:53.404063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:53.407507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:53.410139 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aec345f0-44e2-4117-b882-6757a3202a22 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1338 microversion: 2.47 time: 0.278872 Sep 25 01:15:53.428254 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1489/2978] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:15:53 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1338 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:15:53.439295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf74585b-6fbd-4792-8544-c97033442ab9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:53.451017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf74585b-6fbd-4792-8544-c97033442ab9 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020674 Sep 25 01:15:53.452287 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1490/2979] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:15:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:53.916059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:53.917334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:53.929204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:53.944731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:53.949136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:53.951815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:53.954130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:53.957527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:54.064621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:15:54.426740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Building network info cache for instance {{(pid=122385) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:15:54.638423 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f7a1bee-57a1-40b7-8795-d66d9649a332 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 204 len: 0 microversion: 2.1 time: 0.723972 Sep 25 01:15:54.645050 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1491/2980] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:15:53 2022] DELETE /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:15:54.655809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:54.661739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:54.677290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:54.678483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:54.679537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:54.680963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:54.684371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:54.685142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:55.352618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:55.362625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14424fcf-51b8-4932-86b3-34d69664c2eb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.714853 Sep 25 01:15:55.381604 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1492/2981] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:54 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:55.387221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:55.395187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:55.409661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:55.412261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:55.421143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:55.422300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:55.423151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:55.423766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:55.646837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:55.663035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:55.667622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:55.671021 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ebc9e93-3674-4848-b625-539a633b737a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1338 microversion: 2.47 time: 0.287957 Sep 25 01:15:55.678635 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1493/2982] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:15:55 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:15:56.157099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2c55def7-8ddd-4af4-bfa3-7d1651734d61 req-9ca9e0bc-d31f-435d-8ad5-fa097845a30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d208e8-428f-4cc4-bc6b-0dc8f2673a98", "tag": "93025688-9c58-48e3-9eb3-5977bca6b2f4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:56.183534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2c55def7-8ddd-4af4-bfa3-7d1651734d61 req-9ca9e0bc-d31f-435d-8ad5-fa097845a30a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.184324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2c55def7-8ddd-4af4-bfa3-7d1651734d61 req-9ca9e0bc-d31f-435d-8ad5-fa097845a30a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.185048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2c55def7-8ddd-4af4-bfa3-7d1651734d61 req-9ca9e0bc-d31f-435d-8ad5-fa097845a30a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:56.217649 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2c55def7-8ddd-4af4-bfa3-7d1651734d61 req-9ca9e0bc-d31f-435d-8ad5-fa097845a30a service nova] Creating event network-changed:93025688-9c58-48e3-9eb3-5977bca6b2f4 for instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 on n-h2-master-1 Sep 25 01:15:56.226674 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2c55def7-8ddd-4af4-bfa3-7d1651734d61 req-9ca9e0bc-d31f-435d-8ad5-fa097845a30a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546219 Sep 25 01:15:56.228050 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1494/2983] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:56.235716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:56.236751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:56.246254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.247104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.247781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:56.248731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.249354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.250383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:56.567534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Updating instance_info_cache with network_info: [{"id": "93025688-9c58-48e3-9eb3-5977bca6b2f4", "address": "fa:16:3e:9e:cd:da", "network": {"id": "e0a2d659-a909-4cc9-8950-f95844d9dc25", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1438026077-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "744c3c67433f4d268891a810016366cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93025688-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122385) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:15:56.585808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Releasing lock "refresh_cache-41d208e8-428f-4cc4-bc6b-0dc8f2673a98" {{(pid=122385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:15:56.586790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-240d6db1-dc4d-473b-abfa-a9cc4dd21aa2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98/action" status: 202 len: 0 microversion: 2.1 time: 4.719334 Sep 25 01:15:56.587529 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1490/2984] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:51 2022] POST /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98/action => generated 0 bytes in 4721 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:15:56.599608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:56.601941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:56.615061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.615738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.616302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:56.617126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.618378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.618995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.151752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:57.160911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc19c811-d966-4914-b2c2-7f1cae504b17 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1608 microversion: 2.1 time: 0.930869 Sep 25 01:15:57.162191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1495/2985] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:56 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1608 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:57.167675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:57.168392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:57.185009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.187128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.187775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.191540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.193102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.193753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.207446 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:57.249674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:57.258124 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60fab770-5309-41d9-bdcd-cbfe3285d0be tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.665880 Sep 25 01:15:57.258699 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1491/2986] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:56 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:57.274664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:15:57.280890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:57.281719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:57.289172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.290010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.290629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.309993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.310793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.311445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.411838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af6f2e62-35fa-4d9b-a573-b30f42b94405 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 204 len: 0 microversion: 2.1 time: 0.248168 Sep 25 01:15:57.412647 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1496/2987] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:15:57 2022] DELETE /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:15:57.426088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.105"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:57.431402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:57.440050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.441022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.441489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.442225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.442849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.443277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.477348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:15:57.477843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquired lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:15:57.507545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:57.521845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:57.523943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:57.526489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f09a6b40-7bb6-47d6-b610-4c57238b3c0a tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1359 microversion: 2.47 time: 0.249863 Sep 25 01:15:57.527600 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1492/2988] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:15:57 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:15:57.553922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-141413158"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:57.558861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:57.566368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.567606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.568751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.569932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.570782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.571415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.881378 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6ab456c-93a7-4bbf-9030-cb611638d7fc tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "POST /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05/action" status: 202 len: 52 microversion: 2.47 time: 0.331550 Sep 25 01:15:57.892281 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1493/2989] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:15:57 2022] POST /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05/action => generated 52 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Sep 25 01:15:57.906221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:57.909643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:57.927087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.927594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.928043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.928762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.929221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.929684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.998551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:15:58.136590 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3a350b2-2745-4fc5-aecc-78a2ac71121f tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "DELETE /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 204 len: 0 microversion: 2.47 time: 0.242666 Sep 25 01:15:58.137936 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1494/2990] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:15:57 2022] DELETE /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:15:58.147378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:58.148426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:58.156639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:58.157499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:58.158151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:58.159120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:58.159760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:58.160443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:58.284864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:58.303236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:58.309914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:58.314400 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3040ffa8-3e80-4a40-8813-760f56e2d8cd tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1365 microversion: 2.47 time: 0.171990 Sep 25 01:15:58.316250 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1495/2991] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:15:58 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:15:58.332307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:58.334082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:58.352925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:58.355993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:58.356711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:58.357734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:58.360113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:58.362344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:58.946314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:58.955519 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83a689c9-7e3a-468d-a778-8c0e17617b8e tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1608 microversion: 2.1 time: 0.635268 Sep 25 01:15:58.956119 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1496/2992] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:58 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1608 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:58.987253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:58.987886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:59.005008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:59.005544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:59.005989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:59.006705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:59.007160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:59.007585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.196933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:00.206097 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0128256-5342-4b6d-86fc-90d741d74208 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 1.227663 Sep 25 01:16:00.206681 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1497/2993] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:58 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:00.211885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:00.212830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:00.220384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.221279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.222209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.223242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.223954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.224612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.383165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:00.410116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:00.413754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:00.413754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a75d235-3655-434b-918f-dcc1116c0e3b tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1365 microversion: 2.47 time: 0.204955 Sep 25 01:16:00.427797 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1498/2994] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:16:00 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:16:00.438347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b33e3e56-96c1-4d3e-ae0e-1eb5491d4848"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:00.451886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:00.468427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.469186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.469818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.470687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.474043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.475097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.587217 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Invalid volume: volume b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 is already attached to instances: 7980033e-52a8-4fa2-b2d8-05bea9732bf3 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments HTTP/1.1 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 74 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: {"volumeAttachment": {"volumeId": "b33e3e56-96c1-4d3e-ae0e-1eb5491d4848"}} Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid volume: volume b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 is already attached to instances: 7980033e-52a8-4fa2-b2d8-05bea9732bf3 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': '7980033e-52a8-4fa2-b2d8-05bea9732bf3', 'body': {'volumeAttachment': {'volumeId': 'b33e3e56-96c1-4d3e-ae0e-1eb5491d4848'}}} Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 is already attached to instances: 7980033e-52a8-4fa2-b2d8-05bea9732bf3 Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:16:00.590324 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 is already attached to instances: 7980033e-52a8-4fa2-b2d8-05bea9732bf3 Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 is already attached to instances: 7980033e-52a8-4fa2-b2d8-05bea9732bf3 Sep 25 01:16:00.595310 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:00.597910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 400 to user: Invalid volume: volume b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 is already attached to instances: 7980033e-52a8-4fa2-b2d8-05bea9732bf3 {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:00.600129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a6af7a5-b23d-428f-adb7-2e1b55645b38 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171144 Sep 25 01:16:00.601083 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1499/2995] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:16:00 2022] POST /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:16:00.619309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:00.625203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:00.646095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.647889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.649697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.653003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.653820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.656001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.903678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:00.924970 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:00.931614 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-47d67d2d-5415-4648-a637-cd983c00ab71 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1540 microversion: 2.1 time: 0.329298 Sep 25 01:16:00.932436 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1500/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:00 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1540 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:00.938995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:00.939677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:00.946240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.946966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.948079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.948959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.949729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.950333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.079534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lazy-loading 'services' on Instance uuid 7980033e-52a8-4fa2-b2d8-05bea9732bf3 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:16:01.210394 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc8add08-8ff2-4cb7-9505-cc6a359154b1 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments/b33e3e56-96c1-4d3e-ae0e-1eb5491d4848" status: 202 len: 0 microversion: 2.1 time: 0.275763 Sep 25 01:16:01.213827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1501/2997] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:16:00 2022] DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments/b33e3e56-96c1-4d3e-ae0e-1eb5491d4848 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:16:01.225445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-56c6aefe-524a-4f66-aa34-6da616b2678d req-555840e7-8c28-4203-b8a1-d1be24d8de97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97969ff-afac-48e5-b5bc-b67c2cbffea2", "name": "network-vif-deleted", "tag": "63d143cb-1526-4494-81c7-8146c931ac4c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:01.238545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-56c6aefe-524a-4f66-aa34-6da616b2678d req-555840e7-8c28-4203-b8a1-d1be24d8de97 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.239293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-56c6aefe-524a-4f66-aa34-6da616b2678d req-555840e7-8c28-4203-b8a1-d1be24d8de97 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.239905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-56c6aefe-524a-4f66-aa34-6da616b2678d req-555840e7-8c28-4203-b8a1-d1be24d8de97 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.256091 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-56c6aefe-524a-4f66-aa34-6da616b2678d req-555840e7-8c28-4203-b8a1-d1be24d8de97 service nova] Creating event network-vif-deleted:63d143cb-1526-4494-81c7-8146c931ac4c for instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 on n-h1-master-1 Sep 25 01:16:01.267511 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-56c6aefe-524a-4f66-aa34-6da616b2678d req-555840e7-8c28-4203-b8a1-d1be24d8de97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050074 Sep 25 01:16:01.269248 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1502/2998] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:01.277675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:01.280613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:01.290211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.290983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.293268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.294677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.295496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.296120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.359627 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-458fb889-fdec-4453-907f-d21fa32a0470 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088751 Sep 25 01:16:01.363216 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1503/2999] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:01 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:01.376179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:01.377512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:01.394980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.396724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.398016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.402387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.406664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.407813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.817125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:01.829875 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e3b81166-f4da-4f28-b73e-5aa0d31178c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.462433 Sep 25 01:16:01.830681 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1504/3000] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:01 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:01.845053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:01.845795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:01.859330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.860664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.861604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.863086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.864772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.865440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.157624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Building network info cache for instance {{(pid=122384) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:16:02.174590 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:02.177630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:02.200887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:02.205981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:02.210477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1caa0c36-b7d2-4028-b0f7-844415f37ec7 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1365 microversion: 2.47 time: 0.378716 Sep 25 01:16:02.212100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1505/3001] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:16:01 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:16:02.226367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:02.227372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:02.245684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.246572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.247248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.248177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.248864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.249530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.304621 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:02.511156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:02.522639 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd1e2938-7688-4828-b10f-5eb758452ead tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1253 microversion: 2.1 time: 0.300064 Sep 25 01:16:02.532586 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1506/3002] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:02 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1253 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:02.552186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:02.586089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:02.610130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.618582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.621670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.623013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.624571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.627169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.776503 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf4749e5-83b4-460b-9667-34ef1d31ca25 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240604 Sep 25 01:16:02.778657 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1507/3003] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:02 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:02.863859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:02.863859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:02.873882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.875253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.875724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.876495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.877052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.882027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.498881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:03.512092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-715a028b-e94e-4210-be8a-f65c2c0c177b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.654286 Sep 25 01:16:03.512965 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1508/3004] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:02 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:03.525363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:03.529062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:03.547064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.549997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.551047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.551805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.553147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.556670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.775186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:03.792590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:03.802089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '907d7867b6484e6c9470ffc137e98a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936e54ee92b84e5c96db824056728d1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:03.803771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-479cfa2b-377c-4e23-9bfa-4916c98325ac tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 200 len: 1365 microversion: 2.47 time: 0.288218 Sep 25 01:16:03.805020 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1509/3005] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:16:03 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:16:03.821491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}, {"server_uuid": "41d208e8-428f-4cc4-bc6b-0dc8f2673a98", "name": "network-vif-deleted", "tag": "93025688-9c58-48e3-9eb3-5977bca6b2f4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:03.854814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.855515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.855958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.912350 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] Creating event network-changed:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:16:03.912891 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] Creating event network-vif-deleted:93025688-9c58-48e3-9eb3-5977bca6b2f4 for instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 on n-h2-master-1 Sep 25 01:16:03.925780 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a7d81e56-c201-429a-b698-9944f0341966 req-71d070f7-8e37-4c99-b0c2-52f090da84aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.118376 Sep 25 01:16:03.927169 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1510/3006] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:03.945995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:03.950223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:03.969007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.969978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.971221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.972778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.973517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.974164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:04.822958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:04.836645 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4db21d7-d94d-4cad-a453-6ddfefc33571 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1253 microversion: 2.1 time: 0.896026 Sep 25 01:16:04.838920 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1511/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:03 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1253 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:04.859166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:04.867509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Updating instance_info_cache with network_info: [{"id": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f", "address": "fa:16:3e:d8:c0:cc", "network": {"id": "e0a2d659-a909-4cc9-8950-f95844d9dc25", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1438026077-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "744c3c67433f4d268891a810016366cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9783be42-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:16:04.882496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:04.908182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:04.909900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:04.911254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:04.913227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Releasing lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:16:04.914115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:04.914614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:04.917146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:04.918581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3499ad5f-025b-48c5-81c9-e2a390d7c924 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action" status: 202 len: 0 microversion: 2.1 time: 7.497744 Sep 25 01:16:04.930158 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1497/3008] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:57 2022] POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action => generated 0 bytes in 7511 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:16:04.940485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:04.961598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:04.968064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:04.968817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:04.969481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:04.970204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:04.970684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:04.971093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.002992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-986c7586-282e-40f4-a4e2-8ebe5c33da3d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147695 Sep 25 01:16:05.003581 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1512/3009] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:04 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:05.013784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:05.016213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] [instance: 20a7a433-f6fa-4800-b89b-a31c20c0ce05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:05.030671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.031488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.032166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.033134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.033823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.034452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.053973 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] HTTP exception thrown: Instance 20a7a433-f6fa-4800-b89b-a31c20c0ce05 could not be found. Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Request method failure captured: Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 HTTP/1.1 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6vDFYO0HktxjHAibwFmoxIrtOY3BmL6GbtcAxRO0Ll8BofLG1NoUW3c3HREHFl21igH_ywztLI6PZvW4-KH81JfjY5GT_JRwlEXyTj7EbAK7QvVzxERkllcF5STdeOxHBS9zl-l2N3vLX_wJLhqKkaG-mwu5ydMVeIt6uQtewMYMCA Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.47 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 936e54ee92b84e5c96db824056728d1a Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAaction247Test-1536184257 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/936e54ee92b84e5c96db824056728d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/936e54ee92b84e5c96db824056728d1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/936e54ee92b84e5c96db824056728d1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_936e54ee92b84e5c96db824056728d1a"}]}] Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAaction247Test-1536184257 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 936e54ee92b84e5c96db824056728d1a Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAaction247Test-1536184257 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAaction247Test-1536184257-project Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 907d7867b6484e6c9470ffc137e98a91 Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAaction247Test-1536184257-project Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 20a7a433-f6fa-4800-b89b-a31c20c0ce05 could not be found. Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '20a7a433-f6fa-4800-b89b-a31c20c0ce05'} Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a7a433-f6fa-4800-b89b-a31c20c0ce05 could not be found. Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a7a433-f6fa-4800-b89b-a31c20c0ce05 could not be found. Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:05.056294 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a7a433-f6fa-4800-b89b-a31c20c0ce05 could not be found. Sep 25 01:16:05.060557 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:05.063225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] Returning 404 to user: Instance 20a7a433-f6fa-4800-b89b-a31c20c0ce05 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:05.064369 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a845b9d5-e2ce-4382-a168-76fdc5e45bd2 tempest-ServersAaction247Test-1536184257 tempest-ServersAaction247Test-1536184257-project] 10.222.0.16 "GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05" status: 404 len: 111 microversion: 2.47 time: 0.057593 Sep 25 01:16:05.065926 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1513/3010] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:16:05 2022] GET /compute/v2.1/servers/20a7a433-f6fa-4800-b89b-a31c20c0ce05 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:16:05.083336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-512dd4d8-81ea-42be-9776-5e5a3fa7b7eb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '.version_select at 0x7f7beb4cd310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:05.499236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:05.517497 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87a0e38e-2407-43d0-8581-cc3892aa3c49 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.583537 Sep 25 01:16:05.520309 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1498/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:04 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:05.547428 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-512dd4d8-81ea-42be-9776-5e5a3fa7b7eb tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/67ac3057-7fe7-46d0-9590-fe908ebb9390" status: 200 len: 185 microversion: 2.1 time: 0.480068 Sep 25 01:16:05.548012 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1514/3012] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 25 01:16:05 2022] GET /compute/v2.1/os-floating-ips/67ac3057-7fe7-46d0-9590-fe908ebb9390 => generated 185 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:05.561665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.105"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:05.860277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:05.874428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:05.876930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:05.884730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.887191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.888770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.889944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.890810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.891518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.910387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.911173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.911823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.912732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.913365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.913986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.113491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:06.132492 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7383ab47-d135-4f4e-a9d1-775e20054ccd tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1253 microversion: 2.1 time: 0.260094 Sep 25 01:16:06.133134 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1515/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:05 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1253 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:06.145648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:06.148233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:06.161833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.162622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.163332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.164274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.178183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.179045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.232231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d0b4733f-851c-41b2-96d2-03d03e5c4bdb tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097648 Sep 25 01:16:06.234069 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1516/3014] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:06 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:06.508238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:16:06.508888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquired lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:16:06.547638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:06.548270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:06.555997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.558398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.558857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.559869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.560348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.562271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.977666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:06.992241 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b3bf1032-16c6-448f-8c14-d85907d80724 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.447070 Sep 25 01:16:07.012102 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1517/3015] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:06 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:07.156563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:07.157831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:07.170268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.171321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.172014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.173122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.173918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.174611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.432348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:07.446699 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83ced9f2-54ae-43b6-956e-e51db4a10b5b tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1253 microversion: 2.1 time: 0.293403 Sep 25 01:16:07.450135 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1518/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:07 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1253 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:07.461655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:07.464980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:07.483859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.487472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.488160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.489107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.491820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.492620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.560017 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:07.577925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5cde7e9a-258f-43df-80cb-c037dc2b6201 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126074 Sep 25 01:16:07.578793 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1519/3017] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:07 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:07.685087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Building network info cache for instance {{(pid=122384) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:16:07.703571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-69128d2b-84fb-406e-8505-6e2c897dc899 req-94b9ea88-eeb5-49a7-b8a4-24ae54151507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:07.720183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-69128d2b-84fb-406e-8505-6e2c897dc899 req-94b9ea88-eeb5-49a7-b8a4-24ae54151507 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.721143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-69128d2b-84fb-406e-8505-6e2c897dc899 req-94b9ea88-eeb5-49a7-b8a4-24ae54151507 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.721899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-69128d2b-84fb-406e-8505-6e2c897dc899 req-94b9ea88-eeb5-49a7-b8a4-24ae54151507 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.744137 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-69128d2b-84fb-406e-8505-6e2c897dc899 req-94b9ea88-eeb5-49a7-b8a4-24ae54151507 service nova] Creating event network-changed:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:16:07.761972 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-69128d2b-84fb-406e-8505-6e2c897dc899 req-94b9ea88-eeb5-49a7-b8a4-24ae54151507 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062115 Sep 25 01:16:07.763047 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1520/3018] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:16:08.021636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:08.023681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:08.033852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.034774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.035530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.036437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.037059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.037799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.464565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:08.476029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d83967dc-d62d-4585-9a48-5d3bd4445582 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.459630 Sep 25 01:16:08.490073 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1521/3019] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:08 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:08.506155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:08.512911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:08.528608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.529184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.529661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.530824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.531295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.531723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.747771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:08.764505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-45497b3e-a58e-4076-b968-c60ff61f2b68 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1253 microversion: 2.1 time: 0.272210 Sep 25 01:16:08.765319 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1522/3020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:08 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1253 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:08.790689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:08.801628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:08.831691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.838151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.842371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.844660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.846865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.849081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.975130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4cbc37d0-5aff-4f87-8f88-af12ecf3b570 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208894 Sep 25 01:16:08.977262 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1523/3021] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:08 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:09.506375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:09.507144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:09.518280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:09.519037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:09.519474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:09.520196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:09.520666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:09.553733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:09.944494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Updating instance_info_cache with network_info: [{"id": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f", "address": "fa:16:3e:d8:c0:cc", "network": {"id": "e0a2d659-a909-4cc9-8950-f95844d9dc25", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1438026077-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "744c3c67433f4d268891a810016366cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9783be42-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:16:09.961766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Releasing lock "refresh_cache-d709f02c-216a-4a1e-9b87-6e10ebae65df" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:16:09.964033 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b8194035-8d57-4f3e-9be1-8c23c513890e tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action" status: 202 len: 0 microversion: 2.1 time: 4.405771 Sep 25 01:16:09.965093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1499/3022] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:16:05 2022] POST /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df/action => generated 0 bytes in 4408 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:16:09.976306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:09.981495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.003210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.003720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.004166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.004879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.013159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.015190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.098768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.100140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.101565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.102285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lazy-loading 'fault' on Instance uuid d97969ff-afac-48e5-b5bc-b67c2cbffea2 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:16:10.217511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a8086a0ed34e4898db9e4d4a632a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b730f5960b50450b9f6e724945ae8613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:10.226239 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3419781-181a-4ec9-83c4-c07220074201 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 200 len: 1258 microversion: 2.1 time: 0.259835 Sep 25 01:16:10.248671 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1500/3023] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:09 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 1258 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:10.256994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.257530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.274197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.278152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.278860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.279801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.280553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.281164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.295686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:10.303084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] HTTP exception thrown: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.304438 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a83f44b-de7b-4312-8e2d-ce6a5bf062b4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1542 microversion: 2.1 time: 0.801893 Sep 25 01:16:10.310238 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1524/3024] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:09 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1542 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:10.315617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Request method failure captured: Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 HTTP/1.1 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6t-x1NzHvj9d3gUEHA8DhwjO9S16W3qDwjxHMdUHOE1whlM7ijgKosXipj-v8-JNS9Dc3Y2Dj3ovrJ_foj5T-Gge8oE4dwiJe5Kizp_ZpiPzi40u5wmWqJp31EVvJkGmzO2J6ki8cLgem4hRqOeTHoch6zCS0v2iIDi8rYWRgh7UrI Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/744c3c67433f4d268891a810016366cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_744c3c67433f4d268891a810016366cc"}]}] Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 95b7650e677d47ab9576bc3cb6ea07e7 Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '41d208e8-428f-4cc4-bc6b-0dc8f2673a98'} Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:10.317800 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Returning 404 to user: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b3fcce8-9a07-45cb-94aa-28cb4aea1bc5 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 404 len: 111 microversion: 2.1 time: 0.069624 Sep 25 01:16:10.326578 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1501/3025] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:16:10 2022] DELETE /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:10.328860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.329366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.335921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.336418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.336862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.337626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.338318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.339003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.340131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.361322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.361846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.362279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.362984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.370848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:16:10.378907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.381231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.439040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23448e97-5429-4728-b2d9-eb5d30e09b87 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127298 Sep 25 01:16:10.440126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1525/3026] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:10 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:10.451902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.453886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: 41d208e8-428f-4cc4-bc6b-0dc8f2673a98] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.468210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.469169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.469905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.471902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.472705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.474403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.512705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] HTTP exception thrown: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Request method failure captured: Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 HTTP/1.1 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6t-x1NzHvj9d3gUEHA8DhwjO9S16W3qDwjxHMdUHOE1whlM7ijgKosXipj-v8-JNS9Dc3Y2Dj3ovrJ_foj5T-Gge8oE4dwiJe5Kizp_ZpiPzi40u5wmWqJp31EVvJkGmzO2J6ki8cLgem4hRqOeTHoch6zCS0v2iIDi8rYWRgh7UrI Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/744c3c67433f4d268891a810016366cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_744c3c67433f4d268891a810016366cc"}]}] Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 95b7650e677d47ab9576bc3cb6ea07e7 Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '41d208e8-428f-4cc4-bc6b-0dc8f2673a98'} Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.516796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. Sep 25 01:16:10.522553 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:10.526832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Returning 404 to user: Instance 41d208e8-428f-4cc4-bc6b-0dc8f2673a98 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:10.528030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-666c8d0e-7283-4cd4-a786-6d541289f04d tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98" status: 404 len: 111 microversion: 2.1 time: 0.086705 Sep 25 01:16:10.533513 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1526/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:10 2022] GET /compute/v2.1/servers/41d208e8-428f-4cc4-bc6b-0dc8f2673a98 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:10.546218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23173e86-f294-4656-a167-83ce9bb4494c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '.version_select at 0x7f7beb48a550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.596604 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7120ca36-ac30-46c0-95cf-a4662f45140f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 204 len: 0 microversion: 2.1 time: 0.265404 Sep 25 01:16:10.599800 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1502/3028] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:16:10 2022] DELETE /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:10.627311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.632427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.652432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.652928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.654004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.655048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.655531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.655959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:11.048901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:11.065366 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19553dcc-eb31-493a-93e6-1696c4a336bf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1554 microversion: 2.1 time: 0.459619 Sep 25 01:16:11.066297 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1503/3029] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:10 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1554 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:11.252297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:11.252913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] [instance: d97969ff-afac-48e5-b5bc-b67c2cbffea2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:11.263108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:11.263518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:11.263959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:11.264676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:11.265130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:11.265597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:11.300223 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] HTTP exception thrown: Instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 could not be found. Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Request method failure captured: Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 HTTP/1.1 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6tWGL0_utjZ0q5_KhGR6_1Ns2uJ1JaDhYk6yXgO8XpNp63TRje8Y8Stxgt3gDepmeuE9iRjq6Ox3WcAPYF09L1POsVNb0nCtIN8VI2finUXTU8RphJnk5RUfDrnLcnMDtQS-7gd-_K4jJF6BFz3GBDl-nIlLd7xVHhmNDBh0yGbae0 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b730f5960b50450b9f6e724945ae8613 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestBootFromVolume-570899465 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b730f5960b50450b9f6e724945ae8613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b730f5960b50450b9f6e724945ae8613"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b730f5960b50450b9f6e724945ae8613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b730f5960b50450b9f6e724945ae8613"}]}] Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestBootFromVolume-570899465 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b730f5960b50450b9f6e724945ae8613 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestBootFromVolume-570899465 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestBootFromVolume-570899465-project Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 88a8086a0ed34e4898db9e4d4a632a97 Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestBootFromVolume-570899465-project Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: exception: Instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 could not be found. Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'd97969ff-afac-48e5-b5bc-b67c2cbffea2'} Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 could not be found. Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 could not be found. Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:11.303863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 could not be found. Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Returning 404 to user: Instance d97969ff-afac-48e5-b5bc-b67c2cbffea2 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:11.308469 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-475b7f4d-038d-41b5-8577-487a28b5e68f tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2" status: 404 len: 111 microversion: 2.1 time: 0.056994 Sep 25 01:16:11.317566 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1504/3030] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:11 2022] GET /compute/v2.1/servers/d97969ff-afac-48e5-b5bc-b67c2cbffea2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:11.322865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-083283d1-9204-40f0-accb-3f4609881735 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] Calling method '.version_select at 0x7f7beb92aca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:11.341505 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:11.366236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-083283d1-9204-40f0-accb-3f4609881735 tempest-ServersTestBootFromVolume-570899465 tempest-ServersTestBootFromVolume-570899465-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992395302" status: 202 len: 0 microversion: 2.1 time: 0.047097 Sep 25 01:16:11.368225 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1505/3031] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992395302 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:16:11.378855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:11.379740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:11.401506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:11.402351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:11.404751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:11.407190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:11.409998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:11.412206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:12.381347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:12.437014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2f13b272-0ad7-4f12-8789-23faa4d6128f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1541 microversion: 2.1 time: 1.065802 Sep 25 01:16:12.440482 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1506/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:11 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1541 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:12.454363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:12.459585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:12.467391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:12.467895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:12.468335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:12.469801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:12.470488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:12.471087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:12.543739 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99065cd7-035f-4e31-b00a-1d7008964582 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101101 Sep 25 01:16:12.550932 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1507/3033] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:12 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:12.557342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:12.558736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:12.567964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:12.568746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:12.569382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:12.570861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:12.571499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:12.573285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.184052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:13.201902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c66bc6b7-6c1e-4f87-90eb-7a9ea831051e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1554 microversion: 2.1 time: 0.649394 Sep 25 01:16:13.217838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1508/3034] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:12 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1554 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:13.464125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:13.465550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:13.474037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:13.474037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:13.474037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.474037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:13.474037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:13.474621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.618082 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23173e86-f294-4656-a167-83ce9bb4494c tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/67ac3057-7fe7-46d0-9590-fe908ebb9390" status: 202 len: 0 microversion: 2.1 time: 3.081783 Sep 25 01:16:13.622049 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1527/3035] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:16:10 2022] DELETE /compute/v2.1/os-floating-ips/67ac3057-7fe7-46d0-9590-fe908ebb9390 => generated 0 bytes in 3088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:16:13.636962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:13.644895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:13.688541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:13.690011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:13.691846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.693201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:13.696578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:13.698200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.794178 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88d8add5-0731-4ed4-a8dd-446f01f65249 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169269 Sep 25 01:16:13.797785 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1528/3036] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:13 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:13.814725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:13.817690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:13.839470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:13.845642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:13.846349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.847406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:13.849020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:13.849772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:13.906451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:16:13.918436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:13.922741 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:13.938945 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0695b271-1e34-4aba-88b0-89aa2d864b21 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1541 microversion: 2.1 time: 0.479183 Sep 25 01:16:13.943781 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1509/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:13 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1541 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:13.976077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "name": "network-vif-unplugged", "status": "completed", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:14.035404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:14.038274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:14.040606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:14.072110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be58d38f-2263-41c9-bb14-5f2a2d67d9c6 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 204 len: 0 microversion: 2.1 time: 0.272895 Sep 25 01:16:14.076124 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1529/3038] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:16:13 2022] DELETE /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:14.092231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] Creating event network-vif-unplugged:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h2-master-1 Sep 25 01:16:14.093676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:14.095783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:14.106511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:16:14.110525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:14.111031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:14.111472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:14.112188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:14.112642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:14.113067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:14.156842 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c34d0296-3c01-4eba-b1bf-855ad8850895 req-1d1660ad-00f5-4e2d-beb8-26243cc45f58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189785 Sep 25 01:16:14.157859 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1510/3039] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:16:14.227369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:14.229223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:14.243720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:14.247098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:14.247812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:14.249463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:14.250195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:14.252369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:14.923769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:14.946413 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8bb0f1c7-e4b0-47b5-a24a-b9c099b0fe70 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1554 microversion: 2.1 time: 0.723720 Sep 25 01:16:14.961436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1511/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:14 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1554 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:14.963086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:14.983379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:15.012691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:15.013191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:15.013654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:15.021963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:15.022444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:15.023002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:15.146116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:15.156718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86c2563c-7a67-4171-a7d5-e5368a97a064 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1527 microversion: 2.1 time: 1.076122 Sep 25 01:16:15.160527 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1530/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:14 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1527 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:15.163755 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17b7c7fa-56a0-4efd-9b7f-3744696aa47b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212096 Sep 25 01:16:15.172418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1512/3042] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:14 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:15.175285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:15.176108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:15.198416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:15.199379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:15.199994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:15.202017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:15.202732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:15.203793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:15.893013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:15.917136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-139f4096-0147-4fd4-b6f4-8c1b74ff5afd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1541 microversion: 2.1 time: 0.754881 Sep 25 01:16:15.931104 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1531/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:15 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1541 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:15.972503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:15.973236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:16.003457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:16.006453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:16.006931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:16.007672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:16.011281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:16.012481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:16.179611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:16.182861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:16.194804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:16.195297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:16.195737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:16.199478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:16.201609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:16.207583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:16.279596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1117d100-6aa7-4c57-8b55-3e9354703c6a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105738 Sep 25 01:16:16.287736 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1532/3044] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:16 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:16:16.301894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:16.302835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:16.332000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:16.333000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:16.339028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:16.340628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:16.351654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:16.352900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.106148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:17.125258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-49dfe424-88e5-4ebb-a058-d4dd439e2017 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1346 microversion: 2.1 time: 1.156983 Sep 25 01:16:17.129376 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1513/3045] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:15 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1346 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:17.140791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c", "name": "network-vif-deleted", "tag": "d4239403-3f55-4b83-9485-1dec99b684c4"}, {"name": "network-changed", "server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:17.171174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.172418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.177662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.209986 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Creating event network-vif-deleted:d4239403-3f55-4b83-9485-1dec99b684c4 for instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c on n-h1-master-1 Sep 25 01:16:17.213995 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Creating event network-changed:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h2-master-1 Sep 25 01:16:17.238266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:16:17.295610 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-69c5d7bd-ebd5-478f-9680-7677e0e70e37 req-62777b9e-d3e5-4a24-8fd4-1c6255792dc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.164415 Sep 25 01:16:17.303473 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1514/3046] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:17.319001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:17.328105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:17.354717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.355626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.362141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.362929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.363424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.363973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.473569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:16:17.535595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:17.547520 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-33eb211a-fab9-4ac7-8eba-974ce21761d4 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1527 microversion: 2.1 time: 1.257012 Sep 25 01:16:17.551227 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1533/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:16 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1527 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:17.557299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:17.558741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:17.565715 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:17.567658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.569127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.569862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.570814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.571501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.572503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.714794 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3b0efe6-2812-46e8-bd91-b7eb9ab53454 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 204 len: 0 microversion: 2.1 time: 0.409043 Sep 25 01:16:17.715715 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1515/3048] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:16:17 2022] DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:17.742963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:17.745934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:17.770929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.774705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.777484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:17.781017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:17.786106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:17.787412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:19.073266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:19.133122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f046486a-c907-414d-956c-3ed140a50b67 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1682 microversion: 2.1 time: 1.404941 Sep 25 01:16:19.138483 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1516/3049] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:17 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1682 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:19.167972 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:19.168770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:19.172060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:19.182210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d174c392-e877-4158-8c91-9a02ef78eacb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1541 microversion: 2.1 time: 1.629561 Sep 25 01:16:19.187691 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1534/3050] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:17 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1541 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:19.198595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:19.202498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:19.215926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:19.222018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:19.225511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:19.226391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:19.228438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:19.229314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:19.230148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:19.231792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:19.232633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:19.247526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:19.249736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:19.252161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:19.841593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:19.855387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-52d3a991-a414-42ea-8415-507f627d7f6b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1346 microversion: 2.1 time: 0.715277 Sep 25 01:16:19.856298 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1517/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:19 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1346 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:20.165903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:20.167235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:20.190715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:20.191692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:20.192804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:20.195719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:20.199449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:20.201275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:20.977528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:20.986969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da80532a-e7e8-467f-9f01-a7f45c2503b2 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1527 microversion: 2.1 time: 1.798020 Sep 25 01:16:20.992549 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1535/3052] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:19 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1527 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:21.000832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:21.006302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:21.024934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:21.028224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:21.029519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:21.030523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:21.032009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:21.033979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:21.202990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:21.215485 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d350ade-68a6-4f2d-b44c-56b76150e030 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1682 microversion: 2.1 time: 1.054767 Sep 25 01:16:21.233058 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1518/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:20 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1682 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:21.243933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a6359120-abfb-4c82-9488-d1352a9bc8b9 req-480a99bc-c824-44ef-8da3-1fd4ed590f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d709f02c-216a-4a1e-9b87-6e10ebae65df", "name": "network-vif-deleted", "tag": "9783be42-20f6-4e37-9d2e-c7c85f7feb7f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:21.268588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a6359120-abfb-4c82-9488-d1352a9bc8b9 req-480a99bc-c824-44ef-8da3-1fd4ed590f49 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:21.269562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a6359120-abfb-4c82-9488-d1352a9bc8b9 req-480a99bc-c824-44ef-8da3-1fd4ed590f49 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:21.270034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a6359120-abfb-4c82-9488-d1352a9bc8b9 req-480a99bc-c824-44ef-8da3-1fd4ed590f49 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:21.298166 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a6359120-abfb-4c82-9488-d1352a9bc8b9 req-480a99bc-c824-44ef-8da3-1fd4ed590f49 service nova] Creating event network-vif-deleted:9783be42-20f6-4e37-9d2e-c7c85f7feb7f for instance d709f02c-216a-4a1e-9b87-6e10ebae65df on n-h2-master-1 Sep 25 01:16:21.311248 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a6359120-abfb-4c82-9488-d1352a9bc8b9 req-480a99bc-c824-44ef-8da3-1fd4ed590f49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072137 Sep 25 01:16:21.315394 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1519/3054] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:21.339634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:21.340529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:21.355384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:21.356022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:21.358391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:21.359364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:21.359946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:21.367209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:21.438855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:21.449151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86d0408e-d497-411c-a4ea-c673574834f8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1473 microversion: 2.1 time: 0.455186 Sep 25 01:16:21.459643 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1536/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:20 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1473 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:21.514928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:21.524271 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77b01100-8f68-4908-8239-5409055e4f42 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1346 microversion: 2.1 time: 0.205999 Sep 25 01:16:21.548123 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1520/3056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:21 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1346 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:22.014565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:22.015804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:22.054417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:22.057891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:22.058507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:22.061744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:22.062336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:22.064655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:22.173371 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:22.243575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:22.245055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:22.265015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:22.265553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:22.266003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:22.266739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:22.267198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:22.272000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:22.416889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:22.430446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2964ba5c-e256-47e9-ba0f-bb15a36fcbd8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1485 microversion: 2.1 time: 0.419711 Sep 25 01:16:22.445830 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1537/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:22 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1485 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:22.497928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:22.499338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:22.514131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:22.517203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:22.517948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:22.521206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:22.522095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:22.525143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:23.231332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:23.240081 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67d7082a-3f26-4b04-9042-4382d8e397dc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1682 microversion: 2.1 time: 1.003704 Sep 25 01:16:23.246102 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1521/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:22 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1682 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:23.251740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:23.256584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:23.265301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:23.283151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0389f901-72c0-4596-8247-577bd9add9a8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1473 microversion: 2.1 time: 0.789419 Sep 25 01:16:23.284570 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1538/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:22 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1473 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:23.316448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:23.316953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:23.322895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:23.337948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:23.338740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:23.339398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:23.457006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:23.458003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:23.473750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:23.474249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:23.474690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:23.475405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:23.475873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:23.482725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:23.567671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:23.569370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:23.570226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:23.571667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lazy-loading 'fault' on Instance uuid d709f02c-216a-4a1e-9b87-6e10ebae65df {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:16:23.663064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:23.672472 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9cff9b1b-299b-4746-a13f-a465fb29a51d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1346 microversion: 2.1 time: 0.424618 Sep 25 01:16:23.679522 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1522/3060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:23 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1346 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:23.730893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95b7650e677d47ab9576bc3cb6ea07e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '744c3c67433f4d268891a810016366cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:23.754160 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-20dbde2d-68eb-4604-8987-3808f2f682a8 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 200 len: 1314 microversion: 2.1 time: 0.292935 Sep 25 01:16:23.769641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1539/3061] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:23 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:24.272061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:24.275187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:24.288322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:24.292756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:24.293637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:24.294700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:24.295336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:24.297071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:24.487302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0b1f40df-de51-49e6-a261-a8bfc168fde2 req-57202eb0-58c1-4c6b-ad2c-2a072ad7cb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7980033e-52a8-4fa2-b2d8-05bea9732bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "9f078b6d-051a-44e2-a5fc-1055cf064df2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:24.504348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0b1f40df-de51-49e6-a261-a8bfc168fde2 req-57202eb0-58c1-4c6b-ad2c-2a072ad7cb82 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:24.504841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0b1f40df-de51-49e6-a261-a8bfc168fde2 req-57202eb0-58c1-4c6b-ad2c-2a072ad7cb82 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:24.505280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0b1f40df-de51-49e6-a261-a8bfc168fde2 req-57202eb0-58c1-4c6b-ad2c-2a072ad7cb82 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:24.540143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0b1f40df-de51-49e6-a261-a8bfc168fde2 req-57202eb0-58c1-4c6b-ad2c-2a072ad7cb82 service nova] Creating event network-vif-unplugged:9f078b6d-051a-44e2-a5fc-1055cf064df2 for instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 on n-h1-master-1 Sep 25 01:16:24.563936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0b1f40df-de51-49e6-a261-a8bfc168fde2 req-57202eb0-58c1-4c6b-ad2c-2a072ad7cb82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.607104 Sep 25 01:16:24.567158 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1523/3062] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:24.576535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:24.585141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:24.609216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:24.609757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:24.610201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:24.610923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:24.611534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:24.611805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:24.966845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:24.975603 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5ed04b8-da9c-4238-8cf0-a593b66fb942 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1682 microversion: 2.1 time: 0.708156 Sep 25 01:16:24.993441 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1540/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:24 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1682 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:25.000957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:25.004980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:25.020170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.023120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.026178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.030142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.031500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.032166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.224557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:25.228057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:25.238199 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8749b5fa-f78a-4562-b9d9-61d0580b16e1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1346 microversion: 2.1 time: 0.249003 Sep 25 01:16:25.239466 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1541/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:24 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1346 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:25.244508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:25.245130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] [instance: d709f02c-216a-4a1e-9b87-6e10ebae65df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:25.252730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.254861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.255621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.256614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.257293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.257968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.258111 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4592c066-460e-4162-a80c-437200972b2c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1470 microversion: 2.1 time: 0.689381 Sep 25 01:16:25.262125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1524/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:24 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1470 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:25.295102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:25.298051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:25.305474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] HTTP exception thrown: Instance d709f02c-216a-4a1e-9b87-6e10ebae65df could not be found. Sep 25 01:16:25.312556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Request method failure captured: Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df HTTP/1.1 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6t-x1NzHvj9d3gUEHA8DhwjO9S16W3qDwjxHMdUHOE1whlM7ijgKosXipj-v8-JNS9Dc3Y2Dj3ovrJ_foj5T-Gge8oE4dwiJe5Kizp_ZpiPzi40u5wmWqJp31EVvJkGmzO2J6ki8cLgem4hRqOeTHoch6zCS0v2iIDi8rYWRgh7UrI Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/744c3c67433f4d268891a810016366cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/744c3c67433f4d268891a810016366cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_744c3c67433f4d268891a810016366cc"}]}] Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 744c3c67433f4d268891a810016366cc Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1288922738 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 95b7650e677d47ab9576bc3cb6ea07e7 Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1288922738-project Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: exception: Instance d709f02c-216a-4a1e-9b87-6e10ebae65df could not be found. Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'd709f02c-216a-4a1e-9b87-6e10ebae65df'} Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d709f02c-216a-4a1e-9b87-6e10ebae65df could not be found. Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d709f02c-216a-4a1e-9b87-6e10ebae65df could not be found. Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:25.313329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d709f02c-216a-4a1e-9b87-6e10ebae65df could not be found. Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:25.318609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] Returning 404 to user: Instance d709f02c-216a-4a1e-9b87-6e10ebae65df could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:25.319375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.319375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.319375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.319375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.319742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-846b4e44-00a7-4d9e-b1ac-546d1f796c96 tempest-FloatingIPsAssociationTestJSON-1288922738 tempest-FloatingIPsAssociationTestJSON-1288922738-project] 10.222.0.16 "GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df" status: 404 len: 111 microversion: 2.1 time: 0.076341 Sep 25 01:16:25.321499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1542/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:25 2022] GET /compute/v2.1/servers/d709f02c-216a-4a1e-9b87-6e10ebae65df => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:25.321642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.390847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.391748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.392616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.394492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.398283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.398735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.437883 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:25.440699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:25.451162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for user 5db19a97588e41d1858915c9ccc48620 and project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:25.590602 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a72d0b29-d936-40d3-bd35-26837ed81ea5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23/action" status: 202 len: 0 microversion: 2.1 time: 0.309523 Sep 25 01:16:25.592503 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1525/3067] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:16:25 2022] POST /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:16:25.601008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:25.602131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:25.624569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.625294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.626021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:25.627859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:25.628538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:25.632771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:26.003575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:26.004315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:26.027782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:26.028285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:26.028732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:26.029558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:26.030025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:26.030460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:26.830027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:26.845246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e45595d-192b-4b4a-969e-fd151e5d115d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 200 len: 1614 microversion: 2.1 time: 0.848040 Sep 25 01:16:26.846498 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1526/3068] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:25 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 1614 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:26.851903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:26.856290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:26.864130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:26.865140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:26.866075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:26.867049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:26.867679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:26.868280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:26.947684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:26.951134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:26.964814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:26.965305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lazy-loading 'fault' on Instance uuid b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:16:27.131455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:27.148494 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-386ec885-9a80-49fb-b5eb-b6412478dea7 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1351 microversion: 2.1 time: 0.300451 Sep 25 01:16:27.149370 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1527/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:26 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1351 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:27.366177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:27.379889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5085f5b8-b723-47ea-b6f6-e64d7c7a0924 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1469 microversion: 2.1 time: 1.781309 Sep 25 01:16:27.382762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1543/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:25 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1469 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:27.389875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f67269a3-37bd-4cd3-99fd-8de7ec56443a req-dc3c6a38-0386-4c0e-94c6-fb0c07907d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7980033e-52a8-4fa2-b2d8-05bea9732bf3", "name": "network-vif-deleted", "tag": "9f078b6d-051a-44e2-a5fc-1055cf064df2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:27.419165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f67269a3-37bd-4cd3-99fd-8de7ec56443a req-dc3c6a38-0386-4c0e-94c6-fb0c07907d17 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:27.423874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f67269a3-37bd-4cd3-99fd-8de7ec56443a req-dc3c6a38-0386-4c0e-94c6-fb0c07907d17 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:27.424538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f67269a3-37bd-4cd3-99fd-8de7ec56443a req-dc3c6a38-0386-4c0e-94c6-fb0c07907d17 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:27.462992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f67269a3-37bd-4cd3-99fd-8de7ec56443a req-dc3c6a38-0386-4c0e-94c6-fb0c07907d17 service nova] Creating event network-vif-deleted:9f078b6d-051a-44e2-a5fc-1055cf064df2 for instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 on n-h1-master-1 Sep 25 01:16:27.482618 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f67269a3-37bd-4cd3-99fd-8de7ec56443a req-dc3c6a38-0386-4c0e-94c6-fb0c07907d17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098588 Sep 25 01:16:27.484078 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1544/3071] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:27.750913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a342d18f-df12-4935-9a02-a92c86d85c80 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Action: 'create', calling method: .version_select at 0x7f7beb1fa670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-514103562", "policies": ["affinity"]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:27.794250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a342d18f-df12-4935-9a02-a92c86d85c80 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:27.805265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a342d18f-df12-4935-9a02-a92c86d85c80 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:27.875782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:27.876796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:27.891019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:27.891800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:27.892602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:27.897108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:27.898202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:27.898816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a342d18f-df12-4935-9a02-a92c86d85c80 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:27.900725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:27.911492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a342d18f-df12-4935-9a02-a92c86d85c80 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:27.936943 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 HTTP/1.1 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '7980033e-52a8-4fa2-b2d8-05bea9732bf3'} Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:27.943315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:16:27.948647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:27.950624 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a342d18f-df12-4935-9a02-a92c86d85c80 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.799034 Sep 25 01:16:27.958901 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1528/3072] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 25 01:16:27 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:27.959401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:27.960678 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d9477cd-8a2e-4800-aa49-69ceddb0a20b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 404 len: 111 microversion: 2.1 time: 0.090184 Sep 25 01:16:27.964292 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1545/3073] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:27 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:27.969338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ffcf38d-8033-4bfd-8c32-3563640dab3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Action: 'create', calling method: .version_select at 0x7f7beb9b9e50>, body: {"server_group": {"name": "tempest-server-group-609408103", "policies": ["affinity"]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:27.975932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67838423-595d-4373-9d4c-9ae5c0175d24 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '.version_select at 0x7f7bf0056700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.000395 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:28.017668 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67838423-595d-4373-9d4c-9ae5c0175d24 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025212359" status: 202 len: 0 microversion: 2.1 time: 0.048816 Sep 25 01:16:28.020599 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1546/3074] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025212359 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:16:28.024841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4ffcf38d-8033-4bfd-8c32-3563640dab3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:28.039741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4ffcf38d-8033-4bfd-8c32-3563640dab3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:28.151445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4ffcf38d-8033-4bfd-8c32-3563640dab3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:28.157028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4ffcf38d-8033-4bfd-8c32-3563640dab3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:28.176294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.180919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:28.185552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ffcf38d-8033-4bfd-8c32-3563640dab3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.225032 Sep 25 01:16:28.186172 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1529/3075] 10.222.0.16 () {60 vars in 1173 bytes} [Sun Sep 25 01:16:27 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:28.195062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:28.195954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:28.197363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:28.198368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:28.199087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:28.199742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:28.200147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0368a362-3fcc-4281-839e-12392d2195aa tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Action: 'create', calling method: .version_select at 0x7f7beb92a5e0>, body: {"server_group": {"name": "tempest-server-group-609408103", "policies": ["affinity"]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:28.229098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0368a362-3fcc-4281-839e-12392d2195aa tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:28.237647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0368a362-3fcc-4281-839e-12392d2195aa tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:28.305852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:28.307268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:28.307964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:28.311318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lazy-loading 'fault' on Instance uuid b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:16:28.359584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0368a362-3fcc-4281-839e-12392d2195aa tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:28.370679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0368a362-3fcc-4281-839e-12392d2195aa tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:28.477113 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0368a362-3fcc-4281-839e-12392d2195aa tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.281127 Sep 25 01:16:28.483638 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1530/3076] 10.222.0.16 () {60 vars in 1173 bytes} [Sun Sep 25 01:16:28 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:28.488552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.489190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:28.505287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:28.505879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:28.506336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:28.507072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:28.507595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:28.508156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:28.618193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:28.647717 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5584eaed-ddde-4aa0-aacd-c1b3553a9f7c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 200 len: 1305 microversion: 2.1 time: 0.475421 Sep 25 01:16:28.649661 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1547/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:28 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 1305 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:28.668001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13981b9b-1121-413d-af21-ee417b255a33 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.722614 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13981b9b-1121-413d-af21-ee417b255a33 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e60f04b3-e20b-432d-a6b5-3c487c885afb" status: 204 len: 0 microversion: 2.1 time: 0.070787 Sep 25 01:16:28.723538 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1548/3078] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:28 2022] DELETE /compute/v2.1/os-server-groups/e60f04b3-e20b-432d-a6b5-3c487c885afb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:28.738925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29e71f6b-fbad-491c-89b0-5478f05681d1 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.758183 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29e71f6b-fbad-491c-89b0-5478f05681d1 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.023379 Sep 25 01:16:28.766535 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1549/3079] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:16:28 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:28.772139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-edd97b35-4e8b-4d04-a575-3d4523b7e47a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.811691 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-edd97b35-4e8b-4d04-a575-3d4523b7e47a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/f0172244-6f51-4c8d-974a-3832384ce33e" status: 204 len: 0 microversion: 2.1 time: 0.043490 Sep 25 01:16:28.816468 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1550/3080] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:28 2022] DELETE /compute/v2.1/os-server-groups/f0172244-6f51-4c8d-974a-3832384ce33e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:28.823120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7a7c6c3-4429-4fd1-8d4f-9635b9ba01d7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:28.842078 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7a7c6c3-4429-4fd1-8d4f-9635b9ba01d7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.024080 Sep 25 01:16:28.853881 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1551/3081] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:16:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:28.859178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e2e224b-230e-4363-bd5d-dab0f3aa57fc tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Action: 'create', calling method: .version_select at 0x7f7bebb38550>, body: {"server_group": {"name": "tempest-server-group-2090760622", "policies": ["affinity"]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:28.887676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6e2e224b-230e-4363-bd5d-dab0f3aa57fc tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:28.895406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6e2e224b-230e-4363-bd5d-dab0f3aa57fc tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:28.971069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6e2e224b-230e-4363-bd5d-dab0f3aa57fc tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:28.979891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6e2e224b-230e-4363-bd5d-dab0f3aa57fc tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:28.998785 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e2e224b-230e-4363-bd5d-dab0f3aa57fc tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.143362 Sep 25 01:16:28.999773 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1552/3082] 10.222.0.16 () {60 vars in 1173 bytes} [Sun Sep 25 01:16:28 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:29.011408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-075c9989-33d1-46d0-91e1-1286a7f419ff tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:29.055818 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-075c9989-33d1-46d0-91e1-1286a7f419ff tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5c8b1679-f36b-4e3c-b7be-c61877b38a29" status: 204 len: 0 microversion: 2.1 time: 0.048545 Sep 25 01:16:29.057734 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1553/3083] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:29 2022] DELETE /compute/v2.1/os-server-groups/5c8b1679-f36b-4e3c-b7be-c61877b38a29 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:29.081421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-645befee-a5ac-4acc-9025-f0c5c41009e7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:29.094818 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-645befee-a5ac-4acc-9025-f0c5c41009e7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031951 Sep 25 01:16:29.107113 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1554/3084] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:16:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:29.113607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5e31bfb9-6274-4393-84b3-aac981b2bb74 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Action: 'create', calling method: .version_select at 0x7f7bf08603a0>, body: {"server_group": {"name": "tempest-server-group-1639115253", "policies": ["anti-affinity"]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:29.141951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5e31bfb9-6274-4393-84b3-aac981b2bb74 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:29.148782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5e31bfb9-6274-4393-84b3-aac981b2bb74 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:29.164585 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=10,nova_api:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:29.221930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5e31bfb9-6274-4393-84b3-aac981b2bb74 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:29.230086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5e31bfb9-6274-4393-84b3-aac981b2bb74 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_groups'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:29.247435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5e31bfb9-6274-4393-84b3-aac981b2bb74 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.138455 Sep 25 01:16:29.253908 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1555/3085] 10.222.0.16 () {60 vars in 1173 bytes} [Sun Sep 25 01:16:29 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:29.263284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebaa6225-e4ee-497b-8c83-8c25e3de5149 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:29.309941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ebaa6225-e4ee-497b-8c83-8c25e3de5149 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/0bacff36-c86b-4f94-b54f-42e2efb5a729" status: 204 len: 0 microversion: 2.1 time: 0.054258 Sep 25 01:16:29.313738 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1556/3086] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:16:29 2022] DELETE /compute/v2.1/os-server-groups/0bacff36-c86b-4f94-b54f-42e2efb5a729 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:16:29.319380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a03b4718-6e59-4596-8f62-eaa3bdb10d3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:29.334484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:29.348140 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bcb2ef4-4404-480a-9d00-08c15ac90278 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1469 microversion: 2.1 time: 0.868758 Sep 25 01:16:29.350191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1531/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:28 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1469 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:29.354540 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a03b4718-6e59-4596-8f62-eaa3bdb10d3b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039068 Sep 25 01:16:29.367088 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1557/3088] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:16:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:29.552653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-895040143", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "f9795064-0848-4fc1-9e8f-3bf9f786a3ca"}]}, "os:scheduler_hints": {"group": "e130116f-7b18-40f9-90e8-40d7ebc67657"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:29.658790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] validate_networks() for [('f9795064-0848-4fc1-9e8f-3bf9f786a3ca', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:29.673588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:29.674186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:29.684965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:29.685501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:29.685948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:29.691627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:29.692378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:29.692983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:29.724576 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c HTTP/1.1 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c'} Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:29.730562 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:29.735547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:29.739592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:29.740647 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e346b807-f70c-4de7-8c50-ce62d8688b3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 404 len: 111 microversion: 2.1 time: 0.072088 Sep 25 01:16:29.749364 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1558/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:29 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:16:29.972284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:29.974507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:29.988278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:29.990018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:29.991993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:29.992937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:29.998193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:29.998962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:30.034599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c/os-volume_attachments HTTP/1.1 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': 'b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c'} Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:30.036486 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7b88b02a-bc35-4170-af98-a374e2b0e2c1 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.069799 Sep 25 01:16:30.046624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1559/3090] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:16:29 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:30.371010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1985631671", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:30.498390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:30.969531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:30.970866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:30.971541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:30.972161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:30.972729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:31.012186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:31.015257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:31.015960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:31.020859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:31.022004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:31.022688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:31.083697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:31.097120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:31.127450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:31.131027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:31.291241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:31.307242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:31.416087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for project 512a9166d806477ab93d8eed468bab93. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:31.433079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Getting quotas for user 996dbc72936a46fda11429f9f8438100 and project 512a9166d806477ab93d8eed468bab93. Resources: {'server_group_members'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:31.511792 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-538dcfbc-09ce-4be0-b897-52b9d108c437 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.963457 Sep 25 01:16:31.521836 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1532/3091] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:16:31.528941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:31.529611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:31.558792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:31.559412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:31.559879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:31.560625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:31.561353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:31.561608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:32.659605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:32.677453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d67f613-4c0e-444a-aed8-6e4c00bfe0bb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1469 microversion: 2.1 time: 1.149947 Sep 25 01:16:32.694818 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1533/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:31 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1469 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:32.708455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "name": "network-vif-plugged", "status": "completed", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:32.728971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:32.729477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:32.729920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:32.776218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] Creating event network-vif-plugged:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:16:32.789337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:16:32.815068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2d737028-2af0-4e70-a11e-bf97b816b78a req-43e9c5ec-fee2-4bd7-85cf-b57bb58ed6da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118665 Sep 25 01:16:32.817812 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1534/3093] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:32.842259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:32.843169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:32.877766 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:32.880785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:32.882418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:32.883025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:32.884082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:32.885638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:32.886260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:33.463121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:33.473021 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-26d04579-813c-4044-b12d-f2870d7ec795 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1264 microversion: 2.1 time: 0.645146 Sep 25 01:16:33.477030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1535/3094] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:32 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1264 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:33.504553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-179caef9-2eae-43ad-9eb4-e1a0f94381ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: .version_select at 0x7f7beb1fa670>, body: {"keypair": {"name": "tempest-keypair-313592561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhV6MJ5D70f3PuFRBYt3rFaOwBLSP3r2a8b9ysEkjBh6ufdlwtmpPeCq6ljmPGgSgA8qZ745FzTJPh+/Yr+T6m+K+JOoJ8YF+Yct7d+dyRtNSxkho4Yf6GVrvSze/XQwg=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:33.542405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-179caef9-2eae-43ad-9eb4-e1a0f94381ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:33.548170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-179caef9-2eae-43ad-9eb4-e1a0f94381ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:33.598574 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-179caef9-2eae-43ad-9eb4-e1a0f94381ab tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120325 Sep 25 01:16:33.599204 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1536/3095] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:16:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:33.718686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:33.720591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:33.742077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:33.744861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:33.747314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:33.750945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:33.753666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:33.756156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:34.160270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:34.160763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:34.161298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:34.161923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:34.162477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:34.180134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:34.180632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:34.181110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:34.187567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:34.188239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:34.188706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:34.250448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:34.257971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:34.274278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:34.279107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:34.372348 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48e484c7-171b-43f9-a6b5-02015a5beb54 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.005347 Sep 25 01:16:34.386740 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1560/3096] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:16:34.395869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8cad706f-0d50-432d-8a89-6f87c5d28fa3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:34.397127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8cad706f-0d50-432d-8a89-6f87c5d28fa3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:34.935817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8cad706f-0d50-432d-8a89-6f87c5d28fa3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:34.946258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8cad706f-0d50-432d-8a89-6f87c5d28fa3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78" status: 200 len: 1215 microversion: 2.1 time: 0.558039 Sep 25 01:16:34.947984 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1561/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:34 2022] GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 => generated 1215 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:34.953243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:34.954187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:34.970184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:34.971144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:34.971857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:34.972340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:34.973541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:34.974296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:34.975268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:34.989648 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74c9f1fc-3dba-44d3-adf3-02208d0706f4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1535 microversion: 2.1 time: 1.289930 Sep 25 01:16:35.006492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1537/3098] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:33 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1535 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:35.029544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab031b56-08e9-42dc-955b-fb781c0cec31 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:35.030899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab031b56-08e9-42dc-955b-fb781c0cec31 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:35.082140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab031b56-08e9-42dc-955b-fb781c0cec31 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:16:35.184907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:35.193197 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-77adfea8-0fd5-42af-865c-1d59a10c38b7 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1270 microversion: 2.1 time: 0.243814 Sep 25 01:16:35.197394 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1562/3099] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:34 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1270 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:35.661305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "name": "network-vif-unplugged", "status": "completed", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:35.681076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:35.682531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:35.683277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:35.716022 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] Creating event network-vif-unplugged:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:16:35.730397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:16:35.744149 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cdb9372d-e012-4efe-9c51-56ed8f840fcd req-4a32ca7a-d8ba-4d5f-8920-dbad905930dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087870 Sep 25 01:16:35.745500 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1563/3100] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:35.777071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.scheduler.client.report [None req-ab031b56-08e9-42dc-955b-fb781c0cec31 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Deleted allocations for instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 Sep 25 01:16:35.809049 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab031b56-08e9-42dc-955b-fb781c0cec31 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78" status: 204 len: 0 microversion: 2.1 time: 0.801322 Sep 25 01:16:35.812729 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1538/3101] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:16:35 2022] DELETE /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:16:35.818889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:35.820147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:35.827232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:35.828131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:35.829468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:35.830744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:35.831484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:35.832146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:35.856120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 HTTP/1.1 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: exception: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'cdbf7af7-817a-49bc-9f4e-14954fe00b78'} Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:35.858247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:16:35.862582 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:16:35.864928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:35.868887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c4f0c77-3b5b-4003-b51c-3b8fdaab67bb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78" status: 404 len: 111 microversion: 2.1 time: 0.054501 Sep 25 01:16:35.870110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1564/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:35 2022] GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:16:36.025174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:36.025876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:36.038011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:36.038890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:36.043544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:36.049264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:36.053785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:36.055277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:36.105210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1427908259", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:36.203937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:36.921603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:36.936084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8392685-4282-4bba-87ce-ffd13e61b94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1535 microversion: 2.1 time: 0.915335 Sep 25 01:16:36.941320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1539/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:36 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1535 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:36.959424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:36.960704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:36.973458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:36.974867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:36.976328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:36.977778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:36.978952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:36.979862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:37.955144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:37.955776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:37.956551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:37.957355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:37.958020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:37.963530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:37.977143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0c5a30dc-c930-4e32-936f-b52422ea0e8d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 1.034128 Sep 25 01:16:37.998293 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1540/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:36 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:38.001327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:38.001925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:38.002388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:38.003384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:38.005178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:38.005686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:38.006370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:38.037428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:38.038494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:38.039106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:38.039684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:38.049669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:38.062830 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] Creating event network-changed:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:16:38.069447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:16:38.074792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:38.081693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:38.096576 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-053380dc-669e-46c3-8592-7304fb8878d8 req-d9ed9816-160b-4295-8c3a-8e127a5105ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094558 Sep 25 01:16:38.099142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1541/3105] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:38.106112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:38.107220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:38.116069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:38.116830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:38.117371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:38.118757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:38.119725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:38.120277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:38.218834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73dce1fe-4064-4a05-a157-4c16e1ce799e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.112257 Sep 25 01:16:38.228502 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1565/3106] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:16:38.240625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f60b1473-c5c8-43f8-bc88-d87fb058783b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:38.241811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f60b1473-c5c8-43f8-bc88-d87fb058783b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:38.457078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f60b1473-c5c8-43f8-bc88-d87fb058783b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:38.465005 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f60b1473-c5c8-43f8-bc88-d87fb058783b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1215 microversion: 2.1 time: 0.234861 Sep 25 01:16:38.477834 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1566/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:38 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:38.852574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:38.861833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ccc2b1b0-1648-4022-92eb-d9be1b41a9c0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1535 microversion: 2.1 time: 0.760878 Sep 25 01:16:38.862449 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1542/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:38 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1535 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:39.006190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:39.006840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:39.014428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:39.014914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:39.015361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:39.029961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:39.033800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:39.035056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:39.487573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:39.488979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:39.523454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:39.526185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:39.526933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:39.529740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:39.533040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:39.539118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:39.810886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:39.826343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:39.830769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f5125a7-b3be-4d6e-972e-245ba776ff9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1267 microversion: 2.1 time: 0.347388 Sep 25 01:16:39.834993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fc9640da-20b5-41a4-9917-1860e818886b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 0.832729 Sep 25 01:16:39.836077 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1567/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:39 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:39.850926 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1543/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:39 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:39.887048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:39.887676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:39.894119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:39.894612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:39.895221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:39.896246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:39.896884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:39.897619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:40.557058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:40.576781 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ae43eb2-e5cd-42ce-8291-a9d8b9d89210 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1535 microversion: 2.1 time: 0.692720 Sep 25 01:16:40.579687 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1568/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:39 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1535 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:40.856860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:40.862368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:40.862978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:40.863903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:40.886557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:40.889051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:40.896839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:40.897648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:40.899263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:40.899742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:40.901037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:40.901764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:40.902233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:40.902663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:40.907817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:40.908269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:41.048058 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=5 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:41.147275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:41.167778 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c3fc9bb-cda9-4678-a864-c54cc6081e47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1275 microversion: 2.1 time: 0.316436 Sep 25 01:16:41.169062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1544/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:40 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1275 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:41.506697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1201500344", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "ee2458e7-40a7-4ca9-9d30-dadb21c83aa9"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:41.612861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] validate_networks() for [('ee2458e7-40a7-4ca9-9d30-dadb21c83aa9', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:42.381739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:42.396716 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e08622ac-08f4-4e86-9575-6cda20c83071 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 1.538016 Sep 25 01:16:42.402952 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1569/3113] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:40 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:42.425740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:42.427200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:42.436581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:42.437202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:42.437818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:42.438540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:42.442019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:42.442584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:43.187583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:43.202321 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1278c702-9f8e-478a-92bf-751d79ad39d9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1528 microversion: 2.1 time: 0.789560 Sep 25 01:16:43.203301 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1570/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:42 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1528 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:43.213870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:43.214845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:43.229898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:43.230690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:43.231374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:43.238497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:43.239286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:43.239854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:43.388142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:43.396921 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:43.417309 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f01ce2c9-429b-4365-8e0e-db6669074ff6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1273 microversion: 2.1 time: 0.210071 Sep 25 01:16:43.420296 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1571/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:43 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:43.440281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-810ef48a-1dc2-4864-8d71-836b362bc388 req-1f88674e-9996-4d21-b592-3eb9a448e774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96323d84-4a94-4824-912f-1e2db48a80a8", "tag": "e8206b89-85a1-45e9-9b85-2e25f282d23a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:43.467400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-810ef48a-1dc2-4864-8d71-836b362bc388 req-1f88674e-9996-4d21-b592-3eb9a448e774 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:43.470227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-810ef48a-1dc2-4864-8d71-836b362bc388 req-1f88674e-9996-4d21-b592-3eb9a448e774 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:43.470916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-810ef48a-1dc2-4864-8d71-836b362bc388 req-1f88674e-9996-4d21-b592-3eb9a448e774 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:43.905107 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-810ef48a-1dc2-4864-8d71-836b362bc388 req-1f88674e-9996-4d21-b592-3eb9a448e774 service nova] Creating event network-changed:e8206b89-85a1-45e9-9b85-2e25f282d23a for instance 96323d84-4a94-4824-912f-1e2db48a80a8 on n-h2-master-1 Sep 25 01:16:43.925819 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-810ef48a-1dc2-4864-8d71-836b362bc388 req-1f88674e-9996-4d21-b592-3eb9a448e774 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503400 Sep 25 01:16:43.928239 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1572/3116] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:43.940561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:43.942101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:43.961107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:43.961648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:43.962835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:43.963420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:43.963852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:43.964280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:44.089380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:44.090759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:44.091501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:44.092133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:44.092763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:44.114309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:44.116033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:44.116709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:44.117946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:44.119460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:44.121945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:44.189102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Getting quotas for project 31a0aa9bcbe5414eb0e4e412069cca3b. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:44.199052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Getting quotas for user b83c3369cd634d3aa48681fd18492a0a and project 31a0aa9bcbe5414eb0e4e412069cca3b. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:44.215617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:44.220553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:44.305231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cebfd791-c873-440a-a139-6baf950520a4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.120489 Sep 25 01:16:44.308193 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1545/3117] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:16:44.359315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-934918775", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "859e11de-11e2-49b9-9778-5d1ca46edda6"}], "security_groups": [{"name": "tempest-securitygroup--1596300716"}], "key_name": "tempest-keypair-313592561", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:45.248814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:45.276072 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2d8e3f8-cd56-46d8-8a25-409561547d5f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1528 microversion: 2.1 time: 1.343507 Sep 25 01:16:45.277043 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1573/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:43 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1528 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:45.288189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] validate_networks() for [('859e11de-11e2-49b9-9778-5d1ca46edda6', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:45.293704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:45.294420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:45.306686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:45.308044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:45.308663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:45.314275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:45.318729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:45.319364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:45.968861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:45.981108 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b291c8c-b168-4e64-ac9d-f5afb5495314 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 0.702805 Sep 25 01:16:45.985457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1574/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:45 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:45.996394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:45.996947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:46.015371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:46.015885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:46.016341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:46.017069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:46.017603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:46.018042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:46.371773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:46.372849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:46.373587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:46.374166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:46.374746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:46.390863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:46.394184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:46.395823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:46.398388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:46.405159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:46.405712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:46.440351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:46.445832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Getting quotas for user bb85bd8db516469abb729c1fdc0a1ba1 and project 82fcf2dd9b2c41f5a87eda0402682069. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:46.464003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:46.467567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:46.467733 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:46.476184 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fed91bbc-503b-40ab-9acf-56f0bb962064 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1315 microversion: 2.1 time: 0.491683 Sep 25 01:16:46.476767 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1575/3120] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:45 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:46.490527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1600071173", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "ee2458e7-40a7-4ca9-9d30-dadb21c83aa9"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:46.544253 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d761a228-7f2d-4581-af23-9ab661723794 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.234257 Sep 25 01:16:46.550879 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1546/3121] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:16:46.564336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d0c5967-0a5e-47d0-a3ba-0f2e7efd463b tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:46.574271 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7d0c5967-0a5e-47d0-a3ba-0f2e7efd463b tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] HTTP exception thrown: Flavor 10dbf8bf-d643-47d6-ad0d-86c8d404be46 could not be found. Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d0c5967-0a5e-47d0-a3ba-0f2e7efd463b tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Request method failure captured: Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/flavors/10dbf8bf-d643-47d6-ad0d-86c8d404be46 HTTP/1.1 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sG-tiB76bJOZyKmw0pnm-QGdSQwlrhUxa_NOZDprGxyIeJUinOrsGWvbYSGhb18oWB8_2663YHzsU-8DY_9-LaOpmrXUIixJ-vc7Hxha48CeK5mwNxKiVhvN1Nrj7SkcbSlzt_M2kdQT6jcPhxrzmEppYx78qysLfije8HrKfjSBk Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7569ed03c4fc4fd5a6e987cf82ea14fb Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MigrationsAdminTest-730347336 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7569ed03c4fc4fd5a6e987cf82ea14fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7569ed03c4fc4fd5a6e987cf82ea14fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7569ed03c4fc4fd5a6e987cf82ea14fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7569ed03c4fc4fd5a6e987cf82ea14fb"}]}] Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MigrationsAdminTest-730347336 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7569ed03c4fc4fd5a6e987cf82ea14fb Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MigrationsAdminTest-730347336 Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MigrationsAdminTest-730347336-project-admin Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 231418d4fb2246adb38aaeefb031655e Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MigrationsAdminTest-730347336-project-admin Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: exception: Flavor 10dbf8bf-d643-47d6-ad0d-86c8d404be46 could not be found. Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '10dbf8bf-d643-47d6-ad0d-86c8d404be46'} Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 10dbf8bf-d643-47d6-ad0d-86c8d404be46 could not be found. Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 10dbf8bf-d643-47d6-ad0d-86c8d404be46 could not be found. Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:46.581525 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 10dbf8bf-d643-47d6-ad0d-86c8d404be46 could not be found. Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d0c5967-0a5e-47d0-a3ba-0f2e7efd463b tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Returning 404 to user: Flavor 10dbf8bf-d643-47d6-ad0d-86c8d404be46 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d0c5967-0a5e-47d0-a3ba-0f2e7efd463b tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/10dbf8bf-d643-47d6-ad0d-86c8d404be46" status: 404 len: 109 microversion: 2.1 time: 0.030958 Sep 25 01:16:46.585996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1547/3122] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:16:46 2022] DELETE /compute/v2.1/flavors/10dbf8bf-d643-47d6-ad0d-86c8d404be46 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:16:46.635002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efeb25e9-4029-4ba6-8fbd-ae1bafbe487a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:46.638055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-efeb25e9-4029-4ba6-8fbd-ae1bafbe487a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:46.661291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] validate_networks() for [('ee2458e7-40a7-4ca9-9d30-dadb21c83aa9', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:46.831632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-efeb25e9-4029-4ba6-8fbd-ae1bafbe487a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:46.847585 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-efeb25e9-4029-4ba6-8fbd-ae1bafbe487a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1240 microversion: 2.1 time: 0.259676 Sep 25 01:16:46.863625 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1548/3123] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:46 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1240 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:46.873382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-59221f68-892f-421b-8b72-41b4412126d6 req-c45949d8-322a-4b29-bedc-aa8462608f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "name": "network-vif-plugged", "status": "completed", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:46.891490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-59221f68-892f-421b-8b72-41b4412126d6 req-c45949d8-322a-4b29-bedc-aa8462608f0c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:46.892359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-59221f68-892f-421b-8b72-41b4412126d6 req-c45949d8-322a-4b29-bedc-aa8462608f0c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:46.893032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-59221f68-892f-421b-8b72-41b4412126d6 req-c45949d8-322a-4b29-bedc-aa8462608f0c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:46.917630 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-59221f68-892f-421b-8b72-41b4412126d6 req-c45949d8-322a-4b29-bedc-aa8462608f0c service nova] Creating event network-vif-plugged:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:16:46.927187 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-59221f68-892f-421b-8b72-41b4412126d6 req-c45949d8-322a-4b29-bedc-aa8462608f0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061556 Sep 25 01:16:46.928618 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1549/3124] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:46.941364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-641276853", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:47.009371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:47.733199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:47.734426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:47.735082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:47.735770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:47.736396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:47.762518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:47.763214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:47.763820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:47.764742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:47.765455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:47.766115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:47.811827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:47.821722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Getting quotas for user 5db19a97588e41d1858915c9ccc48620 and project 46ae8b5de3254713b60172f6c0b351e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:47.843966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:47.854137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:47.929911 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:47.999029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-65c5c8cc-adcc-42f2-877d-51f5bda3e165 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067874 Sep 25 01:16:48.003575 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1550/3125] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:16:48.020786 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:48.040295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:48.043036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:48.075598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:48.076614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:48.077237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:48.079728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:48.080516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:48.081106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:48.088154 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:48.461637 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=32 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:48.793435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:48.806183 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4d130c5-85f9-4a0c-96a9-54337066d280 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 0.801107 Sep 25 01:16:48.818102 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1551/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:48 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:48.834530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:48.835346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:48.848097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:48.853446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:48.854198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:48.857343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:48.858072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:48.864392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.138873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:49.139379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:49.139777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:49.140192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:49.140608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:49.159960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.162171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.162625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.163401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.164713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.165254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.199960 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:49.231388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Getting quotas for project 31a0aa9bcbe5414eb0e4e412069cca3b. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:49.252971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Getting quotas for user b83c3369cd634d3aa48681fd18492a0a and project 31a0aa9bcbe5414eb0e4e412069cca3b. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:49.292906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:49.300646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:49.402758 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1ddf23b-c2e8-4798-8a1b-3e600fb238d9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.916439 Sep 25 01:16:49.403474 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1576/3127] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:16:49.431783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:49.435232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:49.462405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.463545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.464762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.471463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.475532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.478473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.626222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:49.640100 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdab7841-52f1-4341-b269-1cd30d3c8c5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1315 microversion: 2.1 time: 0.820445 Sep 25 01:16:49.662137 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1552/3128] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:48 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:49.667912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:49.670160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:49.688205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.689089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.690861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.691864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.692956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.695363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.847432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:49.862006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d03fa66-2618-45ab-bb24-bfc3f9935387 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1292 microversion: 2.1 time: 0.452111 Sep 25 01:16:49.863610 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1577/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:49 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1292 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:49.868636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ec15d558-f3b5-4df6-9420-689cdd375ed8 req-7caf57cc-863a-4076-ba55-191e09547765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4031dcfb-fe82-40d3-a41b-59059dc32b7b", "tag": "b5c69285-0e3d-477e-a3f3-e7ff3f0b323e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:49.880834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ec15d558-f3b5-4df6-9420-689cdd375ed8 req-7caf57cc-863a-4076-ba55-191e09547765 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:49.881958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ec15d558-f3b5-4df6-9420-689cdd375ed8 req-7caf57cc-863a-4076-ba55-191e09547765 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:49.882656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ec15d558-f3b5-4df6-9420-689cdd375ed8 req-7caf57cc-863a-4076-ba55-191e09547765 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:49.897941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ec15d558-f3b5-4df6-9420-689cdd375ed8 req-7caf57cc-863a-4076-ba55-191e09547765 service nova] Creating event network-changed:b5c69285-0e3d-477e-a3f3-e7ff3f0b323e for instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b on n-h1-master-1 Sep 25 01:16:49.914937 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ec15d558-f3b5-4df6-9420-689cdd375ed8 req-7caf57cc-863a-4076-ba55-191e09547765 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041509 Sep 25 01:16:49.916713 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1578/3130] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:49.922805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2003351032", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "451", "networks": [{"uuid": "ee2458e7-40a7-4ca9-9d30-dadb21c83aa9"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:49.997376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] validate_networks() for [('ee2458e7-40a7-4ca9-9d30-dadb21c83aa9', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:16:50.129224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:50.146510 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-608c6916-cd4e-4732-87e3-5a1048c014ed tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1208 microversion: 2.1 time: 0.481287 Sep 25 01:16:50.148838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1553/3131] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:49 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1208 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:50.162962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:50.167270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:50.183512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:50.185687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:50.186157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:50.190546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:50.192573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:50.193712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:51.412169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:51.432218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f677a1d0-fd22-4da5-a1e9-304f42bb0ed4 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 1.280439 Sep 25 01:16:51.432838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1554/3132] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:50 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:51.460412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:51.464829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:51.490063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:51.494740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:51.495683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:51.497855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:51.502287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:51.503373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:52.330427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:52.345385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a605e01-03d3-44f8-bf44-52d18813fa93 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1315 microversion: 2.1 time: 0.903920 Sep 25 01:16:52.346040 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1555/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:51 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:52.363513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:52.364899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:52.389718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:52.397740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:52.398296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:52.399107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:52.399786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:52.400391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:52.544224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:52.552476 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f4ac0564-5944-425c-ae27-c9ad4f41561d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1298 microversion: 2.1 time: 0.205387 Sep 25 01:16:52.553591 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1556/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:52 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1298 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:52.572188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:52.573084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:52.582649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:52.585613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:52.586257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:52.587396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:52.588510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:52.590058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:52.764381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:52.777284 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5dda6005-3c92-4f4b-8b25-e59adb015730 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1270 microversion: 2.1 time: 0.222400 Sep 25 01:16:52.781436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1557/3135] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:52 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:52.796267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:52.797383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:52.813194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:52.815407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:52.817054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:52.819033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:52.822411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:52.823111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:53.104694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:16:53.105143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:16:53.105625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:16:53.106047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:16:53.106466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:16:53.126665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:53.127165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:53.127612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:53.128357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:53.128820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:53.129265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:53.201379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Getting quotas for project 31a0aa9bcbe5414eb0e4e412069cca3b. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:16:53.224152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Getting quotas for user b83c3369cd634d3aa48681fd18492a0a and project 31a0aa9bcbe5414eb0e4e412069cca3b. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:16:53.263424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:16:53.267022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:16:53.413473 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69306eed-6636-4ab6-ba0f-005e7c160a67 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.494485 Sep 25 01:16:53.424326 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1579/3136] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:16:53.437238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:53.440543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:53.483620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:53.484433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:53.485475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:53.486575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:53.487404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:53.488295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:53.750730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:53.765790 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-206ded8a-7a57-428e-8940-4721ff550e0b tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 0.976432 Sep 25 01:16:53.766564 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1558/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:52 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:53.777270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6a75398-1c12-490a-8fd0-02821f7f9725 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:53.778126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6a75398-1c12-490a-8fd0-02821f7f9725 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:54.126492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6a75398-1c12-490a-8fd0-02821f7f9725 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:54.128919 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=65 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:54.142394 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6a75398-1c12-490a-8fd0-02821f7f9725 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1221 microversion: 2.1 time: 0.374655 Sep 25 01:16:54.143343 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1559/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:53 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1221 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:54.148293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:54.148910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:54.174008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:54.174661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:54.175126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:54.175874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:54.176538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:54.177159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:54.469314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:54.485527 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36fe1628-0a8f-411d-9415-6c646c21a237 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1298 microversion: 2.1 time: 0.336455 Sep 25 01:16:54.486422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1560/3139] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:54 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1298 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:54.491632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:54.494156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:54.507713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:54.510279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:54.511098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:54.514383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:54.515186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:54.515881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:54.914280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:54.941925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b3aa7102-bba2-439e-b41e-5dfdb475df7b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1315 microversion: 2.1 time: 1.516015 Sep 25 01:16:54.976500 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1580/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:53 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1315 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:54.991910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:54.992728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:55.014464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:55.016571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:55.017720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:55.020551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:55.021243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:55.022145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:56.476625 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:56.492785 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e583f02-dca5-491b-9862-f5236171a196 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 2.004873 Sep 25 01:16:56.493421 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1561/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:54 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:56.498300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:56.498932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:56.518558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:56.519426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:56.519872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:56.521317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:56.522003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:56.522617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:56.716753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:56.729825 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d46e3ec-acb8-4424-abce-04c68b32e157 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1291 microversion: 2.1 time: 0.235138 Sep 25 01:16:56.735268 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1562/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:56 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1291 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:56.740538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:56.743599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:56.756596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:56.769618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:56.770299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:56.771565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:56.772407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:56.773233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:57.039795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:57.052858 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d707df01-e9ab-4a89-847c-de721dacbba2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 2.074956 Sep 25 01:16:57.053473 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1581/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:54 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:57.060351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9a922de9-c38a-4131-8796-94e812c89bfe req-76072ced-fef9-4850-bf88-b15e1650abbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96323d84-4a94-4824-912f-1e2db48a80a8", "name": "network-vif-plugged", "status": "completed", "tag": "e8206b89-85a1-45e9-9b85-2e25f282d23a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:57.095879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a922de9-c38a-4131-8796-94e812c89bfe req-76072ced-fef9-4850-bf88-b15e1650abbf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:57.103508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a922de9-c38a-4131-8796-94e812c89bfe req-76072ced-fef9-4850-bf88-b15e1650abbf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:57.104113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a922de9-c38a-4131-8796-94e812c89bfe req-76072ced-fef9-4850-bf88-b15e1650abbf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:57.132431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9a922de9-c38a-4131-8796-94e812c89bfe req-76072ced-fef9-4850-bf88-b15e1650abbf service nova] Creating event network-vif-plugged:e8206b89-85a1-45e9-9b85-2e25f282d23a for instance 96323d84-4a94-4824-912f-1e2db48a80a8 on n-h2-master-1 Sep 25 01:16:57.152635 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9a922de9-c38a-4131-8796-94e812c89bfe req-76072ced-fef9-4850-bf88-b15e1650abbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097858 Sep 25 01:16:57.153205 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1582/3144] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:57.162627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:57.163659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:57.190268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:57.191626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:57.192494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:57.194413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:57.197981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:57.204988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:57.705541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:57.726724 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-536cb7e8-85fe-4615-864a-e0be98c47090 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.988931 Sep 25 01:16:57.731417 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1563/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:56 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:57.754892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:57.764407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:57.775098 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:16:57.786408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:57.786915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:57.787363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:57.791491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:57.793653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:57.794173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:58.451774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:58.462907 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93c11868-106f-419d-a22a-a00baf2ce711 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1315 microversion: 2.1 time: 1.308032 Sep 25 01:16:58.468153 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1583/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:57 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:58.486407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:58.487345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:58.496974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:58.501345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:58.501934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:58.502699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:58.503180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:58.503620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:58.886137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:58.895847 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2e54d1b-d9c9-47c3-bf30-dabaa375e7df tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 1.163010 Sep 25 01:16:58.896417 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1564/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:57 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:58.917550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:58.927679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:58.928555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01433212-2334-4852-8848-8105a68863d2 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1279 microversion: 2.1 time: 0.456393 Sep 25 01:16:58.929169 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1584/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:58 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1279 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:58.929863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:58.952238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:58.952559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:58.953001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:58.956494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b531a64c-9fd9-4685-8482-475de09a9380 req-783b1ed3-c707-4707-a03d-25f7613fe85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:58.958735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:58.959491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:58.960118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:58.991644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b531a64c-9fd9-4685-8482-475de09a9380 req-783b1ed3-c707-4707-a03d-25f7613fe85a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:58.992149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b531a64c-9fd9-4685-8482-475de09a9380 req-783b1ed3-c707-4707-a03d-25f7613fe85a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:58.995304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b531a64c-9fd9-4685-8482-475de09a9380 req-783b1ed3-c707-4707-a03d-25f7613fe85a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:59.011393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b531a64c-9fd9-4685-8482-475de09a9380 req-783b1ed3-c707-4707-a03d-25f7613fe85a service nova] Creating event network-changed:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h1-master-1 Sep 25 01:16:59.017505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b531a64c-9fd9-4685-8482-475de09a9380 req-783b1ed3-c707-4707-a03d-25f7613fe85a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085876 Sep 25 01:16:59.018168 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1585/3149] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:59.026096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:59.027127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:59.034406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:59.035346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:59.035968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:59.037021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:59.037684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:59.038291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:59.870637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:59.889094 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a1019c9-b212-424e-bd71-b8c3bfee4c62 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.869780 Sep 25 01:16:59.916666 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1586/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:59 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:59.923477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-18a78c97-e36b-45b0-9c50-46fcb3ba89d6 req-4c9bcb3a-dbe0-4f18-be99-3eb27a954600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031dcfb-fe82-40d3-a41b-59059dc32b7b", "name": "network-vif-plugged", "status": "completed", "tag": "b5c69285-0e3d-477e-a3f3-e7ff3f0b323e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:59.935353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:59.940864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18a78c97-e36b-45b0-9c50-46fcb3ba89d6 req-4c9bcb3a-dbe0-4f18-be99-3eb27a954600 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:59.941395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18a78c97-e36b-45b0-9c50-46fcb3ba89d6 req-4c9bcb3a-dbe0-4f18-be99-3eb27a954600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:59.941861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18a78c97-e36b-45b0-9c50-46fcb3ba89d6 req-4c9bcb3a-dbe0-4f18-be99-3eb27a954600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:59.950637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24e7d303-7061-4222-a4f6-b813dc8ffdb3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1312 microversion: 2.1 time: 1.045467 Sep 25 01:16:59.953903 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1565/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:58 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1312 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:59.963205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-18a78c97-e36b-45b0-9c50-46fcb3ba89d6 req-4c9bcb3a-dbe0-4f18-be99-3eb27a954600 service nova] Creating event network-vif-plugged:b5c69285-0e3d-477e-a3f3-e7ff3f0b323e for instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b on n-h1-master-1 Sep 25 01:16:59.972903 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-18a78c97-e36b-45b0-9c50-46fcb3ba89d6 req-4c9bcb3a-dbe0-4f18-be99-3eb27a954600 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053159 Sep 25 01:16:59.973825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1587/3152] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:00.002305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:00.003401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:00.021332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:00.022068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:00.025643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:00.026838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:00.027617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:00.028398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:00.266069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1258787381", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4ec95620-83af-4c06-b763-713d3bcab477"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:00.342145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] validate_networks() for [('4ec95620-83af-4c06-b763-713d3bcab477', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:17:01.438793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:01.454169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d643538-928a-4f1f-9f6e-7eb0bd41ea44 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1315 microversion: 2.1 time: 1.498533 Sep 25 01:17:01.471798 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1566/3153] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:59 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1315 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:01.485081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:01.485942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:01.495811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:01.496230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:01.496755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:01.497543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:01.498141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:01.498520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:02.831427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:02.863991 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09dcdcb0-6dd7-48ba-ac44-130daae7943b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 1.390707 Sep 25 01:17:02.867721 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1567/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:01 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:02.881239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:02.882147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:02.896499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:02.897522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:02.898258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:02.899985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:02.900716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:02.902618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.160449 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:03.197876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:17:03.198793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:17:03.199783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:17:03.202339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:17:03.203542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:17:03.238638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.240869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.242838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.243998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.244707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.245564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.275640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:17:03.285210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for user ab3394e2971741d7aa5956de0d4afba8 and project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:17:03.303266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:17:03.306473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:17:03.377085 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-931cf102-2c8a-422f-8546-b978f29e1b2f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.401861 Sep 25 01:17:03.377840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1588/3155] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:17:03.391217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:03.392185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:03.402473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.403261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.403900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.404808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.405739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.406817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.688610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:03.699383 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:03.718712 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19e27d7a-c801-43c0-951a-452d661e0aa7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.848303 Sep 25 01:17:03.733890 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1568/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:02 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:03.738343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:03.739259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:03.750069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.750653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.751060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.752166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.752368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.753030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.897134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:03.908490 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2511ba18-3df7-4756-9abc-2dcda05becb0 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.521309 Sep 25 01:17:03.911921 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1589/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:03 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:03.917679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-708e77bb-31ef-442d-b290-09785236a41e req-65c941b5-210a-46de-99b0-79624ff3bbab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de5d07f-1a7b-4152-bebd-455f9a0af262", "tag": "fa5a309e-610e-482f-885b-9ad08b48e85c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:03.950305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-708e77bb-31ef-442d-b290-09785236a41e req-65c941b5-210a-46de-99b0-79624ff3bbab service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:03.950799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-708e77bb-31ef-442d-b290-09785236a41e req-65c941b5-210a-46de-99b0-79624ff3bbab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:03.951243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-708e77bb-31ef-442d-b290-09785236a41e req-65c941b5-210a-46de-99b0-79624ff3bbab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:03.978275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-708e77bb-31ef-442d-b290-09785236a41e req-65c941b5-210a-46de-99b0-79624ff3bbab service nova] Creating event network-changed:fa5a309e-610e-482f-885b-9ad08b48e85c for instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 on n-h2-master-1 Sep 25 01:17:03.987950 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-708e77bb-31ef-442d-b290-09785236a41e req-65c941b5-210a-46de-99b0-79624ff3bbab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072243 Sep 25 01:17:03.990159 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1590/3158] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:03.997797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:03.998796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:04.005851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:04.006596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:04.007274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:04.008269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:04.008956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:04.009622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:04.142311 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:04.651581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:04.666370 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-432a3f6a-7294-447e-a317-375a026d18fe tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1496 microversion: 2.1 time: 0.935638 Sep 25 01:17:04.681785 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1569/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:03 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1496 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:04.689958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:04.691848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:04.713771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:04.721232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:04.733843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:04.734714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:04.735197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:04.735634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:04.913837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:04.925151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13d9255e-2af8-4bed-86a9-57f6c3a942ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1503 microversion: 2.1 time: 0.933437 Sep 25 01:17:04.925859 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1591/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:03 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1503 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:04.935744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:04.938205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:04.951004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:04.951624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:04.951962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:04.952629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:04.953082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:04.953542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.013346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:05.023221 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b915085d-def5-4c25-95f8-0708141de3c5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1260 microversion: 2.1 time: 0.340004 Sep 25 01:17:05.028578 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1570/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:04 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1260 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:05.043813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-14ce80f9-b02e-4094-a562-39fa1bc8f2d5 req-e234d617-d732-4e24-8113-4d8cb883ff11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b280d42-10ba-4ddb-9c3f-f0d3009c1d66", "tag": "38cadc99-611d-41be-9f9a-ea53b422bd56"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:05.059581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-14ce80f9-b02e-4094-a562-39fa1bc8f2d5 req-e234d617-d732-4e24-8113-4d8cb883ff11 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.060490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-14ce80f9-b02e-4094-a562-39fa1bc8f2d5 req-e234d617-d732-4e24-8113-4d8cb883ff11 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.061233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-14ce80f9-b02e-4094-a562-39fa1bc8f2d5 req-e234d617-d732-4e24-8113-4d8cb883ff11 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.075292 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-14ce80f9-b02e-4094-a562-39fa1bc8f2d5 req-e234d617-d732-4e24-8113-4d8cb883ff11 service nova] Creating event network-changed:38cadc99-611d-41be-9f9a-ea53b422bd56 for instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 on n-h1-master-1 Sep 25 01:17:05.082936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-14ce80f9-b02e-4094-a562-39fa1bc8f2d5 req-e234d617-d732-4e24-8113-4d8cb883ff11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050613 Sep 25 01:17:05.084642 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1571/3162] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:05.092219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4bb91f16-db09-4b37-8f02-ed99ec420744 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:05.110070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.server_groups [None req-4bb91f16-db09-4b37-8f02-ed99ec420744 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Querying cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) for 1 instances {{(pid=122384) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 25 01:17:05.111140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bb91f16-db09-4b37-8f02-ed99ec420744 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.111864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bb91f16-db09-4b37-8f02-ed99ec420744 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.112530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bb91f16-db09-4b37-8f02-ed99ec420744 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.141767 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4bb91f16-db09-4b37-8f02-ed99ec420744 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/e130116f-7b18-40f9-90e8-40d7ebc67657" status: 200 len: 221 microversion: 2.1 time: 0.055236 Sep 25 01:17:05.143101 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1572/3163] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:17:05 2022] GET /compute/v2.1/os-server-groups/e130116f-7b18-40f9-90e8-40d7ebc67657 => generated 221 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:05.156084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:05.162390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:05.193710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.194468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.195073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.196761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.202117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.203502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.356505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:05.366474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e84674b8-2e2a-4818-9e17-61fe0980cbc9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 0.434447 Sep 25 01:17:05.402995 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1592/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:04 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:05.408248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:05.408864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:05.432773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.434371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.436768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.437773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.440533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.441256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.520126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:05.534731 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab513199-6875-4e79-80f2-7bc12d87cbc8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.389491 Sep 25 01:17:05.538739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1573/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:05 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:05.558016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:05.558808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:05.565437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.566313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.567009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.567949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.568686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.569370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.676404 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba2fe39a-cc38-4071-a018-a122b5fd5070 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b/action" status: 202 len: 0 microversion: 2.1 time: 0.135484 Sep 25 01:17:05.682162 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1574/3166] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:05 2022] POST /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:17:05.689567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:05.697582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:05.706429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.707191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.707935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.708990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:05.709793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:05.710458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:05.760681 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:17:05.932190 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a7d47a5-9cf0-40aa-a7e2-183e9a87002e tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 204 len: 0 microversion: 2.1 time: 0.247848 Sep 25 01:17:05.938595 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1575/3167] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:17:05 2022] DELETE /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:05.947624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:05.976678 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f4493bf-cb2f-4ebe-9556-6e4783081ce6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.572387 Sep 25 01:17:05.977491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:05.978341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:05.993157 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1593/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:05 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:06.004670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:06.010307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.010817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.013486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:06.018228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.018980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.019731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.020208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.034565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.036435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.037007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.038172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.041355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.043831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.100542 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:06.433003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:06.446363 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-821cbec6-035f-4196-b16d-4e983324f25c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1502 microversion: 2.1 time: 0.451290 Sep 25 01:17:06.465461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1594/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:05 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1502 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:06.471766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:06.472386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:06.479644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:06.490535 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c88eca5-5417-4ed5-80c6-2a485ec75fdf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1508 microversion: 2.1 time: 0.548939 Sep 25 01:17:06.492618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.493979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.495098 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1576/3170] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:05 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1508 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:06.496970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.497905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.500904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.501577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.510424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfe85b2-f8b0-4ca5-bcf3-366be0043c20", "tag": "df3720ac-47e5-406e-b3e4-09f6b04513eb"}, {"name": "network-changed", "server_uuid": "b56a9ef5-540c-46e3-8f3f-6c092da3ee26", "tag": "01ff6228-d87c-49ad-a372-e13256a5a5e6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:06.552748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.553339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.553944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.585378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] Creating event network-changed:df3720ac-47e5-406e-b3e4-09f6b04513eb for instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 on n-h2-master-1 Sep 25 01:17:06.587651 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] Creating event network-changed:01ff6228-d87c-49ad-a372-e13256a5a5e6 for instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 on n-h2-master-1 Sep 25 01:17:06.608299 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b195804c-8b44-40c8-b45b-0ffc70a7966a req-a774dcce-92a9-4d52-9f0b-4d8eba485b1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111330 Sep 25 01:17:06.608935 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1577/3171] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:06.624986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:06.625793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:06.643001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.647044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.656356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:06.657476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:06.658156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:06.658766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.422714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:07.437035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:07.443254 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a0b309a7-4019-49f4-ba78-daf6b07af776 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 0.832339 Sep 25 01:17:07.448096 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1578/3172] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:06 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:07.450207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b222ae1-93d8-4d28-8dc4-3884ea4b4d74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.982022 Sep 25 01:17:07.456478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:07.458503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:07.467413 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1595/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:06 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:07.468250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.469003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.469892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.472910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.473640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.473779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f99731ef-3ec0-4238-8e0b-3189fa66b8a3 req-a8da09ef-6a5a-4319-b770-dcf5a476f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "name": "network-vif-plugged", "status": "completed", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:07.475323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.485798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f99731ef-3ec0-4238-8e0b-3189fa66b8a3 req-a8da09ef-6a5a-4319-b770-dcf5a476f625 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.486586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f99731ef-3ec0-4238-8e0b-3189fa66b8a3 req-a8da09ef-6a5a-4319-b770-dcf5a476f625 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.487111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f99731ef-3ec0-4238-8e0b-3189fa66b8a3 req-a8da09ef-6a5a-4319-b770-dcf5a476f625 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.514695 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f99731ef-3ec0-4238-8e0b-3189fa66b8a3 req-a8da09ef-6a5a-4319-b770-dcf5a476f625 service nova] Creating event network-vif-plugged:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h1-master-1 Sep 25 01:17:07.525495 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f99731ef-3ec0-4238-8e0b-3189fa66b8a3 req-a8da09ef-6a5a-4319-b770-dcf5a476f625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056426 Sep 25 01:17:07.526823 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1596/3174] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:07.534145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:07.535292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:07.542625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.543366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.544077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.545025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.545791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.546421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.813875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:07.833971 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-35016c49-977d-46ea-bfec-ec379f1e66e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.382350 Sep 25 01:17:07.835996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1579/3175] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:07 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:07.855068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:07.862683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:07.867106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:07.873023 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aad50d99-0c51-4f62-8fb2-be78247bbbac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.344798 Sep 25 01:17:07.874409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1597/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:07 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:07.875599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.876102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.876546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.877471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.877734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.878162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.882807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:07.884208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:07.895921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.898127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.899210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:07.900294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:07.900895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:07.902393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.115313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:08.124288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad932929-c8f2-400f-9f04-6b8a77a87cf3 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1502 microversion: 2.1 time: 0.284215 Sep 25 01:17:08.137676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:08.138235 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1580/3177] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:07 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:08.141353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1c022c3-84f6-451b-ba5d-446e9b96c035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1488 microversion: 2.1 time: 0.264981 Sep 25 01:17:08.155158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1598/3178] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:07 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1488 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:08.166132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:08.166673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:08.174097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.175213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.175941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.176763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.177304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.177853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.215974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:17:08.336538 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-44cbffcb-f262-41fe-a72b-21dae6aec1d8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 204 len: 0 microversion: 2.1 time: 0.175340 Sep 25 01:17:08.348175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:08.349125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:08.353122 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1581/3179] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:17:08 2022] DELETE /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:08.357607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.358413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.359072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.360977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.362100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.363063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.474206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:08.475168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:08.484396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.485105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.485745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.486644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.487762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.488692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.712663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:08.722010 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c647e9f5-44c6-4357-8291-91194e31ff0d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1494 microversion: 2.1 time: 0.378771 Sep 25 01:17:08.722597 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1599/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:08 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1494 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:08.751093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:08.751985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:08.759423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.760254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.760862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.761767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.762392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.763090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.851386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:08.859261 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:08.868189 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc5da6b3-cc3a-43c5-8a6c-cbb8bee0d88e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 0.400414 Sep 25 01:17:08.870130 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1582/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:08 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:08.886676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:08.890579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:08.913046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.913532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.913968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:08.915225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:08.916479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:08.916919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.073031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:09.091389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd530032-7ab5-40ec-9870-009a8fb33e8e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.351235 Sep 25 01:17:09.093316 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1600/3182] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:08 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:09.101767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:09.103198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:09.111438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.112250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.112717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.113459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.114108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.114547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.218993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:09.227839 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-621c6986-29f7-48df-8abb-04b9c25b7dd8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.356568 Sep 25 01:17:09.241735 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1583/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:08 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:09.250188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:09.251079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:09.259257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.259989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.260612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.261650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.262290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.262896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.413196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:09.424177 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-661d9e3d-72ff-456b-833a-6c8fed5442d6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.327320 Sep 25 01:17:09.426765 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1601/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:09 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:09.531812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:09.541169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b931073e-1e42-41ce-8a0a-0558bf2866f2 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1502 microversion: 2.1 time: 0.297887 Sep 25 01:17:09.542121 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1584/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:09 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:09.751565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:09.752225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:09.762172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.762898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.763464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.764370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.765000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.765879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.831424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0eb46670-1e1b-4759-8304-c8c7b482b7ac req-fcd3186c-bd52-4a47-908a-772c37924935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0692ab-2627-474a-9bfc-41d182e863e7", "tag": "5b548a6c-ba24-4033-9fa3-c898c507829a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:09.848179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0eb46670-1e1b-4759-8304-c8c7b482b7ac req-fcd3186c-bd52-4a47-908a-772c37924935 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.857889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0eb46670-1e1b-4759-8304-c8c7b482b7ac req-fcd3186c-bd52-4a47-908a-772c37924935 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.858368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0eb46670-1e1b-4759-8304-c8c7b482b7ac req-fcd3186c-bd52-4a47-908a-772c37924935 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.881533 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0eb46670-1e1b-4759-8304-c8c7b482b7ac req-fcd3186c-bd52-4a47-908a-772c37924935 service nova] Creating event network-changed:5b548a6c-ba24-4033-9fa3-c898c507829a for instance 0f0692ab-2627-474a-9bfc-41d182e863e7 on n-h1-master-1 Sep 25 01:17:09.891418 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0eb46670-1e1b-4759-8304-c8c7b482b7ac req-fcd3186c-bd52-4a47-908a-772c37924935 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346592 Sep 25 01:17:09.892846 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1602/3186] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:09.902982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:09.904021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:09.915350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.915862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.916312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:09.917036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:09.917545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:09.917981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:10.379026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:10.388336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f5a696b-c84e-480b-b6cf-83494298b82c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1494 microversion: 2.1 time: 0.641130 Sep 25 01:17:10.391341 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1585/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:09 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1494 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:10.404132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:10.410112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:10.422977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:10.423827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:10.424477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:10.425376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:10.426029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:10.426633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:10.793985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:10.804253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7404118b-eb28-48ba-a1b0-1e312e79fc87 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1312 microversion: 2.1 time: 0.909379 Sep 25 01:17:10.812102 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1603/3188] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:09 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1312 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:10.821532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:10.822553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:10.841383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:10.842069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:10.842523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:10.846598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:10.847085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:10.847720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:10.921554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:10.933675 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1b303fdc-0df4-4aeb-9d8d-e0fc283ebdc8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.535766 Sep 25 01:17:10.934515 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1586/3189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:10 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:10.944315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:10.955508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:10.963127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:10.974182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:10.974958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:10.975949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:10.976853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:10.977653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:11.505230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:11.514780 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a656d67a-9816-4122-8f22-df88d61ab0d4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.577140 Sep 25 01:17:11.519423 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1587/3190] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:10 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:11.534497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:11.535398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:11.546991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:11.547874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:11.548551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:11.549520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:11.550253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:11.550912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:11.652269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:11.672995 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cacf51b5-1875-4e9d-84ec-bb15cd69397f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.859233 Sep 25 01:17:11.674631 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1604/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:10 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:11.686925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:11.687937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:11.696792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:11.697609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:11.698266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:11.699652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:11.700367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:11.701034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.423108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:12.440924 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6558a82-896b-41d0-9e7f-4805e986c0fc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1494 microversion: 2.1 time: 0.764332 Sep 25 01:17:12.441947 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1605/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:11 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1494 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:12.450683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:12.452058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:12.461312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.462551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.463221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.464345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.464818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.465258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.530894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:12.537317 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c13de06-ceeb-48df-a0c7-3159a60f60dd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1502 microversion: 2.1 time: 1.015640 Sep 25 01:17:12.538929 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1588/3193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:11 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1502 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:12.549574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:12.550291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:12.557150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.557689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.558835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.559651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.560290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.699894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:12.711984 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24f619af-c98b-488e-b8c9-9e5351c48666 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1461 microversion: 2.1 time: 0.268677 Sep 25 01:17:12.712828 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1606/3194] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:12 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1461 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:12.730866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:12.731754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:12.735444 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:12.747041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.747774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.748227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.748940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.752812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.753274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.896777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:12.910390 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f45ad26b-b8f5-4b70-b25f-7af6603c9fc9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.369726 Sep 25 01:17:12.913468 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1589/3195] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:12 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:12.925553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:12.926538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:12.945144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.947792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.948252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:12.948996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:12.953049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:12.956558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.116204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:13.127202 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2a4b16f-0b04-4c10-b736-6842ba8030e9 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.413026 Sep 25 01:17:13.134254 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1607/3196] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:12 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:13.142511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:13.143775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:13.159343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.159853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.160393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.161119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.161613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.162053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.257124 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:13.284238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:13.297944 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6aba16a3-5e88-40aa-bc9d-1c0a1b14507d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.374805 Sep 25 01:17:13.298647 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=18 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:13.327759 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1590/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:12 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:13.338357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e1b7c630-aac3-4944-84a6-a4f1cb3d6f74 req-9ad725c1-ca81-46fc-b193-ee18c38ace49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de5d07f-1a7b-4152-bebd-455f9a0af262", "name": "network-vif-plugged", "status": "completed", "tag": "fa5a309e-610e-482f-885b-9ad08b48e85c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:13.369618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e1b7c630-aac3-4944-84a6-a4f1cb3d6f74 req-9ad725c1-ca81-46fc-b193-ee18c38ace49 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.370133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e1b7c630-aac3-4944-84a6-a4f1cb3d6f74 req-9ad725c1-ca81-46fc-b193-ee18c38ace49 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.370601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e1b7c630-aac3-4944-84a6-a4f1cb3d6f74 req-9ad725c1-ca81-46fc-b193-ee18c38ace49 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.412797 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e1b7c630-aac3-4944-84a6-a4f1cb3d6f74 req-9ad725c1-ca81-46fc-b193-ee18c38ace49 service nova] Creating event network-vif-plugged:fa5a309e-610e-482f-885b-9ad08b48e85c for instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 on n-h2-master-1 Sep 25 01:17:13.449366 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e1b7c630-aac3-4944-84a6-a4f1cb3d6f74 req-9ad725c1-ca81-46fc-b193-ee18c38ace49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120194 Sep 25 01:17:13.455986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1591/3198] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:13.485454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7359db96-b0e9-4508-a39b-1b1ccfc4fc43 req-f87a10bf-10ff-4d7a-a193-0ac8114ea283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96323d84-4a94-4824-912f-1e2db48a80a8", "name": "network-vif-deleted", "tag": "e8206b89-85a1-45e9-9b85-2e25f282d23a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:13.487284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1e68801-dc59-41e9-b3ab-58cff0623aed tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1612 microversion: 2.1 time: 0.351676 Sep 25 01:17:13.487869 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1608/3199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:13 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1612 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:13.505558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:13.506503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:13.509256 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:13.514328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.517848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.522041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.523054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.524551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.524775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7359db96-b0e9-4508-a39b-1b1ccfc4fc43 req-f87a10bf-10ff-4d7a-a193-0ac8114ea283 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.525554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.528418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7359db96-b0e9-4508-a39b-1b1ccfc4fc43 req-f87a10bf-10ff-4d7a-a193-0ac8114ea283 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.531600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7359db96-b0e9-4508-a39b-1b1ccfc4fc43 req-f87a10bf-10ff-4d7a-a193-0ac8114ea283 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.582043 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7359db96-b0e9-4508-a39b-1b1ccfc4fc43 req-f87a10bf-10ff-4d7a-a193-0ac8114ea283 service nova] Creating event network-vif-deleted:e8206b89-85a1-45e9-9b85-2e25f282d23a for instance 96323d84-4a94-4824-912f-1e2db48a80a8 on n-h2-master-1 Sep 25 01:17:13.595492 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7359db96-b0e9-4508-a39b-1b1ccfc4fc43 req-f87a10bf-10ff-4d7a-a193-0ac8114ea283 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132601 Sep 25 01:17:13.596524 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1592/3200] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:13.619246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:13.624349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:13.640678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.645147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.646152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.648885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.651345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.652885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.684857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:13.692959 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b2547c0-2017-403d-95f5-e5e7cb826b6e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1285 microversion: 2.1 time: 0.202341 Sep 25 01:17:13.712430 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1609/3201] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:13 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:13.717747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:13.718725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:13.739505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '231418d4fb2246adb38aaeefb031655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7569ed03c4fc4fd5a6e987cf82ea14fb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:13.740897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] flavor_id is None. Assuming migration. {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 25 01:17:13.741577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.742319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.743754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:17:13.744433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.745380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:13.752457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:13.753098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:13.950751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:13.959936 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9431891-a395-4e75-beed-cb6527bb3d8c tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1460 microversion: 2.1 time: 0.246156 Sep 25 01:17:13.960536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1610/3202] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:13 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1460 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:13.972491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:13.974665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:13.998495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:14.000387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:14.001031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:14.002117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:14.002772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:14.003398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:14.199341 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a3f2f34-713e-4ad2-b227-29e2cbd50308 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc/action" status: 202 len: 0 microversion: 2.1 time: 0.598067 Sep 25 01:17:14.199975 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1593/3203] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:13 2022] POST /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:17:14.217149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:14.218390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:14.238421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:14.239169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:14.240025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:14.241187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:14.241854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:14.242516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:14.769387 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:14.780294 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-79ab8fac-cd07-40e5-9b9b-596dd257bd1e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.817027 Sep 25 01:17:14.786302 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1611/3204] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:13 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:14.794120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:14.796499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:14.808474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:14.809206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:14.809994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:14.811494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:14.813666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:14.815578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:14.875021 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:14.989803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:15.008549 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-572e24d1-e66e-48a4-ae3a-c55b304a5055 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.802399 Sep 25 01:17:15.009963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1594/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:14 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:15.034388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:15.036034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:15.053343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.056108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.056915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.060499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.061252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.062003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.109159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:15.120982 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12f1273f-7256-4996-ba61-574b819633ee tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1470 microversion: 2.1 time: 0.332253 Sep 25 01:17:15.123425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1612/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:14 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:15.130144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:15.131051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:15.145815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.146711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.147361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.149351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.150643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.151110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.231128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.231935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.232559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.235595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lazy-loading 'fault' on Instance uuid 4031dcfb-fe82-40d3-a41b-59059dc32b7b {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:17:15.347258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:15.370970 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a27d575-5c4b-4d48-9593-6ab24a184c3e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 200 len: 1305 microversion: 2.1 time: 0.246028 Sep 25 01:17:15.371574 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1613/3207] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:15 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 1305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:15.405286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:15.407256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:15.407884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:15.426405 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55fb8604-0e23-4de8-8a50-394cfe8fc5a5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.403441 Sep 25 01:17:15.431846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.432780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.433523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.434497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.435266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.435921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.439602 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1595/3208] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:15 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:15.481167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.482060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.482754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.483564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lazy-loading 'fault' on Instance uuid 96323d84-4a94-4824-912f-1e2db48a80a8 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:17:15.542916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996dbc72936a46fda11429f9f8438100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512a9166d806477ab93d8eed468bab93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:15.554673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49e5adc3-257f-4327-a12e-0752550a4b6a tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 200 len: 1302 microversion: 2.1 time: 0.151260 Sep 25 01:17:15.557478 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1614/3209] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:15 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 1302 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:15.797616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1ebe303c-2113-4ba8-bebe-2ab569ea1a41 req-d2e4e5cd-f5a1-4e4f-bb84-d78893ca8064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b280d42-10ba-4ddb-9c3f-f0d3009c1d66", "name": "network-vif-plugged", "status": "completed", "tag": "38cadc99-611d-41be-9f9a-ea53b422bd56"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:15.810694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:15.814983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:15.836678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.837204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.837654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.838380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.848558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1ebe303c-2113-4ba8-bebe-2ab569ea1a41 req-d2e4e5cd-f5a1-4e4f-bb84-d78893ca8064 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:15.849124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.849648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.851252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1ebe303c-2113-4ba8-bebe-2ab569ea1a41 req-d2e4e5cd-f5a1-4e4f-bb84-d78893ca8064 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:15.852558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1ebe303c-2113-4ba8-bebe-2ab569ea1a41 req-d2e4e5cd-f5a1-4e4f-bb84-d78893ca8064 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:15.905824 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1ebe303c-2113-4ba8-bebe-2ab569ea1a41 req-d2e4e5cd-f5a1-4e4f-bb84-d78893ca8064 service nova] Creating event network-vif-plugged:38cadc99-611d-41be-9f9a-ea53b422bd56 for instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 on n-h1-master-1 Sep 25 01:17:15.937707 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1ebe303c-2113-4ba8-bebe-2ab569ea1a41 req-d2e4e5cd-f5a1-4e4f-bb84-d78893ca8064 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130546 Sep 25 01:17:15.941161 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1596/3210] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:16.044920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:16.046429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:16.065706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.066980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.068053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.070635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.072849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.073306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.714011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:16.726102 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b254d735-9269-4419-b41b-90e5fc4529bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.918509 Sep 25 01:17:16.729536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1615/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:15 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:16.742011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:16.743567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:16.757392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.761987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.762826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.763936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.767620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.768556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.786816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:16.798749 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c36a9448-3170-4255-be88-4b0bbc2e93ac tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.758118 Sep 25 01:17:16.807188 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1597/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:16 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:16.812831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1bb71a0a-0592-4218-aeda-edd37aa93c46 req-83aac7f0-3b9f-450e-a3eb-96d1609fe375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4031dcfb-fe82-40d3-a41b-59059dc32b7b", "name": "network-vif-deleted", "tag": "b5c69285-0e3d-477e-a3f3-e7ff3f0b323e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:16.839918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1bb71a0a-0592-4218-aeda-edd37aa93c46 req-83aac7f0-3b9f-450e-a3eb-96d1609fe375 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.841787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1bb71a0a-0592-4218-aeda-edd37aa93c46 req-83aac7f0-3b9f-450e-a3eb-96d1609fe375 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.845648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1bb71a0a-0592-4218-aeda-edd37aa93c46 req-83aac7f0-3b9f-450e-a3eb-96d1609fe375 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.883564 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1bb71a0a-0592-4218-aeda-edd37aa93c46 req-83aac7f0-3b9f-450e-a3eb-96d1609fe375 service nova] Creating event network-vif-deleted:b5c69285-0e3d-477e-a3f3-e7ff3f0b323e for instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b on n-h1-master-1 Sep 25 01:17:16.901974 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1bb71a0a-0592-4218-aeda-edd37aa93c46 req-83aac7f0-3b9f-450e-a3eb-96d1609fe375 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092854 Sep 25 01:17:16.904426 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1598/3213] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:16.921228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:16.924498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:16.941364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.941896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.942342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.944891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:16.949348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:16.952315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:16.984775 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b HTTP/1.1 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4031dcfb-fe82-40d3-a41b-59059dc32b7b'} Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:16.999589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:17:17.005461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.010299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:17.013089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d21c7333-51e1-4064-a7aa-c1b97aced8da tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 404 len: 111 microversion: 2.1 time: 0.104520 Sep 25 01:17:17.015244 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1599/3214] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:16 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:17.036860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:17.037780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:17.052415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:17.053825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:17.055141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:17.056437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:17.057247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:17.058257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:17.579260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:17.598952 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e16aa4d7-4d0c-4767-9be0-517d377f3e55 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1470 microversion: 2.1 time: 0.868007 Sep 25 01:17:17.613486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1616/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:16 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1470 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:17.616867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:17.617083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:17.639325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:17.661205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:17.662616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:17.672189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:17.673317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:17.673904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:17.727891 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 HTTP/1.1 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '96323d84-4a94-4824-912f-1e2db48a80a8'} Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:17.729887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fb30abd-bec0-4a8f-90d9-3515f0ff4a22 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 404 len: 111 microversion: 2.1 time: 0.122491 Sep 25 01:17:17.740946 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1617/3216] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:17 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:17.753726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1120444555", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:17.832233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:17:17.922003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:17.931344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ed4df8b-5ea8-4b90-974f-c879406326e1 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.914328 Sep 25 01:17:17.932226 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1600/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:17 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:17.937019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-827b2cae-04a4-4a2b-910c-21e2df0500cb tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:17.985384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.server_groups [None req-827b2cae-04a4-4a2b-910c-21e2df0500cb tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Querying cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) for 1 instances {{(pid=122384) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 25 01:17:17.986531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827b2cae-04a4-4a2b-910c-21e2df0500cb tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:17.987250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827b2cae-04a4-4a2b-910c-21e2df0500cb tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:17.987957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-827b2cae-04a4-4a2b-910c-21e2df0500cb tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:17.998816 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:18.001447 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-827b2cae-04a4-4a2b-910c-21e2df0500cb tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.068033 Sep 25 01:17:18.002520 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1601/3218] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:17:17 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:18.015852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:18.016755 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:18.033275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:18.033798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:18.034241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:18.034944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:18.039101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:18.040040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:18.492698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:18.509759 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c021f792-b30f-44cf-ae08-d0adf621f5f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.505599 Sep 25 01:17:18.514175 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1602/3219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:18 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:18.520389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:18.521041 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:18.529583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:18.530415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:18.531019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:18.531898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:18.532559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:18.533229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:18.865140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:18.873665 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2c1f1a5-f58d-4286-aef9-3168e05b9739 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.358119 Sep 25 01:17:18.874254 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1603/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:18 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:18.896310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-209474de-5784-47bf-8421-2b697c02168c req-2036fcb2-f88f-4627-bd96-1ba695ca22f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfe85b2-f8b0-4ca5-bcf3-366be0043c20", "name": "network-vif-plugged", "status": "completed", "tag": "df3720ac-47e5-406e-b3e4-09f6b04513eb"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:18.912165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-209474de-5784-47bf-8421-2b697c02168c req-2036fcb2-f88f-4627-bd96-1ba695ca22f5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:18.913144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-209474de-5784-47bf-8421-2b697c02168c req-2036fcb2-f88f-4627-bd96-1ba695ca22f5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:18.913618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-209474de-5784-47bf-8421-2b697c02168c req-2036fcb2-f88f-4627-bd96-1ba695ca22f5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:18.928365 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-209474de-5784-47bf-8421-2b697c02168c req-2036fcb2-f88f-4627-bd96-1ba695ca22f5 service nova] Creating event network-vif-plugged:df3720ac-47e5-406e-b3e4-09f6b04513eb for instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 on n-h2-master-1 Sep 25 01:17:18.933557 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-209474de-5784-47bf-8421-2b697c02168c req-2036fcb2-f88f-4627-bd96-1ba695ca22f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057741 Sep 25 01:17:18.934394 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1604/3221] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:18.939660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a01cac0-7938-4ef7-a5e3-f6df5fcca1ef tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:18.955390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.server_groups [None req-4a01cac0-7938-4ef7-a5e3-f6df5fcca1ef tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Querying cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) for 1 instances {{(pid=122384) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 25 01:17:18.956115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a01cac0-7938-4ef7-a5e3-f6df5fcca1ef tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:18.956594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a01cac0-7938-4ef7-a5e3-f6df5fcca1ef tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:18.957350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a01cac0-7938-4ef7-a5e3-f6df5fcca1ef tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:18.971046 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a01cac0-7938-4ef7-a5e3-f6df5fcca1ef tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/e130116f-7b18-40f9-90e8-40d7ebc67657" status: 200 len: 183 microversion: 2.1 time: 0.035427 Sep 25 01:17:18.978020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1605/3222] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:17:18 2022] GET /compute/v2.1/os-server-groups/e130116f-7b18-40f9-90e8-40d7ebc67657 => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:18.978020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:18.978020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.004205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.004635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.005704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.012165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.013018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.013659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.015420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:17:19.019764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:17:19.020454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:17:19.021494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:17:19.022037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:17:19.040207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.041065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.042381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.048439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.048931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.049696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.079420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:17:19.090349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:17:19.113318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:17:19.116507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:17:19.178330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ebb71ad-31db-4228-9384-5871d25c3981 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441346 Sep 25 01:17:19.180028 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1618/3223] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:17:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:17:19.186470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.187381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.196710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.197874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.198485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.199580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.201188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.201859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.576802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:19.594956 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d3b33ff-fd58-44c8-9180-ba155cfd2b52 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.621790 Sep 25 01:17:19.610634 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1606/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:18 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:19.618115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.618880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.630000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.630734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.631360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.632375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.633704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.634316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.656377 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 HTTP/1.1 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '96323d84-4a94-4824-912f-1e2db48a80a8'} Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:17:19.660388 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.665824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.673620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:19.676295 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-337dc4e2-6c5a-40b8-9faa-79dee968bfbd tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 404 len: 111 microversion: 2.1 time: 0.064360 Sep 25 01:17:19.679108 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1607/3225] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:17:19 2022] DELETE /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:19.684943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e4dbe09-6259-4aac-ad8a-1fd1298c1815 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.698796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e4dbe09-6259-4aac-ad8a-1fd1298c1815 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.755050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:19.765388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b7cc5c8-609f-4e27-a79d-79d3f7b7ab0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.584075 Sep 25 01:17:19.780353 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1619/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:19 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:19.786884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e4dbe09-6259-4aac-ad8a-1fd1298c1815 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:19.787375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.796015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.798218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e4dbe09-6259-4aac-ad8a-1fd1298c1815 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1215 microversion: 2.1 time: 0.115547 Sep 25 01:17:19.799474 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1608/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:19 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:19.804228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.807226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] [instance: 96323d84-4a94-4824-912f-1e2db48a80a8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.807788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.808293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.808744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.809844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.810006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.810380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.829965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.830910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.831546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.833871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.835514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.838714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.865321 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 HTTP/1.1 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '96323d84-4a94-4824-912f-1e2db48a80a8'} Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:19.867582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.873250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance 96323d84-4a94-4824-912f-1e2db48a80a8 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:19.877717 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-feb8cc22-6de3-4945-afa6-a06027f29e77 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8" status: 404 len: 111 microversion: 2.1 time: 0.068568 Sep 25 01:17:19.878558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1609/3228] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:19 2022] GET /compute/v2.1/servers/96323d84-4a94-4824-912f-1e2db48a80a8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:19.888865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5808fb98-5671-4821-bdaf-a14842fe1fee tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.918756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5808fb98-5671-4821-bdaf-a14842fe1fee tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance group 0bacff36-c86b-4f94-b54f-42e2efb5a729 could not be found. Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5808fb98-5671-4821-bdaf-a14842fe1fee tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-server-groups/0bacff36-c86b-4f94-b54f-42e2efb5a729 HTTP/1.1 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: exception: Instance group 0bacff36-c86b-4f94-b54f-42e2efb5a729 could not be found. Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '0bacff36-c86b-4f94-b54f-42e2efb5a729'} Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0bacff36-c86b-4f94-b54f-42e2efb5a729 could not be found. Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0bacff36-c86b-4f94-b54f-42e2efb5a729 could not be found. Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.935295 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0bacff36-c86b-4f94-b54f-42e2efb5a729 could not be found. Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5808fb98-5671-4821-bdaf-a14842fe1fee tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance group 0bacff36-c86b-4f94-b54f-42e2efb5a729 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5808fb98-5671-4821-bdaf-a14842fe1fee tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/0bacff36-c86b-4f94-b54f-42e2efb5a729" status: 404 len: 117 microversion: 2.1 time: 0.055953 Sep 25 01:17:19.941116 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1610/3229] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:17:19 2022] DELETE /compute/v2.1/os-server-groups/0bacff36-c86b-4f94-b54f-42e2efb5a729 => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:17:19.944430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:19.945099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:19.960115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.960636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.961108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:19.961883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:19.962343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:19.962775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:20.089260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:20.120320 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0dfa06c4-54b3-41c1-be2b-bb0b429a3fe7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.338455 Sep 25 01:17:20.136100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1620/3230] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:19 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:20.141934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8da32fc-8e6f-4617-801a-75ce400d8214 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:20.168443 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d8da32fc-8e6f-4617-801a-75ce400d8214 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance group 5c8b1679-f36b-4e3c-b7be-c61877b38a29 could not be found. Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8da32fc-8e6f-4617-801a-75ce400d8214 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-server-groups/5c8b1679-f36b-4e3c-b7be-c61877b38a29 HTTP/1.1 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: exception: Instance group 5c8b1679-f36b-4e3c-b7be-c61877b38a29 could not be found. Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5c8b1679-f36b-4e3c-b7be-c61877b38a29'} Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5c8b1679-f36b-4e3c-b7be-c61877b38a29 could not be found. Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5c8b1679-f36b-4e3c-b7be-c61877b38a29 could not be found. Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.170911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.176073 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:20.176073 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:20.176073 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:20.176073 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:20.176073 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5c8b1679-f36b-4e3c-b7be-c61877b38a29 could not be found. Sep 25 01:17:20.176073 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.177872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8da32fc-8e6f-4617-801a-75ce400d8214 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance group 5c8b1679-f36b-4e3c-b7be-c61877b38a29 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:20.178911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8da32fc-8e6f-4617-801a-75ce400d8214 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5c8b1679-f36b-4e3c-b7be-c61877b38a29" status: 404 len: 117 microversion: 2.1 time: 0.041364 Sep 25 01:17:20.182707 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1621/3231] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:17:20 2022] DELETE /compute/v2.1/os-server-groups/5c8b1679-f36b-4e3c-b7be-c61877b38a29 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:20.189809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:20.195183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee534d4c-8b99-44d7-a1bd-d681a15bf586 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:20.199959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff8f68df-092b-472f-a98b-a755e6a0800b tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1366 microversion: 2.1 time: 0.258377 Sep 25 01:17:20.201003 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1611/3232] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:19 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:20.212654 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ee534d4c-8b99-44d7-a1bd-d681a15bf586 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance group f0172244-6f51-4c8d-974a-3832384ce33e could not be found. Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee534d4c-8b99-44d7-a1bd-d681a15bf586 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-server-groups/f0172244-6f51-4c8d-974a-3832384ce33e HTTP/1.1 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: exception: Instance group f0172244-6f51-4c8d-974a-3832384ce33e could not be found. Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f0172244-6f51-4c8d-974a-3832384ce33e'} Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f0172244-6f51-4c8d-974a-3832384ce33e could not be found. Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f0172244-6f51-4c8d-974a-3832384ce33e could not be found. Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.214538 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.219640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:20.219640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:20.219640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:20.219640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:20.219640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f0172244-6f51-4c8d-974a-3832384ce33e could not be found. Sep 25 01:17:20.219640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.221734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee534d4c-8b99-44d7-a1bd-d681a15bf586 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance group f0172244-6f51-4c8d-974a-3832384ce33e could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:20.222801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ee534d4c-8b99-44d7-a1bd-d681a15bf586 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/f0172244-6f51-4c8d-974a-3832384ce33e" status: 404 len: 117 microversion: 2.1 time: 0.034804 Sep 25 01:17:20.223380 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1622/3233] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:17:20 2022] DELETE /compute/v2.1/os-server-groups/f0172244-6f51-4c8d-974a-3832384ce33e => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:20.232559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-884e11cc-d65e-473d-888c-ec8ebcd7bc93 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:20.241702 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-884e11cc-d65e-473d-888c-ec8ebcd7bc93 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] HTTP exception thrown: Instance group e60f04b3-e20b-432d-a6b5-3c487c885afb could not be found. Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-884e11cc-d65e-473d-888c-ec8ebcd7bc93 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Request method failure captured: Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-server-groups/e60f04b3-e20b-432d-a6b5-3c487c885afb HTTP/1.1 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6vq7zTXBd2I-8xN72_md-OwJWuqEnzy_VgiuopZA28Qqjl_RYLGrw8JxX44FXJ5-hcaiQKnY9RE4VIzyt1R623jVADa5Kn15cRWMecnS631nn6cnBFaXkayBlnXEHJZ-9wBxzfRmPJxfbGMMhqJot_KJWI3UuMoykabXHHM8WLt3F8 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/512a9166d806477ab93d8eed468bab93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/512a9166d806477ab93d8eed468bab93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_512a9166d806477ab93d8eed468bab93"}]}] Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 512a9166d806477ab93d8eed468bab93 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerGroupTestJSON-1604187880 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 996dbc72936a46fda11429f9f8438100 Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerGroupTestJSON-1604187880-project Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: exception: Instance group e60f04b3-e20b-432d-a6b5-3c487c885afb could not be found. Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e60f04b3-e20b-432d-a6b5-3c487c885afb'} Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e60f04b3-e20b-432d-a6b5-3c487c885afb could not be found. Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e60f04b3-e20b-432d-a6b5-3c487c885afb could not be found. Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.243436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e60f04b3-e20b-432d-a6b5-3c487c885afb could not be found. Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:17:20.248647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-884e11cc-d65e-473d-888c-ec8ebcd7bc93 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Returning 404 to user: Instance group e60f04b3-e20b-432d-a6b5-3c487c885afb could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:20.249703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-884e11cc-d65e-473d-888c-ec8ebcd7bc93 tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e60f04b3-e20b-432d-a6b5-3c487c885afb" status: 404 len: 117 microversion: 2.1 time: 0.020995 Sep 25 01:17:20.250513 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1612/3234] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:17:20 2022] DELETE /compute/v2.1/os-server-groups/e60f04b3-e20b-432d-a6b5-3c487c885afb => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:20.259981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a2c1bb9-7ab6-46f6-9147-ede2d212ac6d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:20.295449 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a2c1bb9-7ab6-46f6-9147-ede2d212ac6d tempest-ServerGroupTestJSON-1604187880 tempest-ServerGroupTestJSON-1604187880-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e130116f-7b18-40f9-90e8-40d7ebc67657" status: 204 len: 0 microversion: 2.1 time: 0.040046 Sep 25 01:17:20.296747 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1623/3235] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 25 01:17:20 2022] DELETE /compute/v2.1/os-server-groups/e130116f-7b18-40f9-90e8-40d7ebc67657 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:20.627877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:20.628597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:20.654561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:20.656601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:20.657315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:20.658235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:20.659734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:20.660353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:20.794650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:20.795190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:20.806527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:20.806938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:20.807356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:20.813640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:20.814266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:20.814723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.485980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:21.494381 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d950841-b399-405d-9a10-c14b77e80f41 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.875189 Sep 25 01:17:21.494969 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1613/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:20 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:21.515132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:21.515786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:21.524198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.525019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.525720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.526748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.527478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.528214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.622073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:21.629335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:21.638072 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba9c1101-3109-40b8-905e-0924b3e692d0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.847290 Sep 25 01:17:21.638823 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1624/3237] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:20 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:21.649938 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e611fdc-1723-45a5-ae35-048ab1674dba tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1267 microversion: 2.1 time: 0.135574 Sep 25 01:17:21.649938 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1614/3238] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:21 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:21.664950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0692ab-2627-474a-9bfc-41d182e863e7", "name": "network-vif-plugged", "status": "completed", "tag": "5b548a6c-ba24-4033-9fa3-c898c507829a"}, {"server_uuid": "b56a9ef5-540c-46e3-8f3f-6c092da3ee26", "name": "network-vif-plugged", "status": "completed", "tag": "01ff6228-d87c-49ad-a372-e13256a5a5e6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:21.665223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:21.665844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:21.673434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.674056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.674549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.675615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.676554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.677289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.681465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.682174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.683442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.705851 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] Creating event network-vif-plugged:5b548a6c-ba24-4033-9fa3-c898c507829a for instance 0f0692ab-2627-474a-9bfc-41d182e863e7 on n-h1-master-1 Sep 25 01:17:21.706560 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] Creating event network-vif-plugged:01ff6228-d87c-49ad-a372-e13256a5a5e6 for instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 on n-h2-master-1 Sep 25 01:17:21.717196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ebf34510-47aa-40e5-92f3-2b03f34bcffd req-459099e0-87d7-47ca-82e9-13e90b039d6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071630 Sep 25 01:17:21.718480 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1615/3239] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:21.726548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:21.727561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:21.738707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.739375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.739913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:21.740734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:21.741492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:21.743923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.368660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:22.376424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e055599b-607c-4fb0-b069-a2497f64f4db tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1308 microversion: 2.1 time: 0.718140 Sep 25 01:17:22.377023 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1625/3240] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:21 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1308 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:22.414881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:22.426827 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8dbaae9b-b8cb-4829-b8cb-2f305b3b92ee tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1557 microversion: 2.1 time: 0.706952 Sep 25 01:17:22.427428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1616/3241] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:21 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1557 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:22.452993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:22.453530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:22.459827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:22.460752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:22.461382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.462540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:22.463179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:22.464033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.532190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:22.532765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:22.543273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:22.545263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:22.545920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.546887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:22.549631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:22.550396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.624290 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ab07a93-922c-4ff8-aa74-9bf6754fcd1c tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175213 Sep 25 01:17:22.625379 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1626/3242] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:17:22 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:22.664907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:22.665921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:22.672949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:22.674234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:22.674640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.675803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:22.676333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:22.676776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:22.988301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:22.998852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4d337e4-739a-421e-b08d-711cd56f632a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.473807 Sep 25 01:17:23.000356 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1617/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:22 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:23.017348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:23.018087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:23.027869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:23.028953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:23.029397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:23.030379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:23.030834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:23.031444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:23.071433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:23.081261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f162a88f-8a21-4088-89d4-65947b75d7be tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1321 microversion: 2.1 time: 0.423991 Sep 25 01:17:23.095479 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1627/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:22 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:23.122567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:23.134641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4025f66-ceee-4e2c-bb0d-eeb0e9fb8ff0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1273 microversion: 2.1 time: 0.132833 Sep 25 01:17:23.135537 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1618/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:23 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:23.402790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:23.403438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:23.422557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:23.423068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:23.423522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:23.424256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:23.424723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:23.425161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:23.970814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:23.980947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ec57155-8ebc-44a3-9ebe-1d83f63fee02 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1489 microversion: 2.1 time: 0.584192 Sep 25 01:17:23.989723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1628/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:23 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1489 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:24.023749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:24.037501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:24.038205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:24.040034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:24.061916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:24.062654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:24.063572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:24.067615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:24.068925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:24.070027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:24.071010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:24.071502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:24.071946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:24.073074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:24.073591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:24.074034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:24.231789 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fbf0bab8-2787-4a45-9d12-d0e51329f9e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7/action" status: 202 len: 0 microversion: 2.1 time: 0.220829 Sep 25 01:17:24.235166 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1619/3247] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:24 2022] POST /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:17:24.247845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:24.248760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:24.255724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:24.256445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:24.257082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:24.258516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:24.259153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:24.259752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:25.352861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:25.362246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1f9b4dd-ac5a-4d47-9ee6-429a72b30e15 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1512 microversion: 2.1 time: 1.125660 Sep 25 01:17:25.362912 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1620/3248] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:24 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1512 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:25.368286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:25.368901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:25.376733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:25.377592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:25.378826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:25.381218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:25.381737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:25.382170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:25.417538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:25.430126 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8a5175b4-8a23-48b1-9292-b6d7e9fabfd4 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 1.411005 Sep 25 01:17:25.433734 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1629/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:24 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:25.446105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:25.447844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:25.457319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:25.457904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:25.458449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:25.459296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:25.459852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:25.460283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.050539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:26.060131 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4919420e-ed79-4517-838a-085133811e6f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.695683 Sep 25 01:17:26.060782 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1621/3250] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:25 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:26.069184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0ff973d9-7327-41d1-8266-80e2d23ef586 req-411bce91-ec45-48fc-99db-d1d7e878ca89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddfe85b2-f8b0-4ca5-bcf3-366be0043c20", "tag": "df3720ac-47e5-406e-b3e4-09f6b04513eb"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:26.088788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0ff973d9-7327-41d1-8266-80e2d23ef586 req-411bce91-ec45-48fc-99db-d1d7e878ca89 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.089627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0ff973d9-7327-41d1-8266-80e2d23ef586 req-411bce91-ec45-48fc-99db-d1d7e878ca89 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.090385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0ff973d9-7327-41d1-8266-80e2d23ef586 req-411bce91-ec45-48fc-99db-d1d7e878ca89 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.105270 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0ff973d9-7327-41d1-8266-80e2d23ef586 req-411bce91-ec45-48fc-99db-d1d7e878ca89 service nova] Creating event network-changed:df3720ac-47e5-406e-b3e4-09f6b04513eb for instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 on n-h2-master-1 Sep 25 01:17:26.110886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0ff973d9-7327-41d1-8266-80e2d23ef586 req-411bce91-ec45-48fc-99db-d1d7e878ca89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048807 Sep 25 01:17:26.112386 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1622/3251] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:26.121289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:26.122561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:26.135381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.140744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.141588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.142576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.143362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.144060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.157747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:26.171026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-443bd6be-10bd-477e-87fe-ce19ae7ab2ac tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 200 len: 1474 microversion: 2.1 time: 0.735665 Sep 25 01:17:26.173279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1630/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:25 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 1474 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:26.212101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1032776958"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:26.235478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:26.255005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.255499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.255940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.256649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.257103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.258280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.590853 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:26.612475 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6455ef41-292d-4bdc-b3ef-8daca173a927 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7/action" status: 202 len: 0 microversion: 2.1 time: 0.406316 Sep 25 01:17:26.614066 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1631/3253] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:26 2022] POST /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:17:26.631336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:26.634343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:26.658000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.660484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.661877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.662541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:26.664045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.667970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.668682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.683956 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b63becd-12a5-415d-bb50-89ed5f573ea0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1511 microversion: 2.1 time: 0.569083 Sep 25 01:17:26.690695 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1623/3254] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:26 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1511 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:26.705187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b33f53e9-d7c4-468e-98ec-bbd64c480712 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf40dfd30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:26.810132 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b33f53e9-d7c4-468e-98ec-bbd64c480712 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.117532 Sep 25 01:17:26.811496 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1624/3255] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:26 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:26.816979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:26.818157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:26.828187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.829102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.829925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.830956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:26.831672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:26.832378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:26.852443 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:27.479531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:27.488053 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-981e6384-1828-44f4-a180-a21474edce5d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.872392 Sep 25 01:17:27.490244 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1632/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:26 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:27.495606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:27.496431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:27.503236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:27.503964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:27.504580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:27.505575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:27.506210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:27.506822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:27.631344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:27.640577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a34d28f-0aa9-49cb-bd51-877785b541d6 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 200 len: 1512 microversion: 2.1 time: 0.827713 Sep 25 01:17:27.641463 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1625/3257] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:26 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 1512 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:27.666735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:27.672072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:27.672978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:27.688359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:27.689360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:27.690049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:27.691021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:27.691679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:27.692352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:27.810823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:27.967365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:27.979861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:27.981031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:27.981686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:28.182243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:28.193634 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86c32f6a-eedb-4bd3-90f9-b0c6b92e1721 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.702053 Sep 25 01:17:28.194453 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1633/3258] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:27 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:28.199952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95aa002a-cf55-4b6c-b23f-6c6594c93a95 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebc11af0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:28.302703 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95aa002a-cf55-4b6c-b23f-6c6594c93a95 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.106628 Sep 25 01:17:28.303311 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1634/3259] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:28 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:28.516864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:28.518103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:28.527175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:28.527716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:28.528506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:28.529276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:28.530863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:28.531311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:28.919164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0bc5f758-c536-4fa5-a344-d8478243f977 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.256468 Sep 25 01:17:28.920376 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1626/3260] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:17:27 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:28.949745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:28.956506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:28.957862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1201500344', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:28.964134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:28.964749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:28.965288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:28.966426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:28.967265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:28.968151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:29.066638 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:29.109016 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:29.212855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:29.229840 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5284c329-bdaa-4d1b-828f-bb6c12072ea9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.720817 Sep 25 01:17:29.231174 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1635/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:28 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:29.235137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:29.250624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a5b29fa6-b819-4bfe-b858-054fec4aba1e req-8e569641-d27a-454c-a0a0-044b5e2e8aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d11c9f1-7562-45de-924d-f168ada2645a", "tag": "69da5ff9-8dae-4d3c-954c-3fa51f9e10cd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:29.268050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a5b29fa6-b819-4bfe-b858-054fec4aba1e req-8e569641-d27a-454c-a0a0-044b5e2e8aa1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:29.269869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a5b29fa6-b819-4bfe-b858-054fec4aba1e req-8e569641-d27a-454c-a0a0-044b5e2e8aa1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:29.271626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a5b29fa6-b819-4bfe-b858-054fec4aba1e req-8e569641-d27a-454c-a0a0-044b5e2e8aa1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:29.302774 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a5b29fa6-b819-4bfe-b858-054fec4aba1e req-8e569641-d27a-454c-a0a0-044b5e2e8aa1 service nova] Creating event network-changed:69da5ff9-8dae-4d3c-954c-3fa51f9e10cd for instance 3d11c9f1-7562-45de-924d-f168ada2645a on n-h2-master-1 Sep 25 01:17:29.319277 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a5b29fa6-b819-4bfe-b858-054fec4aba1e req-8e569641-d27a-454c-a0a0-044b5e2e8aa1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085229 Sep 25 01:17:29.321892 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1636/3262] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:29.333423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:29.338644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:29.354882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:29.358344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:29.359101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:29.360116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:29.362220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:29.362928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:29.418683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:29.434486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:29.434882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:29.435320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:29.848025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:29.856860 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7aac040b-80ca-4b11-bdb7-5234f136a5ad tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.533340 Sep 25 01:17:29.866271 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1637/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:29 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:29.872012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9faf8280-76f6-4907-b2c1-cb4f3e6f01c7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebab3d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:29.900503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d3844d1-136f-404c-a4e6-d65f6979760d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1201500344" status: 200 len: 1514 microversion: 2.1 time: 0.956137 Sep 25 01:17:29.901136 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1627/3264] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:17:28 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1201500344 => generated 1514 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:29.926736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:29.937591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:29.938414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:29.950992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9faf8280-76f6-4907-b2c1-cb4f3e6f01c7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.083008 Sep 25 01:17:29.951717 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1638/3265] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:29 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:29.965255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:29.966072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:29.966743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:29.967480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:29.968021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:29.968435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:30.096193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:30.209288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:30.235142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:30.236247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:30.236712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:30.257358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:30.258062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:30.277644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:30.277762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:30.278197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:30.279006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:30.280342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:30.280786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:30.978748 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ae9ff03-0c7a-4e88-a44f-6c8065422e16 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.056238 Sep 25 01:17:30.980639 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1628/3266] 10.222.0.16 () {58 vars in 1173 bytes} [Sun Sep 25 01:17:29 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:30.997518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:30.998456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:31.008549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.016808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.017153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.017663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.018387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.018849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.019546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.027454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76a6cc0f-6035-46f8-8ae3-19079bb9f48a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.774189 Sep 25 01:17:31.028059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1639/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:30 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:31.049369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40243992-fe3c-4dd1-af44-ac6047cc9ec3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebc11d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:31.124307 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40243992-fe3c-4dd1-af44-ac6047cc9ec3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.081530 Sep 25 01:17:31.125326 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1640/3268] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:31 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:31.130390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:31.137747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.138562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.servers [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Removing options 'limit' from query {{(pid=122385) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 25 01:17:31.140724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:31.148956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.149579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.150252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.152642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.153427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.154679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.206199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.214081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.214900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.216217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.397890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.407831 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3426708-94a7-4c53-a283-9de5a2c52921 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.425791 Sep 25 01:17:31.408429 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1629/3269] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:30 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:31.488346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bc81ba77-40bb-4ae6-b4f1-9be85c6ef9ae req-18ab6500-fe84-4819-a137-d089006b0acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0692ab-2627-474a-9bfc-41d182e863e7", "name": "network-vif-plugged", "status": "completed", "tag": "5b548a6c-ba24-4033-9fa3-c898c507829a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:31.507971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc81ba77-40bb-4ae6-b4f1-9be85c6ef9ae req-18ab6500-fe84-4819-a137-d089006b0acf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.513079 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1e874f1c-1779-4c02-829f-f40b87b66e45 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.386384 Sep 25 01:17:31.525893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1641/3270] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:17:31 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:31.526121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc81ba77-40bb-4ae6-b4f1-9be85c6ef9ae req-18ab6500-fe84-4819-a137-d089006b0acf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.526700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc81ba77-40bb-4ae6-b4f1-9be85c6ef9ae req-18ab6500-fe84-4819-a137-d089006b0acf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.542508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:31.551693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.557661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:31.578683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.579171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.579607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.584593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.585072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.585885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.595807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bc81ba77-40bb-4ae6-b4f1-9be85c6ef9ae req-18ab6500-fe84-4819-a137-d089006b0acf service nova] Creating event network-vif-plugged:5b548a6c-ba24-4033-9fa3-c898c507829a for instance 0f0692ab-2627-474a-9bfc-41d182e863e7 on n-h1-master-1 Sep 25 01:17:31.606551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bc81ba77-40bb-4ae6-b4f1-9be85c6ef9ae req-18ab6500-fe84-4819-a137-d089006b0acf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121845 Sep 25 01:17:31.613425 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1630/3271] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:31.795758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:31.868338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43e23c71-cf72-480d-913b-6a97359db172 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.329965 Sep 25 01:17:31.869225 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1642/3272] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:17:31 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:31.883031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:31.888555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.889164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.servers [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Removing options 'limit' from query {{(pid=122384) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 25 01:17:31.890102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:31.896941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.897559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.898068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.898878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.899400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.899988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.934659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:31.967397 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea39eaef-8521-484d-b175-cda4c878d1a8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.088334 Sep 25 01:17:31.968654 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1631/3273] 10.222.0.16 () {58 vars in 1150 bytes} [Sun Sep 25 01:17:31 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:31.982630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:31.987912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:31.988982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:31.997089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:31.998081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:31.998808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:31.999879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.000455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.000985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.054162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:32.056297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:32.075110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.075929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.078469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.079460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.080385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.081042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.117695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:32.182276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80551dbf-a549-4953-84b5-327ab11b79df tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.203396 Sep 25 01:17:32.191201 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1643/3274] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:17:31 2022] GET /compute/v2.1/servers => generated 1012 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:32.198196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3beec059-97eb-4b0d-b72a-ed2fe7302903 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebd2bb80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:32.270484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3beec059-97eb-4b0d-b72a-ed2fe7302903 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.077622 Sep 25 01:17:32.271183 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1644/3275] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:32 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:32.284741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:32.291754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:32.293142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:32.296122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:32.309301 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79070d4c-a796-4ed8-be98-fd6725a7708f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.259640 Sep 25 01:17:32.311388 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1632/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:32 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:32.318514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.319020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.319473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.320628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.321427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.322049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.427996 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:32.436951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:32.439359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:32.459172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.459676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.460409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.461678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.462307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.462901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.516330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2111802-0437-4304-aa12-ac549485bf94 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.242986 Sep 25 01:17:32.525857 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1645/3277] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:17:32 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:32.536111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:32.548381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:32.548835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.servers [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Removing options 'limit' from query {{(pid=122385) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 25 01:17:32.549547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:32.555760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.556344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.557066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.557978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.558643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.559074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.587333 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-613661bb-7921-4b1e-8050-b271de6bdc0b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.059194 Sep 25 01:17:32.587836 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1646/3278] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 25 01:17:32 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:32.602427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:32.608468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:32.609274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1201500344', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:32.615770 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:32.618874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.619371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.619814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.620547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.621001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.621457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.729383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:32.801129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-81acbade-bbc7-4587-8070-ff6858924ddd tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1201500344" status: 200 len: 346 microversion: 2.1 time: 0.203346 Sep 25 01:17:32.802003 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1647/3279] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:17:32 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1201500344 => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:32.816721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-28fd32f4-3ad7-4814-ad09-af46db7e7be0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:32.831678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28fd32f4-3ad7-4814-ad09-af46db7e7be0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:32.832708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28fd32f4-3ad7-4814-ad09-af46db7e7be0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:32.833777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28fd32f4-3ad7-4814-ad09-af46db7e7be0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:32.928047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-28fd32f4-3ad7-4814-ad09-af46db7e7be0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:17:33.015296 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-28fd32f4-3ad7-4814-ad09-af46db7e7be0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "POST /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262/action" status: 202 len: 0 microversion: 2.1 time: 0.202905 Sep 25 01:17:33.018407 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1648/3280] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:32 2022] POST /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:17:33.045965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:33.052709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:33.069799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:33.071677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:33.074838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:33.075802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:33.076441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:33.077080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:33.469838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:33.477952 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1c61264-1107-4c4b-b4e9-0e3b8bd9dc67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 1.047762 Sep 25 01:17:33.478559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1633/3281] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:32 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:33.509120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-250a3a34-86ee-4c10-88b3-52930771cd41 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf091d3a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:33.522643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:33.535578 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f2333f4-d847-4e53-8523-4eefea1779e8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1521 microversion: 2.1 time: 0.511673 Sep 25 01:17:33.549444 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1649/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:33 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:33.549444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:33.550207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:33.563406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:33.563909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:33.564350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:33.565099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:33.571411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:33.572331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:33.627468 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-250a3a34-86ee-4c10-88b3-52930771cd41 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.141116 Sep 25 01:17:33.629391 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1634/3283] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:33 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:34.065748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:34.075804 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10177706-f358-4d10-82d8-c8533bde1f7a tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.538213 Sep 25 01:17:34.076407 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1650/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:33 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:34.502184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:34.503759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:34.522070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:34.528190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:34.528871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:34.529840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:34.530479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:34.531107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:34.568081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:34.568976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:34.587970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:34.588494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:34.589995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:34.590760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:34.592305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:34.592927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:34.643988 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:34.873734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:34.881932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80341981-7d4a-4216-9d9a-6a77b4879732 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.384444 Sep 25 01:17:34.890004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1635/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:34 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:34.896016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25599c27-5d29-4922-8a57-03b4d5247124 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf408a3a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:35.022396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25599c27-5d29-4922-8a57-03b4d5247124 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.130382 Sep 25 01:17:35.031632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1636/3286] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:34 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:35.100483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:35.102139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:35.103361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:35.108136 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:35.122727 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-485ee5a7-d571-4b42-8289-2261dd7167d7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1521 microversion: 2.1 time: 0.559363 Sep 25 01:17:35.123508 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1651/3287] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:34 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:35.124617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:35.125221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:35.125748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:35.126602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:35.127124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:35.127780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:35.911094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:35.912481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:35.928191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:35.929697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:35.933185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:35.934647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:35.937763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:35.938490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:36.482803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:36.488368 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80e2a3d1-44e2-49d7-9572-07357e489209 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 1.393160 Sep 25 01:17:36.494698 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1637/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:35 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:36.501729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b378c83-3a35-4590-91c2-8a61a24e896f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3fa7820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:36.576099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:36.591865 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b378c83-3a35-4590-91c2-8a61a24e896f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.095907 Sep 25 01:17:36.592490 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1638/3289] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:36 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:36.602799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:36.603841 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12fc72db-e67d-4a2e-a73f-5fa2335f17c0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.687547 Sep 25 01:17:36.604774 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1652/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:35 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:36.623668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:36.638566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:36.639376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:36.639991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:36.640891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:36.641565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:36.645106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:37.086271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:37.098065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25eb5950-8364-4e37-a296-76090445e350 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1521 microversion: 2.1 time: 0.500435 Sep 25 01:17:37.100624 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1639/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:36 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:37.516478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:37.517097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:37.544692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:37.546710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:37.547837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:37.549998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:37.551386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:37.552499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:37.608538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15ae4af0-9b0b-4097-a515-f72d0344c8e5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3fa79d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:37.726522 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15ae4af0-9b0b-4097-a515-f72d0344c8e5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.121210 Sep 25 01:17:37.740327 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1640/3292] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:37 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:37.754628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:37.758418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:37.776934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:37.778859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:37.783568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:37.784632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:37.785280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:37.785981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:37.843351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:37.855499 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ac2f90b-6745-4b58-9756-68015b0f5d06 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.345281 Sep 25 01:17:37.856698 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1653/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:37 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:37.909906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-61689fb5-7049-40a3-b4ae-63e618e3c7be req-34b4b16c-3b58-48a3-b64e-a7ac439f1c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d11c9f1-7562-45de-924d-f168ada2645a", "name": "network-vif-plugged", "status": "completed", "tag": "69da5ff9-8dae-4d3c-954c-3fa51f9e10cd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:37.934352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61689fb5-7049-40a3-b4ae-63e618e3c7be req-34b4b16c-3b58-48a3-b64e-a7ac439f1c7d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:37.935211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61689fb5-7049-40a3-b4ae-63e618e3c7be req-34b4b16c-3b58-48a3-b64e-a7ac439f1c7d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:37.937921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61689fb5-7049-40a3-b4ae-63e618e3c7be req-34b4b16c-3b58-48a3-b64e-a7ac439f1c7d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:37.980244 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-61689fb5-7049-40a3-b4ae-63e618e3c7be req-34b4b16c-3b58-48a3-b64e-a7ac439f1c7d service nova] Creating event network-vif-plugged:69da5ff9-8dae-4d3c-954c-3fa51f9e10cd for instance 3d11c9f1-7562-45de-924d-f168ada2645a on n-h2-master-1 Sep 25 01:17:38.004133 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-61689fb5-7049-40a3-b4ae-63e618e3c7be req-34b4b16c-3b58-48a3-b64e-a7ac439f1c7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101929 Sep 25 01:17:38.007769 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1654/3294] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:17:38.098515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:38.118283 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c0be151c-e5d7-4058-a70b-a8058a998c04 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.376625 Sep 25 01:17:38.121647 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1641/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:37 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:38.143647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:38.144794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:38.166256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:38.166770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:38.167227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:38.167999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:38.168692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:38.168921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:38.442658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:38.463011 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ced10636-d50c-45e5-84b2-1d59db48f6c9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1521 microversion: 2.1 time: 0.318069 Sep 25 01:17:38.464853 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1655/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:38 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:38.749062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-746e2174-b37c-4ed9-a665-b75606bd4156 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3f361f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:38.863668 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-746e2174-b37c-4ed9-a665-b75606bd4156 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.119221 Sep 25 01:17:38.873273 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1642/3297] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:38 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:38.888020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:38.889462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:38.905474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:38.907074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:38.907956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:38.909092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:38.909800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:38.912177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.151097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:39.151878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:39.164972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:39.167098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:39.169509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.174496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:39.177875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:39.181258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.198311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:39.206848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-986ed3bc-9383-4b01-be99-16eaf8ef0921 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 0.327211 Sep 25 01:17:39.226827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1656/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:38 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:39.489012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:39.490009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:39.501505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:39.503458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:39.504192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.505792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:39.508130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:39.508850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.528424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:39.542588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-270d19de-8b65-49f9-84cf-4458ee12df62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1315 microversion: 2.1 time: 0.396029 Sep 25 01:17:39.543191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1643/3299] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:39 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:39.822518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:39.838084 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd9650c0-d980-4abf-9300-228e52e30179 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1498 microversion: 2.1 time: 0.353588 Sep 25 01:17:39.841716 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1657/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:39 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:39.868939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:39.880695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9384575c-a00b-439b-a116-5c4c81d7939c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf00569d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:39.893943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:39.901491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:39.922836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:39.924299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:39.925256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.928108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:39.930912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:39.931624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:39.967313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9384575c-a00b-439b-a116-5c4c81d7939c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.090915 Sep 25 01:17:39.969028 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1658/3301] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:39 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:40.013631 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:40.103787 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-641bdb16-b68f-4457-8959-a470c594a12d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.236787 Sep 25 01:17:40.105148 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1644/3302] 10.222.0.16 () {58 vars in 1154 bytes} [Sun Sep 25 01:17:39 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:40.118123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-921e4bfd-264f-44a1-b5ca-7be907dfe12f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:40.134226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921e4bfd-264f-44a1-b5ca-7be907dfe12f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:40.135052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921e4bfd-264f-44a1-b5ca-7be907dfe12f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:40.135679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921e4bfd-264f-44a1-b5ca-7be907dfe12f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:40.190654 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-921e4bfd-264f-44a1-b5ca-7be907dfe12f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Going to try to start instance {{(pid=122385) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:17:40.238744 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:40.334905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-921e4bfd-264f-44a1-b5ca-7be907dfe12f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "POST /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262/action" status: 202 len: 0 microversion: 2.1 time: 0.219252 Sep 25 01:17:40.337518 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1659/3303] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:40 2022] POST /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:17:40.361026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:40.365863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:40.406670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:40.412085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:40.412993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:40.414231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:40.414989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:40.415620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:40.758253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:40.759145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:40.770109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:40.770807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:40.771451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:40.772330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:40.773614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:40.774263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:40.785569 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:41.203067 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:41.221937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:41.248470 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-598e6e63-c25c-4364-af74-38e214cc879b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1507 microversion: 2.1 time: 0.906434 Sep 25 01:17:41.257474 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1660/3304] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:40 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1507 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:41.276933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:41.282878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:41.310451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:41.314715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:41.322573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:41.323932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:41.324591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:41.325861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:42.010297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:42.046773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-728a401b-d5f4-4ada-afec-38802f0d5ba7 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1475 microversion: 2.1 time: 1.812697 Sep 25 01:17:42.052573 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1645/3305] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:40 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1475 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:42.063872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb0b4182-91d9-4916-8fe1-270a44fa0de3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb98fb80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:42.162254 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eb0b4182-91d9-4916-8fe1-270a44fa0de3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.101989 Sep 25 01:17:42.171160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1646/3306] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:42 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:42.280046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:42.280678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:42.294554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:42.295432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:42.296654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:42.297581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:42.298052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:42.299648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:42.680225 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:43.034169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:43.045488 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4da73968-c077-42ec-b6a7-f8a9a323c828 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1502 microversion: 2.1 time: 1.783659 Sep 25 01:17:43.054267 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1661/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:41 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1502 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:43.084297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:43.085762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:43.104992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:43.106893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:43.108999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:43.111338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:43.112309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:43.113877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:43.257313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:43.331902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a14fda3-b68f-4f92-8087-4dec944d6edf tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1507 microversion: 2.1 time: 1.051451 Sep 25 01:17:43.337588 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1647/3308] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:42 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1507 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:43.370527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:43.373551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:43.394093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:43.401183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:43.402086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:43.403040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:43.403670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:43.404272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:43.481772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lazy-loading 'flavor' on Instance uuid 3d11c9f1-7562-45de-924d-f168ada2645a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:17:43.948153 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d55d0ae4-fcad-443b-9f3e-741af57796bc tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a/action" status: 202 len: 0 microversion: 2.1 time: 0.606882 Sep 25 01:17:43.949375 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1648/3309] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:43 2022] POST /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:17:43.954951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36267deb-3ff1-442b-a4fd-f1359e404cdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf408ac10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:44.044291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36267deb-3ff1-442b-a4fd-f1359e404cdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.093405 Sep 25 01:17:44.045233 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1649/3310] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:43 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:44.057868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:44.058635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:44.077453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:44.077937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:44.078580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:44.079467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:44.080278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:44.080884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:45.381383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:45.405536 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07652b5d-1391-41be-9fa5-299df355226d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1474 microversion: 2.1 time: 2.325522 Sep 25 01:17:45.406892 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1662/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:43 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1474 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:45.422446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "name": "network-vif-unplugged", "status": "completed", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:45.436013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:45.437556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:45.441359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:45.473861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] Creating event network-vif-unplugged:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h2-master-1 Sep 25 01:17:45.495417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:17:45.530719 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fc0d9b43-386b-4de5-b560-699cdb66941f req-14c2b9db-5099-4a76-ba08-4260c52dd95d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122267 Sep 25 01:17:45.531660 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1663/3312] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:45.537779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:45.539063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:45.558425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:45.559821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:45.560681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:45.564912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:45.565772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:45.566450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:45.602057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:45.616687 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9f4adba-7d3c-45e7-90fb-d2f96a6118d6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 1.570104 Sep 25 01:17:45.626957 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1650/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:44 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:45.640922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11d9dc1e-e5e5-4774-9176-a7ab2f47631e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf010d9d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:45.756882 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11d9dc1e-e5e5-4774-9176-a7ab2f47631e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.128126 Sep 25 01:17:45.757888 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1651/3314] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:45 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:45.930634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:45.939039 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8d8a8a5-fabc-4ba6-8357-97ba9eeb83e0 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1511 microversion: 2.1 time: 0.406086 Sep 25 01:17:45.949992 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1664/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:45 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:45.965502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:45.976770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:45.979984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.servers [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Removing options 'limit' from query {{(pid=122384) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 25 01:17:45.980753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:45.984372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:45.987303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:45.988107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:45.990270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:45.991048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:45.991734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:45.999390 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4fff67ca-4d5f-4483-a986-ecbbda95dc13 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.037766 Sep 25 01:17:46.002815 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1652/3316] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 25 01:17:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:17:46.019589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:46.020222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:46.035011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:46.035429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:46.045967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:46.057362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:46.059992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:46.059992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:46.235464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-881406388", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:46.326217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] validate_networks() for [('2309cf64-61cd-4755-9e43-04778a22257e', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:17:46.833533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:46.851545 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cbbb7320-20f6-4867-945d-3f13397ef84e tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1511 microversion: 2.1 time: 0.830556 Sep 25 01:17:46.852616 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1665/3317] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:46 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1511 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:46.869958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:46.872180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:46.883169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:46.891483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:46.892391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:46.893437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:46.894143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:46.895064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.308806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:47.375044 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3db4d095-18ca-42a5-bf63-cdd6eab37f4f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1474 microversion: 2.1 time: 0.512137 Sep 25 01:17:47.385907 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1666/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:46 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1474 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:47.409299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:47.419209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:47.451554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.452065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.452513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.453235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.453717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.454140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.905082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:47.921127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4d24cd3-886b-458d-b4f8-25ef5b5deeed tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.526034 Sep 25 01:17:47.921853 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1667/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:47 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:47.940634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ea51585-bf86-4e40-8d63-12275d8eb7ef tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebc08430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:48.007168 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ea51585-bf86-4e40-8d63-12275d8eb7ef tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.083962 Sep 25 01:17:48.008655 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1668/3320] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:47 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:48.023734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:48.024959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:48.051764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.052673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.053318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.054385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.055024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.055625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.321904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:17:48.322461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:17:48.322924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:17:48.323191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:17:48.323605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:17:48.361669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.365268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.366005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.369099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.372131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.373035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.399710 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=11 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:48.426695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Getting quotas for project ba24a0d735e74e24aa2cabf4233d0e71. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:17:48.435112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Getting quotas for user 67ce0396cdb949558664fac11b83aca1 and project ba24a0d735e74e24aa2cabf4233d0e71. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:17:48.454352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:17:48.457649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:17:48.556327 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ffd3da8-163f-4753-978c-8f62876056d8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.442595 Sep 25 01:17:48.557020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1653/3321] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:17:48.563935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:48.603431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.603896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.604327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.635580 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] Creating event network-changed:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h2-master-1 Sep 25 01:17:48.654707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:17:48.685294 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-db519ee8-c08e-4c92-9119-0b518c755299 req-c5cd3239-913c-49ff-b394-8a2a91f7aa32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126778 Sep 25 01:17:48.686492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1654/3322] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:48.701555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:48.702660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:48.710590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.712450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.715765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.716895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.717743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.722248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.754197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:48.780504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4320aa3-78b6-4d54-aa18-32056a7f9a74 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 200 len: 1512 microversion: 2.1 time: 0.762280 Sep 25 01:17:48.781098 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1669/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:48 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 1512 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:48.814984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6077ba0b-e84b-43be-9f49-80d97221d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:48.820043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6077ba0b-e84b-43be-9f49-80d97221d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:49.031307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6077ba0b-e84b-43be-9f49-80d97221d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:49.040947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6077ba0b-e84b-43be-9f49-80d97221d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1216 microversion: 2.1 time: 0.250095 Sep 25 01:17:49.041555 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1670/3324] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:48 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:49.051320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:49.051937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:49.076725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.077220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.077688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.078388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.078838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.079263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.142130 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:49.302038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:49.318512 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c1d72e20-40e7-47bf-b7c9-6b9fb3f5648b tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1474 microversion: 2.1 time: 0.630543 Sep 25 01:17:49.345348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1655/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:48 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1474 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:49.365585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:49.370237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:49.401094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.401825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.403576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.407656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.411275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.414852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.558009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:49.568125 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12233fe0-21fa-4d6d-9e4f-1c0087c1e499 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1512 microversion: 2.1 time: 0.525508 Sep 25 01:17:49.569603 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1671/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:49 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:49.574495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51a4477b-cca8-4c98-959b-b4899475b5ab tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebcff430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:49.699692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51a4477b-cca8-4c98-959b-b4899475b5ab tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.128662 Sep 25 01:17:49.704241 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1672/3327] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:49 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:49.713519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:49.724493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:49.726782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:49.960105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.960589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.961279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.962225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.962905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.963575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.008997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:50.021936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b78c3110-5a59-45bf-abdc-f95d4731dd5c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.675349 Sep 25 01:17:50.028547 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1656/3328] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:49 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:50.074362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:50.077894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:50.130685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:50.155153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.157179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.159840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.169050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.171762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.175814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.274901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8b4f991c-e212-4f17-b467-8aa1ec97de90 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.569156 Sep 25 01:17:50.275836 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1673/3329] 10.222.0.16 () {58 vars in 1154 bytes} [Sun Sep 25 01:17:49 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:50.289286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:50.289937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:50.306880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.311065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.311778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.312917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.314147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.315166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.352231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:50.364257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c92d4b05-bd00-4c49-8b8d-e02e89ff4122 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1268 microversion: 2.1 time: 0.301147 Sep 25 01:17:50.375786 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1657/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:50 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:50.381188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:50.381869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:50.400254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.400745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.401199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.401911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.402361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.403172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.738478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:50.751332 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76e194b0-41a9-4a21-a69c-86f9b36da21c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1472 microversion: 2.1 time: 0.372306 Sep 25 01:17:50.753196 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1658/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:50 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:50.769885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa67a994-a2cd-4c8e-b584-7223ebabcc35 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3f36040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:50.804914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:50.815588 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90a5154a-47c5-4fa6-a810-69f655bab595 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1511 microversion: 2.1 time: 0.530610 Sep 25 01:17:50.829431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1674/3332] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:50 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:50.863371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa67a994-a2cd-4c8e-b584-7223ebabcc35 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.108607 Sep 25 01:17:50.863615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:50.864159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:50.880605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.884655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.885165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.886560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.887043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.887476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.898032 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1659/3333] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:50 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:51.064539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:51.065316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:51.080959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.086659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.087662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.090318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.091071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.094501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.339574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:51.356637 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-72876f4f-d96d-43ff-a93e-59ede5359005 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 200 len: 1512 microversion: 2.1 time: 0.515013 Sep 25 01:17:51.362652 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1675/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:50 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:51.390539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:51.391705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:51.414612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.420179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.422083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.423136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.428480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.431050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.579509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:51.595786 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76023757-13e0-45b9-9459-601dd245158c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.539662 Sep 25 01:17:51.596434 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1660/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:51 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:51.606138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:51.616684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:51.625251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.626148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.626842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.628436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.629514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.630695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.843320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:51.852918 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd092f59-856d-4c0b-b200-f3deb42d8fcf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1274 microversion: 2.1 time: 0.255227 Sep 25 01:17:51.855032 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1661/3336] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:51 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:51.864094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:51.871034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:51.871807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:51.876295 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f52c6586-53ae-4dc2-9222-daf3b6548e2c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1512 microversion: 2.1 time: 0.491416 Sep 25 01:17:51.886064 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1676/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:51 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:51.890335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.891092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.891691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.903153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:51.903642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:51.904252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:51.917679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-171344ba-4f1d-408a-8721-d07694b9d6f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebd06e50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:52.027038 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-171344ba-4f1d-408a-8721-d07694b9d6f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.117857 Sep 25 01:17:52.028059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1677/3338] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:51 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:52.039567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:52.049567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:52.052917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:52.067570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.068340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.072463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.073694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.074349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.075032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.140468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:52.213972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:52.219940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:52.221871 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e63bb261-f86e-4101-91b2-48711518c9dd tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1472 microversion: 2.1 time: 0.364744 Sep 25 01:17:52.230288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.231176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.232157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.238374 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1662/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:51 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:52.407887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-facefb3f-7b1a-4034-b81b-f5500365f136 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.377793 Sep 25 01:17:52.409126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1678/3340] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:17:52 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:52.447315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:52.456295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:52.457539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:52.565658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.566390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.567052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.567975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.568622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.569277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.624899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:52.630332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:52.651248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.652420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.654832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.655887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.659912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.661033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.781290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:52.918510 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-376b401f-3fef-4421-98ec-6d4797a9d0f9 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.475132 Sep 25 01:17:52.919423 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1663/3341] 10.222.0.16 () {58 vars in 1150 bytes} [Sun Sep 25 01:17:52 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:52.924354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:52.925168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:52.935941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.936749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.937356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:52.938310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:52.938941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:52.939533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:53.425774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:53.439511 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-acb8e3b6-ce81-44a4-b3fb-9e43e59519e2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1274 microversion: 2.1 time: 0.518602 Sep 25 01:17:53.440684 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1664/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:52 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1274 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:53.462024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:53.472008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:53.474314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:53.489731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:53.490495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:53.493269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:53.497379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:53.499118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:53.499924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:53.724427 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:53.740636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:53.783496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:53.794022 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-713c86b0-f6c0-45ce-8295-7fa4d454f9de tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 1.177133 Sep 25 01:17:53.817990 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1679/3343] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:52 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:53.830364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43950003-8208-407b-a2a9-af980529a99b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebfb3700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:53.903114 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43950003-8208-407b-a2a9-af980529a99b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.083692 Sep 25 01:17:53.903588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6fc6244c-9f1a-4b27-ab44-3c42280cef98 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.452442 Sep 25 01:17:53.904128 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1680/3344] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:53 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:53.905574 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1665/3345] 10.222.0.16 () {58 vars in 1212 bytes} [Sun Sep 25 01:17:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:53.918278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:53.919275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:53.921704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:53.928902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:53.930563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:53.931251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:53.932225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:53.932927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:53.933635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:53.938120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:53.938858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:53.955429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:53.962070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:53.962949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:53.965430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:53.965922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:53.970275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.126088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:54.248759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:54.262650 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f8b3dcc-0488-49d4-b896-679c818765c5 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1469 microversion: 2.1 time: 0.348727 Sep 25 01:17:54.285064 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-208d0e44-cf7e-40a2-b098-c17aa25e670d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.354376 Sep 25 01:17:54.285064 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1666/3346] 10.222.0.16 () {58 vars in 1196 bytes} [Sun Sep 25 01:17:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:54.285550 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1681/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:53 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:54.297109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:54.297851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:54.299730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:54.304844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.305530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.306058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.306202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:54.306964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.307517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.308883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.317916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': '1201500344', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:54.341216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.348324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.348609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.349301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.349811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.350285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.586168 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-847adb37-c9f2-49c1-94e0-33153f5ff6c1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "POST /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc/action" status: 202 len: 0 microversion: 2.1 time: 0.292158 Sep 25 01:17:54.589389 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1667/3348] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:17:54 2022] POST /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:17:54.598011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:54.606169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:54.625137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.626361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.628413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.630775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.633198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.634111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.706714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:54.856824 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17986351-7fe9-4fb7-ae51-f8e2177038b8 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?name=1201500344" status: 200 len: 346 microversion: 2.1 time: 0.560929 Sep 25 01:17:54.872331 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1682/3349] 10.222.0.16 () {58 vars in 1156 bytes} [Sun Sep 25 01:17:54 2022] GET /compute/v2.1/servers?name=1201500344 => generated 346 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:17:54.886946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:54.889149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:54.906929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.908067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.909277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:54.913374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:54.922292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:54.923247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:55.558065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:55.561229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:55.570584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c9473376-8c0f-4ff1-801c-103a326f3fd0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.696541 Sep 25 01:17:55.574652 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6057e28-3d0a-466f-83f2-2681d7487255 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.979732 Sep 25 01:17:55.575138 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1683/3350] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:54 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:55.582809 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1668/3351] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:54 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:55.588883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:55.592969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:55.593630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:55.618486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:55.620427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:55.620883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:55.621345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:55.622123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:55.622599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:55.623028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:55.623525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:55.637453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:55.641943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:55.648454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:55.649930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:55.650820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:55.652217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:55.918260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:56.106055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11d7bef9-ee0d-4b13-be7d-3a80ef55c89f tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.515678 Sep 25 01:17:56.111266 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1669/3352] 10.222.0.16 () {58 vars in 1154 bytes} [Sun Sep 25 01:17:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:56.117846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63aba08e-6d46-46f7-aaff-147409696a29 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3ec7ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:56.209996 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63aba08e-6d46-46f7-aaff-147409696a29 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1412 microversion: 2.1 time: 0.096930 Sep 25 01:17:56.210920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1670/3353] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:56 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:56.222825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-99530b6b-3230-4f1e-b266-94ef85eb67e0 req-e3cfc475-c5b2-4a7f-8e28-7e08428151a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:56.261596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-99530b6b-3230-4f1e-b266-94ef85eb67e0 req-e3cfc475-c5b2-4a7f-8e28-7e08428151a2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.266743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-99530b6b-3230-4f1e-b266-94ef85eb67e0 req-e3cfc475-c5b2-4a7f-8e28-7e08428151a2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.272455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-99530b6b-3230-4f1e-b266-94ef85eb67e0 req-e3cfc475-c5b2-4a7f-8e28-7e08428151a2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:56.305517 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-99530b6b-3230-4f1e-b266-94ef85eb67e0 req-e3cfc475-c5b2-4a7f-8e28-7e08428151a2 service nova] Creating event network-changed:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h1-master-1 Sep 25 01:17:56.320620 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-99530b6b-3230-4f1e-b266-94ef85eb67e0 req-e3cfc475-c5b2-4a7f-8e28-7e08428151a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106549 Sep 25 01:17:56.324698 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1671/3354] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:56.336726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:56.353140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:56.354060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-120150034', 'deleted': False, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:17:56.368256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.371214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.373677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:56.374620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.376144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.377122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:56.401128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:56.430551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a0fea93-a90a-443c-84a3-6e37e9181bf3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.854047 Sep 25 01:17:56.432342 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1684/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:55 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:56.512045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:17:56.596024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:56.596950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:56.615140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.616694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.621304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:56.622479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.629514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.630277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:56.653854 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14d0dd0e-dc92-4b97-baa6-87c6eaf99d0a tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-120150034" status: 200 len: 346 microversion: 2.1 time: 0.327437 Sep 25 01:17:56.655118 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1672/3356] 10.222.0.16 () {58 vars in 1228 bytes} [Sun Sep 25 01:17:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-120150034 => generated 346 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:56.679471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:56.691815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:56.708162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.708162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.708162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:56.708162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:56.708162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:56.708162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.186210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:57.194867 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-77b724ab-f83b-4b32-8176-194e92f68f0d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.602082 Sep 25 01:17:57.196163 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1685/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:56 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:57.207738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:57.208537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:57.215908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:57.216819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.217298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.223580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.224738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.225387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.226040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.260285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:17:57.267345 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e473f2c2-c5e3-4084-aa3f-2a4971efc065 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.604997 Sep 25 01:17:57.269673 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1673/3358] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:56 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:57.275246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "name": "network-vif-plugged", "status": "completed", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:57.290329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.291125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.292832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.320793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] Creating event network-vif-plugged:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h2-master-1 Sep 25 01:17:57.328466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:17:57.342973 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-712cf3a9-bc82-4fc6-9655-ccf393f28670 req-491b40db-e6b7-4bbe-8f16-dbb04eeb6234 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071664 Sep 25 01:17:57.348596 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1674/3359] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:57.354812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f57d63c-cf35-4dff-bcd4-1bffd676d7ba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb184700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:57.384346 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b138a36-831c-416d-8b77-5cb3daca2ada tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 204 len: 0 microversion: 2.1 time: 0.186588 Sep 25 01:17:57.385075 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1686/3360] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:17:57 2022] DELETE /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:57.396130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:57.396844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:57.416324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.416899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.417195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.421463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.422150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.422759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.433135 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f57d63c-cf35-4dff-bcd4-1bffd676d7ba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1421 microversion: 2.1 time: 0.082565 Sep 25 01:17:57.434182 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1675/3361] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:57 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:57.450821 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-838b0e8c-c641-47b9-9885-a33fcb9c56f2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3f36a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:57.513084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-838b0e8c-c641-47b9-9885-a33fcb9c56f2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 200 len: 1421 microversion: 2.1 time: 0.067592 Sep 25 01:17:57.514900 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1676/3362] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:17:57 2022] GET /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:57.528211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:57.528211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:57.531291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.531882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.532387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.533171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:57.533735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:57.534560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:57.799728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:57.802762 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:57.811604 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aef3faa4-85dd-4cbd-a248-f2f1a083ba24 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1518 microversion: 2.1 time: 0.421585 Sep 25 01:17:57.813054 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1687/3363] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:57 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1518 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:57.818096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5a19e96-f928-4356-ba6c-e90bacea6148 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebdaa9d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:57.854601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:57.869547 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e923b206-0cb6-45d2-8711-742e44b46a5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.353320 Sep 25 01:17:57.870436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1677/3364] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:57 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:58.220134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:58.220760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:58.228942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.229469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.229911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.230832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.231460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.232222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.450274 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:58.463591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:58.475913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7f84d0b2-b644-4e0d-b0e1-de4a4cb911e3 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.258876 Sep 25 01:17:58.477551 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1678/3365] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:58 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:58.483532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:58.484359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:58.491329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.492284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.493512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.494697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.496022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.496751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.611035 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5a19e96-f928-4356-ba6c-e90bacea6148 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 204 len: 0 microversion: 2.1 time: 0.794110 Sep 25 01:17:58.614989 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1688/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:57 2022] DELETE /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:58.623666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:58.624515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:58.635929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.636570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.637580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.638678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.639334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.639887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.680623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:17:58.695110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:58.704840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-724567ea-ee45-4651-beec-5e61b5d971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.225697 Sep 25 01:17:58.705582 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1679/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:58 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:58.807894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-47df9cda-74ed-46db-b7c7-abbf046d5d6c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 204 len: 0 microversion: 2.1 time: 0.189126 Sep 25 01:17:58.810341 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1689/3368] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:17:58 2022] DELETE /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:58.842308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:58.843584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:58.858442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.860322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.861783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.867870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.870636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.872457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.900257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:58.901025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:58.914722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.918608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.919261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:58.920049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:58.920531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:58.920969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:59.455460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:59.464201 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13ad66f4-e60d-407b-acfe-02647f1f4f7d tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1518 microversion: 2.1 time: 0.627027 Sep 25 01:17:59.473741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:59.478053 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1680/3369] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:58 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1518 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:59.488569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-552472084", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4ec95620-83af-4c06-b763-713d3bcab477"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:59.493549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4902ee3e-7360-44c1-a4db-d7634cc7e588 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.598726 Sep 25 01:17:59.495375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1690/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:58 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:59.501645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:59.502626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:59.520425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:59.521258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:59.522638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:59.524161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:59.524819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:59.525475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:59.578566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] validate_networks() for [('4ec95620-83af-4c06-b763-713d3bcab477', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:17:59.883793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:59.892806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7fa3d7ed-424b-4167-887d-6ffce6ca71e1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.395968 Sep 25 01:17:59.911877 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1691/3371] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:59 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:59.918492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:59.919395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:59.927967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:59.929493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:59.931129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:59.932096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:59.932767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:59.934371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.161067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:00.188379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad397d51-b29d-4542-b031-de8e1801409d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.273868 Sep 25 01:18:00.189958 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1692/3372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:59 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:00.244921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:18:00.246074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:18:00.246846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:18:00.247300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:18:00.247783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:18:00.260938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.262311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.263209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.264212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.264781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.265300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.284900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:18:00.290771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for user ab3394e2971741d7aa5956de0d4afba8 and project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:18:00.304089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:18:00.306458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:18:00.355477 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ba8216e-9fd2-4210-8b0f-0e68bda6f772 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876193 Sep 25 01:18:00.362638 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1681/3373] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:17:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:18:00.369603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6c76292-fab2-490d-a79e-2e0fdbfab63e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:00.370333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d6c76292-fab2-490d-a79e-2e0fdbfab63e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:00.463693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d6c76292-fab2-490d-a79e-2e0fdbfab63e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:00.472458 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6c76292-fab2-490d-a79e-2e0fdbfab63e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1207 microversion: 2.1 time: 0.108708 Sep 25 01:18:00.473786 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1693/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:00 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1207 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:00.491933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:00.492840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:00.503154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.504639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.505268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.506252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.506898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.508167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.529649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:00.532092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:00.553450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.553938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.554579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.555507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.555967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.556387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.835011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:00.848461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4cb1de67-fc4a-46f6-b6e6-18f79e439a1b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1518 microversion: 2.1 time: 0.360325 Sep 25 01:18:00.852194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:00.862569 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1682/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:00 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1518 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:00.880966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3261a99e-ca0c-4535-a6a3-97e05a1bd135 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.362879 Sep 25 01:18:00.882503 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1694/3376] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:00 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:00.921905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:00.923718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:00.930987 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:00.940215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.940723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.941167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.945511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:00.946890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:00.947755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:00.984378 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:01.214269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:01.215128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:01.231127 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:01.234527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.235156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.235703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.236482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.237046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.237602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.461953 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:01.470747 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d24e0291-3107-4498-b334-5a656084b28d tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.558110 Sep 25 01:18:01.481105 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1683/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:00 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:01.498566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:01.499465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:01.509897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.510666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.513455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.514528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.515168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.524663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.670639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:01.682596 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e8de8d3-6cb1-4055-8104-3b32b5ffcfde tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1211 microversion: 2.1 time: 0.187843 Sep 25 01:18:01.684800 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1684/3378] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:01 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:01.777235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:01.786135 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-edf19cc7-0ca1-40fc-819b-10ce9a16161e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.577455 Sep 25 01:18:01.788201 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1695/3379] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:01 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:01.895167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:01.901694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:01.903913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:01.904537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:01.916737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.917512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.918124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.919033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.919753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.920421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.936331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.936998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.937236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:01.942469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:01.942946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:01.943385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.396270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:02.410216 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-918dd3f8-ce94-4987-a754-4033252c884c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1476 microversion: 2.1 time: 0.525791 Sep 25 01:18:02.415672 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1685/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:01 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:02.435378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-977401a7-dc01-4ec5-a05c-11e135cc8a8d req-0458c76d-4185-4d67-b64f-7f9da6b5d387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56a9ef5-540c-46e3-8f3f-6c092da3ee26", "name": "network-vif-deleted", "tag": "01ff6228-d87c-49ad-a372-e13256a5a5e6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:02.476328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-977401a7-dc01-4ec5-a05c-11e135cc8a8d req-0458c76d-4185-4d67-b64f-7f9da6b5d387 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.477005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-977401a7-dc01-4ec5-a05c-11e135cc8a8d req-0458c76d-4185-4d67-b64f-7f9da6b5d387 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.478249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-977401a7-dc01-4ec5-a05c-11e135cc8a8d req-0458c76d-4185-4d67-b64f-7f9da6b5d387 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.516117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-977401a7-dc01-4ec5-a05c-11e135cc8a8d req-0458c76d-4185-4d67-b64f-7f9da6b5d387 service nova] Creating event network-vif-deleted:01ff6228-d87c-49ad-a372-e13256a5a5e6 for instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 on n-h2-master-1 Sep 25 01:18:02.535178 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-977401a7-dc01-4ec5-a05c-11e135cc8a8d req-0458c76d-4185-4d67-b64f-7f9da6b5d387 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117591 Sep 25 01:18:02.536710 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1686/3381] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:02.551323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:02.552559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:02.567034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.568219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.569661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.571756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.572438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.573077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.702281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:02.712304 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c925e826-640e-4a28-8741-85ea4dd41dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.812031 Sep 25 01:18:02.718353 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1696/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:01 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:02.730427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:02.731109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:02.746293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.746804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.749953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.750727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.751210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.751646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.895004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:02.908026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a71621fd-f8d9-4bf8-bdc4-ef6597acb6bc tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1259 microversion: 2.1 time: 0.186101 Sep 25 01:18:02.925093 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1697/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:02 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:02.926197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:02.926813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:02.935481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.936236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.936922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:02.937922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:02.938709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:02.939561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.077064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:03.085359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05cc2278-71f7-4c33-b901-796a5a6698fe tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.545193 Sep 25 01:18:03.101882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1687/3384] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:02 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:03.140229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-760b542a-ca44-4f10-bc78-d30960717707 req-9f28b87d-c6c6-454e-a0da-aa81d24fb256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0692ab-2627-474a-9bfc-41d182e863e7", "name": "network-vif-deleted", "tag": "5b548a6c-ba24-4033-9fa3-c898c507829a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:03.152413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-760b542a-ca44-4f10-bc78-d30960717707 req-9f28b87d-c6c6-454e-a0da-aa81d24fb256 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.153228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-760b542a-ca44-4f10-bc78-d30960717707 req-9f28b87d-c6c6-454e-a0da-aa81d24fb256 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.153880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-760b542a-ca44-4f10-bc78-d30960717707 req-9f28b87d-c6c6-454e-a0da-aa81d24fb256 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.174183 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-760b542a-ca44-4f10-bc78-d30960717707 req-9f28b87d-c6c6-454e-a0da-aa81d24fb256 service nova] Creating event network-vif-deleted:5b548a6c-ba24-4033-9fa3-c898c507829a for instance 0f0692ab-2627-474a-9bfc-41d182e863e7 on n-h1-master-1 Sep 25 01:18:03.181690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-760b542a-ca44-4f10-bc78-d30960717707 req-9f28b87d-c6c6-454e-a0da-aa81d24fb256 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051991 Sep 25 01:18:03.182965 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1688/3385] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:03.267869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:03.280681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b3544df-afa4-4fbb-8be0-3b56ff1cb76e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.357351 Sep 25 01:18:03.283967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1698/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:02 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:03.408301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "name": "network-vif-unplugged", "status": "completed", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:03.429562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.430124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.430565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.456331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:03.457017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:03.472643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.478150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.494202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.495264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.495750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.496186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.498366 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] Creating event network-vif-unplugged:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h1-master-1 Sep 25 01:18:03.505785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:18:03.548115 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6c19ac27-6669-4952-9f24-eae90661eeed req-a48dfbef-46ee-488a-9598-b4ed2efd1524 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142891 Sep 25 01:18:03.550160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1689/3387] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:03.555118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.555865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.556486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.557152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lazy-loading 'fault' on Instance uuid b56a9ef5-540c-46e3-8f3f-6c092da3ee26 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:18:03.742230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:03.743697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:03.754814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.755657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.756579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.758231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.758938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.759648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.779104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:03.793633 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91ff816f-4283-4a02-b118-ac7854266bc5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 200 len: 1311 microversion: 2.1 time: 0.335804 Sep 25 01:18:03.797495 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1699/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:03 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:03.936952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:03.938048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:03.956103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.956805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.961096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:03.962195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:03.963758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:03.964503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:04.496956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:04.513310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b938b84-5c7d-49fd-bb74-eac8426bd29c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1265 microversion: 2.1 time: 0.584423 Sep 25 01:18:04.514589 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1700/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:03 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1265 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:04.519623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:04.520243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:04.532728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:04.533692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:04.534514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:04.535415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:04.536056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:04.536659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:04.556793 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:04.787932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:04.798245 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3251cf1-c372-4c4e-9ddf-a196f1dc2278 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 1.060817 Sep 25 01:18:04.809826 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1690/3390] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:03 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:04.818436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:04.820507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:04.828083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:04.828569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:04.828998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:04.829761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:04.830204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:04.830618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.141520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:05.151764 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-abfb7464-6bdb-4f78-8f48-4fd0ef463817 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.635924 Sep 25 01:18:05.169759 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1701/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:04 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:05.175371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:05.175987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: b56a9ef5-540c-46e3-8f3f-6c092da3ee26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:05.189512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.190697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.191463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.192216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.192667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.193091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.213262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] HTTP exception thrown: Instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 could not be found. Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Request method failure captured: Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 HTTP/1.1 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6v4nyoV_yZcl9Y2TWA8FMm6yfUz9SSHPZHqqCSePXoG3pQ48ba8yG8c4eYDk2F_EtIMIpqmObwEx1egj8DNRF4QvD6Aszr_YN5vDMqmduzI6Upk3qc_3H2g5vYQAl52UZ6hshIxi1P8RqW90BUyexqroMQaUP2SX-WU-F-lWcd__4s Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31a0aa9bcbe5414eb0e4e412069cca3b Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31a0aa9bcbe5414eb0e4e412069cca3b"}]}] Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31a0aa9bcbe5414eb0e4e412069cca3b Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ListServerFiltersTestJSON-1626307164-project Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b83c3369cd634d3aa48681fd18492a0a Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ListServerFiltersTestJSON-1626307164-project Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 could not be found. Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b56a9ef5-540c-46e3-8f3f-6c092da3ee26'} Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 could not be found. Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 could not be found. Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:05.215509 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 could not be found. Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Returning 404 to user: Instance b56a9ef5-540c-46e3-8f3f-6c092da3ee26 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:05.220286 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-345faf62-34b2-4988-ad8e-23a874f22be3 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26" status: 404 len: 111 microversion: 2.1 time: 0.045922 Sep 25 01:18:05.225593 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1702/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:05 2022] GET /compute/v2.1/servers/b56a9ef5-540c-46e3-8f3f-6c092da3ee26 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:05.234095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:05.235025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:05.260766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.262999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.265115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.268336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.268965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.270221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.304144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:05.339848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:05.355296 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-171bab92-7e97-4dae-8aa5-67b773a8aa9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.542471 Sep 25 01:18:05.355931 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1691/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:04 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:05.361157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:05.391079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.391981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.392771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.418014 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:05.420272 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] Creating event network-changed:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h1-master-1 Sep 25 01:18:05.438730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:18:05.467296 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3e6ea87f-71f5-476e-9152-4113b1b66a0d req-9597d8c1-d84b-4690-b9e7-68aa205d6efd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109706 Sep 25 01:18:05.468125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1692/3394] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:05.525049 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9d729e27-81ce-4712-9f45-038e466781b4 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 204 len: 0 microversion: 2.1 time: 0.296821 Sep 25 01:18:05.529204 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1703/3395] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:05 2022] DELETE /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:05.536425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:05.537148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:05.545114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:05.546360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:05.554464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.555991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.556396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.556706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.557309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.557904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.558430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.559156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.560160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.560710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.561430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.562796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.736323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:05.748113 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27da5204-a542-491a-8499-e48dadb9545c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1265 microversion: 2.1 time: 0.211151 Sep 25 01:18:05.749457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1704/3396] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:05 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:05.755298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d067d3dd-f1b0-4969-867c-d98d6f5b18d4 req-8a7ab06c-2781-4d4d-b181-353691822c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "name": "network-vif-plugged", "status": "completed", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:05.767660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d067d3dd-f1b0-4969-867c-d98d6f5b18d4 req-8a7ab06c-2781-4d4d-b181-353691822c51 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.768523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d067d3dd-f1b0-4969-867c-d98d6f5b18d4 req-8a7ab06c-2781-4d4d-b181-353691822c51 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.769133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d067d3dd-f1b0-4969-867c-d98d6f5b18d4 req-8a7ab06c-2781-4d4d-b181-353691822c51 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.784454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d067d3dd-f1b0-4969-867c-d98d6f5b18d4 req-8a7ab06c-2781-4d4d-b181-353691822c51 service nova] Creating event network-vif-plugged:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h1-master-1 Sep 25 01:18:05.791452 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d067d3dd-f1b0-4969-867c-d98d6f5b18d4 req-8a7ab06c-2781-4d4d-b181-353691822c51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040365 Sep 25 01:18:05.792658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1705/3397] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:05.824439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:05.824945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:05.848441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.848965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.849468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:05.850732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:05.851197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:05.851637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:06.174306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:06.182673 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e2bbdbe-7b87-412f-9267-f7111e990647 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 200 len: 1518 microversion: 2.1 time: 0.652291 Sep 25 01:18:06.183265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1693/3398] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:05 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 1518 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:06.192447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:06.193062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:06.200072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:06.200847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:06.201488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:06.202543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:06.203001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:06.203419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:06.333617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:06.348127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bfd905f4-b8f6-4204-a350-d7da71713f11 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.528287 Sep 25 01:18:06.349076 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1706/3399] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:05 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:06.383486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:06.384114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:06.400194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:06.400488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:06.400935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:06.401684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:06.402148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:06.402574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:07.327357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:07.342411 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bca076c0-7ade-47d7-8052-1168e7727945 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.958987 Sep 25 01:18:07.343723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1707/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:06 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:07.350563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:07.355132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:07.356092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:07.360918 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-33db7b16-85ac-4bbb-9a88-9927c3851df2 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 1.176578 Sep 25 01:18:07.366992 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1694/3401] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:06 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:07.384725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:07.386367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:07.392049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:07.392794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:07.393241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:07.394002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:07.394714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:07.395345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:07.399464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:07.400340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:07.401037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:07.409456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:07.410349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:07.411988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.066572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:08.076148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-792fd83e-7b73-4ad3-a0d1-02d9bba191b5 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 200 len: 1518 microversion: 2.1 time: 0.707377 Sep 25 01:18:08.077263 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1695/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:07 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 1518 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:08.082880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:08.083503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:08.097270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:08.097684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:08.098324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.099220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:08.100496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:08.101163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.112192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:08.127336 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eb82a406-f4f4-4504-ada7-38ea59b0d61a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.782009 Sep 25 01:18:08.128520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1708/3403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:07 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:08.374552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:08.375339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:08.394234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:08.395426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:08.396066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.397542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:08.398862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:08.399306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.608722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:08.618366 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2b2b8158-b6ab-4b9f-8790-6cd8b691007f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 0.539824 Sep 25 01:18:08.620606 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1696/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:08 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:08.626597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:08.627621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:08.636450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:08.637234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:08.637899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.638779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:08.639665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:08.641526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:08.982185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:08.991389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ece3796-6485-4f39-837e-ea0d7deb1a66 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1316 microversion: 2.1 time: 0.624717 Sep 25 01:18:08.992332 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1709/3405] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:08 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:09.104679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:09.106533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:09.133463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.134135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.136222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:09.138411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.141632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.142937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:09.272421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:09.284608 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f381d2e-fcf9-4d64-ac19-7dc0fb1da94e tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1468 microversion: 2.1 time: 0.661869 Sep 25 01:18:09.286359 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1697/3406] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:08 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1468 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:09.295881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:09.297078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:09.308543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.309248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.310959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:09.312057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.312697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.313860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:09.336915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:09.350753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ee7a338-0b44-473f-ba43-233ae1000ef7 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 200 len: 1476 microversion: 2.1 time: 0.253915 Sep 25 01:18:09.351789 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1710/3407] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:09 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:09.361787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e597e419-6c83-4cea-b25a-d2e2452252c1 req-192c3d59-7cd9-48cf-adb4-a2de5356884b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b280d42-10ba-4ddb-9c3f-f0d3009c1d66", "name": "network-vif-deleted", "tag": "38cadc99-611d-41be-9f9a-ea53b422bd56"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:09.398558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e597e419-6c83-4cea-b25a-d2e2452252c1 req-192c3d59-7cd9-48cf-adb4-a2de5356884b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.402448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e597e419-6c83-4cea-b25a-d2e2452252c1 req-192c3d59-7cd9-48cf-adb4-a2de5356884b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.405789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e597e419-6c83-4cea-b25a-d2e2452252c1 req-192c3d59-7cd9-48cf-adb4-a2de5356884b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:09.438113 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e597e419-6c83-4cea-b25a-d2e2452252c1 req-192c3d59-7cd9-48cf-adb4-a2de5356884b service nova] Creating event network-vif-deleted:38cadc99-611d-41be-9f9a-ea53b422bd56 for instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 on n-h1-master-1 Sep 25 01:18:09.451150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e597e419-6c83-4cea-b25a-d2e2452252c1 req-192c3d59-7cd9-48cf-adb4-a2de5356884b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097637 Sep 25 01:18:09.452341 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1711/3408] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:09.649605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:09.650523 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:09.665312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.665900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.668861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:09.669830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:09.672351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:09.673913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:10.274848 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=13 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:10.298325 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:10.468920 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:10.566127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:10.580314 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f68ea861-23c4-4d16-92ad-6bfb67e46f73 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 1.290039 Sep 25 01:18:10.594957 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1698/3409] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:09 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:10.607978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:10.608614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:10.625659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:10.632619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:10.633159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:10.633970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:10.634644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:10.635102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:10.712890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:10.720779 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61acc62a-9fc2-4ed2-806d-4f5ecf65e4f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1508 microversion: 2.1 time: 1.076481 Sep 25 01:18:10.721371 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1712/3410] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:09 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1508 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:10.759875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:10.760866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:10.775765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:10.776543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:10.780496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:10.781532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:10.782205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:10.785242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:11.304091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:11.315796 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0f020e0a-caf3-4a71-af6c-91f021a07743 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.719489 Sep 25 01:18:11.317191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1699/3411] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:10 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:11.323229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:11.324142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:11.325789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:11.333174 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-71d098c8-4ac4-42cb-98d0-901d9deab094 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1461 microversion: 2.1 time: 0.586382 Sep 25 01:18:11.335840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1713/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:10 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1461 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:11.364893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:11.367850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:11.368549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:11.370628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:11.371629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:11.372470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:11.394137 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] HTTP exception thrown: Instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 could not be found. Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Request method failure captured: Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 HTTP/1.1 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6v4nyoV_yZcl9Y2TWA8FMm6yfUz9SSHPZHqqCSePXoG3pQ48ba8yG8c4eYDk2F_EtIMIpqmObwEx1egj8DNRF4QvD6Aszr_YN5vDMqmduzI6Upk3qc_3H2g5vYQAl52UZ6hshIxi1P8RqW90BUyexqroMQaUP2SX-WU-F-lWcd__4s Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 31a0aa9bcbe5414eb0e4e412069cca3b Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31a0aa9bcbe5414eb0e4e412069cca3b"}]}] Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 31a0aa9bcbe5414eb0e4e412069cca3b Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServerFiltersTestJSON-1626307164-project Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: b83c3369cd634d3aa48681fd18492a0a Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServerFiltersTestJSON-1626307164-project Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 could not be found. Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8b280d42-10ba-4ddb-9c3f-f0d3009c1d66'} Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 could not be found. Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 could not be found. Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:11.398214 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 could not be found. Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:11.403804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Returning 404 to user: Instance 8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:11.405807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bacadbbe-1648-4b6b-99a8-3b7f2977369b tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66" status: 404 len: 111 microversion: 2.1 time: 0.086353 Sep 25 01:18:11.406178 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1700/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:11 2022] GET /compute/v2.1/servers/8b280d42-10ba-4ddb-9c3f-f0d3009c1d66 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:11.418730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:11.419667 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:11.429864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:11.430731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:11.431494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:11.432332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:11.432979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:11.433647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:11.491784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:11.573851 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:11.649451 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cbb2721f-e8f4-4d7c-b013-bd11ab4a2503 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 204 len: 0 microversion: 2.1 time: 0.238652 Sep 25 01:18:11.654198 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1701/3414] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:11 2022] DELETE /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:11.667334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-801790534", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:11.758163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] validate_networks() for [('2309cf64-61cd-4755-9e43-04778a22257e', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:18:11.765106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:11.765764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:11.778803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:11.779295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:11.779757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:11.780430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:11.780883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:11.781354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:12.319210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63e4ee0c-dbdc-4812-a024-9bb367340161 tempest-MigrationsAdminTest-730347336 tempest-MigrationsAdminTest-730347336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1612 microversion: 2.1 time: 0.960020 Sep 25 01:18:12.320082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1714/3415] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:11 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1612 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:12.324880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:12.325765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:12.344246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:12.345037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:12.348000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:12.348753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:12.349224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:12.349861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:12.735603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:12.747429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a77e7cd5-3d9e-4340-bab3-1ce4f4443e60 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.425304 Sep 25 01:18:12.768748 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1715/3416] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:12 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:12.775243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:12.776194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:12.784676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:12.793665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:12.794417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:12.802390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:12.803428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:12.803873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.349152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:18:13.350331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:18:13.350813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:18:13.351420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:18:13.351850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:18:13.372775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.373278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.373753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.374472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.374939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.375361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.420869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Getting quotas for project ba24a0d735e74e24aa2cabf4233d0e71. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:18:13.437577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Getting quotas for user 67ce0396cdb949558664fac11b83aca1 and project ba24a0d735e74e24aa2cabf4233d0e71. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:18:13.444042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:13.458882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:18:13.467854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:18:13.482793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00e70d65-2444-4420-98a3-b9bd2e442f4c tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1517 microversion: 2.1 time: 0.711718 Sep 25 01:18:13.489466 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1716/3417] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:12 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1517 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:13.501097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:13.506214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:13.524486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.525539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.526176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.532441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.534390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.535176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.555561 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a37b6e69-d2a2-4023-9038-56aeda1a1721 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899763 Sep 25 01:18:13.562937 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1702/3418] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:18:13.573642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-82075540-387c-4ea1-bc71-053f4f25e9e4 req-5be111ae-4813-4bb5-85ae-93666e2f2073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "name": "network-vif-plugged", "status": "completed", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:13.594460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-82075540-387c-4ea1-bc71-053f4f25e9e4 req-5be111ae-4813-4bb5-85ae-93666e2f2073 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.595507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-82075540-387c-4ea1-bc71-053f4f25e9e4 req-5be111ae-4813-4bb5-85ae-93666e2f2073 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.596134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-82075540-387c-4ea1-bc71-053f4f25e9e4 req-5be111ae-4813-4bb5-85ae-93666e2f2073 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.615231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-82075540-387c-4ea1-bc71-053f4f25e9e4 req-5be111ae-4813-4bb5-85ae-93666e2f2073 service nova] Creating event network-vif-plugged:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h1-master-1 Sep 25 01:18:13.623403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-82075540-387c-4ea1-bc71-053f4f25e9e4 req-5be111ae-4813-4bb5-85ae-93666e2f2073 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053532 Sep 25 01:18:13.625449 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1703/3419] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:13.631796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a9651025-4b73-4c32-ad74-dba3777fa6d3 req-41973bd3-a7fd-43b2-a900-3ddc814bc42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24dfaf3-4058-4dac-80f3-b8dcba17f336", "tag": "f46992f4-e8f9-4563-b623-70ff8828e9be"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:13.650774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9651025-4b73-4c32-ad74-dba3777fa6d3 req-41973bd3-a7fd-43b2-a900-3ddc814bc42b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.651313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9651025-4b73-4c32-ad74-dba3777fa6d3 req-41973bd3-a7fd-43b2-a900-3ddc814bc42b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.651767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9651025-4b73-4c32-ad74-dba3777fa6d3 req-41973bd3-a7fd-43b2-a900-3ddc814bc42b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.664631 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a9651025-4b73-4c32-ad74-dba3777fa6d3 req-41973bd3-a7fd-43b2-a900-3ddc814bc42b service nova] Creating event network-changed:f46992f4-e8f9-4563-b623-70ff8828e9be for instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 on n-h2-master-1 Sep 25 01:18:13.670510 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a9651025-4b73-4c32-ad74-dba3777fa6d3 req-41973bd3-a7fd-43b2-a900-3ddc814bc42b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043265 Sep 25 01:18:13.672002 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1704/3420] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:13.678123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:13.679061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:13.692040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.692545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.692988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.694580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:13.695158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:13.695805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:13.732759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:13.853571 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20e03919-5ac0-448e-afa9-03090a5fe3ad tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 204 len: 0 microversion: 2.1 time: 0.178705 Sep 25 01:18:13.854828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1705/3421] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:13 2022] DELETE /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:13.860810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7067e24d-b427-413f-802c-52946523e821 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:13.861824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7067e24d-b427-413f-802c-52946523e821 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:13.983686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7067e24d-b427-413f-802c-52946523e821 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:13.994413 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7067e24d-b427-413f-802c-52946523e821 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1216 microversion: 2.1 time: 0.137786 Sep 25 01:18:13.995181 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1706/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:13 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:14.003414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:14.007290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:14.026193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.027142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.027827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.028817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.030483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.031272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.086903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:14.098642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ea95ba4b-5aec-478a-8d9c-111763918bc9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1529 microversion: 2.1 time: 0.607754 Sep 25 01:18:14.120094 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1717/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:13 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1529 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:14.125059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:14.125736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:14.145821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.148178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.148586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.151857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.152932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.154523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.660003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:14.670505 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a6d553cc-776b-4216-9460-8c6c88b813a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.672997 Sep 25 01:18:14.671466 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1707/3424] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:13 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:14.676677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:14.682443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:14.694636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.696202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.696892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.697857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.702593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.703400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.761856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:14.780668 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bf8eab68-68c5-4ea1-bcbb-692de3524b1f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1467 microversion: 2.1 time: 0.658784 Sep 25 01:18:14.781707 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1718/3425] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:14 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1467 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:14.792480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c2c0808f-7530-4974-8f54-ffaf40aaa57e req-5d761beb-8354-4650-aca7-5bf8bc0ee54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de5d07f-1a7b-4152-bebd-455f9a0af262", "name": "network-vif-deleted", "tag": "fa5a309e-610e-482f-885b-9ad08b48e85c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:14.819007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c2c0808f-7530-4974-8f54-ffaf40aaa57e req-5d761beb-8354-4650-aca7-5bf8bc0ee54e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:14.820453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c2c0808f-7530-4974-8f54-ffaf40aaa57e req-5d761beb-8354-4650-aca7-5bf8bc0ee54e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:14.821369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c2c0808f-7530-4974-8f54-ffaf40aaa57e req-5d761beb-8354-4650-aca7-5bf8bc0ee54e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:14.833665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c2c0808f-7530-4974-8f54-ffaf40aaa57e req-5d761beb-8354-4650-aca7-5bf8bc0ee54e service nova] Creating event network-vif-deleted:fa5a309e-610e-482f-885b-9ad08b48e85c for instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 on n-h2-master-1 Sep 25 01:18:14.839077 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c2c0808f-7530-4974-8f54-ffaf40aaa57e req-5d761beb-8354-4650-aca7-5bf8bc0ee54e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055498 Sep 25 01:18:14.840267 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1719/3426] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:14.860425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:14.872735 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa1f1357-ae59-494b-af86-17c95df7f900 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1306 microversion: 2.1 time: 0.199859 Sep 25 01:18:14.874112 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1708/3427] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:14 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1306 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:15.021324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:15.022398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:15.028542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.029027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.029487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.030185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.030655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.031118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.124849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:15.125811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:15.133846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.134624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.135735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.136812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.137511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.138111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.140528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:15.152299 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aecf51da-afe9-4566-85c4-9ba40809698b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1220 microversion: 2.1 time: 0.135787 Sep 25 01:18:15.153676 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1720/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:15 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:15.396779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:15.428785 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3fcdfa47-bd46-46c1-b23f-c9f6cf6e176d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1529 microversion: 2.1 time: 0.306631 Sep 25 01:18:15.429785 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1709/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:15 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1529 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:15.700084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:15.701580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:15.736491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.737009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.742321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.746961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.747696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.748817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.812343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:15.812982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:15.825119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.825641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.826079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:15.826792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:15.827243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:15.827664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.355814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:16.364589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b73f09b-a3e6-4c02-9e4f-9e2abdf9bd91 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 200 len: 1467 microversion: 2.1 time: 0.560050 Sep 25 01:18:16.367550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1710/3430] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:15 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 1467 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:16.373509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:16.379674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-47949634-460f-4b31-ba85-f2bdfe2f85df req-7d91ba3c-4e38-4404-8088-545c00174aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d11c9f1-7562-45de-924d-f168ada2645a", "name": "network-vif-plugged", "status": "completed", "tag": "69da5ff9-8dae-4d3c-954c-3fa51f9e10cd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:16.389634 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff8c78cf-7f2c-42ea-847e-7d86e341d2d2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.698972 Sep 25 01:18:16.407923 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1721/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:15 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:16.424798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:16.430422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:16.450517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.457756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47949634-460f-4b31-ba85-f2bdfe2f85df req-7d91ba3c-4e38-4404-8088-545c00174aec service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.460106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.460498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47949634-460f-4b31-ba85-f2bdfe2f85df req-7d91ba3c-4e38-4404-8088-545c00174aec service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.461136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-47949634-460f-4b31-ba85-f2bdfe2f85df req-7d91ba3c-4e38-4404-8088-545c00174aec service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.463474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.464419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.465039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.469037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.482108 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:16.495148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-47949634-460f-4b31-ba85-f2bdfe2f85df req-7d91ba3c-4e38-4404-8088-545c00174aec service nova] Creating event network-vif-plugged:69da5ff9-8dae-4d3c-954c-3fa51f9e10cd for instance 3d11c9f1-7562-45de-924d-f168ada2645a on n-h2-master-1 Sep 25 01:18:16.516041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-47949634-460f-4b31-ba85-f2bdfe2f85df req-7d91ba3c-4e38-4404-8088-545c00174aec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145674 Sep 25 01:18:16.518033 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1711/3432] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:16.532202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:16.534438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:16.543479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.544403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.545190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.546652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.547816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.548643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.643403 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:16.656074 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1fe85750-3783-4768-8f91-d033d8a6ed9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1274 microversion: 2.1 time: 0.128670 Sep 25 01:18:16.658564 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1712/3433] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:16 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:16.673180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:16.673609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:16.674708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:16.684829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64db5cf5-afe2-4018-8793-4b7adef1f701 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1306 microversion: 2.1 time: 0.273267 Sep 25 01:18:16.686826 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1722/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:16 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1306 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:16.706240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.706889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.707494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.708316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.708944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.710004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.882857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-dca70a88-fd8d-425e-9d85-6d00267d6709 req-4315009b-1424-4666-b6cf-019f74415cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53c9b7-a1f8-4312-b71a-6442629990bc", "name": "network-vif-deleted", "tag": "a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:16.918991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dca70a88-fd8d-425e-9d85-6d00267d6709 req-4315009b-1424-4666-b6cf-019f74415cdb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:16.919486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dca70a88-fd8d-425e-9d85-6d00267d6709 req-4315009b-1424-4666-b6cf-019f74415cdb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:16.919921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dca70a88-fd8d-425e-9d85-6d00267d6709 req-4315009b-1424-4666-b6cf-019f74415cdb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:16.963327 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-dca70a88-fd8d-425e-9d85-6d00267d6709 req-4315009b-1424-4666-b6cf-019f74415cdb service nova] Creating event network-vif-deleted:a1c1f5d1-a823-467f-bbf2-de1f3d7d1afd for instance 1f53c9b7-a1f8-4312-b71a-6442629990bc on n-h1-master-1 Sep 25 01:18:16.983869 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-dca70a88-fd8d-425e-9d85-6d00267d6709 req-4315009b-1424-4666-b6cf-019f74415cdb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105557 Sep 25 01:18:16.990441 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1723/3435] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:17.110059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:17.119706 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e6b606a-9688-41ff-aa19-2c76a843081f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1529 microversion: 2.1 time: 0.459324 Sep 25 01:18:17.120709 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1713/3436] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:16 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1529 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:17.395563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:17.396269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1f53c9b7-a1f8-4312-b71a-6442629990bc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:17.416364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:17.416978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:17.419726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.422548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.423083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.423903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.424295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.424730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.431817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.432309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.432743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.433681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.434310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.434926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.449264 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] HTTP exception thrown: Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc could not be found. Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Request method failure captured: Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc HTTP/1.1 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6sFe2P3c7qvecw65nt9Ex5P0j0p18G7Zth4z2WnKlmmNX1EPwPgl2R5rUnFs464BDpm6ldZVPAAyJw-trPPywaAzhlXBipgJESg4G1utxImA8xumzSrBUgaWfxIPcoKsXXBbAMWrxEquys9YSVpjWbwQLFFSI2yAIXAy6giJdNnWzA Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ae8b5de3254713b60172f6c0b351e1"}]}] Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 5db19a97588e41d1858915c9ccc48620 Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc could not be found. Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1f53c9b7-a1f8-4312-b71a-6442629990bc'} Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc could not be found. Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc could not be found. Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:17.451878 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc could not be found. Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Returning 404 to user: Instance 1f53c9b7-a1f8-4312-b71a-6442629990bc could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:17.457720 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d97c2c11-e976-4ca7-a26f-336bd4444eeb tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc" status: 404 len: 111 microversion: 2.1 time: 0.064881 Sep 25 01:18:17.459731 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1724/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:17 2022] GET /compute/v2.1/servers/1f53c9b7-a1f8-4312-b71a-6442629990bc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:17.467525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:17.468075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:17.478308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.479135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.480685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.482241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.482928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.484242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.523739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:17.649372 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7579b459-45f7-4680-98ec-f86ec8676ae9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 204 len: 0 microversion: 2.1 time: 0.186955 Sep 25 01:18:17.650917 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1725/3438] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:17 2022] DELETE /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:17.660096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:17.667161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:17.668285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:17.675446 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5cf0ec13-aa19-4a0a-bb3c-28bcb6b4a73e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.263386 Sep 25 01:18:17.676076 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1714/3439] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:17 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:17.681664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.682387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.683018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.683976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.684586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.685227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.686873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:17.687499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:17.700481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.701722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.702202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.702987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.703452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.706444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.804219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:17.816802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f9c1b70-c51c-40e9-b16a-4e2358749c45 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1274 microversion: 2.1 time: 0.134579 Sep 25 01:18:17.817878 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1715/3440] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:17 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:17.823321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:17.824203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:17.838495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.839349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.839986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.840907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:17.842201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:17.842639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:17.874032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:17.882909 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-adb34de0-f031-4b9e-b68b-bc6dba7bab8c tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1534 microversion: 2.1 time: 0.222650 Sep 25 01:18:17.893457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1726/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:17 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1534 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:17.949692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83c3369cd634d3aa48681fd18492a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a0aa9bcbe5414eb0e4e412069cca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:17.960817 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6aa5c1d5-a3e1-4798-8c24-2118855da602 tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 200 len: 1306 microversion: 2.1 time: 0.141468 Sep 25 01:18:17.975204 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1716/3442] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:17 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 1306 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:18.147218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:18.147740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:18.157181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:18.157890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:18.158341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:18.159069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:18.159694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:18.160131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:18.703577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:18.704361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:18.724529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:18.727579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:18.728615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:18.730314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:18.731034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:18.731911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:18.933456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:18.947335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e9f2e84-15e7-46aa-b4d6-e020ce3b4c8f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1529 microversion: 2.1 time: 0.804742 Sep 25 01:18:18.961768 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1727/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:18 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1529 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:18.983318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:18.983964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:18.990821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:18.991584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:18.992306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:18.993205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:18.993868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:18.994464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:19.202365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:19.210591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec4d5e5c-e4c6-48d4-8377-408bcc1c53dd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.513507 Sep 25 01:18:19.215978 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1717/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:18 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:19.232493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:19.236360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:19.252855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:19.253361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:19.253840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:19.257937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:19.258888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:19.259880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:19.692910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:19.704566 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2187cbd1-ac5b-4788-aef6-d318f9f50839 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 0.741623 Sep 25 01:18:19.711502 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1728/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:18 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:19.731286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:19.732091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] [instance: 6de5d07f-1a7b-4152-bebd-455f9a0af262] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:19.738398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:19.739298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:19.740135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:19.741131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:19.741892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:19.742561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:19.758120 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] HTTP exception thrown: Instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 could not be found. Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Request method failure captured: Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 HTTP/1.1 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6v4nyoV_yZcl9Y2TWA8FMm6yfUz9SSHPZHqqCSePXoG3pQ48ba8yG8c4eYDk2F_EtIMIpqmObwEx1egj8DNRF4QvD6Aszr_YN5vDMqmduzI6Upk3qc_3H2g5vYQAl52UZ6hshIxi1P8RqW90BUyexqroMQaUP2SX-WU-F-lWcd__4s Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31a0aa9bcbe5414eb0e4e412069cca3b Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31a0aa9bcbe5414eb0e4e412069cca3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31a0aa9bcbe5414eb0e4e412069cca3b"}]}] Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31a0aa9bcbe5414eb0e4e412069cca3b Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1626307164 Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ListServerFiltersTestJSON-1626307164-project Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: b83c3369cd634d3aa48681fd18492a0a Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ListServerFiltersTestJSON-1626307164-project Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 could not be found. Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '6de5d07f-1a7b-4152-bebd-455f9a0af262'} Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 could not be found. Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 could not be found. Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:19.760226 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 could not be found. Sep 25 01:18:19.765047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:19.767657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] Returning 404 to user: Instance 6de5d07f-1a7b-4152-bebd-455f9a0af262 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:19.768849 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c634a24-887e-4772-8d65-0f11ba1fa9dc tempest-ListServerFiltersTestJSON-1626307164 tempest-ListServerFiltersTestJSON-1626307164-project] 10.222.0.16 "GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262" status: 404 len: 111 microversion: 2.1 time: 0.042098 Sep 25 01:18:19.770348 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1729/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:19 2022] GET /compute/v2.1/servers/6de5d07f-1a7b-4152-bebd-455f9a0af262 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:19.794183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:19.811128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5f3e9d3-038a-4f4b-a6f1-8e2eb2f993f9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1534 microversion: 2.1 time: 0.593110 Sep 25 01:18:19.811731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1718/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:19 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1534 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:19.974515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:19.976583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:19.984745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:19.988812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:19.991331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:19.992424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:19.994633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:19.996916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:20.246341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:20.247333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:20.251324 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:20.262924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:20.265279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:20.266039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:20.270779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:20.272265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:20.272962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:21.026887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:21.036688 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a4fc946-cd70-4fb7-b5c4-5e8a12f6a541 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 1.066100 Sep 25 01:18:21.058352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1730/3448] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:19 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:21.072596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:21.073587 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:21.085886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:21.087166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:21.088793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:21.090853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:21.093333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:21.094057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:21.159061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:21.164769 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:21.176848 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2603fd1a-6464-4214-aae3-d020da472f7b tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.938220 Sep 25 01:18:21.183853 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1719/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:20 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:21.199105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:21.201095 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:21.225190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:21.225819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:21.231011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:21.231823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:21.232400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:21.232833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:21.378224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:21.395233 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-94648202-7f11-4f49-9962-613e1e5cd102 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 200 len: 1492 microversion: 2.1 time: 0.209676 Sep 25 01:18:21.395830 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1720/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:21 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 1492 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:21.431464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-56da2b32-8267-400d-9271-b1b08aaa172a req-887e3cb8-6645-4cf4-bfb3-ba555281c377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b420ff-1bf8-429e-9210-eab7c0f69b23", "name": "network-vif-deleted", "tag": "5e8f2145-0b11-4987-af78-f5575e97dcc4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:21.475642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-56da2b32-8267-400d-9271-b1b08aaa172a req-887e3cb8-6645-4cf4-bfb3-ba555281c377 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:21.476215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-56da2b32-8267-400d-9271-b1b08aaa172a req-887e3cb8-6645-4cf4-bfb3-ba555281c377 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:21.476676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-56da2b32-8267-400d-9271-b1b08aaa172a req-887e3cb8-6645-4cf4-bfb3-ba555281c377 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:21.506258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-56da2b32-8267-400d-9271-b1b08aaa172a req-887e3cb8-6645-4cf4-bfb3-ba555281c377 service nova] Creating event network-vif-deleted:5e8f2145-0b11-4987-af78-f5575e97dcc4 for instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 on n-h1-master-1 Sep 25 01:18:21.512762 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-56da2b32-8267-400d-9271-b1b08aaa172a req-887e3cb8-6645-4cf4-bfb3-ba555281c377 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086825 Sep 25 01:18:21.514152 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1721/3451] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:18:21.687113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:21.701551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd83c4a4-b7fc-4e96-8f79-d890da100d65 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 0.637386 Sep 25 01:18:21.702427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1731/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:21 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:22.072733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:22.073491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:22.088276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.088790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.089236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.090006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.090470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.090909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.200203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:22.201767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:22.220202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.225634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.226352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.227904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.228559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.229249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.569142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:22.635629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd546bfd-bb95-49ba-86c3-41907410b230 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.568780 Sep 25 01:18:22.642265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1722/3453] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:22 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:22.650289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:22.651877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 30b420ff-1bf8-429e-9210-eab7c0f69b23] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:22.678970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.680115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.680745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.681710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.682348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.684605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.702348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:22.712417 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe292ecc-08df-4a57-9b76-bd841114eee3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.516049 Sep 25 01:18:22.715854 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1732/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:22 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:22.716938 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] HTTP exception thrown: Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 could not be found. Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Request method failure captured: Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 HTTP/1.1 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sFe2P3c7qvecw65nt9Ex5P0j0p18G7Zth4z2WnKlmmNX1EPwPgl2R5rUnFs464BDpm6ldZVPAAyJw-trPPywaAzhlXBipgJESg4G1utxImA8xumzSrBUgaWfxIPcoKsXXBbAMWrxEquys9YSVpjWbwQLFFSI2yAIXAy6giJdNnWzA Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ae8b5de3254713b60172f6c0b351e1"}]}] Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 5db19a97588e41d1858915c9ccc48620 Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 could not be found. Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '30b420ff-1bf8-429e-9210-eab7c0f69b23'} Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 could not be found. Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 could not be found. Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:22.719592 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 could not be found. Sep 25 01:18:22.725265 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:22.727471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Returning 404 to user: Instance 30b420ff-1bf8-429e-9210-eab7c0f69b23 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:22.728562 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87be3328-7c93-4b75-9660-cec6401daa77 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23" status: 404 len: 111 microversion: 2.1 time: 0.084868 Sep 25 01:18:22.729692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1723/3455] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:22 2022] GET /compute/v2.1/servers/30b420ff-1bf8-429e-9210-eab7c0f69b23 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:22.736238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:22.737357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:22.742794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1133d8a9-632f-47d1-8b11-5735637d8d80 req-bc12da06-3c02-4632-9b48-92dc84375945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24dfaf3-4058-4dac-80f3-b8dcba17f336", "name": "network-vif-plugged", "status": "completed", "tag": "f46992f4-e8f9-4563-b623-70ff8828e9be"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:22.744422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.745048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.745530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.746438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.747367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.747969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.774279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1133d8a9-632f-47d1-8b11-5735637d8d80 req-bc12da06-3c02-4632-9b48-92dc84375945 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:22.775584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1133d8a9-632f-47d1-8b11-5735637d8d80 req-bc12da06-3c02-4632-9b48-92dc84375945 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:22.776251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1133d8a9-632f-47d1-8b11-5735637d8d80 req-bc12da06-3c02-4632-9b48-92dc84375945 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:22.797520 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1133d8a9-632f-47d1-8b11-5735637d8d80 req-bc12da06-3c02-4632-9b48-92dc84375945 service nova] Creating event network-vif-plugged:f46992f4-e8f9-4563-b623-70ff8828e9be for instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 on n-h2-master-1 Sep 25 01:18:22.827225 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1133d8a9-632f-47d1-8b11-5735637d8d80 req-bc12da06-3c02-4632-9b48-92dc84375945 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099861 Sep 25 01:18:22.831516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1733/3456] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:22.846909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eff8bdde-44db-4f1e-a6ee-7dc8937e32bc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '.version_select at 0x7f7beba03820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:22.906710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eff8bdde-44db-4f1e-a6ee-7dc8937e32bc tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306024107" status: 202 len: 0 microversion: 2.1 time: 0.073069 Sep 25 01:18:22.912558 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1734/3457] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306024107 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:18:23.049155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:23.071847 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f5e6878e-b36e-4296-92a3-b1b1bdd66e5c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 0.340541 Sep 25 01:18:23.073582 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1724/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:22 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:23.518036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-817ade71-79af-4efe-8f52-a0d1b39475e6 req-b65cd66e-bcdc-4358-9c4e-3b16ec6d603f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746b7b50-ec4b-480c-8f57-2a2daba9a131", "tag": "1858bd8e-df0e-429b-8539-8b6bfc35cbf5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:23.564654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-817ade71-79af-4efe-8f52-a0d1b39475e6 req-b65cd66e-bcdc-4358-9c4e-3b16ec6d603f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:23.572218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-817ade71-79af-4efe-8f52-a0d1b39475e6 req-b65cd66e-bcdc-4358-9c4e-3b16ec6d603f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:23.572842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-817ade71-79af-4efe-8f52-a0d1b39475e6 req-b65cd66e-bcdc-4358-9c4e-3b16ec6d603f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:23.639890 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-817ade71-79af-4efe-8f52-a0d1b39475e6 req-b65cd66e-bcdc-4358-9c4e-3b16ec6d603f service nova] Creating event network-changed:1858bd8e-df0e-429b-8539-8b6bfc35cbf5 for instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 on n-h1-master-1 Sep 25 01:18:23.648266 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-817ade71-79af-4efe-8f52-a0d1b39475e6 req-b65cd66e-bcdc-4358-9c4e-3b16ec6d603f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143808 Sep 25 01:18:23.649180 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1735/3459] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:23.669479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:23.670147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:23.696556 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:23.705996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:23.708206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:23.709111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:23.711301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:23.713438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:23.714054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:23.743484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:23.747736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:23.756755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:23.757249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:23.757708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:23.758413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:23.758866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:23.759286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:23.992807 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:24.255884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:24.265063 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ba0da1d-5751-4c51-b875-481eef2aac4c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.599830 Sep 25 01:18:24.278514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1725/3460] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:23 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:24.289522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:24.290388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:24.297014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:24.297836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:24.298603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:24.299706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:24.300343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:24.300940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:24.344479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:24.360062 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e473f89e-730b-47c7-8474-8d6854a849e4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1307 microversion: 2.1 time: 0.619466 Sep 25 01:18:24.363067 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1736/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:23 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:24.713905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:24.729933 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-234a9444-9e24-4868-a07b-c5a58f779873 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 0.449936 Sep 25 01:18:24.730555 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1726/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:24 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:25.028394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:25.029776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:25.034250 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:25.052796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.053541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.054674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.056214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.057019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.057745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.114385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:25.283854 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0046bd0a-9e8a-47c3-8382-80d824c65722 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 204 len: 0 microversion: 2.1 time: 0.260154 Sep 25 01:18:25.288749 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1737/3463] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:25 2022] DELETE /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:25.292569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:25.293756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:25.296719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:25.298603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:25.305501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.307722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.310102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.311114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.311842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.311996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.312361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.314080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.315208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.315940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.316403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.316832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.841373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:25.850234 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-879916d6-e428-4df1-8f4f-ebc31c0c19cf tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.561951 Sep 25 01:18:25.854814 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1727/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:25 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:25.869464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:25.886485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:25.895294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:25.904324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.907142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.908195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.913016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.914901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.915085 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2a310ce-6715-4a97-be1d-27b412fd76a1 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1467 microversion: 2.1 time: 0.621017 Sep 25 01:18:25.917737 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1738/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:25 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1467 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:25.930473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:25.931101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:25.936186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.948839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.949829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.950309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:25.951613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:25.967515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:25.969774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:26.481713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:26.498071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-241becce-d2b8-4b16-945f-91df9318d6d1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1487 microversion: 2.1 time: 0.633143 Sep 25 01:18:26.499202 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1728/3466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:25 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1487 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:26.557845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1db5d79-90b7-42eb-a1f2-ad94fec2fd74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:26.571193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1db5d79-90b7-42eb-a1f2-ad94fec2fd74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:26.573064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1db5d79-90b7-42eb-a1f2-ad94fec2fd74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:26.573933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1db5d79-90b7-42eb-a1f2-ad94fec2fd74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:26.587565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:26.596732 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:26.608092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cd9c1c92-e719-44b6-a25f-d2d82a85cbab tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 0.687534 Sep 25 01:18:26.609344 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1739/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:25 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:26.717344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1db5d79-90b7-42eb-a1f2-ad94fec2fd74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Going to try to stop instance {{(pid=122384) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:18:26.836646 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1db5d79-90b7-42eb-a1f2-ad94fec2fd74 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336/action" status: 202 len: 0 microversion: 2.1 time: 0.285123 Sep 25 01:18:26.836646 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1729/3468] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:18:26 2022] POST /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:18:26.854191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:26.855471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:26.883298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:26.883999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:26.891044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:26.891813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:26.892744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:26.894196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:26.895197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:26.895677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:26.896427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:26.896573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:26.897338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:26.898075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:26.898531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:26.898958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:27.869800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:27.879329 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0f681e9-3ed9-41d6-b90f-a5b7c5dfdb62 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 1.001547 Sep 25 01:18:27.882633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1730/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:26 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:27.911216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:27.912575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:27.924140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:27.937864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:27.938492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:27.939348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:27.939958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:27.940469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:27.960638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:27.969334 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8d4f0b5c-e6b3-48dd-98ae-d6d1ff4f4096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 1.128580 Sep 25 01:18:27.979441 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1740/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:26 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:27.994890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:27.999042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:28.021903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:28.022495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:28.022969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:28.023699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:28.024213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:28.025571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:28.740919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:28.749088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b80c8bb8-0401-4429-9923-e0beb14c99d0 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1467 microversion: 2.1 time: 0.850248 Sep 25 01:18:28.770350 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1731/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:27 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1467 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:28.778632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4cc33c7f-63cd-472a-a994-7c2ea0be04a9 req-ecc40d43-a724-42bd-a86f-5a2c411daaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746b7b50-ec4b-480c-8f57-2a2daba9a131", "name": "network-vif-plugged", "status": "completed", "tag": "1858bd8e-df0e-429b-8539-8b6bfc35cbf5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:28.798880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4cc33c7f-63cd-472a-a994-7c2ea0be04a9 req-ecc40d43-a724-42bd-a86f-5a2c411daaa8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:28.806579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4cc33c7f-63cd-472a-a994-7c2ea0be04a9 req-ecc40d43-a724-42bd-a86f-5a2c411daaa8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:28.807390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4cc33c7f-63cd-472a-a994-7c2ea0be04a9 req-ecc40d43-a724-42bd-a86f-5a2c411daaa8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:28.829764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:28.838819 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7ffe8261-c3db-433f-9df5-85a1d317eb6f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 0.857877 Sep 25 01:18:28.842138 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4cc33c7f-63cd-472a-a994-7c2ea0be04a9 req-ecc40d43-a724-42bd-a86f-5a2c411daaa8 service nova] Creating event network-vif-plugged:1858bd8e-df0e-429b-8539-8b6bfc35cbf5 for instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 on n-h1-master-1 Sep 25 01:18:28.845726 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1741/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:27 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:28.847641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4cc33c7f-63cd-472a-a994-7c2ea0be04a9 req-ecc40d43-a724-42bd-a86f-5a2c411daaa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075916 Sep 25 01:18:28.848699 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1732/3473] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:28.910796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:28.912933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:28.933877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:28.937245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:28.938690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:28.944869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:28.947456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:28.948856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:29.004131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:29.005669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:29.020601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:29.022562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:29.024468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:29.026194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:29.028812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:29.029491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:29.387968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:29.421117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a9fdc78-3541-4c04-bb1e-30face2f133b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.514973 Sep 25 01:18:29.424343 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1742/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:28 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:29.543543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:29.557082 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e701dc3-8c9e-4adf-9d58-96a2df271d2c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 0.557298 Sep 25 01:18:29.560606 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1733/3475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:28 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:29.784225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:29.786441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:29.802958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:29.804186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:29.805667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:29.806685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:29.807358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:29.808012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:29.866961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:29.867922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:29.879611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:29.887885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:29.888658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:29.889663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:29.890309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:29.890950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:30.193714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:30.214692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a00b79d-103e-496e-82f4-db63ecb27f15 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 200 len: 1425 microversion: 2.1 time: 0.434398 Sep 25 01:18:30.223463 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1743/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:29 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 1425 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:30.451955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:30.452758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:30.481359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:30.483481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:30.486372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:30.491918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:30.498595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:30.501294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.268315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:31.280558 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d501346-b982-4f6f-a59b-1793870fff5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.831135 Sep 25 01:18:31.281348 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1744/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:30 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:31.301564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:31.303356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:31.310616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.311362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.312042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.314792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.315504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.316161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.494551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:31.531155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-31d94e99-f174-450d-aa24-0c2df3a881f5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1316 microversion: 2.1 time: 1.669170 Sep 25 01:18:31.536966 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1734/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:29 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1316 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:31.564876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-369dc30d-efe2-4977-b0ed-d52aae5b67df req-29ead096-47f5-402d-aa6e-1d4ad29f4e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "name": "network-vif-deleted", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:31.610205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-369dc30d-efe2-4977-b0ed-d52aae5b67df req-29ead096-47f5-402d-aa6e-1d4ad29f4e0e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.610938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-369dc30d-efe2-4977-b0ed-d52aae5b67df req-29ead096-47f5-402d-aa6e-1d4ad29f4e0e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.611578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-369dc30d-efe2-4977-b0ed-d52aae5b67df req-29ead096-47f5-402d-aa6e-1d4ad29f4e0e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.638293 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-369dc30d-efe2-4977-b0ed-d52aae5b67df req-29ead096-47f5-402d-aa6e-1d4ad29f4e0e service nova] Creating event network-vif-deleted:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h1-master-1 Sep 25 01:18:31.648006 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-369dc30d-efe2-4977-b0ed-d52aae5b67df req-29ead096-47f5-402d-aa6e-1d4ad29f4e0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107461 Sep 25 01:18:31.654499 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1735/3479] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:31.660116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3ebbd5ac-ba44-4ff9-b8db-dc0d86ac3898 req-b59fbdd5-2335-43fa-b398-46bf6508a4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd8b25d-af74-4b7e-a325-1a7a356ea216", "name": "network-vif-unplugged", "status": "completed", "tag": "7ef228e5-c193-499e-ab7c-8330347491d9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:31.687556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3ebbd5ac-ba44-4ff9-b8db-dc0d86ac3898 req-b59fbdd5-2335-43fa-b398-46bf6508a4eb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.694247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3ebbd5ac-ba44-4ff9-b8db-dc0d86ac3898 req-b59fbdd5-2335-43fa-b398-46bf6508a4eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.695034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3ebbd5ac-ba44-4ff9-b8db-dc0d86ac3898 req-b59fbdd5-2335-43fa-b398-46bf6508a4eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.719521 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3ebbd5ac-ba44-4ff9-b8db-dc0d86ac3898 req-b59fbdd5-2335-43fa-b398-46bf6508a4eb service nova] Creating event network-vif-unplugged:7ef228e5-c193-499e-ab7c-8330347491d9 for instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 on n-h1-master-1 Sep 25 01:18:31.730896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3ebbd5ac-ba44-4ff9-b8db-dc0d86ac3898 req-b59fbdd5-2335-43fa-b398-46bf6508a4eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074638 Sep 25 01:18:31.732033 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1736/3480] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:31.749140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:31.750178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: 1cd8b25d-af74-4b7e-a325-1a7a356ea216] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:31.757332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.758245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.758879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.765427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.766177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.766792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.806965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] HTTP exception thrown: Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 could not be found. Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Request method failure captured: Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 HTTP/1.1 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6sFe2P3c7qvecw65nt9Ex5P0j0p18G7Zth4z2WnKlmmNX1EPwPgl2R5rUnFs464BDpm6ldZVPAAyJw-trPPywaAzhlXBipgJESg4G1utxImA8xumzSrBUgaWfxIPcoKsXXBbAMWrxEquys9YSVpjWbwQLFFSI2yAIXAy6giJdNnWzA Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ae8b5de3254713b60172f6c0b351e1"}]}] Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 5db19a97588e41d1858915c9ccc48620 Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 could not be found. Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1cd8b25d-af74-4b7e-a325-1a7a356ea216'} Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 could not be found. Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 could not be found. Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:31.809735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 could not be found. Sep 25 01:18:31.814659 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:31.816807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Returning 404 to user: Instance 1cd8b25d-af74-4b7e-a325-1a7a356ea216 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:31.818647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc81046d-b795-4bcf-9a1b-66aeac7bef3f tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216" status: 404 len: 111 microversion: 2.1 time: 0.084775 Sep 25 01:18:31.822960 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1737/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:31 2022] GET /compute/v2.1/servers/1cd8b25d-af74-4b7e-a325-1a7a356ea216 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:31.828229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:31.838465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:31.845093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.846006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.846686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.847621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:31.850211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:31.850980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:31.919766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:32.003310 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:32.094009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0dd064d1-31a0-49a3-9d63-0b058f417ca9 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "DELETE /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 204 len: 0 microversion: 2.1 time: 0.269286 Sep 25 01:18:32.095119 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1738/3482] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:31 2022] DELETE /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:32.107419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:32.113247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:32.128736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:32.129701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:32.133214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:32.134353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:32.135088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:32.138023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:32.440527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:32.449110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8956ff3b-805a-4433-9529-3b0e58841161 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 1.154116 Sep 25 01:18:32.450349 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1745/3483] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:31 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:32.465521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:32.466906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:32.483598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:32.484474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:32.485100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:32.486039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:32.486664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:32.487267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:32.821905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:32.840564 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b8879ffc-47db-4dbf-a56c-fc984fe0e2d8 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1468 microversion: 2.1 time: 0.740778 Sep 25 01:18:32.860703 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1739/3484] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:32 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1468 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:32.881153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:32.882564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:32.891084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:32.893158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:32.893808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:32.894931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:32.896649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:32.897248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:33.195433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:33.215249 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-950ac82b-8fdf-4045-a444-c612a1057131 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.760411 Sep 25 01:18:33.216255 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1746/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:32 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:33.337202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:33.345613 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9efb1174-6f0c-4950-92c1-49dea5b60f46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1505 microversion: 2.1 time: 0.482021 Sep 25 01:18:33.358262 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1740/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:32 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:33.384291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:33.385325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:33.402330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:33.405438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:33.406099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:33.409453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:33.410122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:33.413632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:33.476919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:33.478278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:33.503514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:33.506747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:33.507248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:33.515154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:33.515822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:33.516074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:33.516573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:33.753917 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a593d58-4a79-40df-94bc-732bb2edc8ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "DELETE /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 204 len: 0 microversion: 2.1 time: 0.374888 Sep 25 01:18:33.757389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1747/3487] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:33 2022] DELETE /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:33.779875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:33.780592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:33.797321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:33.797926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:33.800186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:33.803385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:33.805092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:33.807388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:34.521567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:34.541450 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ed5a35c-6cfd-45d3-8240-5b53328eed80 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 1.068423 Sep 25 01:18:34.554873 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1741/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:33 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:34.561635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:34.569075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:34.600092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:34.602385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:34.604054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:34.607197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:34.608157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:34.611902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:34.855376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:34.864572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d61df7f1-1ba7-4fef-bbee-9e659cdc7438 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1511 microversion: 2.1 time: 1.097162 Sep 25 01:18:34.865385 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1748/3489] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:33 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1511 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:34.875733 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:34.882221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:34.895376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:34.896806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:34.902708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:34.903944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:34.904604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:34.905216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:35.176328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:35.196904 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc37416a-cf43-427c-95d3-fe05498aa587 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1468 microversion: 2.1 time: 0.640161 Sep 25 01:18:35.197542 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1742/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:34 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1468 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:35.566954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:35.567688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:35.579758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:35.580272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:35.580710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:35.581449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:35.581908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:35.582332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:37.765757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:37.815652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e76df05-a888-48c9-bd4d-b7cbd792ddc6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 2.943523 Sep 25 01:18:37.821882 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1749/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:34 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 2950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:37.838194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:37.839976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:37.857444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:37.860273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:37.862934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:37.863958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:37.865223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:37.869365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:38.156201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:38.167186 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eb62b54b-215f-408c-8a1f-a8aa39d70f9c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 2.603969 Sep 25 01:18:38.167652 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1743/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:35 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:38.187534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:38.188529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:38.216758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:38.217575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:38.218183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:38.219086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:38.219727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:38.220324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:38.311404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:38.313494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:38.318451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:38.319838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lazy-loading 'fault' on Instance uuid affcce72-88eb-458b-ae3b-ebd111f5cfcb {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:18:38.594512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db19a97588e41d1858915c9ccc48620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ae8b5de3254713b60172f6c0b351e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:38.615010 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63f84b0e-134b-483b-bf1e-faf65131e990 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 200 len: 1303 microversion: 2.1 time: 0.433091 Sep 25 01:18:38.637635 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1744/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:38 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 1303 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:38.651390 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e6cb5315-f557-4e66-98dd-86ce631326a3 req-044d36c2-b05f-4e06-b169-c3d817ab71a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affcce72-88eb-458b-ae3b-ebd111f5cfcb", "name": "network-vif-deleted", "tag": "3e636bb7-2165-4a12-be1f-c66e562270f6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:38.680002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e6cb5315-f557-4e66-98dd-86ce631326a3 req-044d36c2-b05f-4e06-b169-c3d817ab71a4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:38.680511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e6cb5315-f557-4e66-98dd-86ce631326a3 req-044d36c2-b05f-4e06-b169-c3d817ab71a4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:38.680958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e6cb5315-f557-4e66-98dd-86ce631326a3 req-044d36c2-b05f-4e06-b169-c3d817ab71a4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:38.737872 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e6cb5315-f557-4e66-98dd-86ce631326a3 req-044d36c2-b05f-4e06-b169-c3d817ab71a4 service nova] Creating event network-vif-deleted:3e636bb7-2165-4a12-be1f-c66e562270f6 for instance affcce72-88eb-458b-ae3b-ebd111f5cfcb on n-h2-master-1 Sep 25 01:18:38.751990 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e6cb5315-f557-4e66-98dd-86ce631326a3 req-044d36c2-b05f-4e06-b169-c3d817ab71a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110976 Sep 25 01:18:38.761446 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1745/3494] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:38.825395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:38.846883 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f37c4c4e-4456-418e-8ecc-387f42ffea03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1511 microversion: 2.1 time: 1.020201 Sep 25 01:18:38.852307 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1750/3495] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:37 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1511 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:38.869472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:38.870592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:38.890091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:38.891301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:38.891857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:38.892990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:38.896210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:38.901640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:39.202260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-44fa9e8d-a351-4a64-b13d-7ea278f34072 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'create', calling method: .version_select at 0x7f7bf000ae50>, body: {"keypair": {"name": "tempest-keypair-798217540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe/W5jns32W8ECoS3EH/wCxhlN5qtyDXaxEpauHJlEY/VUnTJSiVOlClpfu6E4dpITu1U/lM3Fp5ZD7eU5AqZRgcQZdDtMG0dSmpCDJ59pI/ALcXrEdSjfjQO4Vq7BdFg=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:39.240409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-44fa9e8d-a351-4a64-b13d-7ea278f34072 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for project 5404f5e8a04445d08a69a14616c5e008. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:18:39.258116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-44fa9e8d-a351-4a64-b13d-7ea278f34072 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for user c1c655b1afc54b6c98d771d6acf81ee0 and project 5404f5e8a04445d08a69a14616c5e008. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:18:39.301022 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-44fa9e8d-a351-4a64-b13d-7ea278f34072 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.537933 Sep 25 01:18:39.303385 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1746/3496] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:18:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:39.330444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:39.332992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:39.346127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:39.347519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:39.348129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:39.350611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:39.351487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:39.352344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:39.574434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:39.582824 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f21c9bc-c1f1-44c0-b0a7-02d96191219b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.728949 Sep 25 01:18:39.593130 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1751/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:38 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:39.647565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:39.648394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] [instance: affcce72-88eb-458b-ae3b-ebd111f5cfcb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:39.664425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:39.668193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:39.669482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:39.677362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:39.690126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:39.690604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:39.706775 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] HTTP exception thrown: Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb could not be found. Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Request method failure captured: Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb HTTP/1.1 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6sFe2P3c7qvecw65nt9Ex5P0j0p18G7Zth4z2WnKlmmNX1EPwPgl2R5rUnFs464BDpm6ldZVPAAyJw-trPPywaAzhlXBipgJESg4G1utxImA8xumzSrBUgaWfxIPcoKsXXBbAMWrxEquys9YSVpjWbwQLFFSI2yAIXAy6giJdNnWzA Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ae8b5de3254713b60172f6c0b351e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ae8b5de3254713b60172f6c0b351e1"}]}] Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 46ae8b5de3254713b60172f6c0b351e1 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-MigrationsAdminTest-371713768 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 5db19a97588e41d1858915c9ccc48620 Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-MigrationsAdminTest-371713768-project Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: exception: Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb could not be found. Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'affcce72-88eb-458b-ae3b-ebd111f5cfcb'} Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb could not be found. Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb could not be found. Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:39.709216 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb could not be found. Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] Returning 404 to user: Instance affcce72-88eb-458b-ae3b-ebd111f5cfcb could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-232e00b3-53fd-4dec-a8bd-d1b7caf7bb83 tempest-MigrationsAdminTest-371713768 tempest-MigrationsAdminTest-371713768-project] 10.222.0.16 "GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb" status: 404 len: 111 microversion: 2.1 time: 0.068832 Sep 25 01:18:39.714622 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1752/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:39 2022] GET /compute/v2.1/servers/affcce72-88eb-458b-ae3b-ebd111f5cfcb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:18:39.879385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:39.880180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:39.907472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:39.907975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:39.908429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:39.909142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:39.909661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:39.910098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:40.074420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:40.086084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec0fad90-df1e-4b32-9f8b-d7fd21b023f1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 0.780874 Sep 25 01:18:40.089180 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1747/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:39 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:40.098004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:40.100277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:40.106586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:40.111559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lazy-loading 'fault' on Instance uuid 746b7b50-ec4b-480c-8f57-2a2daba9a131 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:18:40.268426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:40.270025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:40.280522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:40.281289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:40.282483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:40.283680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:40.284575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:40.285163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:40.288770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:40.297309 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfa21cf6-1760-424a-8815-600cb5eac91c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 200 len: 1306 microversion: 2.1 time: 0.421655 Sep 25 01:18:40.318330 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1753/3500] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:39 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 1306 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:40.330699 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3fd8da2-ca92-463b-b05f-6e245664e610 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/ips" status: 200 len: 150 microversion: 2.1 time: 0.066345 Sep 25 01:18:40.356709 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1748/3501] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:18:40 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:40.619367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:40.619902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:40.628477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:40.629021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:40.635950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:40.636896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:40.637429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:40.637914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:40.948767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-64439d8c-1a3a-4118-8bd3-bf88702f4ca4 req-fdc3461f-80ee-444e-b54d-f6cbd327862b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746b7b50-ec4b-480c-8f57-2a2daba9a131", "name": "network-vif-deleted", "tag": "1858bd8e-df0e-429b-8539-8b6bfc35cbf5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:40.978821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64439d8c-1a3a-4118-8bd3-bf88702f4ca4 req-fdc3461f-80ee-444e-b54d-f6cbd327862b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:40.980531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64439d8c-1a3a-4118-8bd3-bf88702f4ca4 req-fdc3461f-80ee-444e-b54d-f6cbd327862b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:40.985330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64439d8c-1a3a-4118-8bd3-bf88702f4ca4 req-fdc3461f-80ee-444e-b54d-f6cbd327862b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:41.013020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-64439d8c-1a3a-4118-8bd3-bf88702f4ca4 req-fdc3461f-80ee-444e-b54d-f6cbd327862b service nova] Creating event network-vif-deleted:1858bd8e-df0e-429b-8539-8b6bfc35cbf5 for instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 on n-h1-master-1 Sep 25 01:18:41.025307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-64439d8c-1a3a-4118-8bd3-bf88702f4ca4 req-fdc3461f-80ee-444e-b54d-f6cbd327862b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080111 Sep 25 01:18:41.029509 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1749/3502] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:41.135653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:41.137831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:41.174448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:41.180180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:41.181573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:41.184708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:41.185538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:41.188582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:41.822233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:41.830406 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31593154-662a-4c2d-9689-56bb97e656e8 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 1.215904 Sep 25 01:18:41.849979 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1754/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:40 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:41.869149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:41.882370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:41.891593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:41.892361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:41.893014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:41.893948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:41.894859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:41.896341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:41.934807 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:41.936981 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 HTTP/1.1 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '746b7b50-ec4b-480c-8f57-2a2daba9a131'} Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:41.938837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:18:41.944841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:41.946287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:41.950687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-70f9a2fd-66f0-4a81-ba4d-8ed52e43ab7f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 404 len: 111 microversion: 2.1 time: 0.099615 Sep 25 01:18:41.951475 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1755/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:41 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:41.960458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:41.966362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:41.975647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:41.978056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:41.978771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:41.983840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:41.984511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:41.985137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:42.596597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:42.627133 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac9a3425-7cf4-4b00-b584-e080baf5317e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 1.509466 Sep 25 01:18:42.673186 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1750/3505] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:41 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:42.734042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:42.757849 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4751bfb-20b6-4b37-b688-6b83227980f6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.801285 Sep 25 01:18:42.761267 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1756/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:41 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:42.865955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:42.866893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:42.884618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:42.885131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:42.885606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:42.886349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:42.886815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:42.906024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:43.084181 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83284901-e91b-4c02-a010-4e3aca38b02b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83284901-e91b-4c02-a010-4e3aca38b02b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 163 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": 12345, "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 12345 Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:18:43.102846 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 25 01:18:43.110068 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:43.116397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83284901-e91b-4c02-a010-4e3aca38b02b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:43.117301 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83284901-e91b-4c02-a010-4e3aca38b02b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.051891 Sep 25 01:18:43.121592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1757/3507] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:43 2022] POST /compute/v2.1/servers => generated 127 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:18:43.139965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:43.140602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:43.159515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:43.159942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:43.160387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:43.161138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:43.165331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:43.168433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:43.468668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:43.482053 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9b70233-15c8-4dfa-a00c-84d6a98ddb22 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.619386 Sep 25 01:18:43.484551 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1751/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:42 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:43.497721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f7ae866-da06-4766-befd-a559fd13dd76"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:43.504196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:43.525364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:43.526382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:43.527013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:43.527945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:43.528602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:43.529210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:43.907889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:43.926050 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-418f2f29-be9b-477d-97cd-f7078f5dde9d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.800052 Sep 25 01:18:43.931446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1758/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:43 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:43.950998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:43.952678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:43.975767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:43.978043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:43.980741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:43.984164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:43.986222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:43.986667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:44.290278 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5defca6b-97e9-4f83-92fa-7a1b67c65800 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "POST /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800258 Sep 25 01:18:44.293781 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1752/3510] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:18:43 2022] POST /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:44.314061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:44.324565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:44.354057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:44.354351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:44.354792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:44.360989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:44.363157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:44.366113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:44.893325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:44.906125 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29bc6774-7ffe-4668-802d-438c15fc86c6 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 0.971971 Sep 25 01:18:44.907280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1759/3511] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:43 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:44.917254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:44.920473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:44.935007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:44.936841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:44.937778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:44.942498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:44.943271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:44.944556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:45.097379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:45.111651 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea4bf559-869d-42d0-80a0-1c87df9a696a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.815934 Sep 25 01:18:45.112967 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1753/3512] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:44 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:45.931339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:45.932194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:45.944347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:45.950852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:45.951420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:45.955133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:45.957450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:45.961634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:47.060251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:47.082787 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0df0fe8-0214-4113-ae14-e3f50d032dfb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 2.174228 Sep 25 01:18:47.090013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:47.091694 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1760/3513] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:44 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:47.101113 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24ef064d-9f01-457b-8181-e19518b1880d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 1.174594 Sep 25 01:18:47.110240 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1754/3514] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:45 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:47.361026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2031382368", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd392121-2ba2-4140-9dd3-57e5e13ec24b"}], "security_groups": [{"name": "tempest-securitygroup--85890473"}], "key_name": "tempest-keypair-798217540", "user_data": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:47.727293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] validate_networks() for [('bd392121-2ba2-4140-9dd3-57e5e13ec24b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:18:47.775905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad1fc627-7178-46ef-84e5-da581f297056 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] Calling method '.version_select at 0x7f7beb910af0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:47.823214 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad1fc627-7178-46ef-84e5-da581f297056 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.309666 Sep 25 01:18:47.823740 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1755/3515] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:18:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:18:47.848129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8f797a6-37c7-46d7-88f6-ac7eeb9f5768 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf000af70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:48.019356 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:48.462947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8f797a6-37c7-46d7-88f6-ac7eeb9f5768 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.630553 Sep 25 01:18:48.469957 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1756/3516] 10.222.0.16 () {60 vars in 1206 bytes} [Sun Sep 25 01:18:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:48.479364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:48.480014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:48.494863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:48.495359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:48.495798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:48.496518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:48.496970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:48.497418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:48.557925 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:48.961965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:18:48.962680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:18:48.962680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:18:48.963024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:18:48.963727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:18:48.975389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:48.976340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:48.983616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:48.984909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:48.985694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:48.986530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:49.031994 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:18:49.054574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for user c1c655b1afc54b6c98d771d6acf81ee0 and project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:18:49.087924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:18:49.090360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:18:49.223851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3587477b-a118-46f2-b923-ad082bb39e73 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.871843 Sep 25 01:18:49.230359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:49.230952 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1761/3517] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:18:49.242201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:49.243465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f40eb992-15d9-4ee7-936a-fc8629fc9b5d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1524 microversion: 2.1 time: 0.775735 Sep 25 01:18:49.246259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:49.247210 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1757/3518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:48 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1524 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:49.271869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bad41824-fe9c-43be-8bbb-145ebad95f72 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] Calling method '.version_select at 0x7f7bebba0310>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:49.277920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:49.280806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:49.281582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:49.283665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:49.291704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:49.292666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:49.324579 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bad41824-fe9c-43be-8bbb-145ebad95f72 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.073502 Sep 25 01:18:49.325852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1758/3519] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:18:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:49.336676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0fc1a45d-4677-4e7c-82da-9c689a64e1a7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:49.347211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0fc1a45d-4677-4e7c-82da-9c689a64e1a7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:49.530118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0fc1a45d-4677-4e7c-82da-9c689a64e1a7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:49.547532 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0fc1a45d-4677-4e7c-82da-9c689a64e1a7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1238 microversion: 2.1 time: 0.209827 Sep 25 01:18:49.554501 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1759/3520] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1238 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:49.571437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ce505c7-a169-4eae-b56e-6bc0bf4f97a2 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] Action: 'update', calling method: .version_select at 0x7f7bebb38a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:49.820043 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ce505c7-a169-4eae-b56e-6bc0bf4f97a2 tempest-QuotaClassesAdminTestJSON-602942232 tempest-QuotaClassesAdminTestJSON-602942232-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.262702 Sep 25 01:18:49.821852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1760/3521] 10.222.0.16 () {60 vars in 1206 bytes} [Sun Sep 25 01:18:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:49.900814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:49.926207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d54ebeb9-2f8e-4ed9-9f40-8c7a91ec2ac4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 0.690286 Sep 25 01:18:49.943602 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1762/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:49 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:50.190274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a74e42ca-de53-4111-b8ec-0de60e92b6ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1171260249", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8bc503a8-e35d-424f-bf43-d4accdbe427e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:50.281889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a74e42ca-de53-4111-b8ec-0de60e92b6ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Block Device 8bc503a8-e35d-424f-bf43-d4accdbe427e is not bootable. Sep 25 01:18:50.288276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:50.288995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a74e42ca-de53-4111-b8ec-0de60e92b6ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 358 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1171260249", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8bc503a8-e35d-424f-bf43-d4accdbe427e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: exception: Block Device 8bc503a8-e35d-424f-bf43-d4accdbe427e is not bootable. Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1171260249', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '8bc503a8-e35d-424f-bf43-d4accdbe427e'}], 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 8bc503a8-e35d-424f-bf43-d4accdbe427e is not bootable. Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:50.294446 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 8bc503a8-e35d-424f-bf43-d4accdbe427e is not bootable. Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 8bc503a8-e35d-424f-bf43-d4accdbe427e is not bootable. Sep 25 01:18:50.298882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:18:50.302563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:50.303156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a74e42ca-de53-4111-b8ec-0de60e92b6ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Block Device 8bc503a8-e35d-424f-bf43-d4accdbe427e is not bootable. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:50.303306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:50.304090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:50.304640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a74e42ca-de53-4111-b8ec-0de60e92b6ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.125803 Sep 25 01:18:50.306412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:50.307926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:50.308885 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1761/3523] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:18:50.309840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:50.324764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:50.325427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:50.355292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:50.357161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:50.359199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:50.361188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:50.363609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:50.364958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:50.928136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:50.936822 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-428d123f-a665-48f3-a6b5-bfddbabceb0f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.625901 Sep 25 01:18:50.944680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1762/3524] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:50 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:50.950030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:50.959705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:50.969689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:50.970553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:50.970952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:50.971742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:50.972194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:50.976884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:50.985070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:50.994829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc41d7fc-cb46-4945-a7ab-d36739ea3e6d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1506 microversion: 2.1 time: 0.711656 Sep 25 01:18:50.996819 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1763/3525] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:50 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:51.010568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:51.013551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:51.027351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:51.027884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:51.028326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:51.029042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:51.029520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:51.029945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:51.081667 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:51.090794 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-278f2c95-66bf-40f2-a9a7-4f52825473b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1290 microversion: 2.1 time: 0.144499 Sep 25 01:18:51.092393 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1763/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:50 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:51.097614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:51.098606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:51.106618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:51.107561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:51.108270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:51.109242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:51.110007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:51.110676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:51.270783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:51.283908 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e817aef-b36e-4b8d-8ec3-0b8ae6a0f07e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 0.285672 Sep 25 01:18:51.284507 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1764/3527] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:50 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:51.331156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:51.343629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5abb8e5-06c7-40ad-953e-4d46af4ecf97 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.249924 Sep 25 01:18:51.344223 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1764/3528] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:51 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:52.004007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4c1b6517-c36d-4ee9-9483-fa56094a55e5 req-25edb555-89f7-459c-baac-9d7e40302809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d11c9f1-7562-45de-924d-f168ada2645a", "name": "network-vif-unplugged", "status": "completed", "tag": "69da5ff9-8dae-4d3c-954c-3fa51f9e10cd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:52.027896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:52.029182 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:52.050072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.052982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.055930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.057392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4c1b6517-c36d-4ee9-9483-fa56094a55e5 req-25edb555-89f7-459c-baac-9d7e40302809 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.058127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4c1b6517-c36d-4ee9-9483-fa56094a55e5 req-25edb555-89f7-459c-baac-9d7e40302809 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.058760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.060156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.062145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4c1b6517-c36d-4ee9-9483-fa56094a55e5 req-25edb555-89f7-459c-baac-9d7e40302809 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.063608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.124240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4c1b6517-c36d-4ee9-9483-fa56094a55e5 req-25edb555-89f7-459c-baac-9d7e40302809 service nova] Creating event network-vif-unplugged:69da5ff9-8dae-4d3c-954c-3fa51f9e10cd for instance 3d11c9f1-7562-45de-924d-f168ada2645a on n-h2-master-1 Sep 25 01:18:52.142526 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4c1b6517-c36d-4ee9-9483-fa56094a55e5 req-25edb555-89f7-459c-baac-9d7e40302809 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142338 Sep 25 01:18:52.148212 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1765/3529] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:52.162474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:52.164492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:52.189318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.191827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.194208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.195728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.197814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.199647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.354243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:52.372953 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-70eae63c-aa9e-4984-84bd-d88c02f0035b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1296 microversion: 2.1 time: 0.220564 Sep 25 01:18:52.374337 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1766/3530] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:52 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1296 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:52.391337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:52.391962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:52.418621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.425456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.428150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.429041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:52.430101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:52.432383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:52.483501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:52.507908 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f0e83cf7-bb8b-4e40-9c9b-f17555556089 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1506 microversion: 2.1 time: 0.483441 Sep 25 01:18:52.512290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1765/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:52 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:18:52.945329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:52.959669 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d2f6c3f6-37c9-4daf-a1c7-b9c2af753b23 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1497 microversion: 2.1 time: 0.583096 Sep 25 01:18:52.976034 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1767/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:52 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1497 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:53.404341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:53.406038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:53.438884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:53.447440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:53.448279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:53.449228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:53.450005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:53.452152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:53.537487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:53.538949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:53.570473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:53.571474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:53.572232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:53.573166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:53.573724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:53.574297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:53.988748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:53.997578 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc05a99d-21ad-4bd7-9701-4e181dd234d2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 200 len: 1509 microversion: 2.1 time: 0.464555 Sep 25 01:18:54.002449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1768/3533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:53 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:54.012502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:54.013314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:54.031185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:54.031692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:54.032149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:54.032861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:54.033540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:54.034149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:54.384096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:54.405146 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3cd02ace-d8b3-42f6-9d54-fa48c49f9a04 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1362 microversion: 2.1 time: 1.006487 Sep 25 01:18:54.407529 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1766/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:53 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1362 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:54.426749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:54.427763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:54.447854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:54.448676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:54.449294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:54.450223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:54.450866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:54.451814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:54.489449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:18:54.498269 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Working on deleting snapshot 3c162d94-8a65-4b00-b4d6-d563b684f1f3 from shelved instance... Sep 25 01:18:54.621822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:54.632221 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a5a8802-ae3e-40d0-a619-bff11c189fff tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 200 len: 1474 microversion: 2.1 time: 0.628446 Sep 25 01:18:54.640182 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1769/3535] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:54 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 1474 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:54.659879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2b302cf-bd90-4291-8ed9-93c2ba001b3b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187855823", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "destination_type": "local"}, {"source_type": "volume", "uuid": "e6686776-cbc5-4de2-a915-00d2ace4fc08", "destination_type": "invalid"}], "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2b302cf-bd90-4291-8ed9-93c2ba001b3b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 494 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187855823", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "destination_type": "local"}, {"source_type": "volume", "uuid": "e6686776-cbc5-4de2-a915-00d2ace4fc08", "destination_type": "invalid"}], "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-187855823', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'e6686776-cbc5-4de2-a915-00d2ace4fc08', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'invalid' Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:54.674298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 25 01:18:54.679202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:54.690967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2b302cf-bd90-4291-8ed9-93c2ba001b3b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:54.690967 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2b302cf-bd90-4291-8ed9-93c2ba001b3b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.044509 Sep 25 01:18:54.698934 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1770/3536] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:54 2022] POST /compute/v2.1/servers => generated 155 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:18:54.710235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-816472358"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:54.714956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:54.738344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:54.743194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:54.743816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:54.744700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:54.745269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:54.746183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:55.286704 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13c2584f-b5c7-44ae-a7f0-4fa700fa43c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336/action" status: 202 len: 0 microversion: 2.1 time: 0.577171 Sep 25 01:18:55.290001 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1771/3537] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:18:54 2022] POST /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:18:55.327813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:55.329004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:55.353353 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:55.359782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:55.366824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:55.367479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:55.369029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:55.371445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:55.372382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:56.233196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Doing local delete in cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=122384) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 25 01:18:56.236057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:56.238469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:56.241058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:56.241786 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 25 01:18:56.252564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] deallocate_for_instance() {{(pid=122384) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 25 01:18:56.454168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:56.465443 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6408cb32-30f6-4c52-b831-b881c29f75a1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 1.171584 Sep 25 01:18:56.466021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1772/3538] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:55 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:56.473760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a7b2bfb-1ba3-424a-b234-c29a437831a2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf40ca310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:56.547873 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a7b2bfb-1ba3-424a-b234-c29a437831a2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.078785 Sep 25 01:18:56.548585 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1773/3539] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:56 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:56.563003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:56.563948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:56.584524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:56.586577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:56.587648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:56.594334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:56.595372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:56.596020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:57.169685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:57.180238 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9b8604d7-1381-48c8-8d49-b0a148784f30 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1362 microversion: 2.1 time: 0.627986 Sep 25 01:18:57.190644 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1774/3540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:56 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1362 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:57.205381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:57.208709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:57.225088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:57.225893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:57.227674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:57.228520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:57.229233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:57.230714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:57.318440 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:57.770939 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:57.793163 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-558464b7-ed4b-4e0d-810c-c56339ca3d08 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.601139 Sep 25 01:18:57.794526 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1775/3541] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:57 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:58.106416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f716bea4-94d3-41ae-be8d-ef0047165568 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '.version_select at 0x7f7bf3fab670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.147381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Updating instance_info_cache with network_info: [] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:18:58.217226 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f716bea4-94d3-41ae-be8d-ef0047165568 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3" status: 200 len: 371 microversion: 2.1 time: 0.420775 Sep 25 01:18:58.217555 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1776/3542] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:18:57 2022] GET /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:58.234693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-faf8a473-1e7d-45f3-804b-3751481403e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3fb2c10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.298481 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-faf8a473-1e7d-45f3-804b-3751481403e8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.077031 Sep 25 01:18:58.299079 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1777/3543] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:58 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:58.315629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-75aa9778-9682-45e3-8e2d-ec9f4c367f46 req-dbe282a3-89e5-481c-a2c7-f18ca5cf3e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:58.330142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-75aa9778-9682-45e3-8e2d-ec9f4c367f46 req-dbe282a3-89e5-481c-a2c7-f18ca5cf3e9f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.331310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-75aa9778-9682-45e3-8e2d-ec9f4c367f46 req-dbe282a3-89e5-481c-a2c7-f18ca5cf3e9f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.333397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-75aa9778-9682-45e3-8e2d-ec9f4c367f46 req-dbe282a3-89e5-481c-a2c7-f18ca5cf3e9f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.366513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-75aa9778-9682-45e3-8e2d-ec9f4c367f46 req-dbe282a3-89e5-481c-a2c7-f18ca5cf3e9f service nova] Creating event network-changed:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:18:58.387756 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-75aa9778-9682-45e3-8e2d-ec9f4c367f46 req-dbe282a3-89e5-481c-a2c7-f18ca5cf3e9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086012 Sep 25 01:18:58.389086 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1778/3544] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:58.395981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1710e07c-b036-4bd7-ac5b-151e0e69a5a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-311029756", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1710e07c-b036-4bd7-ac5b-151e0e69a5a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 491 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-311029756", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-311029756', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.403046 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 25 01:18:58.407214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.420726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1710e07c-b036-4bd7-ac5b-151e0e69a5a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:58.422613 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1710e07c-b036-4bd7-ac5b-151e0e69a5a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.031527 Sep 25 01:18:58.427659 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1779/3545] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:58 2022] POST /compute/v2.1/servers => generated 624 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:18:58.433481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.434615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:58.445003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.446586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.447307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.448296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.449010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.450540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.455256 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-91de1c48-7593-496c-bbce-de3f691418f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 204 len: 0 microversion: 2.1 time: 4.043817 Sep 25 01:18:58.457500 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1767/3546] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:18:54 2022] DELETE /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 0 bytes in 4048 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:18:58.472344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Action: 'update', calling method: .version_select at 0x7f7beab41040>, body: {"quota_set": {"ram": "5120"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:58.572979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.573964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.574606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.576461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.577115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.578148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.610936 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=22 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:58.664328 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74ea9a8c-6df2-4a59-94c7-cbf7ba639327 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3" status: 200 len: 328 microversion: 2.1 time: 0.204698 Sep 25 01:18:58.672578 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1768/3547] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:18:58 2022] PUT /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 328 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:18:58.678044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.679019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:58.687634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.688412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.689032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.690894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.691560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.693917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.871367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:58.883026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7374829e-dcf0-4dbd-84f0-972b083e069a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1362 microversion: 2.1 time: 0.452873 Sep 25 01:18:58.898146 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1780/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:58 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:58.913095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.914043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:58.921582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.922572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.923245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.924196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.924878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.925565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.931159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:58.939963 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a46235c-e6e7-49f1-b700-f6883f98d072 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.266205 Sep 25 01:18:58.941229 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1769/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:58 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:58.948534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4fc978d7-fb8f-4420-936a-15c3ff71d4dc tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.959245 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a HTTP/1.1 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3d11c9f1-7562-45de-924d-f168ada2645a'} Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:58.961122 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:18:58.967004 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:58.968420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:58.969330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e76f3c01-5f4c-4b6e-8b2d-e6166276aff3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 404 len: 111 microversion: 2.1 time: 0.069661 Sep 25 01:18:58.970065 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1781/3550] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:58 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:18:58.977088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4fc978d7-fb8f-4420-936a-15c3ff71d4dc tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3" status: 202 len: 0 microversion: 2.1 time: 0.032634 Sep 25 01:18:58.978400 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1770/3551] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:18:58 2022] DELETE /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:18:58.979804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.981180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:58.987982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.988805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.989496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df82c394-a346-49a9-a412-6dbe3fb090ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '.version_select at 0x7f7bf40c4d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:58.989806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:58.990734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:58.991435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:58.992065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:59.013250 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:18:59.128336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df82c394-a346-49a9-a412-6dbe3fb090ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3" status: 200 len: 371 microversion: 2.1 time: 0.146046 Sep 25 01:18:59.129126 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1771/3552] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:18:58 2022] GET /compute/v2.1/os-quota-sets/fde2cee6c52c4c85a795f1ce9aa1abc3 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:18:59.135249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1558642782", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:59.217805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:18:59.229278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:18:59.242440 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-26335f36-1343-4200-a5d6-78dd4d1f0250 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.270943 Sep 25 01:18:59.243443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1782/3553] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:58 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:59.319749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0cd3c1ff-adb3-481f-9964-060f7b263a3a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '.version_select at 0x7f7bf3fcbc10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:59.628607 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0cd3c1ff-adb3-481f-9964-060f7b263a3a tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.313830 Sep 25 01:18:59.631073 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1783/3554] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:18:59 2022] GET /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5/defaults => generated 371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:18:59.646042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cfee88e3-66c5-4312-ac26-9e16cfb9dfe9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf3fabb80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:59.718515 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cfee88e3-66c5-4312-ac26-9e16cfb9dfe9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.083573 Sep 25 01:18:59.719426 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1784/3555] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:18:59 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:18:59.739805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18c5ccde-ac88-42e4-a537-a32cffe5d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18c5ccde-ac88-42e4-a537-a32cffe5d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 416 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.752441 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:18:59.756946 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:18:59.762898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18c5ccde-ac88-42e4-a537-a32cffe5d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:18:59.765104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-18c5ccde-ac88-42e4-a537-a32cffe5d698 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.043468 Sep 25 01:18:59.769927 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1785/3556] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:59 2022] POST /compute/v2.1/servers => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:18:59.783575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:18:59.788987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:18:59.809719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:59.811476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:59.814144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:18:59.819445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:18:59.820780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:18:59.822969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.139799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:19:00.140236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:19:00.140722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:19:00.141880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:19:00.142315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:19:00.153684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.154164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.154887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.155629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.156082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.156710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.164604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:00.184288 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c73b6cd5-ab70-4581-b425-c07275c255f1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.406132 Sep 25 01:19:00.200485 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1786/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:18:59 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:00.213578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf40e2f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:00.215407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:19:00.234616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:19:00.287829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:19:00.291646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:19:00.403383 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-457b5066-94ab-4a6f-b656-45300685ef15 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271811 Sep 25 01:19:00.404062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1772/3558] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:18:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:19:00.425531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:00.431408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:00.449340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.451751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.452828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.454199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.455383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.457213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.496561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.501490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.502335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.503962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.510143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.511144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.622733 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d906def3-96ef-41e6-9139-d3f17382d4a4 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf" status: 200 len: 328 microversion: 2.1 time: 0.420882 Sep 25 01:19:00.635027 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1787/3559] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:19:00 2022] PUT /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf => generated 328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:00.648645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bf6babd0-1e21-4486-beea-bd5de1c2155d req-c80cc27b-ae95-4620-bb7f-ae3d93d27923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24dfaf3-4058-4dac-80f3-b8dcba17f336", "name": "network-vif-plugged", "status": "completed", "tag": "f46992f4-e8f9-4563-b623-70ff8828e9be"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:00.674391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bf6babd0-1e21-4486-beea-bd5de1c2155d req-c80cc27b-ae95-4620-bb7f-ae3d93d27923 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.675169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bf6babd0-1e21-4486-beea-bd5de1c2155d req-c80cc27b-ae95-4620-bb7f-ae3d93d27923 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.675830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bf6babd0-1e21-4486-beea-bd5de1c2155d req-c80cc27b-ae95-4620-bb7f-ae3d93d27923 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.700812 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bf6babd0-1e21-4486-beea-bd5de1c2155d req-c80cc27b-ae95-4620-bb7f-ae3d93d27923 service nova] Creating event network-vif-plugged:f46992f4-e8f9-4563-b623-70ff8828e9be for instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 on n-h2-master-1 Sep 25 01:19:00.712270 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bf6babd0-1e21-4486-beea-bd5de1c2155d req-c80cc27b-ae95-4620-bb7f-ae3d93d27923 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074142 Sep 25 01:19:00.716832 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1788/3560] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:00.724385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:00.725326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:00.737136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.737811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.738107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.739589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:00.740471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:00.740917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:00.850863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:00.875039 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eb83b4e4-1976-4c60-91b8-6be02acdcee8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1362 microversion: 2.1 time: 0.469676 Sep 25 01:19:00.877224 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1773/3561] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:00 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:00.886534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ed9943a-2949-4add-92de-e8b619229f5e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:00.887491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ed9943a-2949-4add-92de-e8b619229f5e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:00.999677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ed9943a-2949-4add-92de-e8b619229f5e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:01.009034 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ed9943a-2949-4add-92de-e8b619229f5e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1215 microversion: 2.1 time: 0.128883 Sep 25 01:19:01.023683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:01.027332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1774/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:00 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:01.037100 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-faaca360-eede-49c8-a033-9ca7841f85c3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.316698 Sep 25 01:19:01.037738 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1789/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:00 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:01.043316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '.version_select at 0x7f7bf40caa60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:01.043823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-221ad673-e82d-40b3-902f-a2a71893a6f7 req-fbb7b698-0816-4f26-8eea-7188391613d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d11c9f1-7562-45de-924d-f168ada2645a", "name": "network-vif-deleted", "tag": "69da5ff9-8dae-4d3c-954c-3fa51f9e10cd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:01.069292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-221ad673-e82d-40b3-902f-a2a71893a6f7 req-fbb7b698-0816-4f26-8eea-7188391613d0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.069855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-221ad673-e82d-40b3-902f-a2a71893a6f7 req-fbb7b698-0816-4f26-8eea-7188391613d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.071438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-221ad673-e82d-40b3-902f-a2a71893a6f7 req-fbb7b698-0816-4f26-8eea-7188391613d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.100018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.server_external_events [req-221ad673-e82d-40b3-902f-a2a71893a6f7 req-fbb7b698-0816-4f26-8eea-7188391613d0 service nova] Unable to find a host for instance 3d11c9f1-7562-45de-924d-f168ada2645a. Dropping event network-vif-deleted {{(pid=122384) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 01:19:01.100960 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-221ad673-e82d-40b3-902f-a2a71893a6f7 req-fbb7b698-0816-4f26-8eea-7188391613d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.071327 Sep 25 01:19:01.105882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1775/3564] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 78 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 01:19:01.118204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-560e1e4f-f0e4-44d7-9236-3f4ecd5b8e08 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb897c10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:01.156788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.157852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.158484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.159407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.160095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.161307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.222748 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-560e1e4f-f0e4-44d7-9236-3f4ecd5b8e08 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.115506 Sep 25 01:19:01.226401 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1776/3565] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:01 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:01.241557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5e0d403-1d3c-4dba-b435-b91a3ff558ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1330544144", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": -1, "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:01.242505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e76e5a4-226e-4943-8221-6f22b6fae8bb tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf/detail" status: 200 len: 916 microversion: 2.1 time: 0.198679 Sep 25 01:19:01.253550 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1790/3566] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:19:01 2022] GET /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf/detail => generated 916 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:01.262440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c5e0d403-1d3c-4dba-b435-b91a3ff558ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Flavor -1 could not be found. Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5e0d403-1d3c-4dba-b435-b91a3ff558ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 206 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1330544144", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": -1, "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: exception: Flavor -1 could not be found. Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1330544144', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': -1, 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:01.265026 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:01.271468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5e0d403-1d3c-4dba-b435-b91a3ff558ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:01.274414 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5e0d403-1d3c-4dba-b435-b91a3ff558ec tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.040789 Sep 25 01:19:01.275106 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1777/3567] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:01 2022] POST /compute/v2.1/servers => generated 73 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:01.283478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:01.284529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:01.292110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.292778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.293292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.294311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.294841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.295339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.440170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Action: 'update', calling method: .version_select at 0x7f7bf02ee550>, body: {"quota_set": {"ram": "2048"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:01.468669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:01.481790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83e825c2-f6da-44a5-819c-17426f0b1ccc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.202060 Sep 25 01:19:01.482388 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1791/3568] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:01 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:01.505654 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:01.506293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:01.513058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.513595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.514042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.514754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.515634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.516065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.530590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.531249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.531774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.532688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.533255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.534781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.594205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.595015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.595632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.596596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.597262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.597889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.706018 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-978b247d-6b64-499d-abd4-e3336766a9ea tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf?user_id=bfdee4887dbc41488ae1f1f223b07098" status: 200 len: 328 microversion: 2.1 time: 0.266270 Sep 25 01:19:01.709831 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1778/3569] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:19:01 2022] PUT /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf?user_id=bfdee4887dbc41488ae1f1f223b07098 => generated 328 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:01.721658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87b3b5b4-03b3-41d2-ad02-d2b53b057a94 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '.version_select at 0x7f7bf005ea60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:01.836530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87b3b5b4-03b3-41d2-ad02-d2b53b057a94 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf?user_id=bfdee4887dbc41488ae1f1f223b07098" status: 200 len: 370 microversion: 2.1 time: 0.118551 Sep 25 01:19:01.844381 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1779/3570] 10.222.0.16 () {58 vars in 1323 bytes} [Sun Sep 25 01:19:01 2022] GET /compute/v2.1/os-quota-sets/89ecd98342b049518496c33a80754dbf?user_id=bfdee4887dbc41488ae1f1f223b07098 => generated 370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:01.867747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:01.883938 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6674048c-183b-46b9-8e42-075caac6edc5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.381035 Sep 25 01:19:01.898004 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1792/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:01 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:01.903562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:01.905332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:01.919546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.920127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.920780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.923818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:01.924484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:01.926016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:01.939669 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:02.000363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccd78664-85bc-4359-8e69-b85dec2c6978 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-890680168", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccd78664-85bc-4359-8e69-b85dec2c6978 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 172 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-890680168", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-890680168', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi -1 Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:19:02.007508 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:02.012304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccd78664-85bc-4359-8e69-b85dec2c6978 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:02.013351 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccd78664-85bc-4359-8e69-b85dec2c6978 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.016538 Sep 25 01:19:02.016085 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1793/3572] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:01 2022] POST /compute/v2.1/servers => generated 145 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:19:02.028962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:02.029666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:02.054608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.055109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.055555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.056259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.057363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.057363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.476476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:02.496124 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-605618eb-8cde-44dc-86a5-b4d55f4a4e5f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1362 microversion: 2.1 time: 0.596465 Sep 25 01:19:02.509522 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1780/3573] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:01 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:02.509522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:02.509522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:02.526559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.526769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:02.527223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.527573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.528591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.529131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.529789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.538729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3eb4cb7a-cd3c-4b31-8b38-249d9d20a836 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.518078 Sep 25 01:19:02.539319 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1794/3574] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:02 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:02.554254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:02.554254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:02.567070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.567890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.568403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.569112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.569591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.570014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.702654 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lazy-loading 'services' on Instance uuid ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:02.724808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:02.747412 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc022712-f2f0-4332-8d7e-74b6b5f96b9c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1267 microversion: 2.1 time: 0.247756 Sep 25 01:19:02.753844 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1781/3575] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:02 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:02.772087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b877fb5-7542-42c9-99a9-a826306e374f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebcb3550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:02.883504 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b877fb5-7542-42c9-99a9-a826306e374f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.124732 Sep 25 01:19:02.885768 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1782/3576] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:02 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:02.899298 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14f94c45-6e5c-4a17-8b93-bb95e50b74a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments/1f7ae866-da06-4766-befd-a559fd13dd76" status: 202 len: 0 microversion: 2.1 time: 0.345538 Sep 25 01:19:02.903823 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1795/3577] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:19:02 2022] DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments/1f7ae866-da06-4766-befd-a559fd13dd76 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:02.907066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d19d52b2-6ff1-4f85-9e38-07de9b945260 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Calling method '.version_select at 0x7f7bebb8d040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:02.915730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:02.917933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:02.937281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.938517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.940957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:02.943694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:02.944774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:02.946299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.359646 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d19d52b2-6ff1-4f85-9e38-07de9b945260 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.472545 Sep 25 01:19:03.369074 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1783/3578] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:19:02 2022] GET /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5/defaults => generated 371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:03.375103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:03.378368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:03.386535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.390307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.390523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.391239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.398704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.399173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.447242 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b71b8314-b73a-43f7-a381-e4622fafc629 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076579 Sep 25 01:19:03.452158 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1784/3579] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:19:03 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:03.460479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a7499274-8dee-4e34-9bae-87cf299c409b req-a309060e-2ba3-4bfb-9675-17274366c567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-plugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:03.472933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a7499274-8dee-4e34-9bae-87cf299c409b req-a309060e-2ba3-4bfb-9675-17274366c567 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.473732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a7499274-8dee-4e34-9bae-87cf299c409b req-a309060e-2ba3-4bfb-9675-17274366c567 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.474254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a7499274-8dee-4e34-9bae-87cf299c409b req-a309060e-2ba3-4bfb-9675-17274366c567 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.488236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a7499274-8dee-4e34-9bae-87cf299c409b req-a309060e-2ba3-4bfb-9675-17274366c567 service nova] Creating event network-vif-plugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:19:03.494743 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a7499274-8dee-4e34-9bae-87cf299c409b req-a309060e-2ba3-4bfb-9675-17274366c567 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044968 Sep 25 01:19:03.495664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1785/3580] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:03.501957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Action: 'update', calling method: .version_select at 0x7f7bebf63700>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:03.599336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:03.614308 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6af543bf-7074-4a09-b52a-2a18b5f5af53 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.706476 Sep 25 01:19:03.617230 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1796/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:02 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:03.631930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:03.634579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:03.657679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.658551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.660335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.665549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.668055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.668924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.672455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.674616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.675132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.675946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:03.677994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:03.680531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:03.927975 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:DELETE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:04.002096 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:04.192057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ef764395-e30b-4581-94fc-967c8c12c416 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5" status: 200 len: 329 microversion: 2.1 time: 0.695168 Sep 25 01:19:04.192926 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1786/3582] 10.222.0.16 () {60 vars in 1263 bytes} [Sun Sep 25 01:19:03 2022] PUT /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5 => generated 329 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:04.208831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:04.209626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:04.217582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:04.218700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:04.219156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:04.220839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:04.221525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:04.221976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:04.863643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:04.876475 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4dc5c6f-e96f-435d-9a2f-e20986eaef8d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1273 microversion: 2.1 time: 0.670181 Sep 25 01:19:04.878442 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1787/3583] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:04 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1273 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:04.896476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-49fa6ef0-c57d-40c7-8ecd-f70cba549ab1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb962b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:04.988697 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-49fa6ef0-c57d-40c7-8ecd-f70cba549ab1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.107705 Sep 25 01:19:04.989611 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1788/3584] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:04 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:05.005946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ba6e854-5498-4b86-af19-23659797f899 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-375335707", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:05.014683 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6ba6e854-5498-4b86-af19-23659797f899 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ba6e854-5498-4b86-af19-23659797f899 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 215 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-375335707", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-375335707', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:05.026511 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ba6e854-5498-4b86-af19-23659797f899 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6ba6e854-5498-4b86-af19-23659797f899 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.036481 Sep 25 01:19:05.032873 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1789/3585] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:04 2022] POST /compute/v2.1/servers => generated 123 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:19:05.044936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Action: 'update', calling method: .version_select at 0x7f7beb897d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:05.198548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.199065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.199518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.200770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.200770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.201175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.792396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba58709f-04c9-4df2-ae93-9de976fb6f45 tempest-QuotasAdminTestJSON-2013247183 tempest-QuotasAdminTestJSON-2013247183-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5" status: 200 len: 329 microversion: 2.1 time: 0.756595 Sep 25 01:19:05.801790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1790/3586] 10.222.0.16 () {60 vars in 1263 bytes} [Sun Sep 25 01:19:05 2022] PUT /compute/v2.1/os-quota-sets/4291fa29af3b4a0fbc4b48548718edc5 => generated 329 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:05.807091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:05.811682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:05.822941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.823868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.824555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.825586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.826646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.827327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.886622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:05.901829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-336169ef-2e3a-4ddd-884d-a86510f9aad1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1362 microversion: 2.1 time: 2.283127 Sep 25 01:19:05.906928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1797/3587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:03 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1362 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:05.915396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3cf02092-a569-4ac1-a260-b4f1587d67a6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096273 Sep 25 01:19:05.921645 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1791/3588] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:19:05 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:05.925727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:05.926750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:05.941040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:05.942056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:05.943620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.949571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.955080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.955711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.955998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.956556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.958969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.959607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:05.959762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.960432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:05.961048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:05.961184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:06.411519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:06.427484 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aef05e57-eb8d-422b-8770-c5eed26cd8d9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1273 microversion: 2.1 time: 0.502027 Sep 25 01:19:06.429260 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1792/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:05 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1273 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:06.451849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5124697a-e3b2-45b8-a063-41d239a0855d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf40c4280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:06.535052 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5124697a-e3b2-45b8-a063-41d239a0855d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.103138 Sep 25 01:19:06.540899 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1793/3590] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:06 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:06.826430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:06.843287 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c64aa73-cf04-4d48-8efa-837f8f6fc528 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.934829 Sep 25 01:19:06.845100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1798/3591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:05 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:06.874081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:06.875794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:06.904523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:06.911652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:06.912299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:06.919001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:06.920142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:06.920916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:06.932399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:06.934925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:06.964227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:06.972041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:06.976495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:06.980233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:06.984241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:06.986680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:07.115509 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49632d54-e86b-423a-8785-9a8fc9d734b6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189736 Sep 25 01:19:07.116746 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1799/3592] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:19:06 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:07.125009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:07.126020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:07.146044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:07.146847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:07.148321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:07.149517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:07.150176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:07.150797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:07.719281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:07.730017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-72d189d4-b6da-4352-8261-9dffb525c94a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.861790 Sep 25 01:19:07.757166 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1794/3593] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:06 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:07.764527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:07.764527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:07.771744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:07.772245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:07.772684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:07.773389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:07.773877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:07.774318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:08.414001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:08.430747 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40884c90-d974-4234-8265-14aeb204aa2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1549 microversion: 2.1 time: 1.312094 Sep 25 01:19:08.447940 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1800/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:07 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1549 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:08.469365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6025df31-d2ce-4dc7-bd5b-615cf8a97b9f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf401e280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:08.578893 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6025df31-d2ce-4dc7-bd5b-615cf8a97b9f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.114713 Sep 25 01:19:08.579494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1801/3595] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:08 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:08.596627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca99b2f3-b879-42e5-b745-385acfc66c2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-646306309", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-key-1280090635", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:08.735375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-ca99b2f3-b879-42e5-b745-385acfc66c2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] validate_networks() for [('2309cf64-61cd-4755-9e43-04778a22257e', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:19:08.981293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:09.000636 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e30f352-6f3e-4369-a444-140e6a672da5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 1.235869 Sep 25 01:19:09.001297 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1795/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:07 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:09.017251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:09.021125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:09.052935 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:INSERT=23,nova_api:SELECT=63,nova_api:UPDATE=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:09.054861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:09.055676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:09.056554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:09.057503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:09.065355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:09.067828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:09.155857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc355d65-d61b-42b0-8998-648560d97368 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145076 Sep 25 01:19:09.166550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1796/3597] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:19:09 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:09.173091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:09.173776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:09.186546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:09.190353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:09.191014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:09.193473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:09.194191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:09.194793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:09.728262 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8fc2b30-f078-4df3-8387-7b6f2d8c5462 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.560215 Sep 25 01:19:09.729498 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1797/3598] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:19:09 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/os-interface => generated 284 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:09.735220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b1c49bb-0e20-4d98-a19d-d35ea554db4a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb897d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:09.832527 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b1c49bb-0e20-4d98-a19d-d35ea554db4a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.100849 Sep 25 01:19:09.841269 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1798/3599] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:09 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:10.025208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:10.025885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:10.056103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:10.060191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:10.064085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:10.065481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:10.072248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:10.076977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:10.188965 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ca99b2f3-b879-42e5-b745-385acfc66c2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Invalid key_name provided. Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca99b2f3-b879-42e5-b745-385acfc66c2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 246 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-646306309", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-key-1280090635", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid key_name provided. Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-646306309', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'key_name': 'tempest-key-1280090635', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1280090635 not found for user 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:10.191026 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca99b2f3-b879-42e5-b745-385acfc66c2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid key_name provided. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:10.194680 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca99b2f3-b879-42e5-b745-385acfc66c2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.612212 Sep 25 01:19:10.201758 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1802/3600] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:08 2022] POST /compute/v2.1/servers => generated 70 bytes in 1622 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 25 01:19:10.213064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:10.216502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:10.245771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:10.246550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:10.251009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:10.251933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:10.261294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:10.261998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:10.342477 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:10.346487 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-851569e2-fe83-4338-b926-f9dee61d1080 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143614 Sep 25 01:19:10.354264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1803/3601] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:19:10 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:10.365098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:10.367922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:10.401645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:10.402337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:10.402967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:10.403902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:10.404513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:10.405093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:10.715599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:10.726803 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fdf95149-1592-4f67-a4b1-b105b2f48fce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.705589 Sep 25 01:19:10.730499 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1799/3602] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:10 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:10.862091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6568a7a-5da9-4aa7-b045-79b479384696 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebd35ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:10.950222 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6568a7a-5da9-4aa7-b045-79b479384696 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.103207 Sep 25 01:19:10.956878 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1800/3603] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:10 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:10.962244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:10.975244 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-544a038b-0fc2-4925-8632-44a1860ee6be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.618176 Sep 25 01:19:10.978035 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1804/3604] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:10 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:11.013973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:11.014657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:11.040661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:11.044011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:11.044723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:11.045651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:11.049558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:11.050601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:11.367879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:11.371804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:11.398136 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=18 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:11.400039 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:11.405221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:11.406007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:11.406971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:11.409095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:11.411531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:11.412170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:11.486436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d64e575-2287-4cce-b4df-0c9704f683fa tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122397 Sep 25 01:19:11.489956 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1805/3605] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:19:11 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:19:11.605500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:11.606262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:11.670194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:11.671876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:11.676493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:11.686946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:11.705566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:11.709700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:11.792394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:19:11.921771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:11.955244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-27a8680c-f581-4ed0-8077-fb3dfd2a87da tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.945203 Sep 25 01:19:11.959299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1801/3606] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:11 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:11.978468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a650b621-b27d-4fae-827c-68df51ad5f6b req-81a3224d-64ed-4fc3-b82b-627caf65af7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3956414a-ef51-449f-b95e-c4feae10fdf9", "tag": "7fca791a-457d-4c3f-8795-34958f8ef9ee"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:12.005862 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14dab9ec-2d16-4653-a054-761a7d407d94 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 204 len: 0 microversion: 2.1 time: 0.408599 Sep 25 01:19:12.007074 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1806/3607] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:11 2022] DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:19:12.009398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a650b621-b27d-4fae-827c-68df51ad5f6b req-81a3224d-64ed-4fc3-b82b-627caf65af7a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.014495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:12.015401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a650b621-b27d-4fae-827c-68df51ad5f6b req-81a3224d-64ed-4fc3-b82b-627caf65af7a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.017262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a650b621-b27d-4fae-827c-68df51ad5f6b req-81a3224d-64ed-4fc3-b82b-627caf65af7a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:12.025472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:12.038369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.039458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.042726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:12.043736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.044391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.045951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:12.049380 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a650b621-b27d-4fae-827c-68df51ad5f6b req-81a3224d-64ed-4fc3-b82b-627caf65af7a service nova] Creating event network-changed:7fca791a-457d-4c3f-8795-34958f8ef9ee for instance 3956414a-ef51-449f-b95e-c4feae10fdf9 on n-h2-master-1 Sep 25 01:19:12.062743 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a650b621-b27d-4fae-827c-68df51ad5f6b req-81a3224d-64ed-4fc3-b82b-627caf65af7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099885 Sep 25 01:19:12.068446 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1802/3608] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:12.077093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3013cb80-a948-4d66-86db-382714b3c3c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb950550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:12.174640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3013cb80-a948-4d66-86db-382714b3c3c2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.104122 Sep 25 01:19:12.176001 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1803/3609] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:12 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:12.183990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:12.185144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:12.193959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.195004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.195640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:12.196727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.197391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.198658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:12.723622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:12.736646 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5e62565-6fa8-4b84-842a-0e8287ff84f3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.728117 Sep 25 01:19:12.737245 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1807/3610] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:12 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:12.757539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b9fbdd77-80fe-49d7-86d6-65b7276f3c83 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1549563035", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:12.758688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:12.766647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0009827a-b8fe-4aaa-983c-77a5a2827453 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1681 microversion: 2.1 time: 0.588137 Sep 25 01:19:12.768059 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1804/3611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:12 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1681 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:12.915871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.security_group_api [None req-b9fbdd77-80fe-49d7-86d6-65b7276f3c83 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Neutron security group does_not_exist not found {{(pid=122385) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 25 01:19:12.916899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b9fbdd77-80fe-49d7-86d6-65b7276f3c83 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b9fbdd77-80fe-49d7-86d6-65b7276f3c83 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 258 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1549563035", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1549563035', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 25 01:19:12.927117 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:12.930992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b9fbdd77-80fe-49d7-86d6-65b7276f3c83 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:12.940757 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b9fbdd77-80fe-49d7-86d6-65b7276f3c83 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.191592 Sep 25 01:19:12.940757 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1808/3612] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:12 2022] POST /compute/v2.1/servers => generated 106 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:19:12.943069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:12.943709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:12.951199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.951703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.952134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:12.953046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:12.953934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:12.954587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:13.177922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:13.187175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e7230ae4-3c69-46bb-b8d2-9979c1332278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.251531 Sep 25 01:19:13.188881 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1805/3613] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:12 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:13.202110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-66d4c7fd-799d-4366-b2f0-d185ec31dc30 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebf08040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:13.213143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:13.214113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:13.222283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:13.229381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:13.230201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:13.231146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:13.231816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:13.232435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:13.311895 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-66d4c7fd-799d-4366-b2f0-d185ec31dc30 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.124609 Sep 25 01:19:13.315201 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1809/3614] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:13 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:13.513653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:13.522901 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ca9e1b1-a3c3-4411-aeee-c87dd25e62c8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.314132 Sep 25 01:19:13.540991 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1806/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:13 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:13.550785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c163bc3-6a6f-4e62-a58b-ea2002d61530 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:13.552428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c163bc3-6a6f-4e62-a58b-ea2002d61530 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: a7557162-a0e5-4b5b-96e8-6ba2d91e7d86] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:13.574993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-9c163bc3-6a6f-4e62-a58b-ea2002d61530 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 could not be found. Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c163bc3-6a6f-4e62-a58b-ea2002d61530 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 HTTP/1.1 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: exception: Instance a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 could not be found. Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'a7557162-a0e5-4b5b-96e8-6ba2d91e7d86'} Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 could not be found. Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 could not be found. Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:13.576585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 could not be found. Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:13.580196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c163bc3-6a6f-4e62-a58b-ea2002d61530 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:13.582699 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c163bc3-6a6f-4e62-a58b-ea2002d61530 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7557162-a0e5-4b5b-96e8-6ba2d91e7d86" status: 404 len: 111 microversion: 2.1 time: 0.040054 Sep 25 01:19:13.591652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:13.592504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:13.599949 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1810/3616] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:13 2022] DELETE /compute/v2.1/servers/a7557162-a0e5-4b5b-96e8-6ba2d91e7d86 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:13.601882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:13.603992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:13.608187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:13.610017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:13.610704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:13.611617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:13.761817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:13.763126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:13.779072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:13.780171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:13.780857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:13.781978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:13.782643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:13.783422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:14.366330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:14.371267 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:14.406193 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5891ba0f-acdf-4a20-8c0c-f780300957c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.814770 Sep 25 01:19:14.409863 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1807/3617] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:13 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:14.436590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:14.438125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:14.447888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:14.448080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:14.448587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:14.449332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:14.449807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:14.450227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:14.540916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:14.558661 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0852711-8af6-4c82-a3a1-5949304075eb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.801791 Sep 25 01:19:14.559743 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1811/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:13 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:14.802489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:14.817584 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a62be2b-000c-4cc9-a7d7-6bded5b4afe6 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1681 microversion: 2.1 time: 0.405014 Sep 25 01:19:14.841353 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1808/3619] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:14 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1681 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:14.848832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-696a91b0-53d8-4fd2-a865-6ea3e47156ac req-f31f9a0f-4e95-4f56-8513-393725691dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:14.851669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-818531998", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:14.861685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-696a91b0-53d8-4fd2-a865-6ea3e47156ac req-f31f9a0f-4e95-4f56-8513-393725691dab service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:14.862621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-696a91b0-53d8-4fd2-a865-6ea3e47156ac req-f31f9a0f-4e95-4f56-8513-393725691dab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:14.863487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-696a91b0-53d8-4fd2-a865-6ea3e47156ac req-f31f9a0f-4e95-4f56-8513-393725691dab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:14.905851 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-696a91b0-53d8-4fd2-a865-6ea3e47156ac req-f31f9a0f-4e95-4f56-8513-393725691dab service nova] Creating event network-changed:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:19:14.918615 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-696a91b0-53d8-4fd2-a865-6ea3e47156ac req-f31f9a0f-4e95-4f56-8513-393725691dab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075128 Sep 25 01:19:14.919566 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1809/3620] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:14.936797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c92482d0-0e7b-4435-8741-a8774888df17 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb9501f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:15.045239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:19:15.045926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:19:15.046553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:19:15.047110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:19:15.047672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:19:15.079737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:15.081382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:15.083091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:15.084678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c92482d0-0e7b-4435-8741-a8774888df17 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.161663 Sep 25 01:19:15.085375 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1810/3621] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:14 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:15.089721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:15.090241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:15.090692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:15.099865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:15.100945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:15.114746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:15.116617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:15.118627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:15.121557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:15.122261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:15.122945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:15.140287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Getting quotas for project 07da64bac2374cb198fd4fe19579fbfc. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:19:15.153051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Getting quotas for user c9035edc30954d749d5c70f004a018b3 and project 07da64bac2374cb198fd4fe19579fbfc. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:19:15.189301 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:15.196416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:19:15.199025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:19:15.227454 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=13 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:15.312361 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1e55b1b9-0878-4247-b14d-0d681a70a3db tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.749163 Sep 25 01:19:15.314885 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1812/3622] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:19:15.338019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a2f7884-ed30-4acc-afbd-631dbf83b3c0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:15.339841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a2f7884-ed30-4acc-afbd-631dbf83b3c0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:15.689837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a2f7884-ed30-4acc-afbd-631dbf83b3c0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:15.706375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a2f7884-ed30-4acc-afbd-631dbf83b3c0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:15.715371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a2f7884-ed30-4acc-afbd-631dbf83b3c0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:15.764749 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a2f7884-ed30-4acc-afbd-631dbf83b3c0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1452 microversion: 2.91 time: 0.433409 Sep 25 01:19:15.767809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1813/3623] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:15 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1452 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:15.782732 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=44 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:15.783905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:15.786212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:15.799239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:15.803013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:15.804712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:15.806958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:15.808482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:15.810152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:16.200047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:16.215741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5145e859-3e71-4e81-a5ff-20515d2d11be tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 1.126184 Sep 25 01:19:16.216616 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1811/3624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:15 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:16.238155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:16.239684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:16.253012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:16.253553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:16.254029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:16.255129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:16.255592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:16.256016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:16.382739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:16.405141 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0487abd4-e818-4c6c-9adf-653cc0d1e4bd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.635721 Sep 25 01:19:16.421944 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1814/3625] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:15 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:16.440243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-584e7861-0ccf-4cdb-b749-bc9afb08e060 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebfe4670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:16.522275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-584e7861-0ccf-4cdb-b749-bc9afb08e060 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.096978 Sep 25 01:19:16.531481 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1815/3626] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:16 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:16.537466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6669102-a1d5-4425-86a0-1c3f20a4d2e8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:16.550152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6669102-a1d5-4425-86a0-1c3f20a4d2e8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:19:16.550976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-a6669102-a1d5-4425-86a0-1c3f20a4d2e8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6669102-a1d5-4425-86a0-1c3f20a4d2e8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9223372036854775808 could not be found. Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9223372036854775808'} Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:16.552656 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6669102-a1d5-4425-86a0-1c3f20a4d2e8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6669102-a1d5-4425-86a0-1c3f20a4d2e8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023500 Sep 25 01:19:16.564647 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1816/3627] 10.222.0.16 () {58 vars in 1188 bytes} [Sun Sep 25 01:19:16 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:19:16.573380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:16.576569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:16.585297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:16.586085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:16.586717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:16.587623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:16.588194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:16.588751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:16.925442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:16.943584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92fc95c1-c95d-43db-8ce5-f819a8b9a944 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.377323 Sep 25 01:19:16.948922 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1817/3628] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:16 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:16.959489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:16.963534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:16.981182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:16.981921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:16.982509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:16.983352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:16.983944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:16.984535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:17.051554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:17.062318 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36865a1e-9b22-4dca-bed6-d2a4fe1d316a tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1681 microversion: 2.1 time: 0.843976 Sep 25 01:19:17.070500 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1812/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:16 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1681 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:17.078175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:17.082182 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:17.094723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:17.095442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:17.097359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:17.098694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:17.110201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:17.110907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:17.277242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:17.303373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:17.315215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:17.333059 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d925137-0a8c-4896-99bb-b161d319ba73 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1504 microversion: 2.91 time: 0.378370 Sep 25 01:19:17.342082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1818/3630] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:16 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:17.452066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:17.455142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:17.496488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:17.499647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:17.502097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:17.506131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:17.507958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:17.510114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:17.879997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:17.894229 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-084bda5e-96d9-44da-8ce1-c2f9babcda0a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.820115 Sep 25 01:19:17.895731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1813/3631] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:17 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:17.908175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4aed2f5b-9685-41c4-9042-9f4d994037cb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebcb5310>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:18.002475 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4aed2f5b-9685-41c4-9042-9f4d994037cb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.088952 Sep 25 01:19:18.007403 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1814/3632] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:17 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:18.018249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b726649-64e7-457a-a43f-d43356ada542 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:18.021907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1b726649-64e7-457a-a43f-d43356ada542 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Failed to fetch instance by id -1 {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:19:18.022635 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1b726649-64e7-457a-a43f-d43356ada542 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance -1 could not be found. Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b726649-64e7-457a-a43f-d43356ada542 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: exception: Instance -1 could not be found. Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '-1'} Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:18.028858 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:18.032065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:18.032065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:18.032065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 25 01:19:18.032065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:18.033094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b726649-64e7-457a-a43f-d43356ada542 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:18.034132 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1b726649-64e7-457a-a43f-d43356ada542 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.024725 Sep 25 01:19:18.034994 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1815/3633] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:19:18 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:19:18.058040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:18.059364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:18.071993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.073790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.074487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.075522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.077346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.078109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.290925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:18.302442 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca6f727b-8d4e-4535-921a-88b9498e0fe6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.854379 Sep 25 01:19:18.305249 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1819/3634] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:17 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:18.318192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:18.319116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:18.354367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.355144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.355714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.357871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.360048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.360727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.664537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:18.673362 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-314544b1-dbdb-4344-b01d-3040cc105b68 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1613 microversion: 2.1 time: 0.366351 Sep 25 01:19:18.682351 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1820/3635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:18 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1613 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:18.695110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:18.700208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:18.723936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.734200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.734895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.735788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.737908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.739304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.809345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:18.836913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-972a4122-27d1-4da0-b5b2-78a8c70c8ca7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.788612 Sep 25 01:19:18.837591 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1816/3636] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:18 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:18.861576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6f0d1fe8-ea71-4e55-b441-8d01bca872c9 req-ddd48c55-53a4-4f1e-847d-f70548eb8d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddfe85b2-f8b0-4ca5-bcf3-366be0043c20", "name": "network-vif-deleted", "tag": "df3720ac-47e5-406e-b3e4-09f6b04513eb"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:18.890985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6f0d1fe8-ea71-4e55-b441-8d01bca872c9 req-ddd48c55-53a4-4f1e-847d-f70548eb8d33 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.891482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6f0d1fe8-ea71-4e55-b441-8d01bca872c9 req-ddd48c55-53a4-4f1e-847d-f70548eb8d33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.891921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6f0d1fe8-ea71-4e55-b441-8d01bca872c9 req-ddd48c55-53a4-4f1e-847d-f70548eb8d33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.917986 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6f0d1fe8-ea71-4e55-b441-8d01bca872c9 req-ddd48c55-53a4-4f1e-847d-f70548eb8d33 service nova] Creating event network-vif-deleted:df3720ac-47e5-406e-b3e4-09f6b04513eb for instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 on n-h2-master-1 Sep 25 01:19:18.938656 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6f0d1fe8-ea71-4e55-b441-8d01bca872c9 req-ddd48c55-53a4-4f1e-847d-f70548eb8d33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096632 Sep 25 01:19:18.940470 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1817/3637] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:18.947851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:18.948684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:18.963336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.964017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.964679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:18.965780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:18.966479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:18.967093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:19.006484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:19.063291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:19.063291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:19.071856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-069afff6-b304-4c99-992c-26f11d5069f2 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1510 microversion: 2.91 time: 0.386808 Sep 25 01:19:19.091081 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1821/3638] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:18 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:19.105820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5c97eec4-c200-4f4d-adfd-386cbf6ef483 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf401e940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:19.210496 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5c97eec4-c200-4f4d-adfd-386cbf6ef483 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.117955 Sep 25 01:19:19.223132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1822/3639] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:19 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:19.332673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:19.334620 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:19.342977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:19.343784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:19.344949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:19.345985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:19.346699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:19.347331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:19.871407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:19.882072 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3deafc22-64bc-4476-b705-0ccfc0812345 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.940316 Sep 25 01:19:19.882658 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1818/3640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:18 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:19.905238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:19.906334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:19.922516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:19.926790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:19.928139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:19.928984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:19.942024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:19.942626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.002389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.004092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.004374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.004855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lazy-loading 'fault' on Instance uuid ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:20.288980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:20.301141 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4236a86e-870a-49b7-82f8-8fe30156245e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.973613 Sep 25 01:19:20.306422 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1823/3641] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:19 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:20.323196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aec0ab94-99ec-4921-a6d9-07f8913c4e9b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:20.328003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aec0ab94-99ec-4921-a6d9-07f8913c4e9b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 857de57c-9daa-4706-9666-5d19387744d4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:20.349359 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-aec0ab94-99ec-4921-a6d9-07f8913c4e9b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 857de57c-9daa-4706-9666-5d19387744d4 could not be found. Sep 25 01:19:20.360709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb85bd8db516469abb729c1fdc0a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fcf2dd9b2c41f5a87eda0402682069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aec0ab94-99ec-4921-a6d9-07f8913c4e9b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/857de57c-9daa-4706-9666-5d19387744d4/action HTTP/1.1 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 19 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: {"forceDelete": {}} Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 857de57c-9daa-4706-9666-5d19387744d4 could not be found. Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '857de57c-9daa-4706-9666-5d19387744d4', 'body': {'forceDelete': {}}} Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 857de57c-9daa-4706-9666-5d19387744d4 could not be found. Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 857de57c-9daa-4706-9666-5d19387744d4 could not be found. Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:20.367662 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 857de57c-9daa-4706-9666-5d19387744d4 could not be found. Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aec0ab94-99ec-4921-a6d9-07f8913c4e9b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 857de57c-9daa-4706-9666-5d19387744d4 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aec0ab94-99ec-4921-a6d9-07f8913c4e9b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/857de57c-9daa-4706-9666-5d19387744d4/action" status: 404 len: 111 microversion: 2.1 time: 0.061808 Sep 25 01:19:20.370923 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1824/3642] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:20 2022] POST /compute/v2.1/servers/857de57c-9daa-4706-9666-5d19387744d4/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:20.375819 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a27c823-a537-48b8-8841-4eadea8fe9a4 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 200 len: 1330 microversion: 2.1 time: 0.489221 Sep 25 01:19:20.389987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1819/3643] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:19 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 1330 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:20.399295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:20.399466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-751dcd32-58ad-4e52-b866-64370e3f311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb1ddca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:20.399917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:20.422315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.422811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.423435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.424308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.424947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.425562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.495356 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-751dcd32-58ad-4e52-b866-64370e3f311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.104141 Sep 25 01:19:20.498466 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1820/3644] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:20 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:20.508672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:20.519286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:20.537440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.538142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.538802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.539742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.540369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.540815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.590369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:20.602882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:20.629456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:20.645743 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5c797c25-af29-44ba-a6a4-c05bab3bbcad tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1510 microversion: 2.91 time: 0.273680 Sep 25 01:19:20.657750 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1825/3645] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:20 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:20.690237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cad5ce04-c7ca-4e83-b697-45f5c2305365 req-6ca6b6fa-0a2b-4dc3-95ea-27ae66c455c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3956414a-ef51-449f-b95e-c4feae10fdf9", "name": "network-vif-plugged", "status": "completed", "tag": "7fca791a-457d-4c3f-8795-34958f8ef9ee"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:20.713253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cad5ce04-c7ca-4e83-b697-45f5c2305365 req-6ca6b6fa-0a2b-4dc3-95ea-27ae66c455c3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.713990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cad5ce04-c7ca-4e83-b697-45f5c2305365 req-6ca6b6fa-0a2b-4dc3-95ea-27ae66c455c3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.714709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cad5ce04-c7ca-4e83-b697-45f5c2305365 req-6ca6b6fa-0a2b-4dc3-95ea-27ae66c455c3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.738977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cad5ce04-c7ca-4e83-b697-45f5c2305365 req-6ca6b6fa-0a2b-4dc3-95ea-27ae66c455c3 service nova] Creating event network-vif-plugged:7fca791a-457d-4c3f-8795-34958f8ef9ee for instance 3956414a-ef51-449f-b95e-c4feae10fdf9 on n-h2-master-1 Sep 25 01:19:20.772403 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:20.787666 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cad5ce04-c7ca-4e83-b697-45f5c2305365 req-6ca6b6fa-0a2b-4dc3-95ea-27ae66c455c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097613 Sep 25 01:19:20.788519 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7c403fe9-6dc7-4f5d-a1f9-8c8b2c4c8c3e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.284708 Sep 25 01:19:20.802303 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1821/3646] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:20 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:20.805080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1826/3647] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:20.816139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:20.818469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:20.826341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.827147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.827782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:20.828679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:20.829358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:20.829964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.246751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:21.259178 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-154ccdfb-a4b0-4671-aff3-b0b48ce42dac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.447852 Sep 25 01:19:21.259944 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1822/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:20 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:21.285797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ddb3c1e9-82a8-4598-b7fe-65e5b467606a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:21.290460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ddb3c1e9-82a8-4598-b7fe-65e5b467606a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:21.306310 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ddb3c1e9-82a8-4598-b7fe-65e5b467606a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc could not be found. Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ddb3c1e9-82a8-4598-b7fe-65e5b467606a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc/action HTTP/1.1 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 39 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: {"os-getConsoleOutput": {"length": 10}} Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc could not be found. Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc could not be found. Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc could not be found. Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.310312 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:21.314739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:21.314739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:21.314739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:21.314739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:21.314739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc could not be found. Sep 25 01:19:21.314739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.316061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ddb3c1e9-82a8-4598-b7fe-65e5b467606a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:21.317742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ddb3c1e9-82a8-4598-b7fe-65e5b467606a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc/action" status: 404 len: 111 microversion: 2.1 time: 0.037578 Sep 25 01:19:21.331541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.332585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:21.337457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1827/3649] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:21 2022] POST /compute/v2.1/servers/2dfcbb2d-698f-4ed3-a94f-22f5496e1ccc/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:21.342934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.346013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.347356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.349365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.350190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:21.357194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.357715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.357930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.358644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.359482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.360337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.360947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.361569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.365133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.651502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:21.664427 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ee99460-d051-45d6-812e-491324742bce tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.332759 Sep 25 01:19:21.665277 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1823/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:21.670692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.671310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:21.689913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.690414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.690855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.691853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.692348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.692845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.732444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:21.734396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 HTTP/1.1 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ddfe85b2-f8b0-4ca5-bcf3-366be0043c20'} Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:21.736633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:21.740412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:21.742143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:21.743245 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-886549cf-d110-4988-b32a-6a6f55ad7e4d tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 404 len: 111 microversion: 2.1 time: 0.076240 Sep 25 01:19:21.744148 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1824/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:21.746386 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-747125bd-3225-4e64-952b-246e7f64e1c4 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.407606 Sep 25 01:19:21.748512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1828/3652] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:21.753704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.754702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:21.761297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.762019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.762616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.763468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.764067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.764635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.768189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-32763518-3c9c-4be3-a135-e23dee03a7b4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebaa4f70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.795903 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:21.854827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:21.857202 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-32763518-3c9c-4be3-a135-e23dee03a7b4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.108572 Sep 25 01:19:21.858117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1825/3653] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:21.862833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d80c9196-7104-4779-9401-852d896a83ef tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '.version_select at 0x7f7beb9621f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.873142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:21.874927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:21.885417 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-893362ff-319d-4150-a144-52f5023873ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1531 microversion: 2.91 time: 0.135632 Sep 25 01:19:21.889794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1829/3654] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1531 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:21.901585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:21.910988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:21.914974 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d80c9196-7104-4779-9401-852d896a83ef tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313592561" status: 202 len: 0 microversion: 2.1 time: 0.055348 Sep 25 01:19:21.915933 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1826/3655] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313592561 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:21.946618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.949372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.952398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:21.953434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:21.954101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:21.955554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.251071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:22.270512 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-75daac84-cd7c-4191-9f4a-2ccf58090eb9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.376899 Sep 25 01:19:22.271999 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1830/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:22.294656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:22.295401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:22.302075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2ec1f8e-d115-4d52-9fc0-d936b4c3e127 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:22.317725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.319901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2ec1f8e-d115-4d52-9fc0-d936b4c3e127 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 63218045-bd79-4e02-b484-fcd723a168f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:22.320599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.321063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.328964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.329678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.332512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.395378 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c2ec1f8e-d115-4d52-9fc0-d936b4c3e127 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 63218045-bd79-4e02-b484-fcd723a168f7 could not be found. Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2ec1f8e-d115-4d52-9fc0-d936b4c3e127 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/63218045-bd79-4e02-b484-fcd723a168f7 HTTP/1.1 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 63218045-bd79-4e02-b484-fcd723a168f7 could not be found. Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '63218045-bd79-4e02-b484-fcd723a168f7'} Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63218045-bd79-4e02-b484-fcd723a168f7 could not be found. Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63218045-bd79-4e02-b484-fcd723a168f7 could not be found. Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:22.411957 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63218045-bd79-4e02-b484-fcd723a168f7 could not be found. Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2ec1f8e-d115-4d52-9fc0-d936b4c3e127 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 63218045-bd79-4e02-b484-fcd723a168f7 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2ec1f8e-d115-4d52-9fc0-d936b4c3e127 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/63218045-bd79-4e02-b484-fcd723a168f7" status: 404 len: 111 microversion: 2.1 time: 0.119008 Sep 25 01:19:22.415327 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1831/3657] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:22 2022] GET /compute/v2.1/servers/63218045-bd79-4e02-b484-fcd723a168f7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:22.427872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:22.428488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:22.459949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.464732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.465961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.472143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.474915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.475532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.536576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lazy-loading 'services' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:22.567236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0c7941af-1f6c-4cf7-974a-ea8e6d9e80be tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1936 microversion: 2.91 time: 0.646488 Sep 25 01:19:22.568142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1827/3658] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:21 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1936 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:22.656121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:22.659373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:22.689900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.695856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.697601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.700633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.700633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.702584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.893446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lazy-loading 'services' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:22.905198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:22.918367 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-857fcc97-c21d-4a02-b402-f0c7e251ce3f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.493865 Sep 25 01:19:22.922120 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1832/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:22 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:22.931215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:22.935945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:22.951181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.952655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-70a72ffb-905b-4f6e-8171-7acae0e17f6c tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1936 microversion: 2.91 time: 0.320655 Sep 25 01:19:22.964262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.964262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.964562 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1828/3660] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:22 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1936 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:22.964648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:22.964648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:22.964648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:22.969137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e600fa17-858f-4310-9541-68e351893f83 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb92a4c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:23.064910 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e600fa17-858f-4310-9541-68e351893f83 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.108165 Sep 25 01:19:23.065823 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1829/3661] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:22 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:23.083023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:23.083023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:23.112383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.114434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.114646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.117167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.117167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.117167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.356116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:23.366889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f1731a4-563c-47ee-b72a-1b9de54e895c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1502 microversion: 2.1 time: 0.443603 Sep 25 01:19:23.369835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1833/3662] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:22 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:23.397524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:23.403156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.406074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.406713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.407997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.421147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.422009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.454951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bf2f113a-ea32-478a-b5fe-67275bcfa7c4 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.083058 Sep 25 01:19:23.456053 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1834/3663] 10.222.0.16 () {60 vars in 1217 bytes} [Sun Sep 25 01:19:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:19:23.461590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51730a7f-a5ba-4218-b5e5-3e25f029d525 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:23.470731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51730a7f-a5ba-4218-b5e5-3e25f029d525 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.471386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51730a7f-a5ba-4218-b5e5-3e25f029d525 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.471978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51730a7f-a5ba-4218-b5e5-3e25f029d525 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.479761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:23.494150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-78e57474-72f4-4764-9331-abea6256a0b3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.426579 Sep 25 01:19:23.509673 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1830/3664] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:23 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:23.527151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:23.527929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:23.535979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.536834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.537797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.539178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.539891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.540538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.544333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-51730a7f-a5ba-4218-b5e5-3e25f029d525 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:19:23.596802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lazy-loading 'flavor' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:23.627223 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51730a7f-a5ba-4218-b5e5-3e25f029d525 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.168657 Sep 25 01:19:23.632106 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1835/3665] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:23 2022] POST /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:23.645234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:23.663128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:23.686818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.689702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.691877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:23.694941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:23.696112 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:23.696225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:23.698607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:24.026420 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-03d3407a-d333-475e-a51c-cba88d1ffaac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action" status: 202 len: 0 microversion: 2.91 time: 0.513337 Sep 25 01:19:24.028197 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1831/3666] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:19:23 2022] POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:19:24.032010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:24.046337 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ac80cfc-da38-4679-89ce-5ef394a4d102 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.408447 Sep 25 01:19:24.049875 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1836/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:23 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:24.059583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:24.060750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:24.062098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a43fbc28-76b2-4846-af60-c7a8df2da63f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-969350346", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:24.072440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:24.075289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:24.076356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:24.078221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:24.079292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:24.080324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a43fbc28-76b2-4846-af60-c7a8df2da63f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 237 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-969350346", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-969350346', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.091813 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a43fbc28-76b2-4846-af60-c7a8df2da63f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a43fbc28-76b2-4846-af60-c7a8df2da63f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.064601 Sep 25 01:19:24.095473 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1832/3668] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:19:24.109030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d333e82d-a2c8-49fc-9f9c-07130a7b8fa0 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf005e4c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:24.199057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:24.203934 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d333e82d-a2c8-49fc-9f9c-07130a7b8fa0 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.103912 Sep 25 01:19:24.209603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1833/3669] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:24 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:24.211623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:24.214965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:24.221492 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b390f13-9d5c-40cd-b0c6-859c607fd429 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.169462 Sep 25 01:19:24.233442 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1837/3670] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:24 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:24.233620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:24.233620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:24.247343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:24.247343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:24.247343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:24.247343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:24.247343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:24.247343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:24.672688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:24.702979 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76352ae0-e803-46b4-bfa2-b1c3ca81e082 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.475642 Sep 25 01:19:24.703862 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1834/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:24 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:24.739913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:24.740541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:24.756350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:24.756988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:24.757567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:24.758381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:24.761655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:24.762199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.083398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:25.085464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:25.102464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:25.105021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:25.106550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.107983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:25.108103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:25.111550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:25.112240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.117811 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-58c96adc-fbe5-4e75-bc15-7a6584369955 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.382888 Sep 25 01:19:25.118770 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1838/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:24 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:25.225476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-94c54a16-ac1c-48a8-8bf1-4e7d854702d3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebf1ca60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:25.330702 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-94c54a16-ac1c-48a8-8bf1-4e7d854702d3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.111936 Sep 25 01:19:25.332576 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1839/3673] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:25 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:25.353584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:25.357914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:25.401884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:25.402407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:25.402854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.403589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:25.427971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:25.428448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.544151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:25.562516 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0013b0c9-00aa-485a-abe0-84f7e97562be tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.487001 Sep 25 01:19:25.563132 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1835/3674] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:25 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:25.568629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bed95ebd-f3e0-45de-8d46-d2f1067bc24d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1178233310", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bed95ebd-f3e0-45de-8d46-d2f1067bc24d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 235 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1178233310", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1178233310', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.593086 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bed95ebd-f3e0-45de-8d46-d2f1067bc24d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bed95ebd-f3e0-45de-8d46-d2f1067bc24d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031585 Sep 25 01:19:25.597031 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1836/3675] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:25 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:19:25.618533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:25.619162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:25.626658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:25.627159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:25.627605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.628320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:25.629376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:25.629858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:25.639380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:25.648222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:25.649570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:25.664447 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90291acd-fd7c-48f7-89b6-faf5d667f9b1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.331036 Sep 25 01:19:25.677437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1840/3676] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:25 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:26.043304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:26.052684 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b64e089b-ee7a-412d-bdc0-2a0ba2a1f174 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.437924 Sep 25 01:19:26.053281 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1837/3677] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:25 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:26.084283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:26.084903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:26.094232 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:26.100987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:26.102808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:26.104387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:26.105495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:26.109469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:26.110078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:26.348976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8cd695ed-e3c1-4510-8236-6bce2e6b49ce tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf40c4dc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:26.439593 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8cd695ed-e3c1-4510-8236-6bce2e6b49ce tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.095278 Sep 25 01:19:26.440196 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1838/3678] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:26 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:26.558842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:26.568197 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccf4dfd5-6831-4ce0-b76e-5a5edd924d9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.488272 Sep 25 01:19:26.588041 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1841/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:26 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:26.588982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:26.590526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:26.605856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea98b47e-d45a-40b7-b0f3-ffee04f603ef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:26.607744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ea98b47e-d45a-40b7-b0f3-ffee04f603ef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: f9519d24-6402-4f94-a552-9abc7dad8a29] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:26.608513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:26.609017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:26.611500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:26.612263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:26.612736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:26.613552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:26.622647 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ea98b47e-d45a-40b7-b0f3-ffee04f603ef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance f9519d24-6402-4f94-a552-9abc7dad8a29 could not be found. Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea98b47e-d45a-40b7-b0f3-ffee04f603ef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/f9519d24-6402-4f94-a552-9abc7dad8a29/action HTTP/1.1 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 13 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: {"pause": {}} Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f9519d24-6402-4f94-a552-9abc7dad8a29 could not be found. Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f9519d24-6402-4f94-a552-9abc7dad8a29', 'body': {'pause': {}}} Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9519d24-6402-4f94-a552-9abc7dad8a29 could not be found. Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9519d24-6402-4f94-a552-9abc7dad8a29 could not be found. Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:26.629381 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:26.633510 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:26.633510 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:26.633510 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9519d24-6402-4f94-a552-9abc7dad8a29 could not be found. Sep 25 01:19:26.633510 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:26.634068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea98b47e-d45a-40b7-b0f3-ffee04f603ef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance f9519d24-6402-4f94-a552-9abc7dad8a29 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:26.635063 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ea98b47e-d45a-40b7-b0f3-ffee04f603ef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/f9519d24-6402-4f94-a552-9abc7dad8a29/action" status: 404 len: 111 microversion: 2.1 time: 0.037082 Sep 25 01:19:26.642706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1842/3680] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:26 2022] POST /compute/v2.1/servers/f9519d24-6402-4f94-a552-9abc7dad8a29/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:26.656001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:26.656799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:26.671175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:26.674345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:26.675370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:26.677020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:26.678361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:26.679237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.086710 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:27.109011 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4145d499-b04a-426d-8283-cfc28c76384d tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.524379 Sep 25 01:19:27.111989 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1839/3681] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:26 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:27.124861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:27.131716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:27.156420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.157663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.158526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.163137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.163780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.164359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.221459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:27.231387 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1c24e24-9a25-41fb-8bd6-8a4b62a06bef tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.587425 Sep 25 01:19:27.242733 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1843/3682] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:26 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:27.269435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:27.270559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:27.287331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.290987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.294142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.295233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.298447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.301851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.309445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:27.322078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:27.323896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:27.330900 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cae83461-8c90-4033-82ce-6d08bc7863a3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.216297 Sep 25 01:19:27.332435 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1840/3683] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:27 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:27.455594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d705872d-03f8-4196-bbed-8fa934c4f4b4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb1fd670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:27.536480 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d705872d-03f8-4196-bbed-8fa934c4f4b4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1411 microversion: 2.1 time: 0.084911 Sep 25 01:19:27.544561 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1841/3684] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:27 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:27.570088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:27.581173 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b06b09ef-f8db-4a11-b3c9-8d320112b12a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.315702 Sep 25 01:19:27.598666 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1844/3685] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:27 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:27.605774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:27.606581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:27.614465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.615209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.615804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.616731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.617366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.617979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.769685 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-579194e7-20f5-4c77-8d02-70c451e87c8e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 202 len: 0 microversion: 2.1 time: 0.166753 Sep 25 01:19:27.771649 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1842/3686] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:27 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:27.801571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:27.802776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:27.813888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.818821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.819471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:27.821006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:27.821668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:27.824644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:28.057391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:28.070405 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0be6cd33-1ebe-4510-8670-0c5d32b93b22 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1509 microversion: 2.1 time: 0.291386 Sep 25 01:19:28.073368 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1845/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:27 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:28.137125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:28.137954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:28.153668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:28.154164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:28.155605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:28.157969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:28.158610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:28.159202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:28.364064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:28.364779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:28.371054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:28.384499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:28.385023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:28.385494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:28.391784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:28.393521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:28.393981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:28.403704 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-88541c7c-9ad6-4ba1-838a-7f4b8ed8996f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.270952 Sep 25 01:19:28.404708 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1843/3688] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:28 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:28.514339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:28.527821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:28.531112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:28.541160 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc1c9159-6879-4b16-8e84-a64fb7f65ab4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.181685 Sep 25 01:19:28.546810 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1846/3689] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:28 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:28.586743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-57ca4eb2-c644-473c-b8b6-7a6ae1e7d269 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb184ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:28.686686 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-57ca4eb2-c644-473c-b8b6-7a6ae1e7d269 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1420 microversion: 2.1 time: 0.129523 Sep 25 01:19:28.690886 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1844/3690] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:28 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:28.707031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c29cd44-73bd-4fe7-babd-63d480f2fb4a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb40cdc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:28.798944 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c29cd44-73bd-4fe7-babd-63d480f2fb4a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 200 len: 1420 microversion: 2.1 time: 0.096757 Sep 25 01:19:28.799911 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1847/3691] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:28 2022] GET /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:28.817902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84a5c8eb-3dce-44ba-92d3-9c12123ca8e3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb183e50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.105106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.105983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.124319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.126622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.127786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.130866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.131938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.133278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.560456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:29.571961 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b7948705-f0a2-4d9c-835b-b1098c7b0b4a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1489 microversion: 2.1 time: 0.475733 Sep 25 01:19:29.572541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1848/3692] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:29 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1489 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:29.589288 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.590220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.604780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.605275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.605735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.606669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.607270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.607862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.640136 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:29.690153 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84a5c8eb-3dce-44ba-92d3-9c12123ca8e3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 204 len: 0 microversion: 2.1 time: 0.877291 Sep 25 01:19:29.691818 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1845/3693] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:28 2022] DELETE /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:19:29.698474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.699087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.708575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.709932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.710615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.711647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.712113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.712553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.729481 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 HTTP/1.1 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ddfe85b2-f8b0-4ca5-bcf3-366be0043c20'} Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:29.733158 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:29.736637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f2e34768-49c9-4e0c-b1b6-f6e653178455 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 404 len: 111 microversion: 2.1 time: 0.041873 Sep 25 01:19:29.739057 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1846/3694] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:29 2022] DELETE /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:29.744428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.745240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.753148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.754267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.755332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.756231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.756694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.757176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.854617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:29.866347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:29.868155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:29.874916 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c679461b-a7df-48fa-ae3a-6d2000bbc989 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.134670 Sep 25 01:19:29.876205 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1847/3695] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:29 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:29.900489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:29.902235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.911422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.911960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.912350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.913065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.913548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.914133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.943795 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'pause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state paused Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 13 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: {"pause": {}} Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'pause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state paused Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'pause': {}}} Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state paused. Cannot pause while the instance is in this state. Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state paused Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:29.945550 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state paused Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'pause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state paused {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ad56621-49fc-4f28-a7ce-63e687a12644 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 143 microversion: 2.1 time: 0.055392 Sep 25 01:19:29.949022 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1848/3696] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:29 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 143 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:19:29.956742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.957635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.960386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:29.963865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.964361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.964839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.965514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.966152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.968411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.974075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce319ccb-262f-416d-9702-4ae766dabbd5 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.400307 Sep 25 01:19:29.974670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1849/3697] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:29 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:29.982885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:29.986337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: ddfe85b2-f8b0-4ca5-bcf3-366be0043c20] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:29.993858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.994349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.994786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:29.995488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:29.995944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:29.996367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:30.016969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 HTTP/1.1 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ddfe85b2-f8b0-4ca5-bcf3-366be0043c20'} Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:30.018806 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. Sep 25 01:19:30.022760 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:30.023132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:19:30.024744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:30.025820 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-223ff48b-b635-4cf3-bcef-c60699a2efa3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20" status: 404 len: 111 microversion: 2.1 time: 0.049937 Sep 25 01:19:30.026866 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1850/3698] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:29 2022] GET /compute/v2.1/servers/ddfe85b2-f8b0-4ca5-bcf3-366be0043c20 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:30.034381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:30.035160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:30.043277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:30.044055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:30.044989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:30.045989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:30.046807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:30.047437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:30.166605 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3bb0fa2f-0cb6-4f28-8df0-0ec2da48311c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 204 len: 0 microversion: 2.1 time: 0.217423 Sep 25 01:19:30.168073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f013b9b-0a4c-41a8-91ff-404ef9f1b2e3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 202 len: 0 microversion: 2.1 time: 0.139774 Sep 25 01:19:30.169088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1849/3699] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:29 2022] DELETE /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:19:30.188433 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1851/3700] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:30 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:30.219147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:30.220892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:30.260750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:30.266149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:30.267631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:30.270864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:30.272361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:30.273582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:30.387727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1108455018", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4ec95620-83af-4c06-b763-713d3bcab477"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:30.480687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] validate_networks() for [('4ec95620-83af-4c06-b763-713d3bcab477', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:19:30.706620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:30.720147 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8e3bc5c2-390c-4003-8642-64e53e3253a3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1496 microversion: 2.1 time: 0.515702 Sep 25 01:19:30.740851 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1850/3701] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:30 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1496 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:30.904811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:30.905452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:30.914957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:30.918124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:30.919252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:30.921677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:30.923582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:30.924221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:31.052996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:31.063385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:31.065151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:31.071251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3da29b6-052a-4f26-a180-68bfe2fa6e0e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.170957 Sep 25 01:19:31.072811 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1851/3702] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:30 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:31.089973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:31.091168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:31.094177 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:31.101585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:31.102244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:31.103339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:31.104494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:31.105112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:31.106116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:31.126529 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:31.441698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:31.479687 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b38baea-3ecf-47e9-ab29-c01587af2bbe tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.405421 Sep 25 01:19:31.481271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1852/3703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:31 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:31.763817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:31.764481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:31.775036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:31.775530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:31.775967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:31.776684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:31.777688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:31.778114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.068396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:19:32.068924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:19:32.069852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:19:32.070518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:19:32.071084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:19:32.083253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.083942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.084539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.085784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.086482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.087430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.110908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:19:32.112416 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:32.118239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for user ab3394e2971741d7aa5956de0d4afba8 and project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:19:32.134656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:19:32.137127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:19:32.173775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:32.186686 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89eaa1f9-0bc6-48d5-8efd-11474d5d2df0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.426864 Sep 25 01:19:32.190459 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-259f4aea-ab3a-4d28-bdee-df9e5bab9a01 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809061 Sep 25 01:19:32.192282 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1852/3704] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:19:32.197034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:32.197893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:32.205633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.205933 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1853/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:31 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:32.206566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.207322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.208315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.208926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.209546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.214374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-94a7b2c8-f67a-46f5-bc44-fc35498894d4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:32.221795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-94a7b2c8-f67a-46f5-bc44-fc35498894d4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:32.373130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:32.384758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:32.387255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:32.396591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-94a7b2c8-f67a-46f5-bc44-fc35498894d4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:32.406045 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3bd8a16-8bd2-451b-ace4-6d8b7278f6e1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.212562 Sep 25 01:19:32.411229 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1853/3706] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:32 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:32.421153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:32.422011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:32.422945 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-94a7b2c8-f67a-46f5-bc44-fc35498894d4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1208 microversion: 2.1 time: 0.199214 Sep 25 01:19:32.426710 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1854/3707] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:32 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1208 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:32.437864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.442408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.443045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.444550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.448465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.448946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.469263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0eaf0ba1-b909-493f-87a5-e0e468de3a4a req-0e004af0-f810-427a-a10e-2df48af2f4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24dfaf3-4058-4dac-80f3-b8dcba17f336", "name": "network-vif-unplugged", "status": "completed", "tag": "f46992f4-e8f9-4563-b623-70ff8828e9be"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:32.507288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0eaf0ba1-b909-493f-87a5-e0e468de3a4a req-0e004af0-f810-427a-a10e-2df48af2f4f4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.507776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0eaf0ba1-b909-493f-87a5-e0e468de3a4a req-0e004af0-f810-427a-a10e-2df48af2f4f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.508209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0eaf0ba1-b909-493f-87a5-e0e468de3a4a req-0e004af0-f810-427a-a10e-2df48af2f4f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.540764 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0eaf0ba1-b909-493f-87a5-e0e468de3a4a req-0e004af0-f810-427a-a10e-2df48af2f4f4 service nova] Creating event network-vif-unplugged:f46992f4-e8f9-4563-b623-70ff8828e9be for instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 on n-h2-master-1 Sep 25 01:19:32.546441 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0eaf0ba1-b909-493f-87a5-e0e468de3a4a req-0e004af0-f810-427a-a10e-2df48af2f4f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096268 Sep 25 01:19:32.547790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1855/3708] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:32.553996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:32.554984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:32.562065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.562844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.563520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:32.564447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:32.565132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:32.565805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.002657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.014239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3df667e6-606f-435b-915f-d5b0ce05e43d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.601767 Sep 25 01:19:33.014820 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1854/3709] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:32 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:33.038566 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:33.039580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.042399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:33.048880 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d33d04a-c37f-43e7-8ab5-e0bea6b5aee6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.499647 Sep 25 01:19:33.051979 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1856/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:32 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:33.065998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.066664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.067129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.068740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.069305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.069693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.091208 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131/action HTTP/1.1 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 28 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: {"reboot": {"type": "SOFT"}} Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '746b7b50-ec4b-480c-8f57-2a2daba9a131', 'body': {'reboot': {'type': 'SOFT'}}} Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:33.093101 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:33.096467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5bbe2540-80da-40d1-8bc8-80e0be3ff278 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131/action" status: 404 len: 111 microversion: 2.1 time: 0.061556 Sep 25 01:19:33.097237 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1855/3711] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:33 2022] POST /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:19:33.105767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:33.106945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:33.114128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.114868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.115680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.116711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.117654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.118362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.451472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-99170deb-4fc5-47c6-9842-a868c98e1a7e req-8c3ee7dd-3568-418f-a4ce-3568fbe5cf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24dfaf3-4058-4dac-80f3-b8dcba17f336", "name": "network-vif-deleted", "tag": "f46992f4-e8f9-4563-b623-70ff8828e9be"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:33.462724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99170deb-4fc5-47c6-9842-a868c98e1a7e req-8c3ee7dd-3568-418f-a4ce-3568fbe5cf0d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.463432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99170deb-4fc5-47c6-9842-a868c98e1a7e req-8c3ee7dd-3568-418f-a4ce-3568fbe5cf0d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.464019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99170deb-4fc5-47c6-9842-a868c98e1a7e req-8c3ee7dd-3568-418f-a4ce-3568fbe5cf0d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.474253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.484336 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-99170deb-4fc5-47c6-9842-a868c98e1a7e req-8c3ee7dd-3568-418f-a4ce-3568fbe5cf0d service nova] Creating event network-vif-deleted:f46992f4-e8f9-4563-b623-70ff8828e9be for instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 on n-h2-master-1 Sep 25 01:19:33.486934 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d26c59c7-e8ad-43b5-b8c7-9da1748949b9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.385361 Sep 25 01:19:33.488236 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1857/3712] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:33 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:33.494147 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-99170deb-4fc5-47c6-9842-a868c98e1a7e req-8c3ee7dd-3568-418f-a4ce-3568fbe5cf0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046278 Sep 25 01:19:33.495045 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1856/3713] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:33.500089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:33.500797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:33.501827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:33.505658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:33.513281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.515002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.515623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.516492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.517149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.517879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.518164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.518886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.521915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.524924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.525576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.526085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.654097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.663693 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af7a70e2-0a4d-464a-9a1b-6b9922dfafeb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1260 microversion: 2.1 time: 0.167264 Sep 25 01:19:33.670540 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1857/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:33 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:33.682104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:33.683147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:33.696742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.700106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.700563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.708848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:33.709885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:33.710388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:33.720073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.731278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.733870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:33.743417 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b4d298d-8d5f-43d0-b3ba-82f8ad662398 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.246672 Sep 25 01:19:33.744601 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1858/3715] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:33 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:34.075493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.076971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.092274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.095287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.095970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.098453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.099738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.100599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.329941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:34.352462 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d2b92c7e-b817-4851-b6a7-0a66b0328f87 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.678422 Sep 25 01:19:34.353612 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1858/3716] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:33 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:34.391383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3b96480-aacb-4db3-932f-22f200575262 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:34.394585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c3b96480-aacb-4db3-932f-22f200575262 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 0debb146-dcd1-4a7b-a2f6-b65be5a52f22] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.411129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c3b96480-aacb-4db3-932f-22f200575262 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 0debb146-dcd1-4a7b-a2f6-b65be5a52f22 could not be found. Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3b96480-aacb-4db3-932f-22f200575262 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/0debb146-dcd1-4a7b-a2f6-b65be5a52f22/action HTTP/1.1 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 28 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: {"reboot": {"type": "SOFT"}} Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0debb146-dcd1-4a7b-a2f6-b65be5a52f22 could not be found. Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0debb146-dcd1-4a7b-a2f6-b65be5a52f22', 'body': {'reboot': {'type': 'SOFT'}}} Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0debb146-dcd1-4a7b-a2f6-b65be5a52f22 could not be found. Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0debb146-dcd1-4a7b-a2f6-b65be5a52f22 could not be found. Sep 25 01:19:34.413841 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0debb146-dcd1-4a7b-a2f6-b65be5a52f22 could not be found. Sep 25 01:19:34.416990 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.419049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3b96480-aacb-4db3-932f-22f200575262 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 0debb146-dcd1-4a7b-a2f6-b65be5a52f22 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:34.420099 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c3b96480-aacb-4db3-932f-22f200575262 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/0debb146-dcd1-4a7b-a2f6-b65be5a52f22/action" status: 404 len: 111 microversion: 2.1 time: 0.045114 Sep 25 01:19:34.424100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1859/3717] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:34 2022] POST /compute/v2.1/servers/0debb146-dcd1-4a7b-a2f6-b65be5a52f22/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:34.429720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.430553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.452155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.454298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.459633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.460827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.461553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.462160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.506803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:34.514672 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1d2f2a1-36d8-48c5-a54d-4a72d347daf6 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.445719 Sep 25 01:19:34.530691 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1859/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:34 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:34.624005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.624519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.631997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.632531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.633087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.633855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.634371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.634807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.665990 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 HTTP/1.1 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7980033e-52a8-4fa2-b2d8-05bea9732bf3'} Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:34.670226 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:34.673284 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b87851c8-2e96-4c2b-9843-7d7eb92b08e3 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 404 len: 111 microversion: 2.1 time: 0.052889 Sep 25 01:19:34.676059 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1860/3719] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:34 2022] DELETE /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:19:34.684128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.684866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 7980033e-52a8-4fa2-b2d8-05bea9732bf3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.692772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.694211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.694928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.695856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.696511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.697134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.712530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 HTTP/1.1 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7980033e-52a8-4fa2-b2d8-05bea9732bf3'} Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.714441 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. Sep 25 01:19:34.717579 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.719573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance 7980033e-52a8-4fa2-b2d8-05bea9732bf3 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:34.720637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a44662a-ef92-4a51-867c-0a1a67877514 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3" status: 404 len: 111 microversion: 2.1 time: 0.040390 Sep 25 01:19:34.726677 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1861/3720] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:34 2022] GET /compute/v2.1/servers/7980033e-52a8-4fa2-b2d8-05bea9732bf3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:19:34.734761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.737163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.746926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.747979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.748969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.749942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.750627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.752379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.782558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:34.794489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c336ce5-9ff0-4db1-aab3-999de2c72bd5 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.368960 Sep 25 01:19:34.795120 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1860/3721] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:34 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:34.826112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.842275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.849665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.850424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.851041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.851928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.852586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.853192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.890463 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 HTTP/1.1 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e709904a-78e9-4d39-ad67-c7e9ffca9762'} Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:34.895221 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:34.898572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:34.899425 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c72235b0-8828-420d-a212-429b9a832679 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 404 len: 111 microversion: 2.1 time: 0.074974 Sep 25 01:19:34.900019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1861/3722] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:34 2022] DELETE /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:34.908077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:34.908878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:34.916490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.917197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.917849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.918695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:34.919292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:34.919861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:34.989959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:35.007236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1847acea-fce9-4bc7-848e-90a410aa127d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1266 microversion: 2.1 time: 0.278687 Sep 25 01:19:35.021796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1862/3723] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:34 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:35.025939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:35.026497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:35.034215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.035977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.036704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.038669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.040984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.041555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.072188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:35.087849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:35.091522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:35.108534 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-89b9ce56-3b52-4913-9a97-11a2072963cf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.204275 Sep 25 01:19:35.109895 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1862/3724] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:34 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:35.123311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:35.127930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: e709904a-78e9-4d39-ad67-c7e9ffca9762] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:35.139034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.139963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.140580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.141607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.142257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.142877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.169520 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 HTTP/1.1 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e709904a-78e9-4d39-ad67-c7e9ffca9762'} Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:35.171258 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance e709904a-78e9-4d39-ad67-c7e9ffca9762 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:35.174460 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d2fb9ad-0dc4-4049-8f19-ebfda0390fdd tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762" status: 404 len: 111 microversion: 2.1 time: 0.061616 Sep 25 01:19:35.176986 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1863/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:35 2022] GET /compute/v2.1/servers/e709904a-78e9-4d39-ad67-c7e9ffca9762 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:35.482151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:35.505318 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ba55443-0118-43d9-80bd-e0070372cec0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.496302 Sep 25 01:19:35.510622 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1863/3726] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:35 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:35.537192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:35.539942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:35.541116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:35.547765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:35.556934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.557562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.557878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.558573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.559022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.559440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.561026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.561615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.561975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.562677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.563129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.563550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.617346 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131/action HTTP/1.1 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 65 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '746b7b50-ec4b-480c-8f57-2a2daba9a131', 'body': {'rebuild': {'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05'}}} Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 25 01:19:35.619678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:19:35.623422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:35.625508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:35.626690 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7feeb7ab-11d1-4dc7-8786-a421eb5f3275 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131/action" status: 404 len: 111 microversion: 2.1 time: 0.093873 Sep 25 01:19:35.627901 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1864/3727] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:35 2022] POST /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:35.639159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:35.642759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:35.652447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.653226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.653830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:35.654701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:35.655305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:35.656029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.342708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:36.351505 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01e12917-a98b-4bbb-b651-a318a9c9d44c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.814070 Sep 25 01:19:36.374243 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1864/3728] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:35 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:36.386941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:36.387567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:36.406410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:36.406912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:36.407354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.419193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:36.420010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:36.422114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.556090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:36.577335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88a9f5a4-5fbb-48d6-8cda-ae656bdb3488 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.934050 Sep 25 01:19:36.578760 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1865/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:35 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:36.604137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:36.604844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:36.623835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:36.624356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:36.626464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.629982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:36.630759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:36.631211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.650859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:36.662450 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5ce80d3-3bee-4447-bd0b-edf4f6507b89 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.286859 Sep 25 01:19:36.680811 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1865/3730] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:36 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:36.685743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:36.686576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:36.693636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:36.694621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:36.695263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.696150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:36.696795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:36.697396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:36.799298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:36.810459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:36.811926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:36.818429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-baf12670-911a-4482-ab45-d63e284eb692 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.238149 Sep 25 01:19:36.834503 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1866/3731] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:36 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:37.110420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:37.118909 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf613afc-c4af-4f3c-adf5-89ac2fe36cb3 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.436921 Sep 25 01:19:37.119499 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1866/3732] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:36 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:37.151151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93d74a4a-d010-4b6c-829a-248b7d6f8bf6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:37.161017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93d74a4a-d010-4b6c-829a-248b7d6f8bf6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: f6c4765f-f06f-42c6-8432-a8916b44864c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:37.176786 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-93d74a4a-d010-4b6c-829a-248b7d6f8bf6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance f6c4765f-f06f-42c6-8432-a8916b44864c could not be found. Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93d74a4a-d010-4b6c-829a-248b7d6f8bf6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/f6c4765f-f06f-42c6-8432-a8916b44864c/action HTTP/1.1 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 65 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f6c4765f-f06f-42c6-8432-a8916b44864c could not be found. Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f6c4765f-f06f-42c6-8432-a8916b44864c', 'body': {'rebuild': {'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05'}}} Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c4765f-f06f-42c6-8432-a8916b44864c could not be found. Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 25 01:19:37.181515 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c4765f-f06f-42c6-8432-a8916b44864c could not be found. Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c4765f-f06f-42c6-8432-a8916b44864c could not be found. Sep 25 01:19:37.184830 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:37.189848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93d74a4a-d010-4b6c-829a-248b7d6f8bf6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance f6c4765f-f06f-42c6-8432-a8916b44864c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:37.191436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93d74a4a-d010-4b6c-829a-248b7d6f8bf6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/f6c4765f-f06f-42c6-8432-a8916b44864c/action" status: 404 len: 111 microversion: 2.1 time: 0.051030 Sep 25 01:19:37.193524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1867/3733] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:37 2022] POST /compute/v2.1/servers/f6c4765f-f06f-42c6-8432-a8916b44864c/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:37.202241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:37.202935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:37.212643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.213299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.214388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.215139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.215578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.216168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.385130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:37.385823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:37.395903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.396669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.397310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.398288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.398982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.399602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.590264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:37.599006 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-522426b0-32af-4280-b54b-71f8f8f7e612 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.400987 Sep 25 01:19:37.599594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1867/3734] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:37 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:37.630170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:37.631124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:37.645967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.646822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.647474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.648223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.648688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.649121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.912432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:37.926413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b39ceb33-225b-4d04-a4d3-dca9b9b0d035 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.543064 Sep 25 01:19:37.930382 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1868/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:37 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:37.937191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:37.937358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:37.942852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:37.953785 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11bb0111-cb8b-493c-8df8-29c21754cdea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.328815 Sep 25 01:19:37.954418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1868/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:37 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:37.968908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.969369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:37.969779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.970334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.970602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:37.977176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.980153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.980650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.981087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.981351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.982127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:37.983073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:37.984601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:37.987793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.108547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:38.121658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:38.124077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:38.133330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01cb3bcc-239c-4a14-aeff-acad901fa7f1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.177835 Sep 25 01:19:38.147946 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1869/3737] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:37 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:38.158031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e531e5d-c921-4001-8840-1996a639642c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:38.161553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e531e5d-c921-4001-8840-1996a639642c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: bd32c1c5-d661-4ab9-984e-03ac65d94770] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:38.167417 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1e531e5d-c921-4001-8840-1996a639642c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance bd32c1c5-d661-4ab9-984e-03ac65d94770 could not be found. Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e531e5d-c921-4001-8840-1996a639642c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/bd32c1c5-d661-4ab9-984e-03ac65d94770/action HTTP/1.1 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 15 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: {"restore": {}} Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: exception: Instance bd32c1c5-d661-4ab9-984e-03ac65d94770 could not be found. Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'bd32c1c5-d661-4ab9-984e-03ac65d94770', 'body': {'restore': {}}} Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd32c1c5-d661-4ab9-984e-03ac65d94770 could not be found. Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd32c1c5-d661-4ab9-984e-03ac65d94770 could not be found. Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:38.169666 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd32c1c5-d661-4ab9-984e-03ac65d94770 could not be found. Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e531e5d-c921-4001-8840-1996a639642c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance bd32c1c5-d661-4ab9-984e-03ac65d94770 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e531e5d-c921-4001-8840-1996a639642c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/bd32c1c5-d661-4ab9-984e-03ac65d94770/action" status: 404 len: 111 microversion: 2.1 time: 0.022063 Sep 25 01:19:38.173474 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1870/3738] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:38 2022] POST /compute/v2.1/servers/bd32c1c5-d661-4ab9-984e-03ac65d94770/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:38.181847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:38.182605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:38.193731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.195376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.196126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.197122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.198739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.199409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.295503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:38.306706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab837e97-343b-412e-950e-1c74f52881f8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.374597 Sep 25 01:19:38.308060 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1869/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:37 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:38.318593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a0eaf641-150b-4421-a5a4-c11d3265ad8c req-fc421951-0fff-4fd6-a9ac-7f457bd6dc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5d9c61-86cd-4bc9-8c63-c204a635ff78", "tag": "54a9a9ac-b974-4b43-b8e9-3025aa05f933"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:38.331596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a0eaf641-150b-4421-a5a4-c11d3265ad8c req-fc421951-0fff-4fd6-a9ac-7f457bd6dc8a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.332709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a0eaf641-150b-4421-a5a4-c11d3265ad8c req-fc421951-0fff-4fd6-a9ac-7f457bd6dc8a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.336172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a0eaf641-150b-4421-a5a4-c11d3265ad8c req-fc421951-0fff-4fd6-a9ac-7f457bd6dc8a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.604690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:38.619008 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9740cc9c-52d3-4cd4-a10a-9ec8c5e93a7d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.440228 Sep 25 01:19:38.620252 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1871/3740] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:38 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:38.646428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:38.647055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:38.670125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.671136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.671745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.678600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.679868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.681335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.892367 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a0eaf641-150b-4421-a5a4-c11d3265ad8c req-fc421951-0fff-4fd6-a9ac-7f457bd6dc8a service nova] Creating event network-changed:54a9a9ac-b974-4b43-b8e9-3025aa05f933 for instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 on n-h2-master-1 Sep 25 01:19:38.903604 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a0eaf641-150b-4421-a5a4-c11d3265ad8c req-fc421951-0fff-4fd6-a9ac-7f457bd6dc8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.593995 Sep 25 01:19:38.904227 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1870/3741] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:38.960851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:38.961652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:38.985234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.985646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:38.987917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.987917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:38.989787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:38.990274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:38.996957 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6ed7e3f-87e3-4276-b90f-41dbdbf26c21 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.355054 Sep 25 01:19:38.997716 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1872/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:38 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:38.997872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.024832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:39.025368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:39.037981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.038476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.038924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.039616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.040066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.040489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.044586 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:39.111899 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'restore' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 15 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: {"restore": {}} Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'restore' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'restore': {}}} Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state active. Cannot restore while the instance is in this state. Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:39.134353 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:39.138678 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:39.138678 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:39.138678 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:39.138678 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:39.138678 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:39.140094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'restore' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:39.142782 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9efab8c-5aaa-4b1f-825b-096fba611f5a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 145 microversion: 2.1 time: 0.121997 Sep 25 01:19:39.143558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1873/3743] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:39 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 145 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:19:39.155359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:39.166336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:39.180303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.182049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.182659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.194489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.195191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.195801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.474216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:39.484294 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2204d9c9-d70f-4a5e-8707-f2c4825fee67 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.537413 Sep 25 01:19:39.500637 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1871/3744] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:38 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:39.511210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:39.511818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:39.526192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.526696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.527142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.527861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.528322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.528760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.559256 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:39.602687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:39.623597 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f130f2a8-439c-4f75-8da6-036c8b5f3241 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.471812 Sep 25 01:19:39.624315 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1874/3745] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:39 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:39.629574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:39.630376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:39.633880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:39.645244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.647066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.649615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:39.652101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:39.652228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.652995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.653506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.653955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.660040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2cac3eae-d729-4ed2-918a-5af2a683899a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.169844 Sep 25 01:19:39.661072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1872/3746] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:39 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:39.667095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:39.667992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:39.681536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.682482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.683138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:39.685144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:39.685881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:39.686789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.012550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:40.022255 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92e11e20-7dec-4140-a523-3c7827c148cb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.359908 Sep 25 01:19:40.047488 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1873/3747] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:39 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:40.063101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:40.064339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.070613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.071113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.071559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.072992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.073477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.073912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.086180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:40.089947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd HTTP/1.1 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '77babc4e-c612-45ee-8bd0-f477b4329ccd'} Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:40.092028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-853e6cb6-27bf-4d04-8183-3a5e033ef241 tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 404 len: 111 microversion: 2.1 time: 0.046280 Sep 25 01:19:40.095329 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1874/3748] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:40 2022] DELETE /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:40.101100 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d42d91ca-ac5d-405a-ac4e-f971e5e026f4 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.475855 Sep 25 01:19:40.105847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2cfca5f6-a1cd-44d9-a2f1-236067cdeaaf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:40.106648 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1875/3749] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:39 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:40.108735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2cfca5f6-a1cd-44d9-a2f1-236067cdeaaf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: e72d91f9-7a5a-4ea8-92ac-693f8db5223c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.116039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:40.119734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] [instance: 77babc4e-c612-45ee-8bd0-f477b4329ccd] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.123941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2cfca5f6-a1cd-44d9-a2f1-236067cdeaaf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance e72d91f9-7a5a-4ea8-92ac-693f8db5223c could not be found. Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2cfca5f6-a1cd-44d9-a2f1-236067cdeaaf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/e72d91f9-7a5a-4ea8-92ac-693f8db5223c/action HTTP/1.1 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 14 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: {"resume": {}} Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e72d91f9-7a5a-4ea8-92ac-693f8db5223c could not be found. Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e72d91f9-7a5a-4ea8-92ac-693f8db5223c', 'body': {'resume': {}}} Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72d91f9-7a5a-4ea8-92ac-693f8db5223c could not be found. Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72d91f9-7a5a-4ea8-92ac-693f8db5223c could not be found. Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:40.133037 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:40.136729 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:40.136729 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:40.136729 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72d91f9-7a5a-4ea8-92ac-693f8db5223c could not be found. Sep 25 01:19:40.136729 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.136968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.136968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.137108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.138909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.139383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2cfca5f6-a1cd-44d9-a2f1-236067cdeaaf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance e72d91f9-7a5a-4ea8-92ac-693f8db5223c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:40.140095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.140687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2cfca5f6-a1cd-44d9-a2f1-236067cdeaaf tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/e72d91f9-7a5a-4ea8-92ac-693f8db5223c/action" status: 404 len: 111 microversion: 2.1 time: 0.044421 Sep 25 01:19:40.141452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.141714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1875/3750] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:40 2022] POST /compute/v2.1/servers/e72d91f9-7a5a-4ea8-92ac-693f8db5223c/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:40.151404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:40.153026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.165099 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] HTTP exception thrown: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Request method failure captured: Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd HTTP/1.1 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6qLfaM0yZtXe5P_Dmdzqsg5dC0zcsGvibEd2Lxev3KRpc4bqPxIsXlWwxDtjFZKrJRO245nrpT29Gub7ASZA6Di49HhfWQHMHGbs0RcidK6F5xVsMD49BFgigb14K6_ao5fmmnAaoPXMbzn7SbcajGyzrDqL-1vCYCPubMRN8tlxqg Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/82fcf2dd9b2c41f5a87eda0402682069"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_82fcf2dd9b2c41f5a87eda0402682069"}]}] Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 82fcf2dd9b2c41f5a87eda0402682069 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948366837 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: bb85bd8db516469abb729c1fdc0a1ba1 Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeNegativeTest-948366837-project Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '77babc4e-c612-45ee-8bd0-f477b4329ccd'} Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:40.166726 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. Sep 25 01:19:40.170293 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:40.170634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.170634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.170775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.172167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.172167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.172490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.173280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] Returning 404 to user: Instance 77babc4e-c612-45ee-8bd0-f477b4329ccd could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:40.174165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6d59767-fad0-4a9b-8cd0-7bcf530031fc tempest-AttachVolumeNegativeTest-948366837 tempest-AttachVolumeNegativeTest-948366837-project] 10.222.0.16 "GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd" status: 404 len: 111 microversion: 2.1 time: 0.066227 Sep 25 01:19:40.174747 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1876/3751] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:40 2022] GET /compute/v2.1/servers/77babc4e-c612-45ee-8bd0-f477b4329ccd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:40.382730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:40.403353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9dabb81f-3930-4946-ac9f-1b66d4f0cccb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.256897 Sep 25 01:19:40.404618 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1876/3752] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:40 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:40.430048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:40.430670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.438638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.439124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.439758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.440492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.441704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.442262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.509771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:40.510250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.517870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.518366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.519750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.520652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:40.521582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:40.522151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:40.916594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:40.930690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a95cfd8-c139-4bb3-acd2-f2d85b63bb03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.504625 Sep 25 01:19:40.930915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:40.932294 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1877/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:40 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:40.948347 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fada481b-7494-4642-a463-b0ab5fffe9cd tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.442834 Sep 25 01:19:40.952696 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1877/3754] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:40 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:40.967908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:40.977965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:40.987979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:40.992748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:41.000797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.005707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.006316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.009465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.010723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.014052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.014682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.020179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.023725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.024634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.028461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.029047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.076648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'resume' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 14 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: {"resume": {}} Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'resume' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'resume': {}}} Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state active. Cannot resume while the instance is in this state. Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:41.091835 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:41.096479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'resume' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:41.098361 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae0fda27-a30d-4042-871a-4bace691505a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 144 microversion: 2.1 time: 0.132014 Sep 25 01:19:41.102651 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1878/3755] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:40 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 144 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:19:41.107750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:41.111230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:41.128960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.129606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.136735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.137704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.138302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.138870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.264020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:41.277272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:41.279187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:41.285822 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36850f0f-cf4f-40cb-812a-8ac5bb972ac8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.351974 Sep 25 01:19:41.286719 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1878/3756] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:40 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:41.291808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:41.293512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:41.302611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.303472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.304286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.305294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.306543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.307736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.599907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:41.609612 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-315a55cb-e421-4818-8d0e-67949b260268 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.505890 Sep 25 01:19:41.637660 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1879/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:41 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:41.646298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:41.647010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:41.654998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.655603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.656671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.657815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.658987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.660050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.704085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:41.712332 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4942061f-4910-40e9-8cd5-7992bc47a663 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.424229 Sep 25 01:19:41.712923 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1879/3758] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:41 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:41.984103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:41.984718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:41.997230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.997840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.998286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:41.999019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:41.999476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:41.999905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:42.098298 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:42.127543 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:42.133671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:42.142574 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07ed13ce-4fc7-4870-928d-f84f5ca23a88 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.503472 Sep 25 01:19:42.143152 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1880/3759] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:41 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:42.321447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:42.322019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:42.334940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:42.335449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:42.335898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:42.336621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:42.337078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:42.337564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:42.401227 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:42.484113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:42.496017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08aa1a92-4aeb-4b22-8eb2-5f96ebe5118e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.515821 Sep 25 01:19:42.498666 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1880/3760] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:41 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:42.509686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19c52d68-a8f3-4294-802c-5a25d3d39573 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19c52d68-a8f3-4294-802c-5a25d3d39573 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 160 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2309cf64-61cd-4755-9e43-04778a22257e"}]}} Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'networks': [{'uuid': '2309cf64-61cd-4755-9e43-04778a22257e'}]}}} Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '' Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:19:42.519608 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:19:42.524157 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:19:42.526361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19c52d68-a8f3-4294-802c-5a25d3d39573 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:42.527414 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19c52d68-a8f3-4294-802c-5a25d3d39573 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027616 Sep 25 01:19:42.530930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:42.541110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:42.542169 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1881/3761] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:19:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:19:42.544072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:42.555365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:42.557005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:42.585374 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a5ae7ff-fbed-4957-adde-dd2da133185d tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.270684 Sep 25 01:19:42.591264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1881/3762] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:42 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:42.597827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:42.604881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:42.606374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:42.607807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:42.609392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:42.610539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:42.735783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:42.737081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:42.750319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:42.751053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:42.751675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:42.752558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:42.754498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:42.755098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.273987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.282857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6899dedf-026d-4976-b863-637a7eb8e591 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.735836 Sep 25 01:19:43.286247 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1882/3763] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:42 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:43.313773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:43.315245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:43.324682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.325353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.326077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.327885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.328491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.329063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.339731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.356817 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85598eba-49de-44bf-a995-1cf110277448 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.624895 Sep 25 01:19:43.358392 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1882/3764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:42 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:43.523074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:43.523948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:43.530906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.531538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.532157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.533139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.533937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.535182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.727061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.735672 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92f06035-fa3c-464c-ad1d-e38a088089fb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.429800 Sep 25 01:19:43.736431 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1883/3765] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:43 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:43.744527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:43.745289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:43.751498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.752234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.752888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.754629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.755322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.755816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.889356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.905438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.920532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.922542 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41827d8f-107c-4cb3-b784-1a15570c3f47 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.403268 Sep 25 01:19:43.927412 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1883/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:43 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:43.932308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:43.941507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8600947-c269-4b6e-b9a0-88a6c282b902 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:43.946534 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d3344a4-432d-45c0-a7f8-8491d3695004 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.207291 Sep 25 01:19:43.947332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1884/3767] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:43 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:43.947552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c8600947-c269-4b6e-b9a0-88a6c282b902 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 23973273-1824-4bb4-ba62-20bfa9c7e7c2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:43.955721 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c8600947-c269-4b6e-b9a0-88a6c282b902 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 23973273-1824-4bb4-ba62-20bfa9c7e7c2 could not be found. Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8600947-c269-4b6e-b9a0-88a6c282b902 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/23973273-1824-4bb4-ba62-20bfa9c7e7c2/action HTTP/1.1 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 14 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: {"shelve": {}} Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 23973273-1824-4bb4-ba62-20bfa9c7e7c2 could not be found. Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '23973273-1824-4bb4-ba62-20bfa9c7e7c2', 'body': {'shelve': {}}} Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23973273-1824-4bb4-ba62-20bfa9c7e7c2 could not be found. Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23973273-1824-4bb4-ba62-20bfa9c7e7c2 could not be found. Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:43.961617 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:43.965715 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:43.965715 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:43.965715 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23973273-1824-4bb4-ba62-20bfa9c7e7c2 could not be found. Sep 25 01:19:43.965715 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:43.967033 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8600947-c269-4b6e-b9a0-88a6c282b902 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 23973273-1824-4bb4-ba62-20bfa9c7e7c2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:43.968127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8600947-c269-4b6e-b9a0-88a6c282b902 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/23973273-1824-4bb4-ba62-20bfa9c7e7c2/action" status: 404 len: 111 microversion: 2.1 time: 0.035108 Sep 25 01:19:43.969379 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1884/3768] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:43 2022] POST /compute/v2.1/servers/23973273-1824-4bb4-ba62-20bfa9c7e7c2/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:43.978298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:43.979201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:43.985974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.986958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.987699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:43.988581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:43.989272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:43.990016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.384280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:44.385509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:44.388580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:44.404198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df99ffeb-2691-4ff5-b544-61663b9971b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.430228 Sep 25 01:19:44.406236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.407714 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1885/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:43 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:44.408469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.409059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.410771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.411532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.412118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.435498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:44.436464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:44.455776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.457050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.459503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.462226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.463328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.465803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.905236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:44.913961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:44.914927 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd63ea94-4e88-40b4-b60a-a5d5f82856af tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.484582 Sep 25 01:19:44.915951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1886/3770] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:44 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:44.921234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-73c8a01b-b116-4e41-a579-6210a4be4964 req-dbcd23bf-8f2b-4ef4-8159-735acb47c979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5d9c61-86cd-4bc9-8c63-c204a635ff78", "name": "network-vif-plugged", "status": "completed", "tag": "54a9a9ac-b974-4b43-b8e9-3025aa05f933"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:44.923990 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e48b0a6-aa79-4911-9ac1-f9b3c7a2feae tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.543804 Sep 25 01:19:44.924564 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1885/3771] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:44 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:44.932953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-73c8a01b-b116-4e41-a579-6210a4be4964 req-dbcd23bf-8f2b-4ef4-8159-735acb47c979 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.933679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-73c8a01b-b116-4e41-a579-6210a4be4964 req-dbcd23bf-8f2b-4ef4-8159-735acb47c979 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.934266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-73c8a01b-b116-4e41-a579-6210a4be4964 req-dbcd23bf-8f2b-4ef4-8159-735acb47c979 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.941884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:44.942666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:44.950009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.950691 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-73c8a01b-b116-4e41-a579-6210a4be4964 req-dbcd23bf-8f2b-4ef4-8159-735acb47c979 service nova] Creating event network-vif-plugged:54a9a9ac-b974-4b43-b8e9-3025aa05f933 for instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 on n-h2-master-1 Sep 25 01:19:44.951440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.952093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.953122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.954483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.955179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.956745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-73c8a01b-b116-4e41-a579-6210a4be4964 req-dbcd23bf-8f2b-4ef4-8159-735acb47c979 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Sep 25 01:19:44.958115 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1887/3772] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:44.964311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:44.965031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:44.973730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.974232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.974677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.975390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:44.975843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:44.976991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:44.987378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lazy-loading 'flavor' on Instance uuid 1fb6535d-78e0-404a-8bf1-9a61d23b7710 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:45.249439 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b16b7d1c-03de-486e-b886-926a0f377a46 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 202 len: 0 microversion: 2.1 time: 0.315101 Sep 25 01:19:45.250545 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1886/3773] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:44 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:19:45.257186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:45.271845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:45.283934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.284465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.285375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.287078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.287543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.287970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.382009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:45.396676 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e05bbc9b-a5ea-4e66-a79e-f91740a471d3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.437336 Sep 25 01:19:45.418302 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1888/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:44 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:45.432555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:45.432555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:45.438933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:45.439468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.439587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.440015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.441442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.442044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.442627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.456091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:45.459382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:45.467869 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2d2faea-40d3-44ad-ad25-81ab1243bd14 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.215534 Sep 25 01:19:45.469509 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1887/3775] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:45 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:45.722898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:45.738859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:45.739730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:45.745839 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b98237bd-5aec-4b54-a167-4e0630b4aafc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.326286 Sep 25 01:19:45.750394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.753763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.754343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.755179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.756973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.757542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.762103 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1889/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:45 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:45.954900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:45.955610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:45.974455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.975082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.975532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:45.976262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:45.976723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:45.977150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.407705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:46.428185 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cebd2a84-f16d-45fe-b381-836972cbddf8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.694305 Sep 25 01:19:46.429975 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1888/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:45 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:46.444893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:46.450292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:46.475520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.476846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.478358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.479426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.480116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.480924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.506585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:46.526853 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9da86c7c-a697-4181-8229-6ddaf622a742 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1308 microversion: 2.1 time: 0.575679 Sep 25 01:19:46.527664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1890/3778] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:45 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:46.532739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:46.533603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:46.550436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.550940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.551385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.552103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.552560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.552993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.816649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:46.828728 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01867614-abd7-48aa-9d18-7b0899351038 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.395951 Sep 25 01:19:46.830357 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1889/3779] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:46 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:46.839837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:46.840775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:46.852621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.855413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.856234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.857139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.858407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.858860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.869006 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:46.891394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:46.904532 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ed750190-56d6-4ba5-834d-47f2d08aa4d0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.375422 Sep 25 01:19:46.909813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1891/3780] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:46 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:46.928801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:46.933744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:46.966298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.970468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.972159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:46.975697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:46.982876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:46.986855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.028235 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:47.047194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:47.063419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:47.072937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:47.088746 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-164f1526-ce8e-479b-9d79-79ab559950c9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.256255 Sep 25 01:19:47.098423 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1890/3781] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:46 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:47.141287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:47.142815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:47.148660 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:47.153475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.154394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.154841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.156254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.157016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.158308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.325004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:47.336877 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7bcf31f7-47f6-4894-ac84-a9acff7dc088 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.424905 Sep 25 01:19:47.337568 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1892/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:46 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:47.549238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:47.551860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:47.552404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:47.561790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3535c3b5-e714-4f5b-86b0-1097bd876dea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.470671 Sep 25 01:19:47.562869 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1891/3783] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:47 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:47.578727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.583732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.584494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.585500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.588593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2124818460"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:47.589434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.590112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.591717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:47.610411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.610918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.611531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.613975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.615860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.616471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.916099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:47.925076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae73c779-cf7d-4211-9a1c-d0d50be12b9a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.340224 Sep 25 01:19:47.925969 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1892/3784] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:47 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 25 01:19:47.929197 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ce1e5f9-e23f-41db-aba7-0bc84f287633 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1488 microversion: 2.1 time: 0.381623 Sep 25 01:19:47.929197 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1893/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:47 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1488 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:47.944867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:47.953975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:47.956889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:47.957717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:47.971246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.973243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.974596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.977524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.978023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.978173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.978582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.978676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.983438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:47.984370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:47.985497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:47.986086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.013697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lazy-loading 'flavor' on Instance uuid 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:19:48.098014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e326030-833f-4f21-9f4f-1935b291a372 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78/action" status: 202 len: 0 microversion: 2.1 time: 0.144849 Sep 25 01:19:48.099114 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1893/3786] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:47 2022] POST /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:48.113059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:48.113934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:48.122554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:48.123052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:48.123498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.124207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:48.124667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:48.125251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.240319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:48.253967 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9fcb7cc9-3673-40fd-a9eb-028cdb5d2620 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.316150 Sep 25 01:19:48.255739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1894/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:47 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:48.261143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:48.261810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:48.274516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:48.275481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:48.276175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.277714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:48.278300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:48.278744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.375363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:48.396962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:48.400016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:48.407575 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0377924e-98ae-428a-8b9c-4ae77829b697 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.150623 Sep 25 01:19:48.408736 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1895/3788] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:48 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:48.415317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:48.416724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:48.418519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:48.427729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-225c733e-5bdf-4885-9034-d86ebe993143 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1496 microversion: 2.1 time: 0.323301 Sep 25 01:19:48.428326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:48.428975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:48.429602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.430291 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1894/3789] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:48 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1496 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:48.430909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:48.431521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:48.432122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:48.754980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:48.763290 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff07b978-e924-46f9-b00d-1a3c0dbb197c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.352406 Sep 25 01:19:48.777986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1896/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:48 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:49.281021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:49.281671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:49.289904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.290398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.290849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.291676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.292014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.292446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.452572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:49.454177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:49.457499 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:49.463075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.463705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.464251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.465147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.465850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.466394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.559104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:49.564614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:49.568967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:49.570474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:49.573656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-105c19e3-84f2-453f-9744-bbe81d39c820 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.296466 Sep 25 01:19:49.574241 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1895/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:49 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:49.575763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-508a6b05-428c-41f9-98b0-cb014b615dee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.127479 Sep 25 01:19:49.576606 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1897/3792] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:49 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:49.590372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:49.591335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:49.607884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.608765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.609435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.610803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.611633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.612925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.740536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2f080697-a003-4719-bdbb-208cacb2970d tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Action: 'create', calling method: .version_select at 0x7f7beaa53dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1936244958"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:49.848064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:49.857778 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a4fdbd88-6a0c-4ce4-a0fd-ea43c6ed6be5 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 200 len: 1479 microversion: 2.1 time: 0.282104 Sep 25 01:19:49.864132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1896/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:49 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 1479 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:49.873304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:49.874124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:49.883339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.883856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.884305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:49.885024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:49.885677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:49.886303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.107371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2f080697-a003-4719-bdbb-208cacb2970d tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.529707 Sep 25 01:19:50.108593 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1898/3794] 10.222.0.16 () {60 vars in 1155 bytes} [Sun Sep 25 01:19:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 531 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 25 01:19:50.116714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-923456102"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:50.119767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:50.130306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:50.131316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:50.131917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.133208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:50.133940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:50.134520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.223853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:50.232509 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31f72244-a686-406a-b20f-bf96ae659ab6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.367065 Sep 25 01:19:50.233077 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1897/3795] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:49 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:50.249773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7706a56-6625-4bcd-b207-338ff158e314 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7bf409a1f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:50.307608 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7706a56-6625-4bcd-b207-338ff158e314 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 200 len: 345 microversion: 2.1 time: 0.073067 Sep 25 01:19:50.308530 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1898/3796] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:19:50 2022] GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:50.423860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-907ab178-d874-4748-ae90-28418a173d70 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78/action" status: 202 len: 0 microversion: 2.1 time: 0.313709 Sep 25 01:19:50.436800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bae131eb-8ce3-4f17-9fee-0ffb84f1342f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf40c3d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:50.441390 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1899/3797] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:19:50 2022] POST /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:19:50.513544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bae131eb-8ce3-4f17-9fee-0ffb84f1342f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.081576 Sep 25 01:19:50.514145 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1899/3798] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:50 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:50.597755 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:50.599312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:50.606064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:50.606867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:50.607367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:50.607711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.608129 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:50.608830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:50.609529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:50.610217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.624346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:50.627231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:50.628668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.633188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:50.641557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:50.647275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:50.784079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:50.796509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:50.798339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:50.807006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb6123c7-9d2c-417f-a9a6-3ee39e12ae62 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.206239 Sep 25 01:19:50.808131 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1900/3799] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:50 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:50.910548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:50.921337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5eb0e91-769b-4914-9ce2-009215344b2a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.328718 Sep 25 01:19:50.922005 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1900/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:50 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:51.260152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.261577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:51.273572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:51.274542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:51.275446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:51.283417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:51.283417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:51.283417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:51.324346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3a9ab00-a8b6-4d1e-a130-a183ab193eda tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaa6caf0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.397394 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3a9ab00-a8b6-4d1e-a130-a183ab193eda tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 200 len: 346 microversion: 2.1 time: 0.078994 Sep 25 01:19:51.398008 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1901/3801] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:51.418522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6960abdd-c292-40e5-b055-f1acb21972fb tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Action: 'create', calling method: .version_select at 0x7f7beaa6c430>, body: {"snapshot": {"volume_id": "a5fb08b6-ed56-4dd5-b89e-f28bae6e765b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1007590303"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:51.537391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:51.552858 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27384932-588e-4678-b7a1-9d905a473ce8 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.300537 Sep 25 01:19:51.553847 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1901/3802] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:51.558600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df8420b7-557b-4f39-9f47-a0aad5434d28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebf1c430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.627489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df8420b7-557b-4f39-9f47-a0aad5434d28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.072502 Sep 25 01:19:51.628197 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1902/3803] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:51.660158 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6960abdd-c292-40e5-b055-f1acb21972fb tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.252084 Sep 25 01:19:51.666950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1902/3804] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 25 01:19:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:51.675589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31ee3df9-99d1-4b93-bce4-a98d0bc1d728 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beb40c9d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.739991 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31ee3df9-99d1-4b93-bce4-a98d0bc1d728 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.071517 Sep 25 01:19:51.740577 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1903/3805] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:51.751744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a3a50a5-89a5-4451-a246-1375259d05c5 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beab58670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.836075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.836867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:51.846354 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a3a50a5-89a5-4451-a246-1375259d05c5 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098269 Sep 25 01:19:51.847444 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1903/3806] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:51.858891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fddd5d53-73a1-4a46-acd3-60fa89397e81 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaa4f5e0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.871490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:51.872013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:51.872478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:51.873232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:51.873753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:51.874191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:51.925452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fddd5d53-73a1-4a46-acd3-60fa89397e81 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.070244 Sep 25 01:19:51.931007 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1904/3807] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:51.952163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:51.953303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:51.967453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:51.968295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:51.968971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:51.973951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:51.974763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:51.975439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:52.084023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:52.096822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:52.101164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:52.121753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-782e8bcd-a23d-488a-bacd-eec04b3368f8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.290733 Sep 25 01:19:52.122806 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1904/3808] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:52.243373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:52.254037 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3a27ffd-c42a-42df-91c0-80cd9f8da952 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.305656 Sep 25 01:19:52.254856 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1905/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:51 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:52.578906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:52.580622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:52.589144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:52.590080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:52.590737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:52.591704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:52.592598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:52.593662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:52.645555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7dc0f96-ef60-488a-bfaf-8b96ed05bddb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beb184f70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:52.720975 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f7dc0f96-ef60-488a-bfaf-8b96ed05bddb tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.079576 Sep 25 01:19:52.731492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1906/3810] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:52 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:52.793524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2728474a-3d53-48a7-96b5-bc2e8f1ce857 req-acb554ee-1779-45c9-8c8a-9db3d474cfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-plugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:52.817028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2728474a-3d53-48a7-96b5-bc2e8f1ce857 req-acb554ee-1779-45c9-8c8a-9db3d474cfcd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:52.817444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2728474a-3d53-48a7-96b5-bc2e8f1ce857 req-acb554ee-1779-45c9-8c8a-9db3d474cfcd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:52.817886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2728474a-3d53-48a7-96b5-bc2e8f1ce857 req-acb554ee-1779-45c9-8c8a-9db3d474cfcd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:52.835797 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2728474a-3d53-48a7-96b5-bc2e8f1ce857 req-acb554ee-1779-45c9-8c8a-9db3d474cfcd service nova] Creating event network-vif-plugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:19:52.854112 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2728474a-3d53-48a7-96b5-bc2e8f1ce857 req-acb554ee-1779-45c9-8c8a-9db3d474cfcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064580 Sep 25 01:19:52.858700 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1907/3811] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:52.939787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03822477-271c-4f08-ab2e-f867bee6ceea tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beab58d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:53.008879 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-03822477-271c-4f08-ab2e-f867bee6ceea tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.073805 Sep 25 01:19:53.014791 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1908/3812] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:52 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:53.033942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:53.045878 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ee9566de-8a48-471d-b8b9-70b2bab4d51c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.469431 Sep 25 01:19:53.046957 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1905/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:52 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:53.149972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:53.150723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:53.171813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:53.172743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:53.173570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:53.174803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:53.175481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:53.176118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:53.280269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:53.280892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:53.288121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:53.288828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:53.289581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:53.291579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:53.292434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:53.293139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:53.576902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:53.595052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:53.596588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:53.619062 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aea13c11-6b0d-406a-851c-91dab1d7bdcb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.472954 Sep 25 01:19:53.620390 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1909/3814] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:53 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:53.739680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-178b4931-c6fa-48bd-8ea4-350a3fbb815c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beaa4c4c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:53.858077 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-178b4931-c6fa-48bd-8ea4-350a3fbb815c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.112082 Sep 25 01:19:53.872246 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1910/3815] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:53 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:54.038579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd2785ca-763f-4b7a-a525-ce56986a4fc0 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaa4f280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:54.042020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:54.056993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b65009d-1638-4d4b-9330-e9a3ef876a01 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1512 microversion: 2.1 time: 0.778704 Sep 25 01:19:54.060697 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1906/3816] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:53 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1512 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:54.076224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:54.078813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:54.096803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:54.098076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:54.099116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:54.100374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:54.101228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:54.102139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:54.134828 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd2785ca-763f-4b7a-a525-ce56986a4fc0 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.116490 Sep 25 01:19:54.140626 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1911/3817] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:54 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:54.379044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:54.383594 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:19:54.399410 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22791470-9625-4873-961f-6932fa8f8b9f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.331246 Sep 25 01:19:54.415021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1907/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:54 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:54.656374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:54.657004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:54.667276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:54.668900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:54.669634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:54.670804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:54.671920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:54.672528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:54.879290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6522795-ce89-4fc5-b48e-27a2acbf58fd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beba033a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:54.894730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:54.919325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:54.922197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:54.936169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa571378-e875-4c8b-8f92-596da1d60f23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1558 microversion: 2.91 time: 0.283694 Sep 25 01:19:54.946187 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1912/3819] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:54 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1558 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:54.968611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6522795-ce89-4fc5-b48e-27a2acbf58fd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.094008 Sep 25 01:19:54.969208 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1908/3820] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:54 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:55.150674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec297eff-aa5b-460b-99ba-0a9ec9569482 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaf581f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:55.236559 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec297eff-aa5b-460b-99ba-0a9ec9569482 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 288 microversion: 2.1 time: 0.091146 Sep 25 01:19:55.244795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1909/3821] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:55 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:55.250543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1658252-abc7-47be-a836-b0d839e8f43d tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7bebf1cb80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:55.507468 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1658252-abc7-47be-a836-b0d839e8f43d tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 202 len: 0 microversion: 2.1 time: 0.261148 Sep 25 01:19:55.508037 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1910/3822] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:19:55 2022] DELETE /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:19:55.517481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:55.518823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:55.528936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:55.529612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:55.553155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:55.553698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:55.554164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:55.554891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:55.555351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:55.555807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:55.561107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:55.571099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:55.571659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:55.572428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:55.572917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:55.573356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:55.905726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:55.915226 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9be79766-b045-4d13-a411-22ba66f83c4b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1489 microversion: 2.1 time: 0.830621 Sep 25 01:19:55.923423 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1913/3823] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:55 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1489 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:55.937704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9acf2410-692c-4125-8491-0c38fac23669 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaa530d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:55.955683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:55.967612 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf1012f7-249e-4d3b-ae87-2dd0c4ac8b78 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 0.458218 Sep 25 01:19:55.968728 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1911/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:55 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:55.974489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:55.975225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:55.984139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:55.985037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:55.986078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:55.987362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:55.988391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:55.989038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:56.030504 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9acf2410-692c-4125-8491-0c38fac23669 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.105757 Sep 25 01:19:56.031218 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1914/3825] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:55 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:56.044139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:56.051754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:56.077232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:56.081010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:56.081971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:56.086783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:56.088060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:56.088855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:56.096956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:19:56.210419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:56.225766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:56.228178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:56.234329 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a30c2092-babb-488d-a68e-26c039e95704 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1558 microversion: 2.91 time: 0.201413 Sep 25 01:19:56.270567 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1915/3826] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:56 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:19:56.283519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-825af436-7a13-4b51-b05b-b1c7d992bc62 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beab58ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:56.286198 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bcbdfdc2-f8c0-48fe-bda1-d21e045dcf28 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 204 len: 0 microversion: 2.1 time: 0.311586 Sep 25 01:19:56.288517 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1912/3827] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:19:55 2022] DELETE /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:19:56.308873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:56.310483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:56.332429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:56.334988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:56.335670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:56.338383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:56.339094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:56.340256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:56.432988 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-825af436-7a13-4b51-b05b-b1c7d992bc62 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.159464 Sep 25 01:19:56.433708 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1916/3828] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:56 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:56.657840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:56.690848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f2af00d-e361-4910-a800-f47c4754130b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1495 microversion: 2.1 time: 0.396463 Sep 25 01:19:56.701950 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1913/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:56 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1495 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:19:56.856571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ffd56eea-f39a-4e9b-9fd3-28b1df7071c9 req-95ca060a-9b30-4b2f-bee4-f4154674cf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5d9c61-86cd-4bc9-8c63-c204a635ff78", "name": "network-vif-plugged", "status": "completed", "tag": "54a9a9ac-b974-4b43-b8e9-3025aa05f933"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:56.891280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ffd56eea-f39a-4e9b-9fd3-28b1df7071c9 req-95ca060a-9b30-4b2f-bee4-f4154674cf2c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:56.894786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ffd56eea-f39a-4e9b-9fd3-28b1df7071c9 req-95ca060a-9b30-4b2f-bee4-f4154674cf2c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:56.897195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ffd56eea-f39a-4e9b-9fd3-28b1df7071c9 req-95ca060a-9b30-4b2f-bee4-f4154674cf2c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:56.941219 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ffd56eea-f39a-4e9b-9fd3-28b1df7071c9 req-95ca060a-9b30-4b2f-bee4-f4154674cf2c service nova] Creating event network-vif-plugged:54a9a9ac-b974-4b43-b8e9-3025aa05f933 for instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 on n-h2-master-1 Sep 25 01:19:56.956582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ffd56eea-f39a-4e9b-9fd3-28b1df7071c9 req-95ca060a-9b30-4b2f-bee4-f4154674cf2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105107 Sep 25 01:19:56.961184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1917/3830] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:56.997351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:56.998367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:57.024193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:57.026446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:57.027714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:57.031666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:57.032387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:57.034134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:57.044708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-57b2cf0a-b76b-4fa4-ba13-88169612bf40 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beab58790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:57.149854 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-57b2cf0a-b76b-4fa4-ba13-88169612bf40 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.110183 Sep 25 01:19:57.155611 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1918/3831] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:57 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:57.267082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:57.268056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:57.285036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:57.285841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:57.291878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:57.293085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:57.293834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:57.294457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:57.575656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:57.588271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:57.589758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:57.615324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be334ccc-48f7-4c1d-b173-4b9a2cf9239a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.353088 Sep 25 01:19:57.615870 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1919/3832] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:57 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:57.642697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5765edd4-85bb-4925-b98f-7f9fd5aea8fd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beaa53790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:57.700604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:57.712850 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-550a4970-a958-4e48-be4b-f9fa2e189f41 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1531 microversion: 2.1 time: 0.720093 Sep 25 01:19:57.714222 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1914/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:56 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1531 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:57.766541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:57.778091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:57.803963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:57.804487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:57.806172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:57.808957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:57.811448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:57.813325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:58.007903 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5765edd4-85bb-4925-b98f-7f9fd5aea8fd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 0.381711 Sep 25 01:19:58.008828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1920/3834] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:57 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:58.164097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e8d0f85-cfab-4214-8110-8afbd5179576 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beb99a8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:58.215599 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e8d0f85-cfab-4214-8110-8afbd5179576 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 200 len: 287 microversion: 2.1 time: 0.056671 Sep 25 01:19:58.216173 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1921/3835] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:58 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:19:58.649534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:58.650665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:58.699378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:58.699936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:58.700397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:58.702223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:58.702688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:58.703122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:58.857797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:58.881261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e191d93-016b-4212-977a-c18eec0d5c90 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1495 microversion: 2.1 time: 1.134592 Sep 25 01:19:58.891296 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1915/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:57 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1495 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:58.918536 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:58.930374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:19:58.955406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:58.956355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:58.957022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:58.958051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:58.959230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:58.967150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:59.103895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:59.113475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:59.114940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:59.155608 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c3741a5-6b4a-47a8-8a0e-e7043da8a86f tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.513423 Sep 25 01:19:59.156406 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1922/3837] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:19:58 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:19:59.183744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63fbbcfb-937a-410c-9368-36f9ab116a78 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beab58160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:59.632769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:19:59.655570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fcd4429c-7d7e-4d2c-a25a-65a13d5c08ff tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 0.760278 Sep 25 01:19:59.658480 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1916/3838] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:19:58 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:19:59.684786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-88d89a1e-eea5-4d0b-89f9-ba3f2d0b36f6 req-17830304-2bbf-462c-9705-b4833da52e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "name": "network-vif-plugged", "status": "completed", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:19:59.718460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-88d89a1e-eea5-4d0b-89f9-ba3f2d0b36f6 req-17830304-2bbf-462c-9705-b4833da52e0a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:19:59.719911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-88d89a1e-eea5-4d0b-89f9-ba3f2d0b36f6 req-17830304-2bbf-462c-9705-b4833da52e0a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:19:59.720981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-88d89a1e-eea5-4d0b-89f9-ba3f2d0b36f6 req-17830304-2bbf-462c-9705-b4833da52e0a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:19:59.754823 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-88d89a1e-eea5-4d0b-89f9-ba3f2d0b36f6 req-17830304-2bbf-462c-9705-b4833da52e0a service nova] Creating event network-vif-plugged:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h1-master-1 Sep 25 01:19:59.766326 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-88d89a1e-eea5-4d0b-89f9-ba3f2d0b36f6 req-17830304-2bbf-462c-9705-b4833da52e0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104546 Sep 25 01:19:59.771447 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1917/3839] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:19:59.778184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ba137b3-eacc-4eed-96c5-a73738002a15 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7bf40c3dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:19:59.840770 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-0ba137b3-eacc-4eed-96c5-a73738002a15 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] HTTP exception thrown: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ba137b3-eacc-4eed-96c5-a73738002a15 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Request method failure captured: Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee HTTP/1.1 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6y1WVyiuszedJIoPVyCbvsWZQ6DRSSM6OhvxVhFAy9vTmaBmITaqkerI1XjXsb6vEtlt0aUCOMH6y7Pd91DjFzbbD1yttp3wCspsYZ98BmLw0OyAqqceINP7uC6sVPMaES14th9TY2WdPn5trEbYWcJAOjKBexXVZXSvCgCRWdbR38 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3de566fc6cf74a44a29e5989042cdb5f"}]}] Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 23d8b5256139488db144848ab8c0aa5e Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: exception: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '491939e7-49c0-4866-98d6-05d60fbdd8ee'} Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. (HTTP 404) (Request-ID: req-431c5cc1-7e8e-4fd3-95fc-2f09b823c37f) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:19:59.851062 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. Sep 25 01:19:59.858899 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:19:59.865751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ba137b3-eacc-4eed-96c5-a73738002a15 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Returning 404 to user: Snapshot 491939e7-49c0-4866-98d6-05d60fbdd8ee could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:19:59.866271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ba137b3-eacc-4eed-96c5-a73738002a15 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee" status: 404 len: 111 microversion: 2.1 time: 0.092177 Sep 25 01:19:59.866987 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1918/3840] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 01:19:59 2022] GET /compute/v2.1/os-snapshots/491939e7-49c0-4866-98d6-05d60fbdd8ee => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:19:59.888902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-724a4c86-4704-40aa-a0f7-7e3948c58b17 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaf588b0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:00.140051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-724a4c86-4704-40aa-a0f7-7e3948c58b17 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 202 len: 0 microversion: 2.1 time: 0.264748 Sep 25 01:20:00.141173 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1919/3841] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:19:59 2022] DELETE /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:20:00.214967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:00.216006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:00.236438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:00.237029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:00.237496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:00.242520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:00.243268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:00.243928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:01.373158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:01.391814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e30e0a5a-d087-403a-8f43-8f8bf185f63e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1495 microversion: 2.1 time: 1.241892 Sep 25 01:20:01.395375 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1920/3842] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:00 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1495 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:01.419904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:01.423053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:01.444992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:01.445774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:01.448007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:01.448941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:01.450417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:01.451207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:01.711549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:01.726276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:01.728182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:01.739970 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fee6c37-9d7d-4df4-a1d1-dd4cb6f3b467 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.337095 Sep 25 01:20:01.740870 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1921/3843] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:01 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:01.759947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ccf6fd6-18d2-4295-90c1-76cca49db1da tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beba03dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:01.978117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ccf6fd6-18d2-4295-90c1-76cca49db1da tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 200 len: 345 microversion: 2.1 time: 0.231171 Sep 25 01:20:01.978947 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1922/3844] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:20:01 2022] GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 345 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:01.989702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:01.994459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:02.032169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.034816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.036613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.037794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.042773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.044098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.347660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:02.361674 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a7957170-70df-4799-8c71-f5bb17c8331a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 0.377959 Sep 25 01:20:02.363104 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1923/3845] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:01 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:02.369722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b0991f96-59f2-453a-a6e0-0500a7c30ab1 req-e6714b08-cf9d-44a7-ae4e-32e21c5a5dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3956414a-ef51-449f-b95e-c4feae10fdf9", "name": "network-vif-deleted", "tag": "7fca791a-457d-4c3f-8795-34958f8ef9ee"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:02.397626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b0991f96-59f2-453a-a6e0-0500a7c30ab1 req-e6714b08-cf9d-44a7-ae4e-32e21c5a5dfe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.399515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b0991f96-59f2-453a-a6e0-0500a7c30ab1 req-e6714b08-cf9d-44a7-ae4e-32e21c5a5dfe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.411994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b0991f96-59f2-453a-a6e0-0500a7c30ab1 req-e6714b08-cf9d-44a7-ae4e-32e21c5a5dfe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.449800 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b0991f96-59f2-453a-a6e0-0500a7c30ab1 req-e6714b08-cf9d-44a7-ae4e-32e21c5a5dfe service nova] Creating event network-vif-deleted:7fca791a-457d-4c3f-8795-34958f8ef9ee for instance 3956414a-ef51-449f-b95e-c4feae10fdf9 on n-h2-master-1 Sep 25 01:20:02.457339 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b0991f96-59f2-453a-a6e0-0500a7c30ab1 req-e6714b08-cf9d-44a7-ae4e-32e21c5a5dfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092670 Sep 25 01:20:02.467731 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1924/3846] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:02.475844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e7039fd0-0d9e-4445-90de-ad8444b7b8fd req-c182ffec-8201-4d77-8000-146f8ae33ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3956414a-ef51-449f-b95e-c4feae10fdf9", "name": "network-vif-unplugged", "status": "completed", "tag": "7fca791a-457d-4c3f-8795-34958f8ef9ee"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:02.515905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e7039fd0-0d9e-4445-90de-ad8444b7b8fd req-c182ffec-8201-4d77-8000-146f8ae33ebd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.528662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e7039fd0-0d9e-4445-90de-ad8444b7b8fd req-c182ffec-8201-4d77-8000-146f8ae33ebd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.529379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e7039fd0-0d9e-4445-90de-ad8444b7b8fd req-c182ffec-8201-4d77-8000-146f8ae33ebd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.559930 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e7039fd0-0d9e-4445-90de-ad8444b7b8fd req-c182ffec-8201-4d77-8000-146f8ae33ebd service nova] Creating event network-vif-unplugged:7fca791a-457d-4c3f-8795-34958f8ef9ee for instance 3956414a-ef51-449f-b95e-c4feae10fdf9 on n-h2-master-1 Sep 25 01:20:02.577906 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e7039fd0-0d9e-4445-90de-ad8444b7b8fd req-c182ffec-8201-4d77-8000-146f8ae33ebd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108033 Sep 25 01:20:02.580847 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1925/3847] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:02.595460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:02.600286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:02.620308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.621872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.622541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.623456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.625516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.626252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.792038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.792550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.793000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.793496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lazy-loading 'fault' on Instance uuid 3956414a-ef51-449f-b95e-c4feae10fdf9 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:20:02.871799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:02.880692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f5d8e5c-41b2-41d8-90b9-d7452b7e26ef tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 200 len: 1305 microversion: 2.1 time: 0.293248 Sep 25 01:20:02.893558 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1926/3848] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:02 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 1305 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:02.893558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:02.893558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:02.910500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.910914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.911378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:02.912174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:02.912578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:02.913016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:03.077846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:03.098792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:03.100609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:03.131170 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8dff578d-0456-43d0-8f12-12c5bd5c1554 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.245915 Sep 25 01:20:03.138618 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1927/3849] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:02 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:03.161448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b2e02ac-d7ed-4c86-852f-c8834bb04278 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7bf40c3dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:03.345633 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b2e02ac-d7ed-4c86-852f-c8834bb04278 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 200 len: 345 microversion: 2.1 time: 0.201107 Sep 25 01:20:03.346542 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1928/3850] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:20:03 2022] GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:03.387368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:03.388338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:03.400813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:03.403123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:03.407239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:03.409116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:03.410817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:03.412943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:03.789211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:03.806372 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-102dac7b-02b5-4dc9-a696-d77394396a82 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 0.423373 Sep 25 01:20:03.812353 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1929/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:03 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:03.909255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:03.910307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:03.928243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:03.929880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:03.933478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:03.937735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:03.938818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:03.939412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:03.992630 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 HTTP/1.1 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3956414a-ef51-449f-b95e-c4feae10fdf9'} Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:03.996594 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:04.000297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:04.002537 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-634226d6-63d0-49d8-8243-9a9401b025f4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 404 len: 111 microversion: 2.1 time: 0.096472 Sep 25 01:20:04.004998 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1930/3852] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:03 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:20:04.180433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:04.181420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:04.211861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:04.217524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:04.218462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:04.220353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:04.223191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:04.223843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:04.462623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:04.495223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:04.496738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:04.514609 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb2b508c-8d5f-49fd-ae3d-3ca4cc174ca3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.346240 Sep 25 01:20:04.515219 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1931/3853] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:04 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:20:04.528248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1007532060", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "372ba293-0fe6-40bc-b81d-70e2ce3d79d7"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:09.111314 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:09.146164 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=35 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:13.756272 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63fbbcfb-937a-410c-9368-36f9ab116a78 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1437 microversion: 2.1 time: 14.594755 Sep 25 01:20:13.759828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] validate_networks() for [('372ba293-0fe6-40bc-b81d-70e2ce3d79d7', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:20:13.772911 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1923/3854] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:19:59 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1437 bytes in 14612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:13.777999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45ac569b-3a52-46b4-bfa3-a4f49f0dfa0e tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beb1dd700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:13.845550 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-45ac569b-3a52-46b4-bfa3-a4f49f0dfa0e tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] HTTP exception thrown: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45ac569b-3a52-46b4-bfa3-a4f49f0dfa0e tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Request method failure captured: Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b HTTP/1.1 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6y1WVyiuszedJIoPVyCbvsWZQ6DRSSM6OhvxVhFAy9vTmaBmITaqkerI1XjXsb6vEtlt0aUCOMH6y7Pd91DjFzbbD1yttp3wCspsYZ98BmLw0OyAqqceINP7uC6sVPMaES14th9TY2WdPn5trEbYWcJAOjKBexXVZXSvCgCRWdbR38 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3de566fc6cf74a44a29e5989042cdb5f"}]}] Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 23d8b5256139488db144848ab8c0aa5e Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: exception: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'a5fb08b6-ed56-4dd5-b89e-f28bae6e765b'} Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. (HTTP 404) (Request-ID: req-fbe2af1e-656c-4e98-afa6-9945381ccf9b) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:20:13.848194 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:13.852497 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:13.855720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45ac569b-3a52-46b4-bfa3-a4f49f0dfa0e tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Returning 404 to user: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:13.857357 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45ac569b-3a52-46b4-bfa3-a4f49f0dfa0e tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 404 len: 109 microversion: 2.1 time: 0.083377 Sep 25 01:20:13.858088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1924/3855] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:20:13 2022] GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:13.864964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:13.870118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:13.882115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:13.886206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:13.886878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:13.887785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:13.888402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:13.888990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:14.210221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:14.236041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34888edb-4049-4328-895b-ce3edd60cd02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 0.365762 Sep 25 01:20:14.239845 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1925/3856] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:13 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:14.257241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:14.258068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:14.285645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:14.286297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:14.290003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:14.290813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:14.291522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:14.292167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:14.491516 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:14.507619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:14.518614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:14.529962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:14.542627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9da3cd40-72af-4c9c-a46c-b4503af1fd3b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.300071 Sep 25 01:20:14.547668 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1926/3857] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:14 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:14.560604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:14.561514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:14.570625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:14.573941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:14.579385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:14.580648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:14.581350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:14.582027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:14.588806 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:15.030076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:15.039415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2dcd115d-e137-4547-9f05-d8910a43bac0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.490328 Sep 25 01:20:15.058129 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1927/3858] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:14 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:15.063716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1c7a6de9-e12a-47d8-aabd-10c9c1d25011 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beaa161f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:15.133519 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1c7a6de9-e12a-47d8-aabd-10c9c1d25011 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] HTTP exception thrown: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1c7a6de9-e12a-47d8-aabd-10c9c1d25011 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Request method failure captured: Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b HTTP/1.1 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6y1WVyiuszedJIoPVyCbvsWZQ6DRSSM6OhvxVhFAy9vTmaBmITaqkerI1XjXsb6vEtlt0aUCOMH6y7Pd91DjFzbbD1yttp3wCspsYZ98BmLw0OyAqqceINP7uC6sVPMaES14th9TY2WdPn5trEbYWcJAOjKBexXVZXSvCgCRWdbR38 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3de566fc6cf74a44a29e5989042cdb5f"}]}] Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 23d8b5256139488db144848ab8c0aa5e Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: exception: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'a5fb08b6-ed56-4dd5-b89e-f28bae6e765b'} Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. (HTTP 404) (Request-ID: req-40f57b2a-be99-4b4e-b042-1fe166ecf28f) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:20:15.135719 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:15.139111 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:15.142225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1c7a6de9-e12a-47d8-aabd-10c9c1d25011 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Returning 404 to user: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:15.143802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1c7a6de9-e12a-47d8-aabd-10c9c1d25011 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 404 len: 109 microversion: 2.1 time: 0.084597 Sep 25 01:20:15.144972 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1928/3859] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:20:15 2022] DELETE /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:15.152165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a14d101a-2b0e-4dca-bbcd-5cb4fc664ed9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beaa68700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:15.279101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:20:15.279635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:20:15.280174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:20:15.280701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:20:15.281226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:20:15.324371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:15.325050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:15.325639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:15.326650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:15.327343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:15.328009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:15.386015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:20:15.398337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Getting quotas for user 8c4d799cd1354609a8604a2db0fc12f1 and project 714fdb4cc705469688b389dab75ce03e. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:20:15.436475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:20:15.439234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:20:15.565936 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-94058961-dc3c-4222-8f85-5a4a49b08d94 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.049461 Sep 25 01:20:15.567207 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1932/3860] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:20:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 11051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:20:15.587279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1072792222"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:15.590023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:15.615499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:15.620102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:15.620820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:15.621838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:15.622565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:15.623262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:24.571036 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.037738 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=18 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.352329 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.420190 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.614054 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:25.731190 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:31.717849 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a14d101a-2b0e-4dca-bbcd-5cb4fc664ed9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1446 microversion: 2.1 time: 16.569746 Sep 25 01:20:31.719994 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1929/3861] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:15 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1446 bytes in 16574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:31.732760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-499b6970-8bcb-4263-be23-3bda87b9f454 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Calling method '.version_select at 0x7f7beb184280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:31.785652 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-499b6970-8bcb-4263-be23-3bda87b9f454 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] HTTP exception thrown: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-499b6970-8bcb-4263-be23-3bda87b9f454 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Request method failure captured: Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b HTTP/1.1 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6y1WVyiuszedJIoPVyCbvsWZQ6DRSSM6OhvxVhFAy9vTmaBmITaqkerI1XjXsb6vEtlt0aUCOMH6y7Pd91DjFzbbD1yttp3wCspsYZ98BmLw0OyAqqceINP7uC6sVPMaES14th9TY2WdPn5trEbYWcJAOjKBexXVZXSvCgCRWdbR38 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3de566fc6cf74a44a29e5989042cdb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3de566fc6cf74a44a29e5989042cdb5f"}]}] Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3de566fc6cf74a44a29e5989042cdb5f Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-982375704 Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 23d8b5256139488db144848ab8c0aa5e Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesSnapshotsTestJSON-982375704-project Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: exception: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'a5fb08b6-ed56-4dd5-b89e-f28bae6e765b'} Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. (HTTP 404) (Request-ID: req-702a9f1e-2a1f-458c-b61e-aaecd5c21146) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:20:31.789439 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-499b6970-8bcb-4263-be23-3bda87b9f454 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] Returning 404 to user: Volume a5fb08b6-ed56-4dd5-b89e-f28bae6e765b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-499b6970-8bcb-4263-be23-3bda87b9f454 tempest-VolumesSnapshotsTestJSON-982375704 tempest-VolumesSnapshotsTestJSON-982375704-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b" status: 404 len: 109 microversion: 2.1 time: 0.068709 Sep 25 01:20:31.793016 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1930/3862] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:20:31 2022] GET /compute/v2.1/os-volumes/a5fb08b6-ed56-4dd5-b89e-f28bae6e765b => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:31.805014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:31.807910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:31.826091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:31.826593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:31.827206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:31.828135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:31.828858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:31.829452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.075556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:32.077809 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2007bc0-0516-4e36-83df-d77110b69f14 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 16.501642 Sep 25 01:20:32.079347 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1933/3863] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:20:15 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 16512 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 25 01:20:32.096804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b69b8aac-35ec-44ba-945a-ce120092db0b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 0.298910 Sep 25 01:20:32.099581 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1931/3864] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:31 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:32.102353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:32.103429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:32.105560 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:32.106430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:32.117307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:32.125764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:32.128771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.129960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:32.130667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:32.131651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.132315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:32.133859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:32.135295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.137554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:32.138304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:32.139204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.225048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:32.235138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:32.246414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:32.264242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-503a24b0-622a-4e03-a362-e8564bb76293 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.182347 Sep 25 01:20:32.265208 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1934/3865] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:32 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:32.276601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-76aea647-aaac-4fd5-a3b6-bb7f633e7b78 req-9e8e7d9d-3cb1-41a5-8652-80a27d3f5f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-unplugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:32.301508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-76aea647-aaac-4fd5-a3b6-bb7f633e7b78 req-9e8e7d9d-3cb1-41a5-8652-80a27d3f5f0e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:32.306133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-76aea647-aaac-4fd5-a3b6-bb7f633e7b78 req-9e8e7d9d-3cb1-41a5-8652-80a27d3f5f0e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:32.307329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-76aea647-aaac-4fd5-a3b6-bb7f633e7b78 req-9e8e7d9d-3cb1-41a5-8652-80a27d3f5f0e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.343239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-76aea647-aaac-4fd5-a3b6-bb7f633e7b78 req-9e8e7d9d-3cb1-41a5-8652-80a27d3f5f0e service nova] Creating event network-vif-unplugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:20:32.359104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-76aea647-aaac-4fd5-a3b6-bb7f633e7b78 req-9e8e7d9d-3cb1-41a5-8652-80a27d3f5f0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091865 Sep 25 01:20:32.363430 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1935/3866] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:32.380233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-26b08359-f0d9-4736-9d40-315c965069fc req-e6fcd43f-d75a-4ff4-9d04-51e521e231e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5b488a-9b1e-40be-8c71-939e47042dd4", "tag": "75a13e85-9964-4262-8f26-bdb18aff8000"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:32.395853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-26b08359-f0d9-4736-9d40-315c965069fc req-e6fcd43f-d75a-4ff4-9d04-51e521e231e8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:32.396361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-26b08359-f0d9-4736-9d40-315c965069fc req-e6fcd43f-d75a-4ff4-9d04-51e521e231e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:32.397198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-26b08359-f0d9-4736-9d40-315c965069fc req-e6fcd43f-d75a-4ff4-9d04-51e521e231e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:32.438234 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-26b08359-f0d9-4736-9d40-315c965069fc req-e6fcd43f-d75a-4ff4-9d04-51e521e231e8 service nova] Creating event network-changed:75a13e85-9964-4262-8f26-bdb18aff8000 for instance ce5b488a-9b1e-40be-8c71-939e47042dd4 on n-h2-master-1 Sep 25 01:20:32.454453 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-26b08359-f0d9-4736-9d40-315c965069fc req-e6fcd43f-d75a-4ff4-9d04-51e521e231e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087000 Sep 25 01:20:32.457122 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1936/3867] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:32.504971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-993269ee-fa40-4cee-b77a-1b315a04003d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf409ac10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:32.549262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:32.564326 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-57d96365-4ff2-4438-b7de-06b6b7e766fb tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1315 microversion: 2.1 time: 0.457860 Sep 25 01:20:32.566530 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1932/3868] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:32 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:32.617050 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-993269ee-fa40-4cee-b77a-1b315a04003d tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 200 len: 1446 microversion: 2.1 time: 0.148681 Sep 25 01:20:32.622438 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1937/3869] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:20:32 2022] GET /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:32.636135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ef983c0-26a6-4601-92bb-51d52f915908 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beaa75790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:33.125234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:33.126244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:33.147751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:33.148266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:33.148713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:33.149467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:33.149925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:33.150351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:33.918463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ef983c0-26a6-4601-92bb-51d52f915908 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 204 len: 0 microversion: 2.1 time: 1.289874 Sep 25 01:20:33.919705 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1933/3870] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:32 2022] DELETE /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 0 bytes in 1292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:20:33.932144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:33.934626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:33.969004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:33.972537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:33.973161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:33.975820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:33.977060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:33.980753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:34.211527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:34.238730 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d34d5ca7-4bbd-4af9-b2b2-e52de815ee15 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 1.114750 Sep 25 01:20:34.251618 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1938/3871] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:33 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:34.269319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:34.270563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:34.284735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:34.285543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:34.286199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:34.287121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:34.287771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:34.288597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:34.445968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:34.460978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:34.462567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:34.468932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ccd48d9d-b087-4baa-816d-3085ed27d4b7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1535 microversion: 2.91 time: 0.548103 Sep 25 01:20:34.495531 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1934/3872] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:33 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1535 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:34.500749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:34.501611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:34.509708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:34.510377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:34.511046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:34.514867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:34.515515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:34.516319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:34.570573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:20:34.799063 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-afd62090-6986-43fd-8bc0-dba04b77dfa2 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 204 len: 0 microversion: 2.1 time: 0.301906 Sep 25 01:20:34.803996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1935/3873] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:34 2022] DELETE /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:20:34.809768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9e8ed030-b538-4538-bdc3-de8dc5b99449 req-cf1eb548-3f0d-4add-a619-709138e19be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5b488a-9b1e-40be-8c71-939e47042dd4", "name": "network-vif-plugged", "status": "completed", "tag": "75a13e85-9964-4262-8f26-bdb18aff8000"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:34.836577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9e8ed030-b538-4538-bdc3-de8dc5b99449 req-cf1eb548-3f0d-4add-a619-709138e19be3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:34.837488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9e8ed030-b538-4538-bdc3-de8dc5b99449 req-cf1eb548-3f0d-4add-a619-709138e19be3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:34.838586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9e8ed030-b538-4538-bdc3-de8dc5b99449 req-cf1eb548-3f0d-4add-a619-709138e19be3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:34.880239 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9e8ed030-b538-4538-bdc3-de8dc5b99449 req-cf1eb548-3f0d-4add-a619-709138e19be3 service nova] Creating event network-vif-plugged:75a13e85-9964-4262-8f26-bdb18aff8000 for instance ce5b488a-9b1e-40be-8c71-939e47042dd4 on n-h2-master-1 Sep 25 01:20:34.898478 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9e8ed030-b538-4538-bdc3-de8dc5b99449 req-cf1eb548-3f0d-4add-a619-709138e19be3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092587 Sep 25 01:20:34.899096 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1936/3874] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:34.912547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:34.924166 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e60913ff-cd75-46b0-887d-f1a3278dcc9e tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1315 microversion: 2.1 time: 0.670496 Sep 25 01:20:34.937978 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1939/3875] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:34 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:35.014528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1259164884", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4ec95620-83af-4c06-b763-713d3bcab477"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:35.106982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] validate_networks() for [('4ec95620-83af-4c06-b763-713d3bcab477', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:20:35.271226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:35.272591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:35.283984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:35.285189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:35.285956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:35.288233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:35.288942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:35.289668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:35.565138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:35.589742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c671b902-d660-419d-97ec-0fcb9d611ed9 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 0.325355 Sep 25 01:20:35.594580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1940/3876] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:35 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:35.604384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:35.605002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:35.614841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:35.615800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:35.616418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:35.617298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:35.617932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:35.618513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:35.724362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:35.733239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:35.737367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:35.748825 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3758feec-e70a-49c9-a39c-837c5d186427 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1535 microversion: 2.91 time: 0.148312 Sep 25 01:20:35.762007 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1941/3877] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:35 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1535 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:35.951402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:35.952377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:35.964802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:35.968539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:35.969347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:35.972226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:35.972830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:35.977619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:36.087046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:20:36.087926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:20:36.088417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:20:36.088828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:20:36.089246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:20:36.120073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:36.120606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:36.121036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:36.138991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:36.141501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:36.142328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:36.237630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:20:36.301763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Getting quotas for user ab3394e2971741d7aa5956de0d4afba8 and project c9172549e19145c5b2201cfa5ef4eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:20:36.344334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:20:36.356161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:20:36.513831 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd995d00-3658-44e3-b7b0-5fefb7f4fa40 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513650 Sep 25 01:20:36.517734 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1937/3878] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:20:36.531194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5a4e4ab-0cbe-46a7-a645-aeff5daeeb7a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:36.531828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5a4e4ab-0cbe-46a7-a645-aeff5daeeb7a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:36.850619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c5a4e4ab-0cbe-46a7-a645-aeff5daeeb7a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:36.881637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5a4e4ab-0cbe-46a7-a645-aeff5daeeb7a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1208 microversion: 2.1 time: 0.341270 Sep 25 01:20:36.882338 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1938/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:36 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1208 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:36.891851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:36.893033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:36.923285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:36.923966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:36.924424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:36.925156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:36.925649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:36.926082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:37.043721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:37.059543 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a0cc7dd-4e53-4f17-be97-75725335f85b tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1315 microversion: 2.1 time: 1.113827 Sep 25 01:20:37.083348 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1942/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:35 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1315 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:37.094597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:37.095290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:37.129911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:37.133886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:37.134613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:37.143268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:37.149486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:37.150170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:37.684332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:37.707413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:37.721702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:37.753884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c109e346-7b3f-457b-9975-8557cadfb7c4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1538 microversion: 2.91 time: 0.669294 Sep 25 01:20:37.757140 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1943/3881] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:37 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1538 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:37.768626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ea9d9f72-1dbf-4a8b-8a25-9bf95f2e07ca req-4f20fa92-b76f-466f-9dcf-9f8ac369cdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5d9c61-86cd-4bc9-8c63-c204a635ff78", "name": "network-vif-unplugged", "status": "completed", "tag": "54a9a9ac-b974-4b43-b8e9-3025aa05f933"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:37.815047 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:20:37.815219 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 01:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 25 01:20:37.820501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea9d9f72-1dbf-4a8b-8a25-9bf95f2e07ca req-4f20fa92-b76f-466f-9dcf-9f8ac369cdae service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:37.820998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea9d9f72-1dbf-4a8b-8a25-9bf95f2e07ca req-4f20fa92-b76f-466f-9dcf-9f8ac369cdae service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:37.821513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea9d9f72-1dbf-4a8b-8a25-9bf95f2e07ca req-4f20fa92-b76f-466f-9dcf-9f8ac369cdae service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:37.875043 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ea9d9f72-1dbf-4a8b-8a25-9bf95f2e07ca req-4f20fa92-b76f-466f-9dcf-9f8ac369cdae service nova] Creating event network-vif-unplugged:54a9a9ac-b974-4b43-b8e9-3025aa05f933 for instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 on n-h2-master-1 Sep 25 01:20:37.901915 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ea9d9f72-1dbf-4a8b-8a25-9bf95f2e07ca req-4f20fa92-b76f-466f-9dcf-9f8ac369cdae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143226 Sep 25 01:20:37.906164 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1944/3882] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:37.915617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:37.927296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:37.936760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:37.950271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:37.951082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:37.952070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:37.952691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:37.953294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:38.090971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=122385) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:20:38.296870 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a75afda7-efd9-499b-93c4-ca872cb182f1 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action" status: 202 len: 0 microversion: 2.91 time: 0.387417 Sep 25 01:20:38.305467 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1945/3883] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:20:37 2022] POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:20:38.311949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:38.316284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:38.336438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:38.338060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:38.341757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:38.342864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:38.344969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:38.346253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:38.824916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:38.835840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-12fc8fe0-e55e-445d-9f1c-cdddc7b63929 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1526 microversion: 2.1 time: 1.952413 Sep 25 01:20:38.857706 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1939/3884] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:36 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1526 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:38.869102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:38.878049 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d797809-7ba8-4e91-81a7-92a2780be096 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1204 microversion: 2.1 time: 0.571216 Sep 25 01:20:38.880409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:38.888518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:38.897173 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1946/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:38 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1204 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:38.902625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:38.903599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:38.911207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:38.912076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:38.912771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:38.913796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:38.914513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:38.915225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:38.917881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:38.918429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:38.924001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:38.925452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:38.925931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:38.926403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:39.185010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:39.200836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:39.208187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:39.220370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a48208e1-34f3-4907-83ca-a9f0bf92865e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1486 microversion: 2.91 time: 0.321563 Sep 25 01:20:39.222684 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1947/3886] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:38 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1486 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:39.243118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a29da1f0-7d0f-4147-87a1-687799c4c97f req-4e58edaa-bf0a-4b58-a701-5e48f22db333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5d9c61-86cd-4bc9-8c63-c204a635ff78", "name": "network-vif-deleted", "tag": "54a9a9ac-b974-4b43-b8e9-3025aa05f933"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:39.277386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a29da1f0-7d0f-4147-87a1-687799c4c97f req-4e58edaa-bf0a-4b58-a701-5e48f22db333 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:39.282709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a29da1f0-7d0f-4147-87a1-687799c4c97f req-4e58edaa-bf0a-4b58-a701-5e48f22db333 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:39.285180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a29da1f0-7d0f-4147-87a1-687799c4c97f req-4e58edaa-bf0a-4b58-a701-5e48f22db333 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:39.352001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a29da1f0-7d0f-4147-87a1-687799c4c97f req-4e58edaa-bf0a-4b58-a701-5e48f22db333 service nova] Creating event network-vif-deleted:54a9a9ac-b974-4b43-b8e9-3025aa05f933 for instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 on n-h2-master-1 Sep 25 01:20:39.404530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a29da1f0-7d0f-4147-87a1-687799c4c97f req-4e58edaa-bf0a-4b58-a701-5e48f22db333 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147783 Sep 25 01:20:39.409194 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1948/3887] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:39.869803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:39.870665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:39.890929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:39.899193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:39.903578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:39.904884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:39.905823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:39.914317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:40.649698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:40.662456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-922b52a6-7ad0-4342-9783-e2cc3b5bae96 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1502 microversion: 2.1 time: 1.803215 Sep 25 01:20:40.667262 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1940/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:38 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1502 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:40.681346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:40.682288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:40.695278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:40.695975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:40.696560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:40.697573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:40.698172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:40.698742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.018691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:41.028319 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb22a3c0-f03e-414d-9e76-11dd3b01e607 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1266 microversion: 2.1 time: 0.359696 Sep 25 01:20:41.035154 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1941/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:40 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:41.040179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8374f4a3-ac7d-485e-88e0-9625c319f0e2 req-d2488993-ad38-4b98-bc62-94da14116b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-plugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:41.066445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8374f4a3-ac7d-485e-88e0-9625c319f0e2 req-d2488993-ad38-4b98-bc62-94da14116b5a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.066930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8374f4a3-ac7d-485e-88e0-9625c319f0e2 req-d2488993-ad38-4b98-bc62-94da14116b5a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.067360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8374f4a3-ac7d-485e-88e0-9625c319f0e2 req-d2488993-ad38-4b98-bc62-94da14116b5a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.086093 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8374f4a3-ac7d-485e-88e0-9625c319f0e2 req-d2488993-ad38-4b98-bc62-94da14116b5a service nova] Creating event network-vif-plugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:20:41.104718 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8374f4a3-ac7d-485e-88e0-9625c319f0e2 req-d2488993-ad38-4b98-bc62-94da14116b5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068053 Sep 25 01:20:41.109630 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1942/3890] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:41.126275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:41.128195 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:41.140989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.146573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.147256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.147994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.148450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.148873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.220240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:41.245656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e60d89f0-f09b-4752-8627-f8e8856d75cc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1508 microversion: 2.1 time: 1.381609 Sep 25 01:20:41.247859 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1949/3891] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:39 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1508 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:41.258179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:41.264828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:41.279816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.282281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.284187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.285222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.288059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.289050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.393852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lazy-loading 'flavor' on Instance uuid ce5b488a-9b1e-40be-8c71-939e47042dd4 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:20:41.453042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:41.456047 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:41.464504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:41.476580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:41.486361 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-97f6b762-6862-4847-ac12-4de0121b7496 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.374719 Sep 25 01:20:41.487312 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1943/3892] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:41 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:41.633455 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae34d94b-4196-4cdf-a650-e56c99a7f3b3 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "POST /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4/action" status: 202 len: 0 microversion: 2.1 time: 0.382744 Sep 25 01:20:41.637778 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1950/3893] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:20:41 2022] POST /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:20:41.661640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:41.663263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:41.693258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.695668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.699023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:41.703751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:41.706060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:41.709986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.053765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:42.054294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:42.070168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:42.070670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:42.071118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.072167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:42.072792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:42.073385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.090724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:42.113528 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87f77cf8-69ba-4949-b469-22558db98009 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1510 microversion: 2.1 time: 0.474145 Sep 25 01:20:42.116681 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1944/3894] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:41 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:42.282797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:42.284178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:42.302104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:42.303114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:42.304701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.321568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:42.323636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:42.325554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.447851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:42.462338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d0770d1e-81b1-4065-ac8f-e185c2337796 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.415272 Sep 25 01:20:42.487013 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1951/3895] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:42 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:42.516287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:42.523581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:42.531477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:42.532330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:42.533224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.534346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:42.534974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:42.535412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:42.697247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:42.708800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:42.713322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:42.717424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:42.721806 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8dc41151-a905-4d99-8266-3070c4dc5f03 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1508 microversion: 2.1 time: 0.450428 Sep 25 01:20:42.722729 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1945/3896] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:42 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:42.754358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69deb22b-550c-4fe4-ae40-3e10e70bc795 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.241896 Sep 25 01:20:42.754950 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1952/3897] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:42 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:43.146508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:43.147145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:43.165981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.169343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.169834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.177451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.178388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.182407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.386128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8f5acd84-9f62-4788-bb9a-32d2876cd0b0 req-469c743d-aa4c-4221-8c4b-70d2752e7082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "name": "network-vif-unplugged", "status": "completed", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:43.408156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f5acd84-9f62-4788-bb9a-32d2876cd0b0 req-469c743d-aa4c-4221-8c4b-70d2752e7082 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.408744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f5acd84-9f62-4788-bb9a-32d2876cd0b0 req-469c743d-aa4c-4221-8c4b-70d2752e7082 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.419779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f5acd84-9f62-4788-bb9a-32d2876cd0b0 req-469c743d-aa4c-4221-8c4b-70d2752e7082 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.459341 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8f5acd84-9f62-4788-bb9a-32d2876cd0b0 req-469c743d-aa4c-4221-8c4b-70d2752e7082 service nova] Creating event network-vif-unplugged:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h1-master-1 Sep 25 01:20:43.478973 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8f5acd84-9f62-4788-bb9a-32d2876cd0b0 req-469c743d-aa4c-4221-8c4b-70d2752e7082 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095914 Sep 25 01:20:43.483277 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1953/3898] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:20:43.497635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:43.514695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:43.533205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.537495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:43.541107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.541905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.546450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.548000 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3e89aea4-1aa2-4192-baf3-3d43b582311a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1493 microversion: 2.1 time: 0.407544 Sep 25 01:20:43.550064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.553516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1946/3899] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:43 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:43.554184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.584391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:43.585234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:43.595757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.603695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.614443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.615595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.618084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.618822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.666075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:20:43.823558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e093cb9d-8346-4239-88c5-2affda5c116a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 204 len: 0 microversion: 2.1 time: 0.234458 Sep 25 01:20:43.828620 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1947/3900] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:43 2022] DELETE /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:20:43.843326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:43.844130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:43.859820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.881347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.881636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.882400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:43.882873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:43.883304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:43.906868 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:44.050210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:44.062303 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-625cad83-0894-4223-a55c-ccf9fe75cb28 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.570264 Sep 25 01:20:44.065274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1954/3901] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:43 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:44.077475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:44.078369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:44.093259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:44.094647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:44.101547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:44.103148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:44.103785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:44.104398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:44.256852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:44.268393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:44.270888 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:44.288565 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da6005f1-f747-4a18-a38b-946600be7ad7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.218845 Sep 25 01:20:44.288565 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1955/3902] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:44 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:44.293704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:44.294339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:44.313168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:44.313721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:44.314926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:44.315756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:44.316219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:44.316653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:44.522350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:44.550260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1f76207-034b-4f02-a93c-fb8c24d9c792 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1508 microversion: 2.1 time: 0.719080 Sep 25 01:20:44.588184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1948/3903] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:43 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:44.684855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:44.708911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc263fde-6df4-463d-9083-24d2164a3335 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1499 microversion: 2.1 time: 0.407978 Sep 25 01:20:44.710845 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1956/3904] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:44 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1499 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:45.093573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:45.094278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:45.108557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:45.111262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:45.111794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:45.112683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:45.114786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:45.115432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:45.319580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:45.320332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:45.340336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:45.348954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:45.350458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:45.353047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:45.355213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:45.363029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:46.181022 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:46.424562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:46.451244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:46.455671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:46.471492 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-305cd760-6e57-49ac-9433-f3ea576f40a9 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 1.156232 Sep 25 01:20:46.472629 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1957/3905] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:45 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:46.482644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:46.486405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:46.502240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:46.502986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:46.503668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:46.504598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:46.505384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:46.506108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:46.863335 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:46.998825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:47.013972 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-652b7865-57df-4eeb-a7f6-bda676688402 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 1.925372 Sep 25 01:20:47.032911 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1949/3906] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:45 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:47.047838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:47.075940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:47.112248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:47.114957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:47.116420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:47.119424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:47.120372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:47.122180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:47.255447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:47.273476 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-77e88237-32bb-4f8a-9d09-d459f0882e6c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1451 microversion: 2.1 time: 0.799430 Sep 25 01:20:47.274094 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1958/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:46 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1451 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:47.323281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:47.341621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:47.374253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:47.383063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:47.396879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:47.397783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:47.398276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:47.398723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:47.754707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:47.772771 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-820dfe88-2535-40ca-898b-d66bffa48740 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1499 microversion: 2.1 time: 0.729824 Sep 25 01:20:47.773793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1950/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:47 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1499 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:47.791939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:47.793012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:47.815353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:47.818756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:47.821337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:47.826624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:47.827534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:47.828505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:48.025578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:48.051031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:48.056648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:48.077327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:48.122280 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cec85ffc-0dca-4e1d-82b6-c7a2bc77325f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1451 microversion: 2.1 time: 0.820163 Sep 25 01:20:48.122939 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1959/3909] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:47 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1451 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:48.135595 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a6a44da-e88d-4df0-8bac-7f9af4a7a945 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.359048 Sep 25 01:20:48.136909 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1951/3910] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:47 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:48.167501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:48.168131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:48.171616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6d5c984e-59f8-499d-adad-4b353d57b27a req-951949e6-ee2a-4441-9610-0457893bceab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022564b2-f6a4-47eb-87fe-a9e277b5f4b2", "tag": "9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:48.197488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:48.197986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:48.198648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:48.199362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:48.199809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:48.200230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:48.206829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6d5c984e-59f8-499d-adad-4b353d57b27a req-951949e6-ee2a-4441-9610-0457893bceab service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:48.207711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6d5c984e-59f8-499d-adad-4b353d57b27a req-951949e6-ee2a-4441-9610-0457893bceab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:48.208381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6d5c984e-59f8-499d-adad-4b353d57b27a req-951949e6-ee2a-4441-9610-0457893bceab service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:48.239171 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6d5c984e-59f8-499d-adad-4b353d57b27a req-951949e6-ee2a-4441-9610-0457893bceab service nova] Creating event network-changed:9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9 for instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 on n-h1-master-1 Sep 25 01:20:48.252372 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6d5c984e-59f8-499d-adad-4b353d57b27a req-951949e6-ee2a-4441-9610-0457893bceab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117887 Sep 25 01:20:48.256838 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1960/3911] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:48.801629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:48.802690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:48.828506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:48.832141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:48.832894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:48.833915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:48.835032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:48.835725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:48.871539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:48.883300 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7d3d325-e0f4-465f-b903-7d1c4b034eb8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.733143 Sep 25 01:20:48.885711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1952/3912] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:48 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:49.172682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:49.174476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:49.191795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4d799cd1354609a8604a2db0fc12f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714fdb4cc705469688b389dab75ce03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:49.196286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:49.196952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:49.198017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:49.200562 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ac6e5289-83ae-42e0-8502-bfa9afec2176 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 200 len: 1457 microversion: 2.1 time: 0.404119 Sep 25 01:20:49.200763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:49.201364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:49.203004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:49.208809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1961/3913] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:48 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 1457 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:49.377024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:49.394496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:49.399304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:49.416431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8d1a3a08-e975-4f75-b8da-9a19110c2be1 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.245328 Sep 25 01:20:49.432386 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1953/3914] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:49 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:20:49.927254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:49.932767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:49.958629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:49.960906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:49.962373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:49.966053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:49.966821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:49.967616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.248879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.250420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.274128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.274955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.278805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.281292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.281948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.283828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.339068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:50.348572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6a29609-23fb-4471-91a8-25d5609c04c8 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.438889 Sep 25 01:20:50.349589 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1962/3915] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:49 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:50.356609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-698cbd32-d90b-4169-a8c3-01ac3100a918 req-95c5aafe-a057-40f7-885e-b9d2c27bea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5b488a-9b1e-40be-8c71-939e47042dd4", "name": "network-vif-deleted", "tag": "75a13e85-9964-4262-8f26-bdb18aff8000"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:50.358938 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 HTTP/1.1 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ce5b488a-9b1e-40be-8c71-939e47042dd4'} Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.360635 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:50.364463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1eb11fe5-66d6-4658-913f-2bd7bd8d5f73 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 404 len: 111 microversion: 2.1 time: 0.117464 Sep 25 01:20:50.372986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1954/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:50 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:20:50.381236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-698cbd32-d90b-4169-a8c3-01ac3100a918 req-95c5aafe-a057-40f7-885e-b9d2c27bea7d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.382130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.382641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.385979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-698cbd32-d90b-4169-a8c3-01ac3100a918 req-95c5aafe-a057-40f7-885e-b9d2c27bea7d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.386700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-698cbd32-d90b-4169-a8c3-01ac3100a918 req-95c5aafe-a057-40f7-885e-b9d2c27bea7d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.393967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.399268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.406364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.410144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.411023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.411717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.416364 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-698cbd32-d90b-4169-a8c3-01ac3100a918 req-95c5aafe-a057-40f7-885e-b9d2c27bea7d service nova] Creating event network-vif-deleted:75a13e85-9964-4262-8f26-bdb18aff8000 for instance ce5b488a-9b1e-40be-8c71-939e47042dd4 on n-h2-master-1 Sep 25 01:20:50.433351 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-698cbd32-d90b-4169-a8c3-01ac3100a918 req-95c5aafe-a057-40f7-885e-b9d2c27bea7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080273 Sep 25 01:20:50.439170 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1963/3917] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:20:50.450767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.455557 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.465539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 HTTP/1.1 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ce5b488a-9b1e-40be-8c71-939e47042dd4'} Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:50.470110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.473694 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.476935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:50.481815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7f8d7e93-4559-48f4-ab3f-4337992b08a9 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 404 len: 111 microversion: 2.1 time: 0.107745 Sep 25 01:20:50.489799 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1955/3918] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:50 2022] DELETE /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:50.494041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.495109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.495784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.504210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.505438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.506128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.506795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.510830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: ce5b488a-9b1e-40be-8c71-939e47042dd4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.548520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.549090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.549667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.550648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.551216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.551748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.593222 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 HTTP/1.1 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ce5b488a-9b1e-40be-8c71-939e47042dd4'} Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.601737 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance ce5b488a-9b1e-40be-8c71-939e47042dd4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:50.609812 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4b01abd-c76b-4c74-90cb-2c61afd1aee2 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4" status: 404 len: 111 microversion: 2.1 time: 0.113263 Sep 25 01:20:50.611635 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1956/3919] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:50 2022] GET /compute/v2.1/servers/ce5b488a-9b1e-40be-8c71-939e47042dd4 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:50.669701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.670619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.734395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.735062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.735970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.737110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.739290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.742850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.777207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:50.804762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:50.810004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 HTTP/1.1 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3956414a-ef51-449f-b95e-c4feae10fdf9'} Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:50.812874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.820331 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.824118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:50.826606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:50.829580 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0937104e-d91d-4f03-b1a9-a80b3749b5c4 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 404 len: 111 microversion: 2.1 time: 0.209624 Sep 25 01:20:50.837926 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1957/3920] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:50 2022] DELETE /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:50.846955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.848899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e5369eb-a855-42d6-9e9f-02dfa8b027e7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.400863 Sep 25 01:20:50.849786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3956414a-ef51-449f-b95e-c4feae10fdf9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.857991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.858792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.859540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.861056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.862097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.862801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.882808 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1964/3921] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:50 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:50.888489 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 HTTP/1.1 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3956414a-ef51-449f-b95e-c4feae10fdf9'} Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:50.892638 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. Sep 25 01:20:50.899266 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:50.900833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 3956414a-ef51-449f-b95e-c4feae10fdf9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:50.903085 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2b983ff7-fa97-4fab-985a-c822ff18d391 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9" status: 404 len: 111 microversion: 2.1 time: 0.063335 Sep 25 01:20:50.913106 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1958/3922] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:50 2022] GET /compute/v2.1/servers/3956414a-ef51-449f-b95e-c4feae10fdf9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:50.918917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:50.921357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:50.955358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.958780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.959318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:50.960059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:50.960700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:50.970973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.106914 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a HTTP/1.1 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3d11c9f1-7562-45de-924d-f168ada2645a'} Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:51.113315 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.117674 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.127301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:51.139403 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e754e70-4f06-4d64-841b-2b0046355b9a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 404 len: 111 microversion: 2.1 time: 0.222617 Sep 25 01:20:51.168271 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1965/3923] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:50 2022] DELETE /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:51.176276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.177383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 3d11c9f1-7562-45de-924d-f168ada2645a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.209702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.210442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.215172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.216597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.218214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.220326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.280518 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a HTTP/1.1 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3d11c9f1-7562-45de-924d-f168ada2645a'} Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.287820 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 3d11c9f1-7562-45de-924d-f168ada2645a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:51.292233 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9bab3ba-442e-4a0c-8f40-974df7816486 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a" status: 404 len: 111 microversion: 2.1 time: 0.118258 Sep 25 01:20:51.300435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.300948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.306419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1959/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:51 2022] GET /compute/v2.1/servers/3d11c9f1-7562-45de-924d-f168ada2645a => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:51.320015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.323919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.324503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.325277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.325802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.331221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.387716 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.399332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.399976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b HTTP/1.1 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4031dcfb-fe82-40d3-a41b-59059dc32b7b'} Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:51.411940 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.415472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:51.425154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b96f0b30-435c-4b03-8e8f-f2643780ccea tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 404 len: 111 microversion: 2.1 time: 0.117944 Sep 25 01:20:51.426725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1966/3925] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:51 2022] DELETE /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:20:51.452576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.454001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.455718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.458446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.474488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.481712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.482500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.484916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 4031dcfb-fe82-40d3-a41b-59059dc32b7b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.526325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.539046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.549142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.553331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.559440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.567608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.642430 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b HTTP/1.1 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4031dcfb-fe82-40d3-a41b-59059dc32b7b'} Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.651719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. Sep 25 01:20:51.656091 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.658575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 4031dcfb-fe82-40d3-a41b-59059dc32b7b could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:51.662668 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d17e821-b82a-4608-b204-e85bd2eb22ee tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b" status: 404 len: 111 microversion: 2.1 time: 0.227447 Sep 25 01:20:51.676559 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1967/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:51 2022] GET /compute/v2.1/servers/4031dcfb-fe82-40d3-a41b-59059dc32b7b => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:51.682237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.686881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.701797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.705354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.706125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.711099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.711917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.712769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.752157 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 HTTP/1.1 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: exception: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'cdbf7af7-817a-49bc-9f4e-14954fe00b78'} Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:51.756049 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.762599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.766296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:51.771790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-691405f0-f6a6-4d0d-aa30-5c472fd84f74 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78" status: 404 len: 111 microversion: 2.1 time: 0.093335 Sep 25 01:20:51.772763 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1968/3927] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:51 2022] DELETE /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:51.787545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.790131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: cdbf7af7-817a-49bc-9f4e-14954fe00b78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.806246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.812510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.813468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.815448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.817790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.819155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.864642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 HTTP/1.1 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: exception: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'cdbf7af7-817a-49bc-9f4e-14954fe00b78'} Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:51.875958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. Sep 25 01:20:51.880735 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:20:51.887304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance cdbf7af7-817a-49bc-9f4e-14954fe00b78 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:51.889288 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-169f163c-98a5-4811-83ae-0264d86f34e0 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78" status: 404 len: 111 microversion: 2.1 time: 0.111524 Sep 25 01:20:51.893530 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1969/3928] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:51 2022] GET /compute/v2.1/servers/cdbf7af7-817a-49bc-9f4e-14954fe00b78 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:51.912470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:51.918182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:51.956493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.958226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.958798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:51.961060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:51.961667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:51.962785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:52.513821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:52.571701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:52.588239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:52.610630 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8672ccfd-7eaa-478e-8d64-2fb99a57fe8e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.714180 Sep 25 01:20:52.612206 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1970/3929] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:51 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:52.761670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:52.774363 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-799518bd-a760-44ba-9078-e474a5599540 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 1.382393 Sep 25 01:20:52.774924 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1960/3930] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:51 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:53.691180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:53.692208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:53.725365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:53.730366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:53.730366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:53.730366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:53.730366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:53.730366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:53.802522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:53.803157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:53.835740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:53.839326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:53.839834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:53.843886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:53.844971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:53.846176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:54.209319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:54.213294 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:54.227469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:54.231874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:54.252429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff205cf3-62e0-4a5b-96a7-2a3c94f81d64 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.601841 Sep 25 01:20:54.253029 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1971/3931] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:53 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:54.367811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:54.384415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-babea8e6-6b77-4640-8d11-06cc642e8cba tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.586735 Sep 25 01:20:54.401486 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1961/3932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:53 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:55.281513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:55.283030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:55.298400 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:55.309511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:55.310325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:55.313813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:55.317816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:55.323019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:55.325605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:55.410716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:55.425114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:55.442546 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:20:55.444512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:55.445355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:55.446267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:55.447483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:55.448219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:55.448881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:55.485987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:55.501752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:55.503293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:55.519262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c5a1599-2a98-4494-a7c3-16d09dc77877 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.237823 Sep 25 01:20:55.525717 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1972/3933] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:55 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:55.787105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-79e9fe50-17cb-445c-b871-5dc36dc17874 req-08f5fb17-0fa4-4201-8257-0348a7d9ed3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022564b2-f6a4-47eb-87fe-a9e277b5f4b2", "name": "network-vif-plugged", "status": "completed", "tag": "9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:55.817561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-79e9fe50-17cb-445c-b871-5dc36dc17874 req-08f5fb17-0fa4-4201-8257-0348a7d9ed3c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:55.817840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-79e9fe50-17cb-445c-b871-5dc36dc17874 req-08f5fb17-0fa4-4201-8257-0348a7d9ed3c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:55.822881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-79e9fe50-17cb-445c-b871-5dc36dc17874 req-08f5fb17-0fa4-4201-8257-0348a7d9ed3c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:55.882355 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-79e9fe50-17cb-445c-b871-5dc36dc17874 req-08f5fb17-0fa4-4201-8257-0348a7d9ed3c service nova] Creating event network-vif-plugged:9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9 for instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 on n-h1-master-1 Sep 25 01:20:55.904002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-79e9fe50-17cb-445c-b871-5dc36dc17874 req-08f5fb17-0fa4-4201-8257-0348a7d9ed3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124936 Sep 25 01:20:55.907694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:55.909798 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1973/3934] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:20:55.916359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7f7411a3-1e33-43d6-acbf-42f09fa5b90f tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.510582 Sep 25 01:20:55.926035 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1962/3935] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:55 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:56.550970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:56.551683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:56.578016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:56.578522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:56.579027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:56.591901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:56.592417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:56.592874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:56.892340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:56.913340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:56.925099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:56.951549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:56.952840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:56.959571 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-242b7ffe-1e8a-4dc4-beb8-e8e8ffed69d5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.413619 Sep 25 01:20:56.965836 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1974/3936] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:56 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:56.967038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:56.968152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:56.968848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:56.970349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:56.970974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:56.971713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:57.258227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:57.279863 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36db286f-43aa-4dc8-9c2d-fcd7c56ff172 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1308 microversion: 2.1 time: 0.331270 Sep 25 01:20:57.309397 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1963/3937] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:56 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:20:57.996023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:57.996641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:58.012092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.012641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.013509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.016516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.018252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.018707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.202254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:58.223366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:58.224814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:58.253549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-505c6421-07a3-4683-b369-5deb25340867 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.261355 Sep 25 01:20:58.254148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1975/3938] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:57 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:58.312717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:58.314695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:58.338015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.340452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.341107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.343404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.343651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.344926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.712094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:58.723967 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a1dc7f8-fc61-496c-a5b6-c39f9c22e68a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1489 microversion: 2.1 time: 0.417853 Sep 25 01:20:58.725103 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1964/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:58 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1489 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:20:58.749903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-947036518"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:20:58.753130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:58.773711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.774336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.775027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.776081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.777728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.778222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.971561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:58.972443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:58.987898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.988728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.990329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:58.994215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:58.994976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:58.995639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.024846 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c HTTP/1.1 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: exception: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c'} Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:59.027114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.030717 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.036571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:59.037908 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-112adb94-297c-4cc3-8d66-8457b4abf34c tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 404 len: 111 microversion: 2.1 time: 0.072425 Sep 25 01:20:59.039153 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1965/3940] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:58 2022] DELETE /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:59.054406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:59.058246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:59.080349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.087033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.087778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.089736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.092734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.093644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.150718 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c HTTP/1.1 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: exception: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c'} Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.155093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. Sep 25 01:20:59.159686 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.166583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:59.167819 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86682980-4780-498c-9237-b0cf3d565c8a tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c" status: 404 len: 111 microversion: 2.1 time: 0.123557 Sep 25 01:20:59.171216 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1966/3941] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:59 2022] GET /compute/v2.1/servers/b8a1b252-2ca5-43aa-b93e-5e19c7ed8d0c => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:59.187246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:59.194081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:59.211620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.215561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.217611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.220296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.224040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.226647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.276902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a HTTP/1.1 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5ff126d3-3f79-4fe2-8a59-b53795308c5a'} Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:59.287765 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.294376 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.298998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:59.306047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ad2cc90-e86f-45bb-861f-d7f9a3af346f tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 404 len: 111 microversion: 2.1 time: 0.128062 Sep 25 01:20:59.313874 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1967/3942] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:20:59 2022] DELETE /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:20:59.342032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:59.353667 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:59.381833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.384059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.384701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.387475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.388122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.394925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.616076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:59.628213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:59.638594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:20:59.659910 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b183096a-b6e3-44cb-81a1-0e0469374959 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.336172 Sep 25 01:20:59.673700 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1968/3943] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:20:59 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:20:59.685551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:20:59.686264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] [instance: 5ff126d3-3f79-4fe2-8a59-b53795308c5a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:20:59.698869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.710623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.711048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.711817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:20:59.712284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:20:59.712929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:20:59.794017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] HTTP exception thrown: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Request method failure captured: Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a HTTP/1.1 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6uOvII6w6HHu6SgqY-vHVh48Vmgz7pkL0Z159PXceRAkFUIdIHZq6yzhnTo5yj1I7FViQBg_nphoTkv61tG5FctRtvB7V6rcRTPVqOs1SJSrwTUjCOtOBfADOG3YpiSDuG8eOugFd2NdHRW8-IawgxfrljVx6EqYRd2AcRXs1QZxuE Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/714fdb4cc705469688b389dab75ce03e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_714fdb4cc705469688b389dab75ce03e"}]}] Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 714fdb4cc705469688b389dab75ce03e Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-967174080 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8c4d799cd1354609a8604a2db0fc12f1 Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-967174080-project Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5ff126d3-3f79-4fe2-8a59-b53795308c5a'} Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:20:59.804596 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] Returning 404 to user: Instance 5ff126d3-3f79-4fe2-8a59-b53795308c5a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:20:59.808133 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fef92383-8827-451b-8818-8fc1e60a0057 tempest-DeleteServersTestJSON-967174080 tempest-DeleteServersTestJSON-967174080-project] 10.222.0.16 "GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a" status: 404 len: 111 microversion: 2.1 time: 0.141735 Sep 25 01:20:59.821884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1969/3944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:20:59 2022] GET /compute/v2.1/servers/5ff126d3-3f79-4fe2-8a59-b53795308c5a => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:00.697775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:00.698400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:00.711382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:00.711889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:00.712347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:00.713070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:00.713589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:00.714026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:01.037146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:01.051343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:01.052819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:01.068147 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62ad5cf4-1aa8-4738-90c6-d4ef66e4b13c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.374185 Sep 25 01:21:01.093428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1970/3945] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:00 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:21:02.115521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:02.116159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:02.132487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:02.133292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:02.133992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:02.135155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:02.135888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:02.136529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:02.163007 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:02.258570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:02.325817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:02.327411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:02.357428 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2b4ec1b-109d-465e-806d-72e538f59fa5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.246950 Sep 25 01:21:02.365258 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1971/3946] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:02 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:21:02.777950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:02.778553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:02.811100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:02.811616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:02.812074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:02.812874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:02.814255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:02.822240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:02.887044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lazy-loading 'flavor' on Instance uuid 1fb6535d-78e0-404a-8bf1-9a61d23b7710 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:21:02.950032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'shelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state shelved_offloaded Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 14 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: {"shelve": {}} Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'shelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state shelved_offloaded Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'shelve': {}}} Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:21:02.951904 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state shelved_offloaded Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state shelved_offloaded Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'shelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state shelved_offloaded {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:02.955918 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c06377d2-2319-47cd-8716-58b981dfc0ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 155 microversion: 2.1 time: 0.179574 Sep 25 01:21:02.982037 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1972/3947] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:02 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 155 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:21:02.988263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:02.988881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:03.016033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:03.016623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:03.017067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:03.022079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:03.022614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:03.023001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:03.175644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122384) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:21:03.385337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5be8506d-6a72-492b-a24f-3989931eeefb tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 202 len: 0 microversion: 2.1 time: 0.402000 Sep 25 01:21:03.386877 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1973/3948] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:02 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:21:03.400513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:03.406494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:03.443990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:03.449965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:03.449965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:03.449965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:03.449965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:03.449965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:03.713425 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a7d55bc-3a73-4832-a947-28b68f0f4bdd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "POST /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2/action" status: 202 len: 0 microversion: 2.1 time: 4.967334 Sep 25 01:21:03.718942 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1976/3949] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:20:58 2022] POST /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2/action => generated 0 bytes in 4972 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:21:03.740461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:03.741332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:03.775741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:03.786381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:03.789765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:03.791513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:03.793561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:03.794417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:04.017615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:04.028781 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05ff685d-fef3-4760-99eb-f276290b8b75 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1681 microversion: 2.1 time: 0.632122 Sep 25 01:21:04.046418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1974/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:03 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1681 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:04.062208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:04.070322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:04.116647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:04.125302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:04.129823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:04.130595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:04.131076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:04.131512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:04.309263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:04.318385 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b32660b1-b9ac-419c-b2c6-c3b5b0b4f469 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1459 microversion: 2.1 time: 0.596960 Sep 25 01:21:04.325303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1977/3951] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:03 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1459 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:04.333349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f7ea35d-327d-4016-946f-82a083b468bd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beaf581f0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:04.391498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:04.409481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:04.410996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:04.426840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c17d0ee9-fb1b-4542-a540-a9011e9e8bf4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.376908 Sep 25 01:21:04.455238 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1975/3952] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:04 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:04.704155 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f7ea35d-327d-4016-946f-82a083b468bd tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162" status: 200 len: 1411 microversion: 2.1 time: 0.373933 Sep 25 01:21:04.710573 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1978/3953] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:04 2022] GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 => generated 1411 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:04.728104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1d7de78-80e5-4394-b9ad-cccc8563826e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bea9cd310>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:04.859600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1d7de78-80e5-4394-b9ad-cccc8563826e tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162" status: 200 len: 1411 microversion: 2.1 time: 0.136147 Sep 25 01:21:04.876474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b73a3c00-2358-407b-b045-785735990fa7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebf27670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:04.882599 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1976/3954] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:04 2022] GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:05.073463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:05.074098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:05.087585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:05.092336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:05.095845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:05.099024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:05.099531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:05.099948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:05.372496 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b73a3c00-2358-407b-b045-785735990fa7 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162" status: 204 len: 0 microversion: 2.1 time: 0.501732 Sep 25 01:21:05.376401 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1979/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:04 2022] DELETE /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:05.381937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:05.382727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:05.417781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:05.418619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:05.419220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:05.432441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:05.433500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:05.434010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:05.858294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:05.872893 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-230cb610-c9a6-4e34-a4a6-181b651a3cd2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.803141 Sep 25 01:21:05.891414 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1977/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:05 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:05.913304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9233d76-8e13-4dde-b7ec-036f8fc5a493 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bea9cdca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:05.971836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a9233d76-8e13-4dde-b7ec-036f8fc5a493 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Image not found. Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9233d76-8e13-4dde-b7ec-036f8fc5a493 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 HTTP/1.1 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e6dd8a3c-0827-4299-a697-580427b56162'} Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e6dd8a3c-0827-4299-a697-580427b56162 Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 25 01:21:05.974093 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6dd8a3c-0827-4299-a697-580427b56162 could not be found. Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:21:05.977640 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:05.992703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9233d76-8e13-4dde-b7ec-036f8fc5a493 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:05.994815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a9233d76-8e13-4dde-b7ec-036f8fc5a493 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162" status: 404 len: 62 microversion: 2.1 time: 0.102083 Sep 25 01:21:06.000414 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1978/3957] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 25 01:21:05 2022] GET /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:21:06.013233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:06.023086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:06.058666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:06.063953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:06.069593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:06.072633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:06.083844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:06.086197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:06.180296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:06.194740 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2956b2c4-16b5-486a-b6e4-6b9bd2a80eb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1459 microversion: 2.1 time: 0.812371 Sep 25 01:21:06.217440 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1980/3958] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:05 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1459 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:06.217440 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1357979895"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:06.217440 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:06.258916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:06.259418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:06.259861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:06.260600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:06.261037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:06.261491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:06.315289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:06.330338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:06.331917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:06.355912 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee2a9d27-c129-4b47-be78-30f943a0425a tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.353048 Sep 25 01:21:06.356491 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1979/3959] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:06 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:06.373277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:06.378152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:06.399405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:06.401843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:06.402449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:06.404002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:06.404795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:06.409339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.043897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:07.064059 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-203d2c80-4d9b-4b69-893a-9a562fed839d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.854510 Sep 25 01:21:07.076715 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1981/3960] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:06 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 25 01:21:07.089135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:07.091528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:07.102455 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-852ac9c5-cbd5-46d7-8fca-d1a37243d744 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1507 microversion: 2.1 time: 0.737081 Sep 25 01:21:07.106909 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1980/3961] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:06 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1507 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:07.115983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:07.118429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:07.121339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.123146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:07.125608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:07.130111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.247861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:07.250632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:07.284354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:07.299675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:07.300796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.301876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:07.302573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:07.316769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.680572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:07.694226 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07b63eed-a4f9-4520-9b3f-1a8c5774ca99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.615543 Sep 25 01:21:07.717552 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1982/3962] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:07 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:07.742585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:07.743207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:07.775285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:07.781990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:07.783705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.786197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:07.791906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:07.792386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:07.996685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:08.025935 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6dc95125-ac61-49f1-b419-67d5ebb8b962 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1459 microversion: 2.1 time: 0.779664 Sep 25 01:21:08.030817 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1981/3963] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:07 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1459 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:08.110669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9c867326-cd32-4857-b58e-157a03b52fd6 req-629eb09a-6ad5-4498-a53b-3f6937f8c789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-unplugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:08.115360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:08.123988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:08.139919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9c867326-cd32-4857-b58e-157a03b52fd6 req-629eb09a-6ad5-4498-a53b-3f6937f8c789 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:08.140407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9c867326-cd32-4857-b58e-157a03b52fd6 req-629eb09a-6ad5-4498-a53b-3f6937f8c789 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:08.146327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:08.146896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9c867326-cd32-4857-b58e-157a03b52fd6 req-629eb09a-6ad5-4498-a53b-3f6937f8c789 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:08.167839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e4f4f74-d49e-42f8-bce3-31183e1ec711 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.470112 Sep 25 01:21:08.181346 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1983/3964] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:07 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:08.197934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:08.202316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:08.208832 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9c867326-cd32-4857-b58e-157a03b52fd6 req-629eb09a-6ad5-4498-a53b-3f6937f8c789 service nova] Creating event network-vif-unplugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:21:08.226400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:08.228592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:08.230068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:08.233983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9c867326-cd32-4857-b58e-157a03b52fd6 req-629eb09a-6ad5-4498-a53b-3f6937f8c789 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128289 Sep 25 01:21:08.236068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:08.236561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:08.239783 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1982/3965] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:21:08.241847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:08.736959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:08.737908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:08.751333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:08.761768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:08.764599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:08.767538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:08.771631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:08.773811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:08.776143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:08.776629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-baaf0ac9-68fc-480e-a39c-a2f23469e596 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1502 microversion: 2.1 time: 0.593786 Sep 25 01:21:08.777319 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1984/3966] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:08 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1502 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:09.060399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:09.061039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:09.084804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:09.088896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:09.089446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:09.111018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:09.111717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:09.116892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:09.226026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:09.236616 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6ce2f5ef-624e-44ca-9bb7-f35863084ca1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.509907 Sep 25 01:21:09.283508 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1983/3967] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:08 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:09.306397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:09.307015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:09.331983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:09.332479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:09.335283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:09.336817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:09.337467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:09.338047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:09.526453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:09.542271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:09.542271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:09.558365 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-671fa633-5b60-4f38-979c-1bef98a2e608 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.274715 Sep 25 01:21:09.577429 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1984/3968] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:09 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:09.683301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:09.709195 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82d824c8-ab1c-4236-a4b2-be7fd4b5c72d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.654300 Sep 25 01:21:09.709790 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1985/3969] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:09 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:09.804429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:09.805048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:09.824353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:09.824833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:09.825265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:09.826170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:09.826470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:09.835943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.298674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:10.300185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:10.317037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:10.331240 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-721083b2-9cea-4db4-8323-0a2b94c9151a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1489 microversion: 2.1 time: 0.524734 Sep 25 01:21:10.331904 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1985/3970] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:09 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1489 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:10.335442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.341141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.341695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.342463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.342925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.343348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.369689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:10.370478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:10.383542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.384495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.385464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.386415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.389529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.393653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.450023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:21:10.586978 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7e0c2236-666c-4ef0-a38e-8b6211869244 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 204 len: 0 microversion: 2.1 time: 0.219987 Sep 25 01:21:10.588309 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1986/3971] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:21:10 2022] DELETE /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:10.602279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:10.610189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:10.620841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.622175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.624054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.625103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.625971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.626839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:10.823691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:10.840981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:10.846282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:10.856673 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3272610f-04f1-44c1-b81f-bc5924a3341b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.265738 Sep 25 01:21:10.857944 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1987/3972] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:10 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:10.886215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-996d3260-86f0-4be6-8424-4bd195f3cf97 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7beaa4cb80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:10.917635 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-996d3260-86f0-4be6-8424-4bd195f3cf97 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Image not found. Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-996d3260-86f0-4be6-8424-4bd195f3cf97 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 HTTP/1.1 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e6dd8a3c-0827-4299-a697-580427b56162'} Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e6dd8a3c-0827-4299-a697-580427b56162 to delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6dd8a3c-0827-4299-a697-580427b56162 could not be found. Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.919661 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:10.924204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-996d3260-86f0-4be6-8424-4bd195f3cf97 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:10.925577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-996d3260-86f0-4be6-8424-4bd195f3cf97 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162" status: 404 len: 62 microversion: 2.1 time: 0.065633 Sep 25 01:21:10.930384 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1988/3973] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:10 2022] DELETE /compute/v2.1/images/e6dd8a3c-0827-4299-a697-580427b56162 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:21:10.939682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9de3e6c6-d17d-424b-9ce4-33ee346ab457 req-430836ef-bf56-4333-9f2c-40eedb7a69c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022564b2-f6a4-47eb-87fe-a9e277b5f4b2", "name": "network-vif-plugged", "status": "completed", "tag": "9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:10.981217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9de3e6c6-d17d-424b-9ce4-33ee346ab457 req-430836ef-bf56-4333-9f2c-40eedb7a69c0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:10.982647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9de3e6c6-d17d-424b-9ce4-33ee346ab457 req-430836ef-bf56-4333-9f2c-40eedb7a69c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:10.984153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9de3e6c6-d17d-424b-9ce4-33ee346ab457 req-430836ef-bf56-4333-9f2c-40eedb7a69c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:11.017331 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:11.019362 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9de3e6c6-d17d-424b-9ce4-33ee346ab457 req-430836ef-bf56-4333-9f2c-40eedb7a69c0 service nova] Creating event network-vif-plugged:9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9 for instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 on n-h1-master-1 Sep 25 01:21:11.041268 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9de3e6c6-d17d-424b-9ce4-33ee346ab457 req-430836ef-bf56-4333-9f2c-40eedb7a69c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109541 Sep 25 01:21:11.045756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1989/3974] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:11.057996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:11.059170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:11.074204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:11.079728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:11.081089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:11.087075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:11.087808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:11.088679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:11.640450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:11.661672 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-479112f1-852b-46d2-9af3-93758f9bc535 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1686 microversion: 2.1 time: 1.366702 Sep 25 01:21:11.664815 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1986/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:10 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1686 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:11.674091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:11.675134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:11.700256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:11.702802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:11.704771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:11.706811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:11.709209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:11.710701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:11.784326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:21:11.914497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:11.930521 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0765eb62-6cc0-435c-a4b3-b53e8cf7d293 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.883147 Sep 25 01:21:11.931477 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1990/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:11 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:11.939301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:11.939924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:11.942490 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:11.954433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:11.954964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:11.955803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:11.956555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:11.957051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:11.957546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:12.003647 n-d-master-1 devstack@n-api.service[122385]: INFO nova.compute.api [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Instance is already in deleting state, ignoring this request Sep 25 01:21:12.004562 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dee279b1-ca5f-4592-a10c-49cd71637709 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 204 len: 0 microversion: 2.1 time: 0.338494 Sep 25 01:21:12.005158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1987/3977] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:21:11 2022] DELETE /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:12.012924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:12.021349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:12.040006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:12.047899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:12.051192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:12.052110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:12.053356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:12.053990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:12.108174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:12.132074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:12.137502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:12.154393 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5c96a55-0705-4d07-b089-306d7ab551ee tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.221764 Sep 25 01:21:12.155272 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1991/3978] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:11 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:12.368696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:12.391027 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b216570-dc60-4458-9fdf-73dfafef0b82 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1495 microversion: 2.1 time: 0.381672 Sep 25 01:21:12.406458 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1988/3979] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:12 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1495 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:12.686666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:12.687529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:12.697130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:12.698281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:12.699173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:12.701357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:12.704199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:12.705939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:12.960885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:12.961772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:12.967587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:12.968090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:12.968534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:12.973260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:12.973826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:12.974271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:13.442154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:13.459211 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-26253ad1-267d-4260-8579-d5beeaa58002 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1686 microversion: 2.1 time: 0.773827 Sep 25 01:21:13.463661 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1992/3980] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:12 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1686 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:13.470589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-380c0468-92fe-4be8-8259-e58f59d59da3 req-a4cdb970-9d14-4d4c-8676-25775a5cc452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022564b2-f6a4-47eb-87fe-a9e277b5f4b2", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:13.497854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-380c0468-92fe-4be8-8259-e58f59d59da3 req-a4cdb970-9d14-4d4c-8676-25775a5cc452 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:13.501639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-380c0468-92fe-4be8-8259-e58f59d59da3 req-a4cdb970-9d14-4d4c-8676-25775a5cc452 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:13.502328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-380c0468-92fe-4be8-8259-e58f59d59da3 req-a4cdb970-9d14-4d4c-8676-25775a5cc452 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:13.538652 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-380c0468-92fe-4be8-8259-e58f59d59da3 req-a4cdb970-9d14-4d4c-8676-25775a5cc452 service nova] Creating event network-vif-unplugged:9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9 for instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 on n-h1-master-1 Sep 25 01:21:13.550164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-380c0468-92fe-4be8-8259-e58f59d59da3 req-a4cdb970-9d14-4d4c-8676-25775a5cc452 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083849 Sep 25 01:21:13.552709 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1993/3981] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:13.564290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:13.566645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:13.584311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:13.585152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:13.587845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:13.588773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:13.589383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:13.590008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:13.600823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:13.618343 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67621539-1c34-45fa-a188-d2889bd604ca tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.663338 Sep 25 01:21:13.621884 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1989/3982] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:12 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:13.749995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:13.778930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:13.783792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:13.789766 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d415f6b5-c5af-4a1a-be12-4c57e277688e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.234587 Sep 25 01:21:13.791169 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1994/3983] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:13 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:13.796119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:13.797019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:13.817211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:13.818922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:13.820137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:13.821756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:13.822340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:13.822831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:13.964097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8a0d4001-41a1-4e47-a913-38e094109c9d req-c45df857-f7a0-48e3-acef-97d68ba056f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:13.988612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8a0d4001-41a1-4e47-a913-38e094109c9d req-c45df857-f7a0-48e3-acef-97d68ba056f8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:13.989622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8a0d4001-41a1-4e47-a913-38e094109c9d req-c45df857-f7a0-48e3-acef-97d68ba056f8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:13.990352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8a0d4001-41a1-4e47-a913-38e094109c9d req-c45df857-f7a0-48e3-acef-97d68ba056f8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:14.022930 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8a0d4001-41a1-4e47-a913-38e094109c9d req-c45df857-f7a0-48e3-acef-97d68ba056f8 service nova] Creating event network-changed:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h2-master-1 Sep 25 01:21:14.036249 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8a0d4001-41a1-4e47-a913-38e094109c9d req-c45df857-f7a0-48e3-acef-97d68ba056f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413093 Sep 25 01:21:14.045931 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1990/3984] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:14.494655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:14.495400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:14.518249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:14.523158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:14.526663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:14.528816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:14.530275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:14.535980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:14.555002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3394e2971741d7aa5956de0d4afba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9172549e19145c5b2201cfa5ef4eddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:14.586414 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d45c147-7171-44e2-ae30-e932b6234a1c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 200 len: 1495 microversion: 2.1 time: 0.793700 Sep 25 01:21:14.588615 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1995/3985] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:13 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 1495 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:14.644640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:14.645438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:14.658145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:14.663331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:14.664771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:14.665828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:14.670228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:14.672260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:15.380180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:15.413653 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a04c6485-086c-40eb-9ee6-c264ce21e08b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.771696 Sep 25 01:21:15.414416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:15.415797 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1996/3986] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:14 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:15.426698 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24fd8923-8675-4cb5-9d97-2f6781f791b5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1681 microversion: 2.1 time: 0.938793 Sep 25 01:21:15.443087 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1991/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:14 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1681 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:15.448496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:15.449608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:15.504223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:15.504798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:15.507830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:15.508606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:15.514376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:15.514862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:15.573845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b9ccb4ac-0afe-459c-9281-d16e27e06dc8 req-e18bcc46-c65c-4b19-8cff-0c3d6d44c855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-plugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:15.631299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b9ccb4ac-0afe-459c-9281-d16e27e06dc8 req-e18bcc46-c65c-4b19-8cff-0c3d6d44c855 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:15.632425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b9ccb4ac-0afe-459c-9281-d16e27e06dc8 req-e18bcc46-c65c-4b19-8cff-0c3d6d44c855 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:15.633748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b9ccb4ac-0afe-459c-9281-d16e27e06dc8 req-e18bcc46-c65c-4b19-8cff-0c3d6d44c855 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:15.718583 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b9ccb4ac-0afe-459c-9281-d16e27e06dc8 req-e18bcc46-c65c-4b19-8cff-0c3d6d44c855 service nova] Creating event network-vif-plugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:21:15.754109 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b9ccb4ac-0afe-459c-9281-d16e27e06dc8 req-e18bcc46-c65c-4b19-8cff-0c3d6d44c855 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176367 Sep 25 01:21:15.757787 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1992/3988] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:21:15.791110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:15.791863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 022564b2-f6a4-47eb-87fe-a9e277b5f4b2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:15.825514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:15.826717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:15.830427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:15.833050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:15.836443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:15.838024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:15.840106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:15.863396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:15.870025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:15.896398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 could not be found. Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 HTTP/1.1 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 could not be found. Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '022564b2-f6a4-47eb-87fe-a9e277b5f4b2'} Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 could not be found. Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 could not be found. Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:15.899463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 could not be found. Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:15.903242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:15.908907 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48ee9dcd-f4df-4640-ba4d-3dfcf34a9149 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2" status: 404 len: 111 microversion: 2.1 time: 0.147213 Sep 25 01:21:15.912531 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c77301fd-66b0-486b-8774-49b08f280d04 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.473061 Sep 25 01:21:15.913138 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1993/3989] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:15 2022] GET /compute/v2.1/servers/022564b2-f6a4-47eb-87fe-a9e277b5f4b2 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:15.926936 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1997/3990] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:15 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:15.933073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12c4ed76-7aaa-46ce-9fa7-1786b17f22a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bebabd940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:16.352397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bc54ff76-f8e4-4621-804a-98490da92c32 req-52c8bd09-5162-44e5-99ed-c6909e869ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022564b2-f6a4-47eb-87fe-a9e277b5f4b2", "name": "network-vif-deleted", "tag": "9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:16.380715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc54ff76-f8e4-4621-804a-98490da92c32 req-52c8bd09-5162-44e5-99ed-c6909e869ad8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:16.383956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc54ff76-f8e4-4621-804a-98490da92c32 req-52c8bd09-5162-44e5-99ed-c6909e869ad8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:16.385628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc54ff76-f8e4-4621-804a-98490da92c32 req-52c8bd09-5162-44e5-99ed-c6909e869ad8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:16.430431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bc54ff76-f8e4-4621-804a-98490da92c32 req-52c8bd09-5162-44e5-99ed-c6909e869ad8 service nova] Creating event network-vif-deleted:9a9d2fcd-4fa6-4bd6-96e8-3528abd44cc9 for instance 022564b2-f6a4-47eb-87fe-a9e277b5f4b2 on n-h1-master-1 Sep 25 01:21:16.446392 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bc54ff76-f8e4-4621-804a-98490da92c32 req-52c8bd09-5162-44e5-99ed-c6909e869ad8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098184 Sep 25 01:21:16.447395 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1998/3991] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:16.452853 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:16.464564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:16.471791 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:16.475940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:16.478998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:16.479609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:16.482742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:16.485317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:16.489099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:16.932148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-12c4ed76-7aaa-46ce-9fa7-1786b17f22a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Image not found. Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12c4ed76-7aaa-46ce-9fa7-1786b17f22a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 HTTP/1.1 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '31251fe5-a74e-438a-ba1f-aa5e9dd90db3'} Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 31251fe5-a74e-438a-ba1f-aa5e9dd90db3 to delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 31251fe5-a74e-438a-ba1f-aa5e9dd90db3 could not be found. Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.935016 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:21:16.940171 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:16.944187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12c4ed76-7aaa-46ce-9fa7-1786b17f22a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:16.945511 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12c4ed76-7aaa-46ce-9fa7-1786b17f22a3 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3" status: 404 len: 62 microversion: 2.1 time: 1.026253 Sep 25 01:21:16.946674 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1994/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:15 2022] DELETE /compute/v2.1/images/31251fe5-a74e-438a-ba1f-aa5e9dd90db3 => generated 62 bytes in 1028 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:21:16.960383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:16.965804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:16.995351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.003597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.005172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.013584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.022478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.026622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.434310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:17.448385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b28718ff-c504-4b5e-93e8-1b637ef65b30 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.999485 Sep 25 01:21:17.457374 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 1999/3993] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:16 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:17.471762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:17.472612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:17.492395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.497257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.498196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.499146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.499818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.501025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.535154 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 HTTP/1.1 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '2d5d9c61-86cd-4bc9-8c63-c204a635ff78'} Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:17.544449 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:17.557024 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:17.561074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:17.562208 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9459a635-3ea1-41af-9f37-2224627d460c tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 404 len: 111 microversion: 2.1 time: 0.101273 Sep 25 01:21:17.565238 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2000/3994] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:21:17 2022] DELETE /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:17.580969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:17.583018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:17.598534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.601160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.604265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.607341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.608108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.608776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.919188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:17.930914 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5c6a0ecc-6ffd-468b-be5c-89461538754e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1681 microversion: 2.1 time: 0.983012 Sep 25 01:21:17.937153 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1995/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:16 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1681 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:17.945980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:17.948000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 2d5d9c61-86cd-4bc9-8c63-c204a635ff78] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:17.967307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.967959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.970264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:17.989999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:17.991036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:17.998595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:18.044633 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 HTTP/1.1 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '2d5d9c61-86cd-4bc9-8c63-c204a635ff78'} Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:18.047842 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:18.051453 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:18.051453 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:18.051453 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:18.051453 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:18.051453 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. Sep 25 01:21:18.051453 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:18.055875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance 2d5d9c61-86cd-4bc9-8c63-c204a635ff78 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:18.061752 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9e16200e-68f7-4710-9561-72b86cfb9297 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78" status: 404 len: 111 microversion: 2.1 time: 0.122018 Sep 25 01:21:18.064245 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1996/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:17 2022] GET /compute/v2.1/servers/2d5d9c61-86cd-4bc9-8c63-c204a635ff78 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:18.073026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02bb5892-c089-4d27-bcd0-83362d2396ee tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bf0017f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:18.073213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:18.090961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:18.092921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:18.105641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9e664f8-685f-484b-a453-d4c5450fcd16 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1531 microversion: 2.91 time: 0.538848 Sep 25 01:21:18.123985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2001/3997] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:17 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1531 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:18.144142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:18.148282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:18.161725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:18.170290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:18.171010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:18.172076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:18.172873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:18.173586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:18.319056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lazy-loading 'services' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:21:18.383461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9dca8dd-ed08-4303-a799-10f1dc13d097 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1936 microversion: 2.91 time: 0.244425 Sep 25 01:21:18.410697 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2002/3998] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:18 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1936 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:18.426160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:18.427039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:18.449171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:18.453607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:18.454138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:18.454913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:18.455398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:18.455838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:18.549457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lazy-loading 'flavor' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:21:27.965801 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=51 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:28.024230 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=35 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:28.446268 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=12 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:28.694193 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:35.727631 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-02bb5892-c089-4d27-bcd0-83362d2396ee tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Image not found. Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02bb5892-c089-4d27-bcd0-83362d2396ee tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 HTTP/1.1 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: exception: Image not found. Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1b2d45b9-84e7-4c04-ab14-778ad6aa4921'} Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b2d45b9-84e7-4c04-ab14-778ad6aa4921 to delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b2d45b9-84e7-4c04-ab14-778ad6aa4921 could not be found. Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.729459 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02bb5892-c089-4d27-bcd0-83362d2396ee tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Image not found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-02bb5892-c089-4d27-bcd0-83362d2396ee tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921" status: 404 len: 62 microversion: 2.1 time: 17.661877 Sep 25 01:21:35.733592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1997/3999] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:18 2022] DELETE /compute/v2.1/images/1b2d45b9-84e7-4c04-ab14-778ad6aa4921 => generated 62 bytes in 17663 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:21:35.738126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:35.738755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:35.776533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:35.777045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:35.777516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:35.778239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:35.778995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:35.779105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:35.980955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a49aa092-3c19-426e-8e11-b7fe6306d694 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action" status: 202 len: 0 microversion: 2.91 time: 17.568273 Sep 25 01:21:35.983453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2003/4000] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:21:18 2022] POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action => generated 0 bytes in 17572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:21:36.004470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:36.030554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:36.048305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.049218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.049951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.051163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.051882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.052601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.071852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:36.081207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14913095-8d57-46a8-8322-20f63cad4175 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.348141 Sep 25 01:21:36.081828 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1998/4001] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:35 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:36.423466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:36.438350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8362ec0a-15bd-48e8-b024-075386ab3235 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1681 microversion: 2.1 time: 0.451194 Sep 25 01:21:36.441426 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2004/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:35 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1681 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:36.450093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:36.450878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:36.474431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.475374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.477806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.478993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.480514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.481204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.542871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1399433249", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "650bcb71-833d-45f1-9079-24480120f08f"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:36.570766 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 HTTP/1.1 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e24dfaf3-4058-4dac-80f3-b8dcba17f336'} Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:36.573766 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.579925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:36.582410 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4050cd2-f9f2-4a55-aa4f-e3edc9efb31a tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 404 len: 111 microversion: 2.1 time: 0.135055 Sep 25 01:21:36.583023 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2005/4003] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:21:36 2022] DELETE /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:36.600613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:36.602772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:36.610402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.611082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.611696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.612582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.617560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.618449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.660231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] validate_networks() for [('650bcb71-833d-45f1-9079-24480120f08f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:21:36.865076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:36.879319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:36.881107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:36.899527 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3de2d324-1bc4-45da-9f7a-6f1896c55f10 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.315526 Sep 25 01:21:36.900552 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2006/4004] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:36 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:36.910199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:36.910873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: e24dfaf3-4058-4dac-80f3-b8dcba17f336] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:36.929197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.930000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.930456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.931167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:36.931633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:36.932052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:36.969488 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 HTTP/1.1 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e24dfaf3-4058-4dac-80f3-b8dcba17f336'} Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.971029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance e24dfaf3-4058-4dac-80f3-b8dcba17f336 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eb8d8d5d-d33e-4a82-b034-71cf3b884087 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336" status: 404 len: 111 microversion: 2.1 time: 0.070817 Sep 25 01:21:36.978528 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2007/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:36 2022] GET /compute/v2.1/servers/e24dfaf3-4058-4dac-80f3-b8dcba17f336 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:36.984539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbec1902-1b74-4548-ac7e-b6f10f9207c9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '.version_select at 0x7f7bea9cd430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:37.407824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:21:37.408650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:21:37.408900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:21:37.409375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:21:37.409892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:21:37.423639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:37.425110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:37.425776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:37.426581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:37.427113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:37.427759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:37.451871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Getting quotas for project cc36a1f6ad32416e93ab335e5dcef9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:21:37.461295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Getting quotas for user d37e243ab8cf43ffae620d23215d496b and project cc36a1f6ad32416e93ab335e5dcef9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:21:37.478682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:21:37.481881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:21:37.550963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba735026-f14e-4331-b043-226650165d38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.466472 Sep 25 01:21:37.554425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 1999/4006] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:21:37.559626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:37.560578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:37.569195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:37.569984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:37.570659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:37.571582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:37.572251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:37.572906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:37.768629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-dbec1902-1b74-4548-ac7e-b6f10f9207c9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Image not found. Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbec1902-1b74-4548-ac7e-b6f10f9207c9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 HTTP/1.1 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: exception: Image not found. Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e77b9567-d210-4188-aceb-e1e77d87e4e2'} Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e77b9567-d210-4188-aceb-e1e77d87e4e2 to delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e77b9567-d210-4188-aceb-e1e77d87e4e2 could not be found. Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.772700 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 25 01:21:37.777433 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:37.783426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbec1902-1b74-4548-ac7e-b6f10f9207c9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Image not found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:37.784331 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbec1902-1b74-4548-ac7e-b6f10f9207c9 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2" status: 404 len: 62 microversion: 2.1 time: 0.803927 Sep 25 01:21:37.792768 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2008/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:36 2022] DELETE /compute/v2.1/images/e77b9567-d210-4188-aceb-e1e77d87e4e2 => generated 62 bytes in 807 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:21:37.793393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:37.794658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:37.815205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:37.815397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:37.815981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:37.816796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:37.818148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:37.818753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:37.819309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:37.831767 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fc22d318-7f81-4da5-aa07-44e11904750c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.276115 Sep 25 01:21:37.832371 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2000/4008] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:37 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:37.852128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c380d132-c3f2-4f81-a71c-88e2188f4d04 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:37.852971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c380d132-c3f2-4f81-a71c-88e2188f4d04 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:37.956032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c380d132-c3f2-4f81-a71c-88e2188f4d04 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:37.966614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c380d132-c3f2-4f81-a71c-88e2188f4d04 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:37.968695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c380d132-c3f2-4f81-a71c-88e2188f4d04 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:37.970696 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c380d132-c3f2-4f81-a71c-88e2188f4d04 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1259 microversion: 2.21 time: 0.131987 Sep 25 01:21:37.978135 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2001/4009] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:37 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:37.983124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:37.983569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:38.007821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.008337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.008780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.009731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.010197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.010632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.041661 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 HTTP/1.1 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0f0692ab-2627-474a-9bfc-41d182e863e7'} Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:38.043907 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:38.050123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9218385f-1aa6-4920-af24-79f52d1932a1 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 404 len: 111 microversion: 2.1 time: 0.070498 Sep 25 01:21:38.054057 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2002/4010] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:21:37 2022] DELETE /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:38.061170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:38.062892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:38.070861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:38.080297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.081150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d21d7a2-1885-477d-98f0-93e913aac0be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.293278 Sep 25 01:21:38.082780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.084148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.085165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.085687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.086182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.094183 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2009/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:37 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:38.105593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:38.106170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] [instance: 0f0692ab-2627-474a-9bfc-41d182e863e7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:38.115066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.115579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.116063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.116811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.117287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.117762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.138239 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] HTTP exception thrown: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Request method failure captured: Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 HTTP/1.1 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6wLByEzLeguqsVUwyESSlXiPIEGlhqM2QjTLPTOVxE9gtvYeYAShPUiN98Aa2O_glR3ebDtFdom3YcqmwNcpB59eiY0hIJ4VvLxQANM3_G0MqSETHf0hIEe_mJQePop2IKNIRtvruZnAkPepI-rFsHDPt1T6ekIbGEsiBcehN-5z38 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c9172549e19145c5b2201cfa5ef4eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c9172549e19145c5b2201cfa5ef4eddd"}]}] Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ImagesTestJSON-833258893 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c9172549e19145c5b2201cfa5ef4eddd Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ImagesTestJSON-833258893 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: ab3394e2971741d7aa5956de0d4afba8 Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ImagesTestJSON-833258893-project Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '0f0692ab-2627-474a-9bfc-41d182e863e7'} Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.140616 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:38.145304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:38.145304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:38.145304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:38.145304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:38.145304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. Sep 25 01:21:38.145304 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:38.146989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] Returning 404 to user: Instance 0f0692ab-2627-474a-9bfc-41d182e863e7 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:38.148016 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-efe74d71-8368-4778-ac09-adf55775ab68 tempest-ImagesTestJSON-833258893 tempest-ImagesTestJSON-833258893-project] 10.222.0.16 "GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7" status: 404 len: 111 microversion: 2.1 time: 0.052667 Sep 25 01:21:38.152313 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2010/4012] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:38 2022] GET /compute/v2.1/servers/0f0692ab-2627-474a-9bfc-41d182e863e7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:38.209742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:38.226366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:38.228409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:38.240561 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5825b1ea-869d-43a4-953b-e1414050f577 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.185180 Sep 25 01:21:38.241451 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2003/4013] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:38 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:38.259928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:38.260925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:38.271920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.280481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.281113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.282128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.282852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.283532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.473566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:38.481811 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3cc5c3a9-2d4d-45e5-b1de-a2a1f64b3000 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.226026 Sep 25 01:21:38.499315 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2011/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:38 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:38.858336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:38.860342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:38.870700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.871786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.872581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:38.873664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:38.876197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:38.876909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:39.005677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:39.006433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:39.019165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:39.019736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:39.020676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:39.023804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:39.026146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:39.026726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:39.073121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.086343 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03dcefea-8d4c-457f-95f0-969da9a43343 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.232027 Sep 25 01:21:39.087869 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2004/4015] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:38 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:39.149594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.166623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.168217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.169945 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e59ebb85-343b-488f-a61e-9b6fdadf642f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1263 microversion: 2.21 time: 0.168225 Sep 25 01:21:39.195849 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2012/4016] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:39 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:39.271661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:39.274610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:39.290444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:39.291261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:39.292551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:39.294917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:39.295561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:39.298568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:39.457148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.470316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.471771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:39.496227 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9142056c-a2e7-4ba7-9f1c-593db344aec7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.227837 Sep 25 01:21:39.497849 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2005/4017] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:39 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:39.527762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e91c549f-beaa-4dd5-a3af-78df98406064 req-152404b7-30b8-4050-a69b-b5005a786333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-unplugged", "status": "completed", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:39.603822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e91c549f-beaa-4dd5-a3af-78df98406064 req-152404b7-30b8-4050-a69b-b5005a786333 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:39.607345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e91c549f-beaa-4dd5-a3af-78df98406064 req-152404b7-30b8-4050-a69b-b5005a786333 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:39.608477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e91c549f-beaa-4dd5-a3af-78df98406064 req-152404b7-30b8-4050-a69b-b5005a786333 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:39.636064 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e91c549f-beaa-4dd5-a3af-78df98406064 req-152404b7-30b8-4050-a69b-b5005a786333 service nova] Creating event network-vif-unplugged:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:21:39.644402 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e91c549f-beaa-4dd5-a3af-78df98406064 req-152404b7-30b8-4050-a69b-b5005a786333 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.277163 Sep 25 01:21:39.645715 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2013/4018] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:40.063459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:40.064277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.070891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.071576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.072144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.072908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.073637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.074129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.116898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:40.117700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.127711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.128552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.129341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.130228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.132030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.134163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.366970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.371412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.380395 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bee64f6d-0913-4e6d-b602-1ab7acc35ed0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.318451 Sep 25 01:21:40.380793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-88951a64-5baa-47a8-96aa-debaa2cc2307 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.269522 Sep 25 01:21:40.381072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2006/4019] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:40 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:40.396887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:40.397792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.399736 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2014/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:40 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:40.405010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.405546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:40.406083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.406396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.407338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.408249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.409312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.410148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.413397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.414162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.414733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.415655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.416242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.416799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.539541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.549861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.551999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.553332 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9863247-0d23-4d51-acb8-357965299734 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1311 microversion: 2.21 time: 0.171076 Sep 25 01:21:40.554046 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2007/4021] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:40 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:40.575303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:40.576076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.582844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.583487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.584028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.584843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.585456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.586145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.627687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.636632 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c7667f8-a53f-4bb6-ba72-4c5f2ca46267 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.234794 Sep 25 01:21:40.637567 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2015/4022] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:40 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:40.660607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:40.661222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.667430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.668163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.668761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.669639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.670243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.670817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.684003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.693593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.695990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.701556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6952239e-d741-49c8-81de-78b28d584070 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.146205 Sep 25 01:21:40.703068 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2008/4023] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:40 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:40.847563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:40.874929 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3bad8d19-9072-4576-9256-286d56f4d081 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.216091 Sep 25 01:21:40.875928 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2016/4024] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:40 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:40.898467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:40.900754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:40.909366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.910294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.910889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:40.911776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:40.912386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:40.912964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.025522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41a61f8f-32e4-4554-b399-40bdba44f31e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.131058 Sep 25 01:21:41.027684 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2009/4025] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:40 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:21:41.037221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:41.037872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:41.046221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.047163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.047757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.048595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.049076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.049636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.351084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:41.361697 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3779dd6-393a-471a-a1c5-3fbd1db562cd tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1670 microversion: 2.1 time: 0.328957 Sep 25 01:21:41.366214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2017/4026] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:41 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1670 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:41.428085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:41.429276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:41.451902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.452927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.454439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.455391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.456078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.456713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.590627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:41.591869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:41.612080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.612570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.613043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.613752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.614207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.614634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.791171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:41.801034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:41.815428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:41.816921 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b6b4b494-6d52-4258-8415-dbcd35040f24 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1311 microversion: 2.21 time: 0.239777 Sep 25 01:21:41.828072 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2018/4027] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:41 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1311 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:21:41.833085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:41.833943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:41.847014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.850044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.850731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.853525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:41.854286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:41.856029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:41.992402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:42.005903 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d5f48fb-4b51-417b-963b-7ec79ca25a42 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.582158 Sep 25 01:21:42.008747 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2010/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:41 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:42.041330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:42.063063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:42.064720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:42.081835 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd4c8c90-ea97-4fe9-9e8f-8a4368fdf2ca tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1558 microversion: 2.91 time: 0.262274 Sep 25 01:21:42.086524 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2019/4029] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:41 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:42.392884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:42.394259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:42.411400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:42.412564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:42.413291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:42.414453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:42.415142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:42.415912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:42.844831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:42.846251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:42.854986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:42.862191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:42.862910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:42.863833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:42.864444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:42.865031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:42.986750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:42.998646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.000699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.001879 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-313043b2-59f6-45f4-a99c-925b94f017e6 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1317 microversion: 2.21 time: 0.161705 Sep 25 01:21:43.002460 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2020/4030] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:42 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:21:43.033640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:43.034277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:43.047279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:43.047802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:43.048236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:43.056544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:43.057046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:43.057534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:43.135984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.145060 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0f3deb4-692e-4e52-a246-4049b8351e21 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1670 microversion: 2.1 time: 0.756613 Sep 25 01:21:43.152824 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2011/4031] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:42 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1670 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:43.161919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:43.162546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:43.190788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:43.191331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:43.191814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:43.197772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:43.198321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:43.198784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:43.357504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.371150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.372705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.385904 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6324c9d7-56b8-4454-b3b7-5db9736958f4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1558 microversion: 2.91 time: 0.228030 Sep 25 01:21:43.390496 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2012/4032] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:43 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:43.810989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:43.825231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b9aeba2-7fb5-4347-b4c8-74bc2212b84b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.798082 Sep 25 01:21:43.826579 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2021/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:43 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:44.033482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:44.036215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:44.047164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.047815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.048213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.048937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.049417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.049869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.163779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.173294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.175207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:44.176423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:44.180746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.182350 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bad5a0b-99ec-4862-8945-1b94e89f786a tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1317 microversion: 2.21 time: 0.154235 Sep 25 01:21:44.186619 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2013/4034] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:44 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:44.196624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.206608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.207018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.207776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.208254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.211784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.422200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:44.427213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:44.448135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.449551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.450218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.451158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.451813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.452488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.557062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.567107 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cb96799-0b50-4703-a9ad-423027264a43 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.397154 Sep 25 01:21:44.578376 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2022/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:44 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:44.602363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:44.608169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:44.623996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.625381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.629033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.630076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.635249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.636616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.756643 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e657e41-e0d2-47c1-b834-4d01029a58ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 200 len: 322 microversion: 2.1 time: 0.162076 Sep 25 01:21:44.762641 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2023/4036] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:44 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:44.788613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:44.802419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:44.833077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.833564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.834007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.834811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:44.835161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:44.835590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:44.884143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.911238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.913101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:44.944607 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9668c4be-37bc-4701-a870-b8023f9984d4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.529479 Sep 25 01:21:44.951602 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:44.981999 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2014/4037] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:44 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:21:44.989315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:44.995526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:45.010672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:45.012751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:45.013685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:45.014583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:45.015649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:45.016183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.032316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.040068 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:46.046312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5bed42fc-2df0-4151-8417-8d233711743d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 1.059345 Sep 25 01:21:46.053776 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2015/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:44 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:46.069595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:46.074205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:46.093995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.098335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.099071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.100487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.101949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.102594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.348078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.369635 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3411881b-42d0-4780-a9dd-03a01537a33c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.602545 Sep 25 01:21:46.374951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2024/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:44 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:46.379923 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1b384d85-d0bd-48c4-956a-cffa1b10be80 req-9a33dc53-5da4-4be2-985c-2c345724778a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "name": "network-vif-plugged", "status": "completed", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:46.428521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1b384d85-d0bd-48c4-956a-cffa1b10be80 req-9a33dc53-5da4-4be2-985c-2c345724778a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.433580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1b384d85-d0bd-48c4-956a-cffa1b10be80 req-9a33dc53-5da4-4be2-985c-2c345724778a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.434685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1b384d85-d0bd-48c4-956a-cffa1b10be80 req-9a33dc53-5da4-4be2-985c-2c345724778a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.473315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.516689 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1b384d85-d0bd-48c4-956a-cffa1b10be80 req-9a33dc53-5da4-4be2-985c-2c345724778a service nova] Creating event network-vif-plugged:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h2-master-1 Sep 25 01:21:46.560209 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1b384d85-d0bd-48c4-956a-cffa1b10be80 req-9a33dc53-5da4-4be2-985c-2c345724778a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170019 Sep 25 01:21:46.568270 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2025/4040] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:46.580187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.595247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:46.597564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:46.606566 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.607942 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8225adb-becd-4c29-8b98-0c0514e7ad38 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.550817 Sep 25 01:21:46.618924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.619421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.619865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.620576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.621034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.621483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.632118 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2016/4041] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:46 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:46.649261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:46.653122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:46.669046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.669323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.669806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.670523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:46.675050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:46.676065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:46.939883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.953213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.973018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:46.996601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbdcf47c-3bca-4d10-9453-255ffbf57966 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.424584 Sep 25 01:21:47.024202 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2026/4042] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:46 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:47.091037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:47.094501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:47.112559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:47.114279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:47.115825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:47.119923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:47.120984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:47.121667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:47.347995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:47.357059 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2502f96b-ff23-4e93-b7d6-332894caf9d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.722701 Sep 25 01:21:47.361757 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2017/4043] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:46 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:47.382312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:47.383191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:47.398276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:47.398984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:47.399599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:47.400521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:47.401287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:47.402299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:47.459938 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:47.894436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:47.925150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-98c86e77-050e-4973-9ed6-9c4a90d640ce tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.834300 Sep 25 01:21:47.929240 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2027/4044] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:47 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:47.950894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:47.953596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:47.963463 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:47.963864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:47.964531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:47.965145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:47.966075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:47.967194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:47.967624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.161884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.203392 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ff9a69f-96d4-4313-ba3f-71a4058d5a99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.822149 Sep 25 01:21:48.205023 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2018/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:47 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:48.240331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:48.242567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:48.268695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.269219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:48.274969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.277813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.281518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:48.282500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.587430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.601251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.609089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.610529 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a10ee35-01ac-4465-a153-edd5d65f6a68 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.674064 Sep 25 01:21:48.611104 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2028/4046] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:47 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:48.621758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8022ed17-121c-4fa6-8c43-27d9c8d1aa46 req-735df4e5-b499-4b49-88fa-a03b99a10119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb62d9f-275f-4528-b9fc-acc87d3119e2", "tag": "b29f9418-a876-4dda-9422-3b8d69635de4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:48.654342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8022ed17-121c-4fa6-8c43-27d9c8d1aa46 req-735df4e5-b499-4b49-88fa-a03b99a10119 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.655137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8022ed17-121c-4fa6-8c43-27d9c8d1aa46 req-735df4e5-b499-4b49-88fa-a03b99a10119 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:48.657338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8022ed17-121c-4fa6-8c43-27d9c8d1aa46 req-735df4e5-b499-4b49-88fa-a03b99a10119 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.667710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.681130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.699961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:48.711374 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f2f2e4a-1e51-4d12-ac0e-a6a943f5a3bb tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.501146 Sep 25 01:21:48.713013 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2019/4047] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:48 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:48.732405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:48.736128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8022ed17-121c-4fa6-8c43-27d9c8d1aa46 req-735df4e5-b499-4b49-88fa-a03b99a10119 service nova] Creating event network-changed:b29f9418-a876-4dda-9422-3b8d69635de4 for instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 on n-h2-master-1 Sep 25 01:21:48.736918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:48.755861 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8022ed17-121c-4fa6-8c43-27d9c8d1aa46 req-735df4e5-b499-4b49-88fa-a03b99a10119 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139847 Sep 25 01:21:48.757339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.757897 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2029/4048] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:48.763157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:48.763836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.765350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.766689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:48.767367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.952383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:48.957620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:48.965056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.984896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:48.992107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:48.994669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:48.999146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:49.004618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:49.195186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:49.211915 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-28f8f982-0b58-4827-9628-d2c5b7de6e67 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.494405 Sep 25 01:21:49.212509 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2020/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:48 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:49.564283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1843224214", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "bd392121-2ba2-4140-9dd3-57e5e13ec24b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:49.595391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:49.619335 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e0f7e27-6117-49e9-98f7-51a191203471 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.671816 Sep 25 01:21:49.620923 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2030/4050] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:48 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:49.641610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:49.644293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:49.665240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:49.666308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:49.666754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:49.667505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:49.667895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:49.668383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:50.064945 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:50.079532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:50.084149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:50.086985 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-761ab309-ae77-47f6-85fd-4876dfb09d32 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.451776 Sep 25 01:21:50.105533 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2031/4051] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:49 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:50.115784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:50.129450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:50.143148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:50.146164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:50.146807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:50.147699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:50.149274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:50.152261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:50.255928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:50.272294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:50.274785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:50.286022 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b514bb6c-b104-4a55-87cf-06c1310f7c49 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.179134 Sep 25 01:21:50.289523 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2032/4052] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:50 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:50.357162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] validate_networks() for [('bd392121-2ba2-4140-9dd3-57e5e13ec24b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:21:50.647332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:50.648373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:50.660824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:50.661695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:50.662335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:50.669849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:50.670581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:50.672805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.245084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:51.263875 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a0cbc16e-1b4b-4e54-b7d3-6e4f56209332 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1517 microversion: 2.1 time: 0.620315 Sep 25 01:21:51.264504 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2033/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:50 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1517 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:51.312609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:51.320851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:51.343803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:51.347172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:51.347725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.348579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:51.351012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:51.358233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.590782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:21:51.592474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:21:51.593369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:21:51.594270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:21:51.602103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:21:51.633685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:51.642802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:51.643587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.652901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:51.653725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:51.654357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.783255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:51.807112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:21:51.807570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:51.809618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:51.811042 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd2e8525-b322-4284-bd47-9f85466bc4ca tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.522377 Sep 25 01:21:51.812831 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2034/4054] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:51 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:51.820388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:51.821682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:51.828992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:51.830000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:51.830684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.831677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:51.832491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:51.845761 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for user c1c655b1afc54b6c98d771d6acf81ee0 and project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:21:51.849084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:51.931291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:21:51.946247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:21:52.102525 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1606ee7c-0ca4-4d11-b35c-1d4228a040c3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.542156 Sep 25 01:21:52.104958 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2021/4055] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:21:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:21:52.120046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b673136-b100-4689-8c61-8858df3a4a94 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:52.120942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b673136-b100-4689-8c61-8858df3a4a94 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:52.361291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:52.367230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4b673136-b100-4689-8c61-8858df3a4a94 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:52.379669 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b673136-b100-4689-8c61-8858df3a4a94 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1215 microversion: 2.1 time: 0.265697 Sep 25 01:21:52.386056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:52.388592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:52.425732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1477864-7858-49ac-92ee-159fe37806ea tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.603276 Sep 25 01:21:52.428269 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2022/4056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:52 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:52.432003 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2035/4057] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:51 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:52.443746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:52.444642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:52.463552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:52.464397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:52.465092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:52.466182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:52.466999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:52.473972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:52.848025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:52.850444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:52.915666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:52.918000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:52.919141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:52.925434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:52.926163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:52.926815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.465292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.475222 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d2e13d5-cc4f-4961-b3e1-c81f7be93b55 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 1.045489 Sep 25 01:21:53.475822 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2023/4058] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:52 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:53.513162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.527030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:53.528329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.530096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.531407 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18fd6562-c37c-4e5a-9705-c641e822a9c0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.690778 Sep 25 01:21:53.534505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:53.554003 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2036/4059] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:52 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:53.576994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:53.578466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:53.578791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:53.579246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.582782 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:53.584699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:53.585332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:53.585821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.597574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:53.598296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:53.598770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.599501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:53.599964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:53.600390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.930161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.948371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.949629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9050e6a0-cbc2-4c0c-be31-d7b5019734bf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1219 microversion: 2.1 time: 0.472543 Sep 25 01:21:53.951233 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2024/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:53 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1219 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:53.969276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:53.970200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:53.970444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.972030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:53.976216 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:53.978538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:53.979773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:53.980658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.981746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:53.982391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:53.983011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:53.991368 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-565ee6e6-8ce4-49cd-8c37-50937c1756a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.436142 Sep 25 01:21:53.996727 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2037/4061] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:53 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:54.197329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:54.205937 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12584d6c-a271-4cea-a87c-2d9289803bfa tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.252549 Sep 25 01:21:54.221447 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2025/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:53 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:54.247071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:54.247281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:54.263623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:54.266033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:54.266646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:54.268793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:54.269468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:54.272306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:54.571789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:54.572619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:54.592070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:54.594012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:54.596038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:54.597045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:54.599315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:54.600007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:55.211192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:55.235511 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4a09ea0-8670-4634-a983-a394e4ab6062 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.991850 Sep 25 01:21:55.245998 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2038/4063] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:54 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:55.261442 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:55.262348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:55.276260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:55.277970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:55.278523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:55.280882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:55.283895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:55.284693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:55.799138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:55.817507 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1c206f86-d1f4-4a5c-bb27-77472669dd2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1273 microversion: 2.1 time: 0.565481 Sep 25 01:21:55.834371 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2039/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:55 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1273 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:55.849552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:55.850192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:55.866482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:55.868695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:55.869331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:55.870242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:55.872177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:55.872960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:56.055390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:56.084780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:56.088964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:56.092454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fdf99f0a-2914-4fbc-9d9c-3ab71d84e52d tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 1.524804 Sep 25 01:21:56.095427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2026/4065] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:54 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:56.107696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e743a575-00be-4220-8924-beee04e18961 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:56.122897 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e743a575-00be-4220-8924-beee04e18961 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 820b3582-270b-4870-abb4-a480acc06c44 has no mapping to a cell. Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e743a575-00be-4220-8924-beee04e18961 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/820b3582-270b-4870-abb4-a480acc06c44/action HTTP/1.1 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 15 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: {"os-stop": {}} Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 820b3582-270b-4870-abb4-a480acc06c44 has no mapping to a cell. Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '820b3582-270b-4870-abb4-a480acc06c44', 'body': {'os-stop': {}}} Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 820b3582-270b-4870-abb4-a480acc06c44 has no mapping to a cell. Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:56.137028 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820b3582-270b-4870-abb4-a480acc06c44 has no mapping to a cell. Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820b3582-270b-4870-abb4-a480acc06c44 has no mapping to a cell. Sep 25 01:21:56.142214 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:21:56.145360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e743a575-00be-4220-8924-beee04e18961 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 820b3582-270b-4870-abb4-a480acc06c44 has no mapping to a cell. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:56.147274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e743a575-00be-4220-8924-beee04e18961 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/820b3582-270b-4870-abb4-a480acc06c44/action" status: 404 len: 117 microversion: 2.1 time: 0.050225 Sep 25 01:21:56.148370 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2027/4066] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:56 2022] POST /compute/v2.1/servers/820b3582-270b-4870-abb4-a480acc06c44/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:56.157066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:56.157958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:56.178418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:56.179359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:56.180143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:56.181361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:56.181993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:56.184457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:56.603538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:56.616515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:56.636271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:56.663122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-91a6d681-c55c-437f-bd20-0a75a21f27e6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.814080 Sep 25 01:21:56.684361 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2040/4067] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:55 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:56.849165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:56.849969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:56.867777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:56.868522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:56.868988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:56.873095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:56.878087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:56.878602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:57.361258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:57.376039 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3afc57d7-94b4-4f94-b9b3-87705803d382 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1273 microversion: 2.1 time: 0.531886 Sep 25 01:21:57.393893 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2041/4068] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:56 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1273 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:57.404858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:57.427172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:57.473604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:57.474295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:57.475119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:57.476003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:57.476618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:57.477204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:57.543029 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:57.600886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:57.611317 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5be755f1-0539-4472-9de1-14f8a655044e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 1.458872 Sep 25 01:21:57.618307 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2028/4069] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:56 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:21:57.651550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:57.652462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:57.671356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:57.678230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:57.679047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:57.681711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:57.682454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:57.688171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:58.293515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:58.307811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:58.326583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:58.332661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ca0f01f-dd4c-446f-ba5f-ec3159d76826 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.931637 Sep 25 01:21:58.337372 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2042/4070] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:57 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:58.350847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:58.357636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:58.378378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:58.386671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:58.391541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:58.397112 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b5e1c162-6c4f-4fed-9613-857cacc8f266 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.749784 Sep 25 01:21:58.398220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:58.407160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:58.411268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:58.411718 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2029/4071] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:57 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:21:58.416621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-37006541-6de6-4aec-9e7c-f559633adbc7 req-c2601bec-bd94-418d-bf7d-5c81a877489b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb62d9f-275f-4528-b9fc-acc87d3119e2", "name": "network-vif-plugged", "status": "completed", "tag": "b29f9418-a876-4dda-9422-3b8d69635de4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:58.418841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:58.484112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-37006541-6de6-4aec-9e7c-f559633adbc7 req-c2601bec-bd94-418d-bf7d-5c81a877489b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:58.491004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-37006541-6de6-4aec-9e7c-f559633adbc7 req-c2601bec-bd94-418d-bf7d-5c81a877489b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:58.496068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-37006541-6de6-4aec-9e7c-f559633adbc7 req-c2601bec-bd94-418d-bf7d-5c81a877489b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:58.548513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-37006541-6de6-4aec-9e7c-f559633adbc7 req-c2601bec-bd94-418d-bf7d-5c81a877489b service nova] Creating event network-vif-plugged:b29f9418-a876-4dda-9422-3b8d69635de4 for instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 on n-h2-master-1 Sep 25 01:21:58.562747 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-37006541-6de6-4aec-9e7c-f559633adbc7 req-c2601bec-bd94-418d-bf7d-5c81a877489b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141466 Sep 25 01:21:58.563631 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2030/4072] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:21:58.575918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:58.583561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:58.601536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:58.602145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:58.618871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:58.621005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:58.625978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:58.627551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:58.973773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:58.982900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:58.992268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:21:59.024226 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=93 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:21:59.026108 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b9b29f0c-4753-4e37-ad83-fc65da304348 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.679172 Sep 25 01:21:59.050963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2043/4073] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:21:58 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:21:59.065368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83528e22-9886-48ae-b9e6-ed1335f18a93 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:21:59.074383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83528e22-9886-48ae-b9e6-ed1335f18a93 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: c5e6a080-6137-4785-9fcd-361928b56a59] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:59.136610 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-83528e22-9886-48ae-b9e6-ed1335f18a93 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance c5e6a080-6137-4785-9fcd-361928b56a59 could not be found. Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83528e22-9886-48ae-b9e6-ed1335f18a93 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/c5e6a080-6137-4785-9fcd-361928b56a59/action HTTP/1.1 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 15 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: {"suspend": {}} Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: exception: Instance c5e6a080-6137-4785-9fcd-361928b56a59 could not be found. Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'c5e6a080-6137-4785-9fcd-361928b56a59', 'body': {'suspend': {}}} Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e6a080-6137-4785-9fcd-361928b56a59 could not be found. Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e6a080-6137-4785-9fcd-361928b56a59 could not be found. Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:21:59.138933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:21:59.143804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:21:59.143804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:21:59.143804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e6a080-6137-4785-9fcd-361928b56a59 could not be found. Sep 25 01:21:59.143804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:21:59.151616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83528e22-9886-48ae-b9e6-ed1335f18a93 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance c5e6a080-6137-4785-9fcd-361928b56a59 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:21:59.152790 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83528e22-9886-48ae-b9e6-ed1335f18a93 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/c5e6a080-6137-4785-9fcd-361928b56a59/action" status: 404 len: 111 microversion: 2.1 time: 0.100541 Sep 25 01:21:59.168584 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2044/4074] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:21:59 2022] POST /compute/v2.1/servers/c5e6a080-6137-4785-9fcd-361928b56a59/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:21:59.176167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:21:59.189518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:21:59.219637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:59.220258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:59.220817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:21:59.221689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:21:59.222278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:21:59.226680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:00.773265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:00.796640 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2102bd9-29d6-4e59-a29c-8aa557e0e884 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 2.228432 Sep 25 01:22:00.798828 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2031/4075] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:58 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:00.810498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:00.814479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:00.846772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:00.850612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:00.851292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:00.852274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:00.853078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:00.855893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:00.993718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.016381 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7cf7a2a6-c01a-4773-b798-638659c03c9a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 1.846421 Sep 25 01:22:01.022982 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2045/4076] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:21:59 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:01.035814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:01.042089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:01.068011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:01.071317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:01.072031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:01.074151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:01.075098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:01.080095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:01.386084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.398410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.405001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.418832 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3653641-b0bd-495d-b3c1-6f32056e9ecd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.394352 Sep 25 01:22:01.419937 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2046/4077] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:01 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:01.648456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.660445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.669363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:01.681583 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f95eca2-8aee-41d8-933d-fd00095f3d95 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1359 microversion: 2.21 time: 0.878789 Sep 25 01:22:01.682660 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2032/4078] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:00 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1359 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:01.693433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:01.695425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:01.719119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:01.737655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:01.748460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:01.750547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:01.756863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:01.760132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:01.761550 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:01.808591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Calling method '.version_select at 0x7f7bea9504c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:01.887992 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:22:01.888928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Neutron security group b208944d-4c8d-44bb-8fa0-396c6f17489c not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:22:01.891868 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] HTTP exception thrown: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.891868 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Request method failure captured: Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/b208944d-4c8d-44bb-8fa0-396c6f17489c HTTP/1.1 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6047AE0ROTZX7rgh7r0OJH0X6mZFrARZ6B2LVCwkAnJ1HsYxZt4dyx-1Smb0uZagVAmS5S6SwGUBgaGJE0Z32jks3Es9hCTkls4Si5NmrohyC-57jisbe1xQ96TN9PxFLtOdJNiDZcv3xy2noES-BN4LtI9NAlfIuf5Fu1JUrlG4js Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_21cecfd3059f4397b34b26fa4b3f3769"}]}] Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 520c748cec88405a86547a86faf10247 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: exception: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b208944d-4c8d-44bb-8fa0-396c6f17489c'} Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:22:01.895235 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] Sep 25 01:22:01.903812 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:01.912099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Returning 404 to user: Security group b208944d-4c8d-44bb-8fa0-396c6f17489c does not exist Sep 25 01:22:01.912099 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-d846171c-058c-495d-90d6-7c69fadd21b7'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:01.913779 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3221174-66c1-4162-971a-0b1ee4f4999d tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b208944d-4c8d-44bb-8fa0-396c6f17489c" status: 404 len: 194 microversion: 2.1 time: 0.492324 Sep 25 01:22:01.915349 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2047/4079] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:22:01 2022] DELETE /compute/v2.1/os-security-groups/b208944d-4c8d-44bb-8fa0-396c6f17489c => generated 194 bytes in 495 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:01.934618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:01.935518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:01.963559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:01.973510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:01.974322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:01.978790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:01.986760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:01.987878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:02.371222 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:02.631100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:02.640631 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b3216da0-76d2-4e24-8161-b249b08232ca tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 0.719984 Sep 25 01:22:02.648259 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2048/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:01 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:02.665671 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3e9953cf-1147-4e79-b296-c02bbcddeccf tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.015989 Sep 25 01:22:02.668207 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2049/4081] 10.222.0.16 () {58 vars in 1164 bytes} [Sun Sep 25 01:22:02 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:22:02.686980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:02.695923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:02.709416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:02.715426 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ba458d9-b907-47f4-83ef-5006d6ba666a tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 1.025864 Sep 25 01:22:02.721768 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2033/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:01 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:02.736104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91a444ad-db8c-41d5-823f-91d472544a3a tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Calling method '.version_select at 0x7f7bebcff430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:02.750668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:02.751932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:02.752553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:02.760086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:02.760955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:02.762246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:03.109432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:03.131400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:03.133217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:03.167664 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7fb9de5-095a-4fed-804f-1bd7392cd99e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.497070 Sep 25 01:22:03.177797 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2050/4083] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:02 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:03.201789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:03.203009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:03.223282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:03.223780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:03.224221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:03.224941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:03.225417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:03.225836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:03.638804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:03.654104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:03.669737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:03.674555 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d9790ab-afcc-421e-b48f-00cd2d1d4e30 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1552 microversion: 2.21 time: 0.495643 Sep 25 01:22:03.678877 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2051/4084] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:03 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1552 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:03.691516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:03.692258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:03.704475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:03.705488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:03.706228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:03.707457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:03.708630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:03.710042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:03.740811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lazy-loading 'flavor' on Instance uuid 1fb6535d-78e0-404a-8bf1-9a61d23b7710 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:22:04.023588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc2dfd79-90d0-4094-b858-c256bd2afb75 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 202 len: 0 microversion: 2.1 time: 0.343131 Sep 25 01:22:04.029514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2052/4085] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:03 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:22:04.056092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:04.056909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:04.069215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.073110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.073616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.074376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.074848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.075292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.219413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91a444ad-db8c-41d5-823f-91d472544a3a tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.496280 Sep 25 01:22:04.220682 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2034/4086] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:22:02 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:04.225753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:04.228138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:04.247421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.247929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.248382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.249223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.250012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.250517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.325155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:22:04.418336 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:04.504002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3107240c-bbcf-4140-824f-158b5470e415 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 204 len: 0 microversion: 2.21 time: 0.281817 Sep 25 01:22:04.505778 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2035/4087] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:22:04 2022] DELETE /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:22:04.515986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-981c8cac-587a-4c16-9b86-a4d28fa2f25f req-840ba702-606b-4020-b616-24cacf3bfb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e125d906-0565-4287-b3d8-82a6ea23ed89", "tag": "6d189d35-76a2-45c5-abf9-bc5345e3335c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:04.542570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-981c8cac-587a-4c16-9b86-a4d28fa2f25f req-840ba702-606b-4020-b616-24cacf3bfb8d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.543056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-981c8cac-587a-4c16-9b86-a4d28fa2f25f req-840ba702-606b-4020-b616-24cacf3bfb8d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.543488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-981c8cac-587a-4c16-9b86-a4d28fa2f25f req-840ba702-606b-4020-b616-24cacf3bfb8d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.566440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:04.572970 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-981c8cac-587a-4c16-9b86-a4d28fa2f25f req-840ba702-606b-4020-b616-24cacf3bfb8d service nova] Creating event network-changed:6d189d35-76a2-45c5-abf9-bc5345e3335c for instance e125d906-0565-4287-b3d8-82a6ea23ed89 on n-h1-master-1 Sep 25 01:22:04.575783 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80499f47-3c15-4aae-a503-0a912624a675 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 0.544506 Sep 25 01:22:04.586095 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-981c8cac-587a-4c16-9b86-a4d28fa2f25f req-840ba702-606b-4020-b616-24cacf3bfb8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076695 Sep 25 01:22:04.592356 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2036/4088] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:04.596861 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2053/4089] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:04 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:04.606948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:04.607941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:04.608774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:04.609808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:04.621968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.624028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.624742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.628020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.628723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.629386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.634195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.634692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.635134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.636015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:04.636377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:04.636800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:04.792807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:04.805428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:04.807134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:04.822336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4e80a92-52d7-4d11-a8de-0b8449811e23 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.223394 Sep 25 01:22:04.830424 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2054/4090] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:04 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:04.845904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7815a24-afce-4aa5-b309-f14dc77d1f0c tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Calling method '.version_select at 0x7f7beaa1de50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:05.301360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:05.334092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2559b6d6-86ae-4176-aadd-c01049cdc681 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1512 microversion: 2.1 time: 0.738517 Sep 25 01:22:05.346382 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2037/4091] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:04 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1512 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:05.352812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:05.377381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:05.394178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:05.397147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:05.397919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:05.400937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:05.401955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:05.416221 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-f7815a24-afce-4aa5-b309-f14dc77d1f0c tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:22:05.417128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f7815a24-afce-4aa5-b309-f14dc77d1f0c tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 25 01:22:05.417128 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] Sep 25 01:22:05.418387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7815a24-afce-4aa5-b309-f14dc77d1f0c tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Request method failure captured: Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-security-groups/559d7eea-b417-4a8b-98cc-798707ed4dab HTTP/1.1 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6047AE0ROTZX7rgh7r0OJH0X6mZFrARZ6B2LVCwkAnJ1HsYxZt4dyx-1Smb0uZagVAmS5S6SwGUBgaGJE0Z32jks3Es9hCTkls4Si5NmrohyC-57jisbe1xQ96TN9PxFLtOdJNiDZcv3xy2noES-BN4LtI9NAlfIuf5Fu1JUrlG4js Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_21cecfd3059f4397b34b26fa4b3f3769"}]}] Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 520c748cec88405a86547a86faf10247 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: exception: Insufficient rights for removing default security group. Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '559d7eea-b417-4a8b-98cc-798707ed4dab'} Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:22:05.420268 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] Sep 25 01:22:05.424964 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.428563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7815a24-afce-4aa5-b309-f14dc77d1f0c tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 25 01:22:05.428563 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-d5c5c033-4977-4773-ba7f-9f9ad66ba4f1'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:05.429872 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f7815a24-afce-4aa5-b309-f14dc77d1f0c tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/559d7eea-b417-4a8b-98cc-798707ed4dab" status: 400 len: 182 microversion: 2.1 time: 0.598323 Sep 25 01:22:05.433786 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2055/4092] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:22:04 2022] DELETE /compute/v2.1/os-security-groups/559d7eea-b417-4a8b-98cc-798707ed4dab => generated 182 bytes in 600 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:22:05.465842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Calling method '.version_select at 0x7f7bea95be50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:05.515124 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:22:05.516226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Neutron security group 11b09088-ba44-4903-98d2-4d81509f2a59 not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:22:05.517198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] HTTP exception thrown: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.517198 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Request method failure captured: Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/os-security-groups/11b09088-ba44-4903-98d2-4d81509f2a59 HTTP/1.1 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6047AE0ROTZX7rgh7r0OJH0X6mZFrARZ6B2LVCwkAnJ1HsYxZt4dyx-1Smb0uZagVAmS5S6SwGUBgaGJE0Z32jks3Es9hCTkls4Si5NmrohyC-57jisbe1xQ96TN9PxFLtOdJNiDZcv3xy2noES-BN4LtI9NAlfIuf5Fu1JUrlG4js Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_21cecfd3059f4397b34b26fa4b3f3769"}]}] Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 520c748cec88405a86547a86faf10247 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: exception: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '11b09088-ba44-4903-98d2-4d81509f2a59'} Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:22:05.519232 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Returning 404 to user: Security group 11b09088-ba44-4903-98d2-4d81509f2a59 does not exist Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-c1893713-73f2-4284-9233-e62edf1974df'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:05.523057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0aac0df-3784-49f6-b839-6f00233c6050 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/11b09088-ba44-4903-98d2-4d81509f2a59" status: 404 len: 194 microversion: 2.1 time: 0.071027 Sep 25 01:22:05.527445 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2056/4093] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:22:05 2022] GET /compute/v2.1/os-security-groups/11b09088-ba44-4903-98d2-4d81509f2a59 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:05.595080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Action: 'update', calling method: .version_select at 0x7f7beaa1d820>, body: {"security_group": {"name": "tempest-sg-1123500244", "description": "tempest-description-1064080256"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:05.933825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:05.953593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:05.955076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:05.956276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a84cf9ca-1392-4cbf-8311-08ea827b4e66 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1558 microversion: 2.21 time: 0.608454 Sep 25 01:22:05.956843 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2038/4094] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:05 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1558 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:05.960828 n-d-master-1 devstack@n-api.service[122384]: DEBUG neutronclient.v2_0.client [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist", "detail": ""}} {{(pid=122384) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 25 01:22:05.961570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.security_group_api [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Neutron security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 not found {{(pid=122384) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 25 01:22:05.962204 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] HTTP exception thrown: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.962204 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Request method failure captured: Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/os-security-groups/b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 HTTP/1.1 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 102 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6047AE0ROTZX7rgh7r0OJH0X6mZFrARZ6B2LVCwkAnJ1HsYxZt4dyx-1Smb0uZagVAmS5S6SwGUBgaGJE0Z32jks3Es9hCTkls4Si5NmrohyC-57jisbe1xQ96TN9PxFLtOdJNiDZcv3xy2noES-BN4LtI9NAlfIuf5Fu1JUrlG4js Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/21cecfd3059f4397b34b26fa4b3f3769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_21cecfd3059f4397b34b26fa4b3f3769"}]}] Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 21cecfd3059f4397b34b26fa4b3f3769 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-599577558 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 520c748cec88405a86547a86faf10247 Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-599577558-project Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: {"security_group": {"name": "tempest-sg-1123500244", "description": "tempest-description-1064080256"}} Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: exception: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b1cc5e74-55be-470d-b3c3-3c8507d6b9b5', 'body': {'security_group': {'name': 'tempest-sg-1123500244', 'description': 'tempest-description-1064080256'}}} Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 25 01:22:05.964275 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] Returning 404 to user: Security group b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 does not exist Sep 25 01:22:05.969611 n-d-master-1 devstack@n-api.service[122384]: Neutron server returns request_ids: ['req-7ee1cf92-9206-4ee9-b8aa-2fc568291020'] {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:05.974344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ff489a0-9056-4854-82ad-e8194ba22223 tempest-SecurityGroupsNegativeTestJSON-599577558 tempest-SecurityGroupsNegativeTestJSON-599577558-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/b1cc5e74-55be-470d-b3c3-3c8507d6b9b5" status: 404 len: 194 microversion: 2.1 time: 0.444355 Sep 25 01:22:05.976186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:05.981888 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2057/4095] 10.222.0.16 () {60 vars in 1290 bytes} [Sun Sep 25 01:22:05 2022] PUT /compute/v2.1/os-security-groups/b1cc5e74-55be-470d-b3c3-3c8507d6b9b5 => generated 194 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:05.997834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:06.000355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:06.025433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:06.044392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:06.046734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:06.051396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:06.053037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:06.066712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:06.067050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:06.067796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:06.068319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:06.071661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:06.072924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:06.073556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:06.074143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:06.504537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:06.519033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:06.520496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:06.534152 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a42baf6c-4a84-480c-8d0d-0dc2d6adebb4 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.550255 Sep 25 01:22:06.536504 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2058/4096] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:05 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:06.551406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:06.552028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:06.558200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:06.558706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:06.559147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:06.559938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:06.560293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:06.560720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:07.587785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:07.597532 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e8b25e5-bcd2-4cc4-a7be-b337238800b7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 1.636192 Sep 25 01:22:07.616870 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2039/4097] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:05 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:07.623424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:07.627071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:07.642760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:07.650912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:07.651866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:07.655877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:07.655877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:07.662202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.281697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.304877 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1290ca9a-36d1-4345-b59e-524b7e0e0e1d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1495 microversion: 2.1 time: 1.767081 Sep 25 01:22:08.312370 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2059/4098] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:06 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1495 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:08.338242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:08.354046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:08.389197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.392284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.392902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.396247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.398775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.403322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.500380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.519555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.524182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.526702 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a054ac25-4917-4695-9d1a-b2f1af959359 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1558 microversion: 2.21 time: 0.907180 Sep 25 01:22:08.533285 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2040/4099] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:07 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1558 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:08.540317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:08.546410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:08.555252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.565123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.566219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.566912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.567402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.568326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.569435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.570130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.579617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:08.597764 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-621f84ee-fefe-431f-acd7-73199ab75ff7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.283973 Sep 25 01:22:08.603882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2060/4100] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:08 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:08.629546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:08.630097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:08.636236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.637969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.640351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.642926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.645451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.650034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.676459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lazy-loading 'flavor' on Instance uuid 1fb6535d-78e0-404a-8bf1-9a61d23b7710 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:22:08.702887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'suspend' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state suspended Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 15 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: {"suspend": {}} Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'suspend' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state suspended Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'suspend': {}}} Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 25 01:22:08.709075 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state suspended Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state suspended Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'suspend' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state suspended {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:08.712976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-39881930-01ab-419c-8dfb-6ac3aa49fd2c tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 148 microversion: 2.1 time: 0.175983 Sep 25 01:22:08.718634 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2041/4101] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:08 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 148 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:22:08.734257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:08.734857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:08.769658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.770174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.770614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.771621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:08.781530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:08.782150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:08.978899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed7299f2-e984-4b91-98a9-7423844bf9ea tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 202 len: 0 microversion: 2.1 time: 0.258766 Sep 25 01:22:08.979936 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2042/4102] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:08 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:22:08.994235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:08.995087 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:09.006249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:09.006752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:09.007191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:09.008147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:09.008758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:09.009904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:10.946939 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:10.963366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:10.992353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-00edea49-a7a2-4ff5-b5d1-12eee163b4ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 2.363755 Sep 25 01:22:10.995061 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23c1ea11-ba9a-469f-b881-d8735f0d208d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1501 microversion: 2.1 time: 2.010442 Sep 25 01:22:10.997448 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2061/4103] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:08 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 2378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:11.018750 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2043/4104] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:08 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1501 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:11.024696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:11.024696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:11.042763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:11.043915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:11.057358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:11.059118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:11.061952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:11.062769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:11.065666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:11.066580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:11.069809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:11.071490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:11.074058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:11.075596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:11.076305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:11.079442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:11.577294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:11.592869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:11.595950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:11.611333 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c930cb45-aadf-4186-81f8-5fce31038412 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.590582 Sep 25 01:22:11.612124 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2044/4105] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:11 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:11.626246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-55e63b06-6820-4ea9-8bd1-b1fd6072971c req-64f7cd48-2e82-4399-b18c-870b5a2e47f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb62d9f-275f-4528-b9fc-acc87d3119e2", "name": "network-vif-unplugged", "status": "completed", "tag": "b29f9418-a876-4dda-9422-3b8d69635de4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:11.649533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-55e63b06-6820-4ea9-8bd1-b1fd6072971c req-64f7cd48-2e82-4399-b18c-870b5a2e47f9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:11.650967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-55e63b06-6820-4ea9-8bd1-b1fd6072971c req-64f7cd48-2e82-4399-b18c-870b5a2e47f9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:11.655970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-55e63b06-6820-4ea9-8bd1-b1fd6072971c req-64f7cd48-2e82-4399-b18c-870b5a2e47f9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:11.682947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:11.699914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:11.700738 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-55e63b06-6820-4ea9-8bd1-b1fd6072971c req-64f7cd48-2e82-4399-b18c-870b5a2e47f9 service nova] Creating event network-vif-unplugged:b29f9418-a876-4dda-9422-3b8d69635de4 for instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 on n-h2-master-1 Sep 25 01:22:11.702369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:11.707324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4741921a-1a5d-43dc-a28b-a6a73835f8e0 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1558 microversion: 2.21 time: 0.696060 Sep 25 01:22:11.708091 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2062/4106] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:10 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1558 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:11.723786 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-55e63b06-6820-4ea9-8bd1-b1fd6072971c req-64f7cd48-2e82-4399-b18c-870b5a2e47f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108060 Sep 25 01:22:11.723786 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2045/4107] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:12.028821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:12.030391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:12.034864 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:12.035488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:12.046993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:12.048892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:12.049633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:12.051993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:12.052124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:12.052601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:12.053043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:12.053777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:12.054234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:12.054666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:12.056094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:12.056800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:12.099894 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:12.701798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:12.751156 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-334acdea-c45f-4aff-8a9c-aa6fcaf165c9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 0.729105 Sep 25 01:22:12.758378 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2046/4108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:12 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:12.785768 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-11bcc1d8-7a6f-4fdb-aa41-d4650d357418 req-d846f2ae-11de-4f83-a02a-b37fa019b9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb62d9f-275f-4528-b9fc-acc87d3119e2", "name": "network-vif-deleted", "tag": "b29f9418-a876-4dda-9422-3b8d69635de4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:12.886937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11bcc1d8-7a6f-4fdb-aa41-d4650d357418 req-d846f2ae-11de-4f83-a02a-b37fa019b9c9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:12.895606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11bcc1d8-7a6f-4fdb-aa41-d4650d357418 req-d846f2ae-11de-4f83-a02a-b37fa019b9c9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:12.896404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11bcc1d8-7a6f-4fdb-aa41-d4650d357418 req-d846f2ae-11de-4f83-a02a-b37fa019b9c9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:12.967916 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-11bcc1d8-7a6f-4fdb-aa41-d4650d357418 req-d846f2ae-11de-4f83-a02a-b37fa019b9c9 service nova] Creating event network-vif-deleted:b29f9418-a876-4dda-9422-3b8d69635de4 for instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 on n-h2-master-1 Sep 25 01:22:12.982358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-11bcc1d8-7a6f-4fdb-aa41-d4650d357418 req-d846f2ae-11de-4f83-a02a-b37fa019b9c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213038 Sep 25 01:22:12.988008 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2047/4109] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:13.000918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:13.003045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:13.026152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.028844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.030950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.032282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.033757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.034980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.077828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.101720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-285b7a75-d739-488e-a678-a57deb7d21ac tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1501 microversion: 2.1 time: 1.067996 Sep 25 01:22:13.104627 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2063/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:12 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1501 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:13.122553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:13.132524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:13.175147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.185758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.190446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.193966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.195883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.196769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.253447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.280472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.287532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.307297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.308872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.312296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.313312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lazy-loading 'fault' on Instance uuid 7bb62d9f-275f-4528-b9fc-acc87d3119e2 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:22:13.313792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f03caf7e-dc73-49d2-aeb2-ee54f70f8720 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.321361 Sep 25 01:22:13.316672 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2048/4111] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:12 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:13.564392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.595104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.597397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd37e243ab8cf43ffae620d23215d496b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc36a1f6ad32416e93ab335e5dcef9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:13.598843 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be8a89e4-3504-48a8-9f4a-06b07d3f780f tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 200 len: 1349 microversion: 2.21 time: 0.491554 Sep 25 01:22:13.599560 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2064/4112] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:13 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 1349 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:13.759493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8425ed8b-6c34-4838-837a-61ee1977a76a req-2f5433c0-bdf5-4b74-a92c-57fd36618d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e125d906-0565-4287-b3d8-82a6ea23ed89", "name": "network-vif-plugged", "status": "completed", "tag": "6d189d35-76a2-45c5-abf9-bc5345e3335c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:13.778421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:13.779024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:13.790730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.791224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.792184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8425ed8b-6c34-4838-837a-61ee1977a76a req-2f5433c0-bdf5-4b74-a92c-57fd36618d3f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.792710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8425ed8b-6c34-4838-837a-61ee1977a76a req-2f5433c0-bdf5-4b74-a92c-57fd36618d3f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.793157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8425ed8b-6c34-4838-837a-61ee1977a76a req-2f5433c0-bdf5-4b74-a92c-57fd36618d3f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.800016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.800921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:13.801500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:13.802598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:13.854466 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8425ed8b-6c34-4838-837a-61ee1977a76a req-2f5433c0-bdf5-4b74-a92c-57fd36618d3f service nova] Creating event network-vif-plugged:6d189d35-76a2-45c5-abf9-bc5345e3335c for instance e125d906-0565-4287-b3d8-82a6ea23ed89 on n-h1-master-1 Sep 25 01:22:13.876186 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8425ed8b-6c34-4838-837a-61ee1977a76a req-2f5433c0-bdf5-4b74-a92c-57fd36618d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117003 Sep 25 01:22:13.879532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2049/4113] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:14.131845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:14.132764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:14.148874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:14.151537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:14.156184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:14.163299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:14.165333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:14.167710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:14.708241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:14.721870 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b63e9bb-48a3-49f2-b6c9-197d58d80288 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 0.942408 Sep 25 01:22:14.723680 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2065/4114] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:13 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:14.734327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:14.745334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:14.757696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:14.769171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:14.770027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:14.770970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:14.771705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:14.772102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:14.868882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:14.884609 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3810d176-7560-4068-86ee-6d6b20608db6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1501 microversion: 2.1 time: 0.757742 Sep 25 01:22:14.903143 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2050/4115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:14 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1501 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:14.912412 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:14.913585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:14.924806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:14.925702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:14.926539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:14.927429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:14.928211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:14.928810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:14.947295 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] HTTP exception thrown: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Request method failure captured: Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 HTTP/1.1 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL60YSAHX6NN4_6CPv8V9Xsrb7ovOEpB7R98oH_bldRdX-LRv6g5mCe_T9ZXo7asPZH2-WLC85ENvk5C_amOeO2655wccda3uiBl2V62hI4uoy2MKHpzqjLQLBqRWTvmyKGS1ypBdrEsF_QJqHd6XuheQtW7ph66D2DygGc5IxKfSCVY Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.21 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: cc36a1f6ad32416e93ab335e5dcef9a6 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc36a1f6ad32416e93ab335e5dcef9a6"}]}] Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: cc36a1f6ad32416e93ab335e5dcef9a6 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-InstanceActionsV221TestJSON-1640470089-project Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d37e243ab8cf43ffae620d23215d496b Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-InstanceActionsV221TestJSON-1640470089-project Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '7bb62d9f-275f-4528-b9fc-acc87d3119e2'} Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:14.949281 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:14.954378 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:14.956600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Returning 404 to user: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:14.958231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c1285801-817b-4512-8823-b36cb43ab694 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 404 len: 111 microversion: 2.21 time: 0.053632 Sep 25 01:22:14.959579 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2051/4116] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:14 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:22:14.979811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:14.994177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:14.995627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:14.997559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '.version_select at 0x7f7bf40c2670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:14.999538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:15.010984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.011775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.012449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.013379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.014126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.014781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.020172 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38360f90-7bf4-4813-a9b6-0d1fa39b76a0 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.293592 Sep 25 01:22:15.020778 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2066/4117] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:14 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:15.128103 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f966a64-4671-4f2d-9b40-afd43e9f6720 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.148966 Sep 25 01:22:15.138524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2052/4118] 10.222.0.16 () {60 vars in 1337 bytes} [Sun Sep 25 01:22:14 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2/os-instance-actions => generated 611 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:22:15.162774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:15.167505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:15.180725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.181253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.182034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.184694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.184958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.185505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.223423 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] HTTP exception thrown: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Request method failure captured: Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 HTTP/1.1 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL60YSAHX6NN4_6CPv8V9Xsrb7ovOEpB7R98oH_bldRdX-LRv6g5mCe_T9ZXo7asPZH2-WLC85ENvk5C_amOeO2655wccda3uiBl2V62hI4uoy2MKHpzqjLQLBqRWTvmyKGS1ypBdrEsF_QJqHd6XuheQtW7ph66D2DygGc5IxKfSCVY Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.21 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: cc36a1f6ad32416e93ab335e5dcef9a6 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc36a1f6ad32416e93ab335e5dcef9a6"}]}] Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: cc36a1f6ad32416e93ab335e5dcef9a6 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-InstanceActionsV221TestJSON-1640470089-project Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d37e243ab8cf43ffae620d23215d496b Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-InstanceActionsV221TestJSON-1640470089-project Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7bb62d9f-275f-4528-b9fc-acc87d3119e2'} Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:15.225102 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.229634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Returning 404 to user: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:15.230818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-458d204a-45b3-4e54-be29-1c353e22ba2e tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 404 len: 111 microversion: 2.21 time: 0.080591 Sep 25 01:22:15.234272 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2067/4119] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:22:15 2022] DELETE /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:22:15.243171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:15.243801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] [instance: 7bb62d9f-275f-4528-b9fc-acc87d3119e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:15.254951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.255486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.255884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.256582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.257044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.257506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.300352 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] HTTP exception thrown: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Request method failure captured: Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 HTTP/1.1 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL60YSAHX6NN4_6CPv8V9Xsrb7ovOEpB7R98oH_bldRdX-LRv6g5mCe_T9ZXo7asPZH2-WLC85ENvk5C_amOeO2655wccda3uiBl2V62hI4uoy2MKHpzqjLQLBqRWTvmyKGS1ypBdrEsF_QJqHd6XuheQtW7ph66D2DygGc5IxKfSCVY Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.21 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: cc36a1f6ad32416e93ab335e5dcef9a6 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc36a1f6ad32416e93ab335e5dcef9a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc36a1f6ad32416e93ab335e5dcef9a6"}]}] Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: cc36a1f6ad32416e93ab335e5dcef9a6 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1640470089 Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-InstanceActionsV221TestJSON-1640470089-project Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d37e243ab8cf43ffae620d23215d496b Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-InstanceActionsV221TestJSON-1640470089-project Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '7bb62d9f-275f-4528-b9fc-acc87d3119e2'} Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.307730 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. Sep 25 01:22:15.312298 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:15.314260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] Returning 404 to user: Instance 7bb62d9f-275f-4528-b9fc-acc87d3119e2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:15.317762 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f54841a-bb37-469f-bccb-4a7258592177 tempest-InstanceActionsV221TestJSON-1640470089 tempest-InstanceActionsV221TestJSON-1640470089-project] 10.222.0.16 "GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2" status: 404 len: 111 microversion: 2.21 time: 0.078444 Sep 25 01:22:15.318524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2053/4120] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:15 2022] GET /compute/v2.1/servers/7bb62d9f-275f-4528-b9fc-acc87d3119e2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:22:15.750436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:15.751638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:15.767656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.768138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.768575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.769287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.777325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.777830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.921177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:15.922286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:15.938778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.940436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.941373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:15.944041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:15.947086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:15.948263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:16.475766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:16.484882 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a02aa7e7-036f-439e-b86e-d77454678941 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1315 microversion: 2.1 time: 0.738704 Sep 25 01:22:16.496683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2068/4121] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:15 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:16.502991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:16.517714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:16.522344 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:16.527415 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a618b264-ff8c-4454-9b21-de1e94905c50 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.614595 Sep 25 01:22:16.530699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:16.547323 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2054/4122] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:15 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:16.560530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:16.566390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:16.566607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:16.567385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:16.570156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:16.575598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:16.581276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:16.581918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:16.606087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:16.616656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:16.620271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:16.624427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:16.629942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:16.636609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:16.807386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:16.851948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:16.853582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:16.882969 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea2f38af-21aa-4bea-9de4-3d8fd6bb670c tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1553 microversion: 2.91 time: 0.381429 Sep 25 01:22:16.884523 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2069/4123] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:16 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:17.076338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:17.088067 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-846790b3-c1ce-4447-9912-f2411d013d02 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.525110 Sep 25 01:22:17.090806 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2055/4124] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:16 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:17.114553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c810a4b-79d0-4a5a-9d07-f70fef5b0ed6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:17.115141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c810a4b-79d0-4a5a-9d07-f70fef5b0ed6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: e84b0452-ac67-413b-9c9b-362b0e7e6cc4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:17.128664 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-9c810a4b-79d0-4a5a-9d07-f70fef5b0ed6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance e84b0452-ac67-413b-9c9b-362b0e7e6cc4 could not be found. Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c810a4b-79d0-4a5a-9d07-f70fef5b0ed6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/e84b0452-ac67-413b-9c9b-362b0e7e6cc4/action HTTP/1.1 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 15 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: {"unpause": {}} Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e84b0452-ac67-413b-9c9b-362b0e7e6cc4 could not be found. Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e84b0452-ac67-413b-9c9b-362b0e7e6cc4', 'body': {'unpause': {}}} Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84b0452-ac67-413b-9c9b-362b0e7e6cc4 could not be found. Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84b0452-ac67-413b-9c9b-362b0e7e6cc4 could not be found. Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:17.132619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:17.137559 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:17.137559 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:17.137559 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84b0452-ac67-413b-9c9b-362b0e7e6cc4 could not be found. Sep 25 01:22:17.137559 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:17.137559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c810a4b-79d0-4a5a-9d07-f70fef5b0ed6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance e84b0452-ac67-413b-9c9b-362b0e7e6cc4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:17.137559 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c810a4b-79d0-4a5a-9d07-f70fef5b0ed6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/e84b0452-ac67-413b-9c9b-362b0e7e6cc4/action" status: 404 len: 111 microversion: 2.1 time: 0.025591 Sep 25 01:22:17.141513 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2070/4125] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:17 2022] POST /compute/v2.1/servers/e84b0452-ac67-413b-9c9b-362b0e7e6cc4/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:22:17.149088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:17.149981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:17.173066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.173944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:17.174395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:17.181006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.182776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:17.183253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:17.480935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:17.490609 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-89fccafa-b2a7-4b13-ba33-26ceaf249852 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.349683 Sep 25 01:22:17.491714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2056/4126] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:17 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:17.516538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:17.523982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:17.525324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:17.525916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:17.550879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.553161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:17.555029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:17.555571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.558184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.559084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:17.559603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:17.560176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:17.561816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:17.562655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.564664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:17.566889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:17.950520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:17.963514 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9269b31-2e48-4f77-ad7f-9d9702b97425 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.452178 Sep 25 01:22:17.981337 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2071/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:17 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:17.989826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:17.990676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:17.998606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:17.999429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.000092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.001058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.001895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.002665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.041966 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:18.056329 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4127468d-7e4e-4fd2-b321-c547cf434087 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1503 microversion: 2.1 time: 0.537601 Sep 25 01:22:18.057723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2057/4128] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:17 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1503 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:18.070292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:18.071112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:18.087601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.088574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.091023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.092258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.094202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.094956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.159743 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'unpause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 15 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: {"unpause": {}} Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'unpause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'unpause': {}}} Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state active. Cannot unpause while the instance is in this state. Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:18.165272 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:18.169148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:18.169148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:18.169148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:18.169148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:18.169148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:18.172611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'unpause' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:18.179393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73b21433-68f5-4830-a875-07fb775d0fbd tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 145 microversion: 2.1 time: 0.117342 Sep 25 01:22:18.180323 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2058/4129] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:18 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 145 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:22:18.188944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff15adb5-6b2c-4c0b-8c8a-c60a0ef0606e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:18.205221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff15adb5-6b2c-4c0b-8c8a-c60a0ef0606e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.206147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff15adb5-6b2c-4c0b-8c8a-c60a0ef0606e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.206845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff15adb5-6b2c-4c0b-8c8a-c60a0ef0606e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.244386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff15adb5-6b2c-4c0b-8c8a-c60a0ef0606e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:22:18.309937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:18.353803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:18.356413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff15adb5-6b2c-4c0b-8c8a-c60a0ef0606e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89/action" status: 202 len: 0 microversion: 2.1 time: 0.172985 Sep 25 01:22:18.359152 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2059/4130] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:18 2022] POST /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:22:18.364954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:18.365838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:18.366953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:18.375147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.376179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.376921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.378087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.378721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.379679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.381389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3947098-fff5-4b7a-aecb-e1905a1f0152 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1535 microversion: 2.91 time: 0.398530 Sep 25 01:22:18.382005 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2072/4131] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:17 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1535 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:18.418476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:18.419100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:18.440902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.441393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.441853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:18.442578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:18.443034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:18.443466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.041535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.042222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.051312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f977f36d-32a8-4ac0-9354-672ff9a739b0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.690655 Sep 25 01:22:19.066802 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2060/4132] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:18 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:19.074097 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d3e8bba-0ab4-41e7-9f8a-70fb9aff7418 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.678092 Sep 25 01:22:19.075026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2073/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:18 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:19.082243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:19.083617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:19.090540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.091298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.093957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.095396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.095593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.096228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.377826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.404179 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a85c160-7759-4804-98cd-c4856d8ccd07 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.327744 Sep 25 01:22:19.408364 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2061/4134] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:19 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:19.440699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef7a3616-77b1-4b39-aa1d-b104b77aacb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:19.441441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:19.442259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:19.442729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef7a3616-77b1-4b39-aa1d-b104b77aacb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:19.448690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.449364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.450004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.450863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.451493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.452382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.456231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ef7a3616-77b1-4b39-aa1d-b104b77aacb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb could not be found. Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef7a3616-77b1-4b39-aa1d-b104b77aacb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb/action HTTP/1.1 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 18 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: {"unshelve": null} Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb could not be found. Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb', 'body': {'unshelve': None}} Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb could not be found. Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb could not be found. Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:19.463753 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb could not be found. Sep 25 01:22:19.468948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:19.469656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef7a3616-77b1-4b39-aa1d-b104b77aacb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:19.470823 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef7a3616-77b1-4b39-aa1d-b104b77aacb0 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb/action" status: 404 len: 111 microversion: 2.1 time: 0.036293 Sep 25 01:22:19.471640 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2062/4135] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:19 2022] POST /compute/v2.1/servers/6987ed0b-bce6-4a9b-9f31-e1c7fb3460cb/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:22:19.487403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:19.491448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:19.509874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.510365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.510812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.511615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.511944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.512366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.560580 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:22:19.562974 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 01:22:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea (ip 10.222.0.16) !!! Sep 25 01:22:19.579617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.589973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.591823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.598698 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ebcae6f6-085d-49e0-b09e-dfa3fb6023ec tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1535 microversion: 2.91 time: 0.190891 Sep 25 01:22:19.600607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2074/4136] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:19 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:22:19.885291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:19.905507 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2fddc356-35ab-4e25-b332-2330d449bd4d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.416560 Sep 25 01:22:19.906967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2063/4137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:19 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:19.934959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:19.935904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:19.954975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.955464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.956117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:19.956857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:19.957284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:19.957737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.101927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:20.102621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:20.112804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.130631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.131079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.131988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.132602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.133210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.319775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:20.331241 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4fb8502-38c5-49a5-95b6-02693002f5b2 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.400088 Sep 25 01:22:20.340675 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2075/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:19 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:20.377048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:20.377730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:20.395249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.398178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.398627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.399363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.399816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.400239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.445376 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Cannot 'unshelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action HTTP/1.1 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 18 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: {"unshelve": null} Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'unshelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'unshelve': None}} Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 in vm_state active. Cannot unshelve while the instance is in this state. Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:22:20.449006 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:20.454452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 409 to user: Cannot 'unshelve' instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 while it is in vm_state active {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:20.455630 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f65a41ba-0af3-4e45-b7d9-cb9663805ffc tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action" status: 409 len: 146 microversion: 2.1 time: 0.081212 Sep 25 01:22:20.460905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2076/4139] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:20 2022] POST /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710/action => generated 146 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:22:20.469032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:20.469756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:20.484969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.485929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.486732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.487921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.488831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.489510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.569950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:20.580271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-04696e23-61c0-475b-9f44-027bd33fe7db tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.482020 Sep 25 01:22:20.581040 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2064/4140] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:20 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:20.655473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:20.670117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:20.689104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.689728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.691399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.692238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:20.695330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:20.695869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:20.946687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:20.958923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:20.961093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:20.967398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed1cd704-82b8-46c5-8e76-c950139948fd tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1538 microversion: 2.91 time: 0.335388 Sep 25 01:22:20.969273 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2065/4141] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:20 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1538 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:21.004530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:21.007530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:21.028666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.038438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.040744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.041220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3cdb2b23-3e9e-459f-9279-8e4d18fe0172 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.579141 Sep 25 01:22:21.041736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.042766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.044110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.044770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.047345 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2077/4142] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:20 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:21.072051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:21.072756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:21.096487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.098615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.102955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.113777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.115506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.118440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.119030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=122385) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:22:21.215098 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31b9f677-29db-4cc5-b934-3f63cb82d9e2 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action" status: 202 len: 0 microversion: 2.91 time: 0.214988 Sep 25 01:22:21.217658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2066/4143] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:22:20 2022] POST /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:22:21.233276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:21.238356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:21.255039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.256882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.261583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.262456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.263142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.264025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.453509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.459851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.473204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.475867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.476204 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02d898cf-3eaa-48f0-858d-442b070996d1 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.408651 Sep 25 01:22:21.477117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2078/4144] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:21 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:21.489210 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:21.501248 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cdfd9414-d3f4-4c8a-bb3e-8e557665b846 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1486 microversion: 2.91 time: 0.279194 Sep 25 01:22:21.501988 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2067/4145] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:21 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1486 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:21.504907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3646414f-54ac-4a86-b231-b93d6a658279 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1347222914_updated"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:21.508499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3646414f-54ac-4a86-b231-b93d6a658279 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:21.526884 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3646414f-54ac-4a86-b231-b93d6a658279 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 could not be found. Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3646414f-54ac-4a86-b231-b93d6a658279 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/servers/5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 HTTP/1.1 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 81 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1347222914_updated"}} Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 could not be found. Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5a7732af-d0c5-4d04-aec1-8c7c2a262ce1', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1347222914_updated'}}} Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 could not be found. Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 25 01:22:21.530886 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 could not be found. Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 could not be found. Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3646414f-54ac-4a86-b231-b93d6a658279 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:21.534679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3646414f-54ac-4a86-b231-b93d6a658279 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "PUT /compute/v2.1/servers/5a7732af-d0c5-4d04-aec1-8c7c2a262ce1" status: 404 len: 111 microversion: 2.1 time: 0.031924 Sep 25 01:22:21.542736 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2079/4146] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:22:21 2022] PUT /compute/v2.1/servers/5a7732af-d0c5-4d04-aec1-8c7c2a262ce1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:22:21.551694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:21.559941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:21.575051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.575516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.575960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.580109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.580853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.583780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.603830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:21.604452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:21.619895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.621607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.622076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.625106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:21.625640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:21.626254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:21.934760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.947279 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-314401c1-59d1-4bf8-b721-05cafc01e35e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.398366 Sep 25 01:22:21.974010 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2068/4147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:21 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:21.984456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:21.994754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f42854be-9d71-4fd9-8308-115b55a9f0fe tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.394692 Sep 25 01:22:21.998432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:21.999294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:22.000171 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2080/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:21 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:22.006629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.007436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.008092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.009436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.010129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.010768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.176586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:22.187600 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c395d365-b05f-49ac-a2e7-17efbaf87bc6 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.212045 Sep 25 01:22:22.188310 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2069/4149] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:21 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:22.215642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc91d247-de41-44c7-8d8f-521d425e93ae tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc91d247-de41-44c7-8d8f-521d425e93ae tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 HTTP/1.1 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 280 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.224465 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.227991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc91d247-de41-44c7-8d8f-521d425e93ae tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:22.236130 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc91d247-de41-44c7-8d8f-521d425e93ae tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "PUT /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 400 len: 619 microversion: 2.1 time: 0.019343 Sep 25 01:22:22.236130 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2081/4150] 10.222.0.16 () {60 vars in 1257 bytes} [Sun Sep 25 01:22:22 2022] PUT /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:22:22.240967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:22.245901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:22.265928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.266425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.266863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.267579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.268030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.268476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.299994 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:22.540367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:22.541005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:22.553245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.555294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.555748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.556623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.557094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.557936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.568783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:22.580128 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-483e07a6-f60b-4fed-97f5-15e4ba6a68db tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.344642 Sep 25 01:22:22.581587 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2070/4151] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:22 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:22.618641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:22.619618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:22.631778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.632748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.633795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.634772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:22.635509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:22.636210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:22.728326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:22.747856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:22.754178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:22.776153 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0dad917d-125d-45cc-8b5b-8a46aed97dbe tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1486 microversion: 2.91 time: 0.238399 Sep 25 01:22:22.794536 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2082/4152] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:22 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1486 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:22.921677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:22.932905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e90efc7-9fb8-4988-80c7-2d86fc00b409 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.327186 Sep 25 01:22:22.956372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e420f6c2-c4a0-4577-b694-d27ca68c796f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e420f6c2-c4a0-4577-b694-d27ca68c796f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: request: PUT /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 HTTP/1.1 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 24 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: {"server": {"name": ""}} Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710', 'body': {'server': {'name': ''}}} Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '' Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:22:22.970161 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 25 01:22:22.974416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:22.977380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e420f6c2-c4a0-4577-b694-d27ca68c796f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:22.978949 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2071/4153] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:22 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:22.979408 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e420f6c2-c4a0-4577-b694-d27ca68c796f tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "PUT /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 400 len: 108 microversion: 2.1 time: 0.026292 Sep 25 01:22:22.986002 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2083/4154] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:22:22 2022] PUT /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:22:22.990312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:22.991022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:23.010277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:23.013101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:23.015468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:23.017022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:23.017982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:23.019764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:23.031565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:23.032437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:23.055468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:23.082399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:23.083217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:23.096467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:23.098058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:23.100052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:23.455756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:23.465436 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3294e11-1ec7-4005-9bda-37e560e16630 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1504 microversion: 2.1 time: 0.480165 Sep 25 01:22:23.478853 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2072/4155] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:22 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:23.594166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:23.599467 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:23.605793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73204571-a198-4b42-bca3-b17fcbcf8aab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.579711 Sep 25 01:22:23.607500 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2084/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:23 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:23.807930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:23.810341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:23.823317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:23.823810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:23.825397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:23.835679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:23.836177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:23.836621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:23.976263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:23.993621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:23.995567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:24.008465 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5f7eecc-c303-417d-8360-445155befd65 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.207104 Sep 25 01:22:24.009067 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2073/4157] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:23 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:24.634247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:24.636048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:24.645103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:24.646818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:24.647626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:24.650459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:24.651178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:24.651933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:25.039264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:25.043187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:25.044369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:25.050234 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-650150f5-c40b-4f22-af35-d1f5422f1494 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.419771 Sep 25 01:22:25.056248 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2085/4158] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:24 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:25.065590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:25.066573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:25.067124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:25.067972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:25.069682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:25.073889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:25.272467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:25.292777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:25.301641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:25.324806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8f059de-5940-4475-817e-93e9047fac0b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.285092 Sep 25 01:22:25.325827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2074/4159] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:25 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:26.080514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:26.081140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:26.118357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:26.118866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:26.119315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:26.120042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:26.120503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:26.121261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:26.359866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:26.361659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:26.385041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:26.385862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:26.390019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:26.390998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:26.394519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:26.396524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:26.691598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:26.731760 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bdc724dc-3170-41ff-bb52-7b28a16c8e50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.655802 Sep 25 01:22:26.734300 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2086/4160] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:26 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:26.841027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:26.853044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:26.863217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:26.887402 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-529e762d-4d43-488f-be2e-d2d986ee3af5 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.531636 Sep 25 01:22:26.899059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2075/4161] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:26 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:22:27.764446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:27.765275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:27.792337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:27.793923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:27.795691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:27.797920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:27.800208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:27.802311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:27.922151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:27.923104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:27.937473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:27.937986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:27.939444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:27.941647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:27.943279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:27.943913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:28.332430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:28.352670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:28.359684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:28.395883 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f80d24e8-6f54-4846-98c5-519f9a21366e tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.467252 Sep 25 01:22:28.400592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2076/4162] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:27 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:28.556345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:28.579990 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a106207c-9af6-404b-9bc3-93f8b8177485 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.822057 Sep 25 01:22:28.580598 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2087/4163] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:27 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:29.444997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:29.446304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:29.458630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:29.466025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:29.466490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:29.468045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:29.468700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:29.469142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:29.607465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:29.609064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:29.612765 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=98 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:29.635250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:29.635746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:29.636178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:29.636882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:29.637325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:29.669798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:29.671777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:29.681058 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:29.682638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:29.690518 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c57195a5-a281-4263-9a5f-a1609e469ee7 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.249902 Sep 25 01:22:29.691703 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2077/4164] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:29 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:30.083016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:30.105237 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be87ca66-7cc1-4726-9da1-78f013b01728 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.500619 Sep 25 01:22:30.107622 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2088/4165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:29 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:30.723260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:30.724717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:30.751946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:30.752643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:30.753107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:30.756616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:30.760125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:30.760686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:31.134169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:31.134792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:31.149595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:31.150409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:31.153791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:31.165737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:31.166386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:31.170950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:31.172573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:31.176071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:31.188997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:31.212354 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63677d03-b0d2-411a-bf82-839bb05ed904 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.494113 Sep 25 01:22:31.221098 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2078/4166] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:30 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:31.524617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:31.536373 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bbb94b50-b3d7-43b8-9e3a-a9169d0db1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.404957 Sep 25 01:22:31.550496 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2089/4167] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:31 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:32.251038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:32.252220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:32.287199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:32.288677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:32.291674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:32.293556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:32.298022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:32.300000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:32.567719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:32.572408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:32.588056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:32.594771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:32.597305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:32.599954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:32.602553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:32.610726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:32.681458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:32.691869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:32.694750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:32.701789 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1bb0eac-3be6-497a-a7bc-8ae68bd5bc86 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.454494 Sep 25 01:22:32.718598 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2079/4168] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:32 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:33.343234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:33.355731 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b2c73d2-53fc-489f-9c13-134a7559df50 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.791607 Sep 25 01:22:33.369931 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2090/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:32 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:33.741652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:33.742284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:33.782304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:33.783831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:33.787289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:33.797358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:33.803909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:33.806925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:34.131658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:34.169253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:34.175229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:34.205309 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0fbf5ff3-0bc6-4416-a1f1-6959f405a341 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.467945 Sep 25 01:22:34.206720 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2080/4170] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:33 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:34.385563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:34.386468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:34.400908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:34.401948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:34.406017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:34.407315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:34.408109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:34.408857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:35.238740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:35.239527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:35.270529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:35.271424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:35.273136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:35.275665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:35.280635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:35.282264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:35.724989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:35.735126 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-44a98b5b-521e-4eca-8c9a-22417c47a625 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 1.353407 Sep 25 01:22:35.758370 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2091/4171] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:34 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:35.805604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:35.856289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:35.858726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:35.928150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21ecd0d8-b22b-44cf-94ab-eba4126b68da tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.696185 Sep 25 01:22:35.933124 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2081/4172] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:35 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:36.766789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:36.767579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:36.789567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:36.792002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:36.794084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:36.798102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:36.801379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:36.803093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:37.343700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1475962177", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "aefdc321-4655-4e3a-9448-45733e6a77c7"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:37.486720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] validate_networks() for [('aefdc321-4655-4e3a-9448-45733e6a77c7', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:22:38.924201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:38.936274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57453318-f7dd-401f-8164-f7992cdd7005 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 2.173479 Sep 25 01:22:38.936877 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2082/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:36 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:22:38.942107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:38.942731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:38.969911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:38.970419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:38.970866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:38.983752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:38.985927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:38.986559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.492217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:39.516349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:39.524094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:39.544770 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14fca0c1-8765-4f80-8271-b386713d2e63 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.606788 Sep 25 01:22:39.545363 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2083/4174] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:38 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:39.603736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:39.604261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:39.618839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:39.619341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:39.621526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.622257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:39.626394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:39.626901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.686269 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 HTTP/1.1 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '746b7b50-ec4b-480c-8f57-2a2daba9a131'} Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:39.687857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.692531 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.699255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:39.704830 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d73f76a9-5b7e-42c3-814c-b19b3bd0f641 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "DELETE /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 404 len: 111 microversion: 2.1 time: 0.158427 Sep 25 01:22:39.705432 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2084/4175] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:22:39 2022] DELETE /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:39.716144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:39.718168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 746b7b50-ec4b-480c-8f57-2a2daba9a131] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:39.727943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:39.731015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:39.731629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.732704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:39.733959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:39.734829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.759317 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 HTTP/1.1 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '746b7b50-ec4b-480c-8f57-2a2daba9a131'} Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:39.763150 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. Sep 25 01:22:39.772484 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:22:39.775132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 746b7b50-ec4b-480c-8f57-2a2daba9a131 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:39.776297 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbc90bb3-02ff-40f3-83ea-474e8fb53083 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131" status: 404 len: 111 microversion: 2.1 time: 0.064916 Sep 25 01:22:39.781303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2085/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:39 2022] GET /compute/v2.1/servers/746b7b50-ec4b-480c-8f57-2a2daba9a131 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:39.789851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:39.791080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:39.803273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:39.804539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:39.806002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.807641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:39.808627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:39.809553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:39.876779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:22:39.971584 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:40.065748 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2803776b-5e8a-4cea-bdf3-6e5badb9aab7 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 204 len: 0 microversion: 2.1 time: 0.280819 Sep 25 01:22:40.068679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2086/4177] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:22:39 2022] DELETE /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:22:40.099026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:40.100238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:40.125389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:40.129043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:40.132142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:40.135582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:40.137039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:40.137515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:40.807518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:22:40.808102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:22:40.808369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:22:40.808781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:22:40.809580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:22:40.831855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:40.832362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:40.838552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:40.842467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:40.842750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:40.843205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:40.893321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Getting quotas for project f975dd85a90549e99f53ea92c21fb41f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:22:40.927457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Getting quotas for user 023415a906544acea2a4d54b1717010e and project f975dd85a90549e99f53ea92c21fb41f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:22:40.931336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:40.944856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a4ea7dc-3cca-4ecf-9bd9-24848102b49a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 0.872269 Sep 25 01:22:40.948543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2087/4178] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:40 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:40.961577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:40.967794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:40.986935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:40.987561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:40.987901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:40.988808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:40.989808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:40.990281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:22:40.990782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:41.003810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:22:41.136869 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-49ba552d-3de8-48ea-b562-09bccfc15f2c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.753872 Sep 25 01:22:41.149681 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2092/4179] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:22:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:22:41.157463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:41.158660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:41.167127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:41.168277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:41.169239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:41.170277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:41.170924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:41.172879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:41.588412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:41.607834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:41.614605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:41.624572 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c47cfc2-0981-4956-aa8d-0c60be5636bf tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.472923 Sep 25 01:22:41.626626 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2093/4180] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:41 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:41.652672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-591f6877-dbb2-4078-bf16-6d179fde488b tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:41.655227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-591f6877-dbb2-4078-bf16-6d179fde488b tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:42.087424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-591f6877-dbb2-4078-bf16-6d179fde488b tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:42.111038 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-591f6877-dbb2-4078-bf16-6d179fde488b tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1216 microversion: 2.1 time: 0.474087 Sep 25 01:22:42.113264 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2094/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:41 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1216 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:42.152935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:42.158934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:42.189045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:42.192605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:42.193134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:42.196843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:42.197398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:42.197888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:42.396696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:42.410667 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-780630db-a24b-4b89-81cd-23bf7e9a2093 tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 1.460866 Sep 25 01:22:42.414146 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2088/4182] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:40 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:42.657680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:42.658928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:42.679024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:42.683861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:42.687493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:42.688743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:42.690668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:42.692744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:43.213191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:43.231460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:43.240825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:43.297271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c6faa55-4106-48db-9292-b7ee6e3b0148 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.646266 Sep 25 01:22:43.324543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2089/4183] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:42 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:43.336192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:43.336825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:43.372380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:43.379905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:43.380652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:43.381619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:43.382265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:43.384004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:43.630364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:43.642784 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e139592-a32a-4891-b41f-deeea3e10434 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 1.526266 Sep 25 01:22:43.647658 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2095/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:42 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:43.656193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:43.665864 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:43.689717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:43.692785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:43.693987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:43.701434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:43.702942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:43.706665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:43.959101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:43.978565 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5b72d8e-8362-4795-9455-d6a59f1813c9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1268 microversion: 2.1 time: 0.652444 Sep 25 01:22:43.979197 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2090/4185] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:43 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1268 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:44.332721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:44.333708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:44.351624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:44.352122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:44.352572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:44.353281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:44.355176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:44.355972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:45.023831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:45.038895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:45.040672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:45.050203 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3c47deb-43d1-471e-9b7c-895f9a9cf2d6 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.721357 Sep 25 01:22:45.069909 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2091/4186] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:44 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:22:45.099228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:45.100205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:45.107355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:45.107518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:45.107979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:45.110115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:45.110772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:45.112312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:45.180912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:45.195249 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1a6d6ff-2eb7-4567-bff0-702c93b83e2b tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1510 microversion: 2.1 time: 1.545853 Sep 25 01:22:45.213498 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2096/4187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:43 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1510 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:45.213498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:45.213498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:45.225655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:45.233817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:45.234451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:45.235416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:45.236007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:45.236539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:45.603427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:45.612366 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ca7dfb4-ef5d-440d-b603-ba489159487c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1274 microversion: 2.1 time: 0.409246 Sep 25 01:22:45.618399 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2097/4188] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:45 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:46.099333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:46.102221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:46.124070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:46.125134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:46.125945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:46.127156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:46.128338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:46.129557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:46.291403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:46.305777 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5af64dde-dd88-405f-b2dd-aef3c694f1f1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1513 microversion: 2.1 time: 1.234630 Sep 25 01:22:46.306431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2092/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:45 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1513 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:46.332049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:46.333295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:46.349974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:46.352673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:46.353772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:46.354528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:46.356782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:46.357447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:46.564329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:46.579771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:46.584097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:46.604704 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cae1f2fc-7282-4161-b846-6b96b6019a2b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.512100 Sep 25 01:22:46.611355 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2098/4190] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:46 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:46.644842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:46.645486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:46.656989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:46.657508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:46.657946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:46.658653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:46.659115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:46.659527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:46.916378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:46.927343 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10b737fc-eb1a-488c-ac77-aa22f6560ade tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1274 microversion: 2.1 time: 0.286393 Sep 25 01:22:46.930720 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2099/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:46 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:47.031158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e84a81d9-6828-456b-8e13-127cf8c72c1b req-8768e6c9-ca53-4a04-8203-d049ed69367d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb6535d-78e0-404a-8bf1-9a61d23b7710", "name": "network-vif-deleted", "tag": "2702c662-9d50-40a6-a247-7254aea968fe"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:47.052061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e84a81d9-6828-456b-8e13-127cf8c72c1b req-8768e6c9-ca53-4a04-8203-d049ed69367d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:47.052921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e84a81d9-6828-456b-8e13-127cf8c72c1b req-8768e6c9-ca53-4a04-8203-d049ed69367d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:47.053972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e84a81d9-6828-456b-8e13-127cf8c72c1b req-8768e6c9-ca53-4a04-8203-d049ed69367d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:47.087620 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e84a81d9-6828-456b-8e13-127cf8c72c1b req-8768e6c9-ca53-4a04-8203-d049ed69367d service nova] Creating event network-vif-deleted:2702c662-9d50-40a6-a247-7254aea968fe for instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 on n-h2-master-1 Sep 25 01:22:47.108259 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e84a81d9-6828-456b-8e13-127cf8c72c1b req-8768e6c9-ca53-4a04-8203-d049ed69367d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081098 Sep 25 01:22:47.121821 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2100/4192] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 25 01:22:47.128446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1821982888", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "f56f4e0d-1c79-4103-b373-56422d49e8f1"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:47.273444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:47.282650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] validate_networks() for [('f56f4e0d-1c79-4103-b373-56422d49e8f1', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:22:47.283833 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21a64e63-8ac9-4454-ae2b-58e112a3ec2d tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1468 microversion: 2.1 time: 0.965215 Sep 25 01:22:47.284418 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2093/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:46 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1468 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:47.332619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:47.333973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:47.347297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:47.348044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:47.356230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:47.358077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:47.360576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:47.361208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.037629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:48.046690 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a515afb-4380-46fe-ab01-dd3c7fdf5788 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1490 microversion: 2.1 time: 0.717996 Sep 25 01:22:48.047973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2094/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:47 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1490 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:48.053017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:48.054029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:48.060981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.061843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.062652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.063585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.064258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.064906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.186032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:48.198908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:48.200750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:48.206884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e155607d-9538-49f5-9b9a-67890e8ac2b8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.157572 Sep 25 01:22:48.207541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2095/4195] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:48 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:48.220226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:48.221136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:48.228528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.229106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.229645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.230419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.230945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.231434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.395718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:48.410538 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-007d1fec-8604-402c-8f88-b31a03482d31 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1274 microversion: 2.1 time: 0.201663 Sep 25 01:22:48.425464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:22:48.426717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:22:48.427536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:22:48.428216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:22:48.428863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:22:48.439691 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2096/4196] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:48 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:48.440033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.440941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.441873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.442829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.443523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.444167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.446773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:48.453020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:48.460968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.462068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.462697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.463749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.464369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.465172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.488132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Getting quotas for project 31367060596548b59603860aafed267f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:22:48.494484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Getting quotas for user 2f080bae0ec94a5b88128dd69c8a3e74 and project 31367060596548b59603860aafed267f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:22:48.510520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:22:48.514599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:22:48.547313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-701481df-d314-4318-8431-209a74761e2c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 200 len: 192 microversion: 2.1 time: 0.105920 Sep 25 01:22:48.553751 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2097/4197] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:22:48 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:48.562005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:48.563998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:48.577134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.578158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.580252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.581714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.582398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.583579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.600582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dce2f85a-54e9-484a-8723-3fdcd344babe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472719 Sep 25 01:22:48.608461 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2101/4198] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:22:48.614430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:48.632248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:48.634984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.636012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.636621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.637314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lazy-loading 'fault' on Instance uuid 1fb6535d-78e0-404a-8bf1-9a61d23b7710 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:22:48.661888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.663048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.663932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.664898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:48.665869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:48.666520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:48.760046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ce0396cdb949558664fac11b83aca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24a0d735e74e24aa2cabf4233d0e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:48.781431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0372a2e-0c40-42b6-9bed-4b5d43bec36e tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 200 len: 1306 microversion: 2.1 time: 0.224208 Sep 25 01:22:48.782224 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2098/4199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:48 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:48.791663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f739881-026b-4b7a-abe4-63e5fc47fdc2 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:48.792286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f739881-026b-4b7a-abe4-63e5fc47fdc2 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:48.803473 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:49.234522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f739881-026b-4b7a-abe4-63e5fc47fdc2 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:49.244739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f739881-026b-4b7a-abe4-63e5fc47fdc2 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1219 microversion: 2.1 time: 0.459956 Sep 25 01:22:49.275937 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2099/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:48 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1219 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:49.297538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:49.298334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:49.313870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:49.314435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:49.316681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:49.317610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:49.327070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:49.327687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:49.519959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:49.531102 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a431c28-f1b5-4505-82d7-785a9e88598f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.919139 Sep 25 01:22:49.531884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2102/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:48 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:49.557144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:49.557144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:49.568185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:49.568605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:49.569114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:49.569860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:49.570384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:49.570813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:49.628028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:49.651099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:49.656898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:49.671192 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eea289ea-7f0b-47d5-9700-644235297410 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.393474 Sep 25 01:22:49.672924 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2100/4202] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:49 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:49.683864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:49.684496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:49.702984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:49.703490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:49.704117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:49.704839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:49.705297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:49.705751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.015527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:51.028865 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cedfa57-8077-48f7-8aa1-533d0786072e tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.489122 Sep 25 01:22:51.041999 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2103/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:49 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:51.060689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:51.061335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] [instance: 1fb6535d-78e0-404a-8bf1-9a61d23b7710] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:51.078194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.078689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.081597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.082546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.087313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.087966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.121105 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] HTTP exception thrown: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 could not be found. Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Request method failure captured: Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 HTTP/1.1 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6w5MZ8e63PcWT8yWFWoHeT90zjBAk9Bn7FLpGm7sxnJrkyjV-tl_rx_TL4F-1a_DuCGpTBbdicAcGsIqryRWW6DzyDFDPLuE9fMysApMFswXUrvCXe71CqMqli-yPYtipsVkfEvc1t5WpGc4jKpCPjTQJVqASgSgpVTEr6vffX_dcY Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba24a0d735e74e24aa2cabf4233d0e71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba24a0d735e74e24aa2cabf4233d0e71"}]}] Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba24a0d735e74e24aa2cabf4233d0e71 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-151250999 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 67ce0396cdb949558664fac11b83aca1 Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-151250999-project Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 could not be found. Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1fb6535d-78e0-404a-8bf1-9a61d23b7710'} Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 could not be found. Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 could not be found. Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:51.126240 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 could not be found. Sep 25 01:22:51.135323 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:51.148818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] Returning 404 to user: Instance 1fb6535d-78e0-404a-8bf1-9a61d23b7710 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:51.149773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8936c499-71e3-4900-bed2-56c34194bcbe tempest-ServersNegativeTestJSON-151250999 tempest-ServersNegativeTestJSON-151250999-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710" status: 404 len: 111 microversion: 2.1 time: 0.106626 Sep 25 01:22:51.161548 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2104/4204] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:51 2022] GET /compute/v2.1/servers/1fb6535d-78e0-404a-8bf1-9a61d23b7710 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:22:51.166423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:51.167042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:51.183428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.186272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.187140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.188079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.188942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.192132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.255262 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:51.416071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:51.440573 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9630a9b3-b73f-4482-9907-39465c243021 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1277 microversion: 2.1 time: 0.277849 Sep 25 01:22:51.445637 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2105/4205] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:51 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:51.450616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:51.459953 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:51.475032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.475714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.476242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.478181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.483646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.484241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.548304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:51.563107 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aef7633c-1108-4196-9716-4ab6de6e34f5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.881351 Sep 25 01:22:51.567920 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2101/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:51.589377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:51.590024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:51.616892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.617388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.619276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:51.620003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:51.620462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:51.620885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:52.151999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:52.178919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:52.192056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:52.213960 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f178abe6-d3a0-4353-ab87-5fdfc1d8f294 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1544 microversion: 2.91 time: 0.766257 Sep 25 01:22:52.215615 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2106/4207] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:51 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1544 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:52.231414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:52.233190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:52.261156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:52.262575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:52.267377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:52.269635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:52.271851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:52.272591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:52.451451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:52.460602 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53fdc010-e3f5-4268-9ace-c95aa0818d2d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.875217 Sep 25 01:22:52.465597 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2102/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:51 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:52.476214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:52.478837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:52.494439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:52.499016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:52.499712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:52.500634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:52.501257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:52.503517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:53.239458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:53.258302 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de61cd53-7b05-4ed1-b31e-147d1694d803 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1277 microversion: 2.1 time: 0.791260 Sep 25 01:22:53.259218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2103/4209] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:52 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1277 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:53.270704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:53.275201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:53.289329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:53.290537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:53.291236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:53.292234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:53.298007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:53.298748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:53.329053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:53.345870 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74da57a8-b5d9-45dd-a6bd-e78bd6ed39ad tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.118862 Sep 25 01:22:53.348713 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:53.359929 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2107/4210] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:52 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:53.369338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:53.379425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:53.393627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:53.395189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:53.399681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:53.400766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:53.401601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:53.402263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:53.854916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:53.869936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:53.871819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:53.893118 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34cfb00d-7bb8-4711-924f-7d7c432a368b tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1531 microversion: 2.91 time: 0.531948 Sep 25 01:22:53.894072 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2108/4211] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:53 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1531 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:53.927549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:53.928137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:53.952329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:53.956356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:53.956909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:53.960524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:53.962221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:53.962660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.264451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] Lazy-loading 'services' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:22:54.304117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3eda0ea-b1ef-4c08-a844-d588a018f214 tempest-UnshelveToHostMultiNodesTest-364284745 tempest-UnshelveToHostMultiNodesTest-364284745-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1936 microversion: 2.91 time: 0.380626 Sep 25 01:22:54.313457 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2109/4212] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:53 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1936 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:22:54.313457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:54.313457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:54.318588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.319401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.319849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.320560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.321019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.321603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.569736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:54.580896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab1bab48-8ff6-459b-8915-6aace821b7a1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1277 microversion: 2.1 time: 0.274512 Sep 25 01:22:54.583955 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2110/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:54 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:54.590601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:54.591382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:54.598537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.599343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.600046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.600977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.601687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.602331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.644857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:22:54.730417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:54.745801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85cc3856-ff67-4596-8b07-3335f550c8e3 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.482041 Sep 25 01:22:54.747994 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2104/4214] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:53 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:54.754804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:54.756394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:54.769053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.772069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.773222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.774434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.775135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.775846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.776261 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1705d04a-4aab-4832-b76b-930359a31ba3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 204 len: 0 microversion: 2.91 time: 0.189487 Sep 25 01:22:54.785268 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2111/4215] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:22:54 2022] DELETE /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:22:54.798386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:54.799638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:54.811778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.812513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.813110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:54.814057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:54.814690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:54.815283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:55.530129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:55.547123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:55.548600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:55.564168 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09647178-7327-4fd1-8920-5e4235634cb3 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.773916 Sep 25 01:22:55.565025 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2112/4216] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:54 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:55.581778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1645787851", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "bd392121-2ba2-4140-9dd3-57e5e13ec24b"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:55.674311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] validate_networks() for [('bd392121-2ba2-4140-9dd3-57e5e13ec24b', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:22:56.098547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:56.115706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-020e81d7-ec2b-4e8c-93e6-ab7c5f2cb6bf tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.365077 Sep 25 01:22:56.138950 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2105/4217] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:54 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:56.152374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:56.153325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:56.168102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:56.168721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:56.169781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:56.176468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:56.177260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:56.178634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:56.996223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:57.012851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-675706ad-fbf6-427d-9a10-8aa892cfadfc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 0.871858 Sep 25 01:22:57.014707 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2106/4218] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:56 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:57.024558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:57.026090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:57.035722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:57.036644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:57.037314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:57.038209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:57.038818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:57.039626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:57.203411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:57.219979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:57.221498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:57.252375 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa1d2da1-aa5c-49cb-9704-2264f6137851 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1537 microversion: 2.91 time: 0.235816 Sep 25 01:22:57.254474 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2107/4219] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:57 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:57.264647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7d1f667c-b578-49b0-90bc-e6fce4971d65 req-194bd4a8-aae7-4d8c-9dba-ad2db68270a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6996767-a4b0-4319-9431-d2a11fdc955f", "tag": "8789a9f1-84e8-4c1c-bf80-6dcb14f59b62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:22:57.283367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7d1f667c-b578-49b0-90bc-e6fce4971d65 req-194bd4a8-aae7-4d8c-9dba-ad2db68270a3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:57.284009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7d1f667c-b578-49b0-90bc-e6fce4971d65 req-194bd4a8-aae7-4d8c-9dba-ad2db68270a3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:57.284749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7d1f667c-b578-49b0-90bc-e6fce4971d65 req-194bd4a8-aae7-4d8c-9dba-ad2db68270a3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:57.302180 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7d1f667c-b578-49b0-90bc-e6fce4971d65 req-194bd4a8-aae7-4d8c-9dba-ad2db68270a3 service nova] Creating event network-changed:8789a9f1-84e8-4c1c-bf80-6dcb14f59b62 for instance f6996767-a4b0-4319-9431-d2a11fdc955f on n-h2-master-1 Sep 25 01:22:57.324994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7d1f667c-b578-49b0-90bc-e6fce4971d65 req-194bd4a8-aae7-4d8c-9dba-ad2db68270a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066846 Sep 25 01:22:57.326504 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2108/4220] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:22:57.335924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:57.337093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:57.355795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:57.357358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:57.361607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:57.364172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:57.364833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:57.366426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.175863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:22:58.176949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:22:58.178848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:22:58.179472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:22:58.180083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:22:58.186264 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:58.214866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.215808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.217264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.235236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.235236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.239040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.266161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:22:58.273485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for user c1c655b1afc54b6c98d771d6acf81ee0 and project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:22:58.291255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:22:58.294218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:22:58.377673 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc637f1c-578a-40c8-8a13-3789b0afa965 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.811441 Sep 25 01:22:58.378943 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2113/4221] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:22:58.398102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:58.399978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:58.408968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.409716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.410336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.422983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.423841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.425313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.430928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:58.445684 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b60df499-cb36-4f0e-a15e-03bd32435219 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.114442 Sep 25 01:22:58.446291 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2109/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:57 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:58.453280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:58.453940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:58.475040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.475542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.476097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.476980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.477703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.478632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.528071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:58.530085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:58.530919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:58.532201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lazy-loading 'fault' on Instance uuid f8186a7a-b6ca-4725-955f-7989ff77a2ea {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:22:58.803813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:58.818010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:58.822286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9035edc30954d749d5c70f004a018b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07da64bac2374cb198fd4fe19579fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:58.839581 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2042c275-4aa7-4879-a3d4-a50580a7bfac tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 200 len: 1542 microversion: 2.91 time: 0.391984 Sep 25 01:22:58.853883 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2110/4223] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:58 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:22:58.862439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bf576c3-e1a4-4354-8721-68613ff75b54 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:58.863299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bf576c3-e1a4-4354-8721-68613ff75b54 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:59.240335 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:22:59.305860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bf576c3-e1a4-4354-8721-68613ff75b54 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:59.315770 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bf576c3-e1a4-4354-8721-68613ff75b54 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1215 microversion: 2.1 time: 0.471538 Sep 25 01:22:59.321616 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2111/4224] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:58 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1215 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:59.482860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:59.483621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:59.503526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:59.510552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:59.512008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:59.513596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:59.517680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:59.518566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:59.563655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:22:59.589966 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63689ad1-8381-4048-89c2-f1c26d23edc1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 1.209626 Sep 25 01:22:59.594883 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2114/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:58 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:22:59.890080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:22:59.891021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] [instance: f8186a7a-b6ca-4725-955f-7989ff77a2ea] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:22:59.899836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:59.900632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:59.901308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:59.917554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:22:59.918287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:22:59.919096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:22:59.939774 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] HTTP exception thrown: Instance f8186a7a-b6ca-4725-955f-7989ff77a2ea could not be found. Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Request method failure captured: Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea HTTP/1.1 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6yQJ_Bkb_b3FBwyAbJU9Rzo-g9AgA_ipycay9ws_Shc84CYBRtUZ85rR7sjpjwt5ElV2J0ixaN2-25nyoS3MmAi3NUPLWyRqYiPABu-W1APCUQdWwWr5WZqe0rpPkViJ71Kf4C-K7d27wtVNNsWqoICxyfmsj26Ta5yhoXOLMZiXOs Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.91 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 07da64bac2374cb198fd4fe19579fbfc Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-510612048 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07da64bac2374cb198fd4fe19579fbfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07da64bac2374cb198fd4fe19579fbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07da64bac2374cb198fd4fe19579fbfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07da64bac2374cb198fd4fe19579fbfc"}]}] Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-510612048 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 07da64bac2374cb198fd4fe19579fbfc Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-510612048 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-UnshelveToHostMultiNodesTest-510612048-project Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c9035edc30954d749d5c70f004a018b3 Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-510612048-project Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: exception: Instance f8186a7a-b6ca-4725-955f-7989ff77a2ea could not be found. Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'f8186a7a-b6ca-4725-955f-7989ff77a2ea'} Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8186a7a-b6ca-4725-955f-7989ff77a2ea could not be found. Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8186a7a-b6ca-4725-955f-7989ff77a2ea could not be found. Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:59.949750 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8186a7a-b6ca-4725-955f-7989ff77a2ea could not be found. Sep 25 01:22:59.956262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:22:59.961706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] Returning 404 to user: Instance f8186a7a-b6ca-4725-955f-7989ff77a2ea could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:22:59.963656 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8e2716d0-e006-4b4f-a38b-c78b4e6637a8 tempest-UnshelveToHostMultiNodesTest-510612048 tempest-UnshelveToHostMultiNodesTest-510612048-project] 10.222.0.16 "GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea" status: 404 len: 111 microversion: 2.91 time: 0.096676 Sep 25 01:22:59.967156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2115/4226] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:22:59 2022] GET /compute/v2.1/servers/f8186a7a-b6ca-4725-955f-7989ff77a2ea => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:23:00.323349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:00.337107 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-578ab447-f683-468d-9be1-e6bd0a0043ae tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 0.872104 Sep 25 01:23:00.339158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2112/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:22:59 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:00.360862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:00.361830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:00.371066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:00.371794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:00.372543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:00.374771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:00.377854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:00.378498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:00.571841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:00.595715 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-42b14883-6a49-4681-8982-83a53d0e3d37 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1267 microversion: 2.1 time: 0.256633 Sep 25 01:23:00.599256 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2116/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:00 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:00.614272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:00.614881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:00.626706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:00.628743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:00.631020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:00.631634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:00.633244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:00.633694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:00.689670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2274d5cd-8f20-4522-a05b-30f81b31cb9e req-989e4e9d-c68b-4207-b249-47dbb00c5dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f14386a-fe75-43fb-9c4e-dc27f52e4099", "tag": "88212245-9e1b-4a5c-b750-49c686036f3b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:00.700314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2274d5cd-8f20-4522-a05b-30f81b31cb9e req-989e4e9d-c68b-4207-b249-47dbb00c5dec service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:00.712523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2274d5cd-8f20-4522-a05b-30f81b31cb9e req-989e4e9d-c68b-4207-b249-47dbb00c5dec service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:00.713170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2274d5cd-8f20-4522-a05b-30f81b31cb9e req-989e4e9d-c68b-4207-b249-47dbb00c5dec service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:00.743813 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2274d5cd-8f20-4522-a05b-30f81b31cb9e req-989e4e9d-c68b-4207-b249-47dbb00c5dec service nova] Creating event network-changed:88212245-9e1b-4a5c-b750-49c686036f3b for instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 on n-h1-master-1 Sep 25 01:23:00.754803 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2274d5cd-8f20-4522-a05b-30f81b31cb9e req-989e4e9d-c68b-4207-b249-47dbb00c5dec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073922 Sep 25 01:23:00.759887 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2117/4229] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:23:01.312194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1690942444", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a4b4f8d2-abb5-4e43-9987-592e7159f42c"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:01.385999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] validate_networks() for [('a4b4f8d2-abb5-4e43-9987-592e7159f42c', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:23:02.147973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:02.165154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d0663a8c-8d74-433d-9721-2842672337ad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 1.552395 Sep 25 01:23:02.167966 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2113/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:00 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:02.178053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:02.185807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:02.203452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:02.206979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:02.210556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:02.215829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:02.219387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:02.220056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:03.315558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:03.335892 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-568cc1cd-db72-45ed-ae67-5c328b0d0256 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.165170 Sep 25 01:23:03.337171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2114/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:02 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:03.350948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:03.355931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:03.378640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:03.380533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:03.382777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:03.383805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:03.386994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:03.388771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:03.786470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:03.796704 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-debb531c-bb34-4d6b-9cdf-52853d6299e7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1273 microversion: 2.1 time: 0.458182 Sep 25 01:23:03.800123 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2115/4232] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:03 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:03.829298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:03.830624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:03.838350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:03.840075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:03.841003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:03.842231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:03.842886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:03.843468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.308338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:23:04.310588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:23:04.311897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:23:04.313665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:23:04.314455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:23:04.331268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.332354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.333248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.335017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.337498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.340027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.426214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Getting quotas for project d0c73d4bbb354b0fafd5f5a714f6d4a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:04.439595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Getting quotas for user 0b6b3f79b49c4c13a2fdceba3b60d09f and project d0c73d4bbb354b0fafd5f5a714f6d4a0. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:04.471854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Going to run 3 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:23:04.477702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:23:04.510485 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:04.531381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54a6787c-b0f5-4318-a935-88afdc6082cb tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 0.711503 Sep 25 01:23:04.534938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2116/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:03 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:04.553729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:04.555595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:04.569131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.570061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.570749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.571752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.572504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.573151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.592811 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=18a74f1e-a42d-4d0c-ab75-56ab33464e32,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:23:04.675249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=785de9d1-5ca9-4ad9-8ab9-7d065abab18b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:23:04.818247 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-54b7c9eb-51d5-437b-b606-7dcc0882e653 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.673969 Sep 25 01:23:04.820844 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2118/4234] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:23:04.839410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:04.847434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:04.857295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:04.880152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.880655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.881103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.882231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.883518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.884123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.909264 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-07de6067-8135-489d-9b49-0995a309e32b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.082320 Sep 25 01:23:04.910633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2119/4235] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:23:04 2022] GET /compute/v2.1/servers => generated 1018 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:04.921107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:04.921997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:04.929571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.930310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.931851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:04.932938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:04.934051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:04.940581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:06.237037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:06.263155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:06.267032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3e9606d9-acff-4b42-b1a6-76e630366558 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1273 microversion: 2.1 time: 1.353210 Sep 25 01:23:06.269491 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2120/4236] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:04 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1273 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:06.280297 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a687f40-4cdf-4619-8596-6edc928a1fba tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.739033 Sep 25 01:23:06.282066 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2117/4237] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:04 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:06.294360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40b0f549-df5c-4e55-a26f-9856a3f6e01f tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:06.296344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-40b0f549-df5c-4e55-a26f-9856a3f6e01f tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:06.304860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:06.311940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:06.331529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:06.338144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:06.341473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:06.344086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:06.348222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:06.350128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:06.598586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40b0f549-df5c-4e55-a26f-9856a3f6e01f tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:06.626154 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40b0f549-df5c-4e55-a26f-9856a3f6e01f tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1223 microversion: 2.1 time: 0.354435 Sep 25 01:23:06.628124 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2121/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:06 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1223 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:06.766121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-dbe72f8c-1208-45f9-bcd0-700fd3fe074d req-6c6a775a-4cc6-4fdf-9c51-0556164f2004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6996767-a4b0-4319-9431-d2a11fdc955f", "name": "network-vif-plugged", "status": "completed", "tag": "8789a9f1-84e8-4c1c-bf80-6dcb14f59b62"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:06.813558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dbe72f8c-1208-45f9-bcd0-700fd3fe074d req-6c6a775a-4cc6-4fdf-9c51-0556164f2004 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:06.815087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dbe72f8c-1208-45f9-bcd0-700fd3fe074d req-6c6a775a-4cc6-4fdf-9c51-0556164f2004 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:06.816189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dbe72f8c-1208-45f9-bcd0-700fd3fe074d req-6c6a775a-4cc6-4fdf-9c51-0556164f2004 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:06.867771 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dbe72f8c-1208-45f9-bcd0-700fd3fe074d req-6c6a775a-4cc6-4fdf-9c51-0556164f2004 service nova] Creating event network-vif-plugged:8789a9f1-84e8-4c1c-bf80-6dcb14f59b62 for instance f6996767-a4b0-4319-9431-d2a11fdc955f on n-h2-master-1 Sep 25 01:23:06.891637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-dbe72f8c-1208-45f9-bcd0-700fd3fe074d req-6c6a775a-4cc6-4fdf-9c51-0556164f2004 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133801 Sep 25 01:23:06.893335 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2122/4239] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:07.319462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:07.327220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:07.381014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:07.385032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:07.388208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:07.402885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:07.407613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:07.409141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:08.007015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:08.017983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-459f4e1b-67b0-4b19-b330-dc58da003350 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1273 microversion: 2.1 time: 0.724680 Sep 25 01:23:08.021314 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2123/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:07 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1273 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:08.039578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:08.040495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:08.047777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:08.054583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:08.055417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:08.056513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:08.062446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:08.063232 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-25e3ce8e-fe3f-4c73-94ae-736c811efca9 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 1.773294 Sep 25 01:23:08.063508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:08.064166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:08.064347 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2118/4241] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:06 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:08.073722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:08.074360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:08.094301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:08.094826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:08.096044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:08.096837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:08.097246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:08.097715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:08.303394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:08.320280 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54a2db1a-ad32-4e23-a863-8edf931ac914 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1219 microversion: 2.1 time: 0.253807 Sep 25 01:23:08.321279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2119/4242] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:08 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:08.759589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1379473013", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:08.868982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:23:09.315155 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:09.343433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:09.355292 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:09.382693 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b9f068ef-bdf6-4875-b905-07bc0361c9c3 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1316 microversion: 2.1 time: 1.354357 Sep 25 01:23:09.400970 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2124/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:08 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1316 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:09.407865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:09.408733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:09.418823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:09.419735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:09.421082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:09.422570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:09.424016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:09.427394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.013906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:23:10.014518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:23:10.015141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:23:10.015692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:23:10.016246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:23:10.026250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:10.027538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:10.028675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.029633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:10.030242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:10.030830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.053360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Getting quotas for project 23809750555c4833995dcc11499fa523. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:10.059470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Getting quotas for user f33ca9c1d1bd4d8dbc768c1746d42e25 and project 23809750555c4833995dcc11499fa523. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:10.074225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:23:10.076855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:23:10.145555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1b06c72-bcc8-4750-8ef6-df98e0a23540 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.819336 Sep 25 01:23:10.146300 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2120/4244] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:23:10.171610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:10.172750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:10.192155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:10.193976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:10.194578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.196509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:10.197054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:10.199167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.273304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:10.283757 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe2b4e07-1e95-4eeb-96d2-b00d4f50d477 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 0.881150 Sep 25 01:23:10.285948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2125/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:09 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:10.295769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:10.296598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:10.305361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:10.306152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:10.306828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.308934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:10.310279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:10.318482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:10.543042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:10.561551 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d237f84d-8b7f-43ed-96d6-2e5cc39abde6 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1281 microversion: 2.1 time: 0.268469 Sep 25 01:23:10.562306 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2126/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:10 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1281 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:10.574699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60861799-5648-4266-bf9d-f9554fba91ff tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:10.578574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60861799-5648-4266-bf9d-f9554fba91ff tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:11.267789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60861799-5648-4266-bf9d-f9554fba91ff tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:11.270518 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=29 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:11.280959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60861799-5648-4266-bf9d-f9554fba91ff tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1214 microversion: 2.1 time: 0.716140 Sep 25 01:23:11.283340 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2127/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:10 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1214 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:11.289642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:11.299282 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd027cfb-1a7d-475d-936a-e91564461d9c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 1.143162 Sep 25 01:23:11.301137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2121/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:10 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:11.301385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:11.301887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:11.307842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8f860f24-c5ba-41ea-a420-a88a09c06b40 req-987e89c6-ec5e-43c1-9622-0d501c4b4c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f14386a-fe75-43fb-9c4e-dc27f52e4099", "name": "network-vif-plugged", "status": "completed", "tag": "88212245-9e1b-4a5c-b750-49c686036f3b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:11.321649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f860f24-c5ba-41ea-a420-a88a09c06b40 req-987e89c6-ec5e-43c1-9622-0d501c4b4c52 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:11.322646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f860f24-c5ba-41ea-a420-a88a09c06b40 req-987e89c6-ec5e-43c1-9622-0d501c4b4c52 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:11.323291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f860f24-c5ba-41ea-a420-a88a09c06b40 req-987e89c6-ec5e-43c1-9622-0d501c4b4c52 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:11.329894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:11.330937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:11.331744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:11.332669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:11.333618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:11.334212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:11.337459 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8f860f24-c5ba-41ea-a420-a88a09c06b40 req-987e89c6-ec5e-43c1-9622-0d501c4b4c52 service nova] Creating event network-vif-plugged:88212245-9e1b-4a5c-b750-49c686036f3b for instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 on n-h1-master-1 Sep 25 01:23:11.345891 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8f860f24-c5ba-41ea-a420-a88a09c06b40 req-987e89c6-ec5e-43c1-9622-0d501c4b4c52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042759 Sep 25 01:23:11.347608 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2122/4249] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:11.354674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:11.356974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:11.368682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:11.369607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:11.370308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:11.372498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:11.374185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:11.374877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:11.945089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:11.955618 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d8ef097-5a71-4f63-9d2e-0932dd96803f tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1503 microversion: 2.1 time: 0.665083 Sep 25 01:23:11.974514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2128/4250] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:11 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1503 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:11.990643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:11.992495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:12.008943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.010063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.010657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.013042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.015485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.016358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.279042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:12.285181 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:12.314635 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c4e6d02-8847-4f61-bc47-154acf67a627 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 0.965382 Sep 25 01:23:12.315968 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2123/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:11 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:12.333273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:12.335722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:12.353103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.358890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.359428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.360405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.360888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.361336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.480385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:12.491672 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cb2453db-3bd9-4537-bb1d-8e74733882ae tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1281 microversion: 2.1 time: 0.515035 Sep 25 01:23:12.494650 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2129/4252] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:11 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1281 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:12.510496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:12.511422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:12.527973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.529200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.530370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.531485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.540454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a7875304-53df-44f9-9315-9fa66295bee5 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.222609 Sep 25 01:23:12.545219 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2124/4253] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 25 01:23:12 2022] DELETE /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f/os-server-password => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:12.547607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.548347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.556642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:12.558521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:12.577739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.578258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.584148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.585071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.585610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.586056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.758531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:12.768091 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ed884a1-6373-437d-8297-2f4a7fe3c898 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1272 microversion: 2.1 time: 0.272129 Sep 25 01:23:12.769236 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2130/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:12 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:12.774447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:12.775219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:12.783877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.784798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.785579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.786601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.787322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.788018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.826867 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf67af20-34f4-4fa8-83e8-d4b99f0406e0 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.056335 Sep 25 01:23:12.827689 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2131/4255] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:23:12 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f/os-server-password => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:12.838657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:12.839364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:12.846999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.847832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.848467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.849577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:12.850256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:12.850881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:12.881320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:23:12.986231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd84a0ad-2fb8-4446-889c-d5df23e07727 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 204 len: 0 microversion: 2.1 time: 0.151041 Sep 25 01:23:12.987787 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2132/4256] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:23:12 2022] DELETE /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:23:12.998924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:12.999805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:13.007875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:13.008777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:13.009322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:13.010503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:13.011111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:13.011689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:13.179034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:13.195320 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-777e5e95-ecce-4324-a225-ece50f77dfe1 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1319 microversion: 2.1 time: 0.646948 Sep 25 01:23:13.198414 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2125/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:12 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:13.344187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:13.345715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:13.360221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:13.363795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:13.365244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:13.367015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:13.367724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:13.368494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:13.629028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:13.642773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-da12687f-de47-483e-85d2-0a998474b2d9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1509 microversion: 2.1 time: 0.646328 Sep 25 01:23:13.643737 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2133/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:12 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:13.652338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:13.658472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:13.675625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:13.676364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:13.678772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:13.680763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:13.683220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:13.685545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.150620 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:14.163839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d901588c-8364-4895-a79c-9270fbc52668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 0.826480 Sep 25 01:23:14.169658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2126/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:13 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:14.174907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:14.182736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:14.193808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.195014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.198601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.199605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.201115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.201907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.204345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:14.213313 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c85ff52-de9a-49de-8dab-80e6906bc3db tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 0.568297 Sep 25 01:23:14.221602 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2134/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:13 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:14.238442 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:14.246773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:14.264823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.270119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.272164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.273177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.279277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.282769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.442975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:14.455260 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-98ab34f1-1982-434b-bd4a-1b54910ca1b9 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1272 microversion: 2.1 time: 0.284175 Sep 25 01:23:14.472744 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2127/4261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:14 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:14.478293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-aa92761d-5705-41af-ae0e-3e97f058f5b9 req-12fc2c5e-fe2f-490b-aa5f-9bf177188b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c89cb86-01d6-47d4-8a84-7e318ffa267d", "tag": "44a6911c-24d3-4412-908b-95b8ba905e5e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:14.499440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-aa92761d-5705-41af-ae0e-3e97f058f5b9 req-12fc2c5e-fe2f-490b-aa5f-9bf177188b21 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.500063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-aa92761d-5705-41af-ae0e-3e97f058f5b9 req-12fc2c5e-fe2f-490b-aa5f-9bf177188b21 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.500547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-aa92761d-5705-41af-ae0e-3e97f058f5b9 req-12fc2c5e-fe2f-490b-aa5f-9bf177188b21 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.530247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-aa92761d-5705-41af-ae0e-3e97f058f5b9 req-12fc2c5e-fe2f-490b-aa5f-9bf177188b21 service nova] Creating event network-changed:44a6911c-24d3-4412-908b-95b8ba905e5e for instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d on n-h2-master-1 Sep 25 01:23:14.535494 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-aa92761d-5705-41af-ae0e-3e97f058f5b9 req-12fc2c5e-fe2f-490b-aa5f-9bf177188b21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061205 Sep 25 01:23:14.537900 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2128/4262] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:14.666992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:14.668292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:14.681220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.689990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.702627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.704416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:14.707345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:14.709029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:14.892249 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:15.338668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:15.364729 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc3d2363-12c2-4f2b-a0f1-8ad023834381 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1508 microversion: 2.1 time: 1.139704 Sep 25 01:23:15.377544 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2135/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:14 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1508 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:15.734589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-59eaa28a-112b-4f53-a0bb-1e364fa5769a req-c3aeda42-ef4b-4fd3-8de4-6157b6921330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a74f1e-a42d-4d0c-ab75-56ab33464e32", "tag": "61a0b284-7715-4696-8e3a-656c09793638"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:15.803089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-59eaa28a-112b-4f53-a0bb-1e364fa5769a req-c3aeda42-ef4b-4fd3-8de4-6157b6921330 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:15.803530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-59eaa28a-112b-4f53-a0bb-1e364fa5769a req-c3aeda42-ef4b-4fd3-8de4-6157b6921330 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:15.803974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-59eaa28a-112b-4f53-a0bb-1e364fa5769a req-c3aeda42-ef4b-4fd3-8de4-6157b6921330 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:15.860936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-59eaa28a-112b-4f53-a0bb-1e364fa5769a req-c3aeda42-ef4b-4fd3-8de4-6157b6921330 service nova] Creating event network-changed:61a0b284-7715-4696-8e3a-656c09793638 for instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 on n-h1-master-1 Sep 25 01:23:15.874859 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-59eaa28a-112b-4f53-a0bb-1e364fa5769a req-c3aeda42-ef4b-4fd3-8de4-6157b6921330 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.500246 Sep 25 01:23:15.876093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2136/4264] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:15.890417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:15.891124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:15.920924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:15.921462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:15.921880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:15.922589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:15.923032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:15.936499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:16.159954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:16.172755 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a20ccbfb-63c5-419b-8cb1-6cb324aa2da9 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1509 microversion: 2.1 time: 1.507964 Sep 25 01:23:16.173319 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2129/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:14 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1509 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:16.190511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:16.195329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:16.213117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:16.219955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:16.220753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:16.223957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:16.224792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:16.225444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:17.999319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:18.007487 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13fa4ea9-ee77-49e2-9927-094ac2d9f391 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 1.828094 Sep 25 01:23:18.024993 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2130/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:16 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:18.024993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:18.024993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:18.037327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:18.037881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:18.038330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:18.039056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:18.039509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:18.039931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:18.065166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:18.074131 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a887c5a9-a8dc-4419-90c7-e7baa424a6d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 2.196654 Sep 25 01:23:18.075242 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2137/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:15 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:18.081003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:18.091143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:18.113078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:18.118643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:18.119928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:18.120889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:18.122664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:18.127831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:18.234278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:18.246000 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1c96607-80b0-4fd4-8e93-6843c00460a0 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1272 microversion: 2.1 time: 0.233251 Sep 25 01:23:18.247726 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2131/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:18 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:18.253666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785de9d1-5ca9-4ad9-8ab9-7d065abab18b", "tag": "e6524338-db50-4050-a69f-3ae747a38f43"}, {"name": "network-changed", "server_uuid": "ecc60efc-e7ad-43a8-ad69-cacdc58f782f", "tag": "416a2ba2-7d4b-442c-b086-2caabb80f47d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:18.269169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:18.270474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:18.271205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:18.288857 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] Creating event network-changed:e6524338-db50-4050-a69f-3ae747a38f43 for instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b on n-h2-master-1 Sep 25 01:23:18.289982 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] Creating event network-changed:416a2ba2-7d4b-442c-b086-2caabb80f47d for instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f on n-h1-master-1 Sep 25 01:23:18.303742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7487f22a-d164-497c-a54f-96318b7d9d80 req-e9d5e8ce-4d32-481e-8bca-69172ad4e6eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053785 Sep 25 01:23:18.304623 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2132/4269] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:18.954904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:18.975542 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bbd63527-32b2-494e-9dda-b0043499a36a tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1509 microversion: 2.1 time: 0.897974 Sep 25 01:23:18.977571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2138/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:18 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1509 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:19.036436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:19.037487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:19.045392 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:19.056457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.057268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.060497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.061521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.063230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.064713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.107916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:19.109991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:19.125126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.128337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.129981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.133975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.136448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.137865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.784797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:19.810308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d403bc20-5607-4294-839c-1d02b94cc01a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 0.708453 Sep 25 01:23:19.817576 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2139/4271] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:19 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:19.819156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:19.828175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:19.834282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:19.842737 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b8617456-b672-443b-869e-9a02a8a84d45 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 0.813005 Sep 25 01:23:19.843348 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2133/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:19 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:19.856296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.860874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-70b4346a-8725-4885-8c57-6543f692b03e req-21621cfb-a8cb-4459-baa8-e82b913af027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6996767-a4b0-4319-9431-d2a11fdc955f", "name": "network-vif-deleted", "tag": "8789a9f1-84e8-4c1c-bf80-6dcb14f59b62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:19.875148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.876842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.881139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.890463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.891390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.900636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-70b4346a-8725-4885-8c57-6543f692b03e req-21621cfb-a8cb-4459-baa8-e82b913af027 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:19.904381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-70b4346a-8725-4885-8c57-6543f692b03e req-21621cfb-a8cb-4459-baa8-e82b913af027 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:19.905035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-70b4346a-8725-4885-8c57-6543f692b03e req-21621cfb-a8cb-4459-baa8-e82b913af027 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:19.933838 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-70b4346a-8725-4885-8c57-6543f692b03e req-21621cfb-a8cb-4459-baa8-e82b913af027 service nova] Creating event network-vif-deleted:8789a9f1-84e8-4c1c-bf80-6dcb14f59b62 for instance f6996767-a4b0-4319-9431-d2a11fdc955f on n-h2-master-1 Sep 25 01:23:19.949298 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-70b4346a-8725-4885-8c57-6543f692b03e req-21621cfb-a8cb-4459-baa8-e82b913af027 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099127 Sep 25 01:23:19.955262 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2134/4273] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:20.004262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:20.004968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:20.020508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:20.021982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:20.026349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:20.028868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:20.030343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:20.031173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:20.042099 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:20.085123 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:20.199771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:20.209379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c395a0a6-c267-4067-ac96-f570be8d6bfc tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1467 microversion: 2.1 time: 0.209215 Sep 25 01:23:20.219045 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2135/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:19 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1467 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:20.239955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:20.258029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2960de52-dee7-4c94-bcd3-2949a0ab39f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.439157 Sep 25 01:23:20.263944 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2140/4275] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:19 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:20.841487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:20.842191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:20.857543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:20.860190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:20.861243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:20.863605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:20.865481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:20.866647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:20.871377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:20.872780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:20.876013 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:20.885902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:20.894042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:20.894783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:20.895530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:20.895983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:20.896406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.275636 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:21.523601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:21.533878 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b7bc9d36-3f8c-4e3f-8286-b477eaff542e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 0.701144 Sep 25 01:23:21.536055 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2136/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:20 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:21.541334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cac48a0b-5ea0-48f7-baec-067b57539341 req-570db21f-a3e2-41bb-a65e-1fe643347d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a74f1e-a42d-4d0c-ab75-56ab33464e32", "name": "network-vif-plugged", "status": "completed", "tag": "61a0b284-7715-4696-8e3a-656c09793638"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:21.556730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cac48a0b-5ea0-48f7-baec-067b57539341 req-570db21f-a3e2-41bb-a65e-1fe643347d54 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:21.557881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cac48a0b-5ea0-48f7-baec-067b57539341 req-570db21f-a3e2-41bb-a65e-1fe643347d54 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:21.559811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cac48a0b-5ea0-48f7-baec-067b57539341 req-570db21f-a3e2-41bb-a65e-1fe643347d54 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.579853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cac48a0b-5ea0-48f7-baec-067b57539341 req-570db21f-a3e2-41bb-a65e-1fe643347d54 service nova] Creating event network-vif-plugged:61a0b284-7715-4696-8e3a-656c09793638 for instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 on n-h1-master-1 Sep 25 01:23:21.587568 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cac48a0b-5ea0-48f7-baec-067b57539341 req-570db21f-a3e2-41bb-a65e-1fe643347d54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049303 Sep 25 01:23:21.589529 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2137/4277] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:21.599502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:21.600641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:21.609200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:21.610491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:21.611423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.612409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:21.613134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:21.613902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.643873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:21.654100 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:21.674121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:21.674991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:21.675930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.677575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lazy-loading 'fault' on Instance uuid f6996767-a4b0-4319-9431-d2a11fdc955f {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:23:21.701348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ac466ec-40ae-4ec4-b791-995fe998df5a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 0.833430 Sep 25 01:23:21.708976 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2141/4278] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:20 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:21.743046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:21.743910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:21.752676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:21.754164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:21.755025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.756481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:21.757162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:21.757982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:21.801220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023415a906544acea2a4d54b1717010e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f975dd85a90549e99f53ea92c21fb41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:21.810121 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8dbdfa03-97d5-4143-b6a5-e48c35b0a09c tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 200 len: 1306 microversion: 2.1 time: 0.218286 Sep 25 01:23:21.810708 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2138/4279] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:21 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:22.126658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:22.136692 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ea1b06f-09d3-470a-8b36-cc1a33a16b5f tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.422938 Sep 25 01:23:22.139633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2142/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:21 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:22.564071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:22.569482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:22.593380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:22.594729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:22.595336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:22.596563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:22.597567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:22.598425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:22.727064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:22.727738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:22.750851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:22.753698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:22.754455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:22.755207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:22.755676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:22.757884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:24.150792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:24.162882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14da4603-8993-4342-abfe-3a68f2feb15a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 1.604651 Sep 25 01:23:24.164654 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2139/4281] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:22 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:24.172943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:24.174186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] [instance: f6996767-a4b0-4319-9431-d2a11fdc955f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:24.188524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:24.189637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:24.191426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:24.194090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:24.195204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:24.198139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:24.235080 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] HTTP exception thrown: Instance f6996767-a4b0-4319-9431-d2a11fdc955f could not be found. Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Request method failure captured: Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f HTTP/1.1 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL61cQbs8rMLUJvFkB_dEgcl0AMjie58lPgCqiCDxPnYKmHpdJkagjTujnvKF6kV8r066-MvWJLJokLquRRXqCo6YiDki6Izcf_CZmfQMJuIPrlLX5ey-cKUo-zTCshj7gxqweX5ReKO57tiN6TbGKLL1TN9SQzBn0EE5cwOAgk8Rbic Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: f975dd85a90549e99f53ea92c21fb41f Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerPasswordTestJSON-1943559577 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f975dd85a90549e99f53ea92c21fb41f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f975dd85a90549e99f53ea92c21fb41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f975dd85a90549e99f53ea92c21fb41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f975dd85a90549e99f53ea92c21fb41f"}]}] Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerPasswordTestJSON-1943559577 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: f975dd85a90549e99f53ea92c21fb41f Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1943559577 Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerPasswordTestJSON-1943559577-project Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 023415a906544acea2a4d54b1717010e Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerPasswordTestJSON-1943559577-project Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f6996767-a4b0-4319-9431-d2a11fdc955f could not be found. Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f6996767-a4b0-4319-9431-d2a11fdc955f'} Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6996767-a4b0-4319-9431-d2a11fdc955f could not be found. Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6996767-a4b0-4319-9431-d2a11fdc955f could not be found. Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:24.237065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6996767-a4b0-4319-9431-d2a11fdc955f could not be found. Sep 25 01:23:24.242088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:24.244627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] Returning 404 to user: Instance f6996767-a4b0-4319-9431-d2a11fdc955f could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:24.248218 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7cb7544d-846c-4d89-8b23-c02c2319b7f4 tempest-ServerPasswordTestJSON-1943559577 tempest-ServerPasswordTestJSON-1943559577-project] 10.222.0.16 "GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f" status: 404 len: 111 microversion: 2.1 time: 0.079963 Sep 25 01:23:24.249074 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2140/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:24 2022] GET /compute/v2.1/servers/f6996767-a4b0-4319-9431-d2a11fdc955f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:23:24.255848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1b3152e4-c471-4877-b40b-f69fc98b16e1 req-cc56bb1f-d4e8-4a61-b512-b1e0366cf4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec60e15b-799a-4b31-aa84-813592121b12", "tag": "9d3489f9-653c-4e05-ba5e-499725e532c8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:24.269823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1b3152e4-c471-4877-b40b-f69fc98b16e1 req-cc56bb1f-d4e8-4a61-b512-b1e0366cf4db service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:24.271176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1b3152e4-c471-4877-b40b-f69fc98b16e1 req-cc56bb1f-d4e8-4a61-b512-b1e0366cf4db service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:24.272115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1b3152e4-c471-4877-b40b-f69fc98b16e1 req-cc56bb1f-d4e8-4a61-b512-b1e0366cf4db service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:24.303460 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1b3152e4-c471-4877-b40b-f69fc98b16e1 req-cc56bb1f-d4e8-4a61-b512-b1e0366cf4db service nova] Creating event network-changed:9d3489f9-653c-4e05-ba5e-499725e532c8 for instance ec60e15b-799a-4b31-aa84-813592121b12 on n-h2-master-1 Sep 25 01:23:24.325665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1b3152e4-c471-4877-b40b-f69fc98b16e1 req-cc56bb1f-d4e8-4a61-b512-b1e0366cf4db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074900 Sep 25 01:23:24.327456 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2141/4283] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:24.336131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:24.339196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:24.355422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:24.359981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:24.362179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:24.365288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:24.366017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:24.368851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:24.391761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:24.438889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df54c956-fd4d-463e-a660-63b9a6fc7959 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 1.717304 Sep 25 01:23:24.439512 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2143/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:22 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:25.158591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f429d878-79bc-4717-a7be-1027c76be176 req-002744c9-9813-40e1-9951-5bea86e360e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c89cb86-01d6-47d4-8a84-7e318ffa267d", "name": "network-vif-plugged", "status": "completed", "tag": "44a6911c-24d3-4412-908b-95b8ba905e5e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:25.186360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f429d878-79bc-4717-a7be-1027c76be176 req-002744c9-9813-40e1-9951-5bea86e360e3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:25.187113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f429d878-79bc-4717-a7be-1027c76be176 req-002744c9-9813-40e1-9951-5bea86e360e3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:25.188026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f429d878-79bc-4717-a7be-1027c76be176 req-002744c9-9813-40e1-9951-5bea86e360e3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:25.208083 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f429d878-79bc-4717-a7be-1027c76be176 req-002744c9-9813-40e1-9951-5bea86e360e3 service nova] Creating event network-vif-plugged:44a6911c-24d3-4412-908b-95b8ba905e5e for instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d on n-h2-master-1 Sep 25 01:23:25.226995 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f429d878-79bc-4717-a7be-1027c76be176 req-002744c9-9813-40e1-9951-5bea86e360e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072011 Sep 25 01:23:25.230446 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2144/4285] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:23:25.244976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:25.245746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:25.293860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:25.294362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:25.294961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:25.295687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:25.296141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:25.297320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:25.343937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:25.348540 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:25.365933 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27b38b08-ba16-4c6d-aeff-04bcaae324d1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 1.035377 Sep 25 01:23:25.373451 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2142/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:24 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:25.468870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:25.469744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:25.503016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:25.504379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:25.507941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:25.508740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:25.509219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:25.509687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:26.008913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:26.022965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b8c27f1-ab78-4263-a29b-aef0b4c88012 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 0.790432 Sep 25 01:23:26.026937 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2145/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:25 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:26.109826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:26.118276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1e7b349-1497-4c1b-b2d9-dfebd6815b18 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 0.658983 Sep 25 01:23:26.118855 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2143/4288] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:25 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:26.404429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:26.405338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:26.417378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:26.422449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:26.424524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:26.425940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:26.426648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:26.427882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:26.908822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:26.922102 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13969102-ed23-4fe5-b575-9188bbabfbb1 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.525754 Sep 25 01:23:26.926249 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2146/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:26 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:27.052013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:27.053187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:27.070427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:27.070937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:27.071381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:27.072098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:27.072549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:27.072972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:27.142942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:27.144596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:27.156869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:27.158885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:27.160451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:27.162073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:27.163820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:27.182524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:28.104431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:28.124422 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-440e8fe7-ba51-478f-9b1b-4a29d3f02395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 1.075782 Sep 25 01:23:28.125021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2144/4290] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:27 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:28.129484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-61478b3f-a3b5-4391-ad7b-973673537d6c req-16dab59b-276d-412c-8096-0735f5906db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc60efc-e7ad-43a8-ad69-cacdc58f782f", "name": "network-vif-plugged", "status": "completed", "tag": "416a2ba2-7d4b-442c-b086-2caabb80f47d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:28.139333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61478b3f-a3b5-4391-ad7b-973673537d6c req-16dab59b-276d-412c-8096-0735f5906db0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:28.139806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61478b3f-a3b5-4391-ad7b-973673537d6c req-16dab59b-276d-412c-8096-0735f5906db0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:28.140408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61478b3f-a3b5-4391-ad7b-973673537d6c req-16dab59b-276d-412c-8096-0735f5906db0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:28.144484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:28.153095 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-61478b3f-a3b5-4391-ad7b-973673537d6c req-16dab59b-276d-412c-8096-0735f5906db0 service nova] Creating event network-vif-plugged:416a2ba2-7d4b-442c-b086-2caabb80f47d for instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f on n-h1-master-1 Sep 25 01:23:28.156460 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-42c15d92-5a26-4681-b2cd-71933be678a1 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 1.017543 Sep 25 01:23:28.167987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2147/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:27 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:28.167987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:28.167987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:28.175725 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-61478b3f-a3b5-4391-ad7b-973673537d6c req-16dab59b-276d-412c-8096-0735f5906db0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045522 Sep 25 01:23:28.176115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:28.176434 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2145/4292] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:28.176990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:28.177473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:28.180276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:28.180928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:28.181369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:28.693745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:28.705856 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a97dc33e-61e8-49cb-9f8d-2a9eba0cc9f8 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.545289 Sep 25 01:23:28.722796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2148/4293] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:28 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:29.164824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:29.166298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:29.183595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:29.184520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:29.201775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:29.202856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:29.204253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:29.206354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:29.206930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:29.208950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:29.209856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:29.220572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:29.224630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:29.225422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:29.235270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:29.241483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:30.319312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:30.336855 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2b63d56e-ecf6-40d1-8ee4-8d1be1839421 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1323 microversion: 2.1 time: 1.157881 Sep 25 01:23:30.342913 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2149/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:29 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1323 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:30.362415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:30.363203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:30.401513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:30.405082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:30.405634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:30.406341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:30.406808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:30.407240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:30.685896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:30.703210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f579434c-75f5-4ee0-83d2-4202b0b4c1c7 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1315 microversion: 2.1 time: 1.555701 Sep 25 01:23:30.709443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2146/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:29 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1315 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:30.724494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-264ae959-98cf-4188-ba3d-bb648d5b6617 req-1ecf7215-2da1-47f1-9177-425b07c83039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785de9d1-5ca9-4ad9-8ab9-7d065abab18b", "name": "network-vif-plugged", "status": "completed", "tag": "e6524338-db50-4050-a69f-3ae747a38f43"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:30.763525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-264ae959-98cf-4188-ba3d-bb648d5b6617 req-1ecf7215-2da1-47f1-9177-425b07c83039 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:30.764111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-264ae959-98cf-4188-ba3d-bb648d5b6617 req-1ecf7215-2da1-47f1-9177-425b07c83039 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:30.764549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-264ae959-98cf-4188-ba3d-bb648d5b6617 req-1ecf7215-2da1-47f1-9177-425b07c83039 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:30.806709 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-264ae959-98cf-4188-ba3d-bb648d5b6617 req-1ecf7215-2da1-47f1-9177-425b07c83039 service nova] Creating event network-vif-plugged:e6524338-db50-4050-a69f-3ae747a38f43 for instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b on n-h2-master-1 Sep 25 01:23:30.824591 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-264ae959-98cf-4188-ba3d-bb648d5b6617 req-1ecf7215-2da1-47f1-9177-425b07c83039 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108505 Sep 25 01:23:30.828264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2147/4296] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:31.107973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:31.118576 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ed2d5cac-5eec-4a45-a53f-8fbe507e489e tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.774511 Sep 25 01:23:31.127160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2150/4297] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:30 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:31.375830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:31.378708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:31.402093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:31.407599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:31.409158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:31.410612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:31.411840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:31.414031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:31.733989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:31.734804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:31.747350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:31.750085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:31.754054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:31.755137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:31.755837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:31.756662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:31.774140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:31.788718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c25488c6-8f49-4427-8689-ec191636cb9b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1515 microversion: 2.1 time: 0.423863 Sep 25 01:23:31.793726 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2148/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:31 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:31.819661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:31.820995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:31.852409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:31.853453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:31.855689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:31.856709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:31.883446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:31.883997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:32.275702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:32.291791 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b55121db-ca98-4ce5-b225-67f22ad06386 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 200 len: 1323 microversion: 2.1 time: 0.480401 Sep 25 01:23:32.310215 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2149/4299] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:31 2022] GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:32.318675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:32.319475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:32.323239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:32.332925 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ba82ff5-5c02-4446-aab5-6f51b7f0421f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1503 microversion: 2.1 time: 0.603099 Sep 25 01:23:32.338041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:32.338583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:32.338986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:32.345653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:32.346375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:32.348110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:32.351674 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2151/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:31 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1503 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:32.366716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:32.374676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:32.392076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:32.396318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:32.398008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:32.402117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:32.404094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:32.405809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:32.523838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37f6836a-58ae-444c-bef5-8bfacc2ff75d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 0.163685 Sep 25 01:23:32.529393 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2152/4301] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:32 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:32.708253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:32.724326 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-37a50331-256a-436c-85bb-cc8e933d9448 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.412078 Sep 25 01:23:32.725579 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2150/4302] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:32 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:32.860701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-92e61cf5-671f-4194-9b55-320eeb4a1e61 req-e4e13dc9-a9a3-4488-a1ae-7e81949cb65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec60e15b-799a-4b31-aa84-813592121b12", "name": "network-vif-plugged", "status": "completed", "tag": "9d3489f9-653c-4e05-ba5e-499725e532c8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:32.888213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-92e61cf5-671f-4194-9b55-320eeb4a1e61 req-e4e13dc9-a9a3-4488-a1ae-7e81949cb65a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:32.888811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-92e61cf5-671f-4194-9b55-320eeb4a1e61 req-e4e13dc9-a9a3-4488-a1ae-7e81949cb65a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:32.889288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-92e61cf5-671f-4194-9b55-320eeb4a1e61 req-e4e13dc9-a9a3-4488-a1ae-7e81949cb65a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:32.920225 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-92e61cf5-671f-4194-9b55-320eeb4a1e61 req-e4e13dc9-a9a3-4488-a1ae-7e81949cb65a service nova] Creating event network-vif-plugged:9d3489f9-653c-4e05-ba5e-499725e532c8 for instance ec60e15b-799a-4b31-aa84-813592121b12 on n-h2-master-1 Sep 25 01:23:32.930756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-92e61cf5-671f-4194-9b55-320eeb4a1e61 req-e4e13dc9-a9a3-4488-a1ae-7e81949cb65a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075430 Sep 25 01:23:32.941688 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2153/4303] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:33.317276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:33.317908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:33.326105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.326697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.327352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.328244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.328927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.329455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.539081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:33.542044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:33.559707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.560816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.563331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.564458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:33.565608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.568089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.568751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.573682 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6aa80660-ec6f-4498-94ed-c59142e141e8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 200 len: 1516 microversion: 2.1 time: 0.261384 Sep 25 01:23:33.578332 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2151/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:33 2022] GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:33.603138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:33.603912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:33.621923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.622985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.624021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.626781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.629170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.630788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.691734 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5fdbf630-8fec-4c1f-b9f3-7b4e7701a0f9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 0.158963 Sep 25 01:23:33.693294 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2154/4305] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:33 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:23:33.748516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:33.749594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:33.766725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.768664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.770308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:33.772627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:33.775220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:33.775906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.103120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:34.114140 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aad8bfee-131e-4c43-b664-42bfae62aa6b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 200 len: 1515 microversion: 2.1 time: 0.520527 Sep 25 01:23:34.133754 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2152/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:33 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:34.140837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:34.148146 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:34.160364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:34.164875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:34.166355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.167141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:34.167611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:34.168613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.222318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:34.235746 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3a4b137-312b-47cf-b290-d54987a86535 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1314 microversion: 2.1 time: 0.492264 Sep 25 01:23:34.236343 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2155/4307] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:33 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:34.274580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:23:34.414751 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50982ab7-7711-424e-ab7c-01a85c356fbd tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 204 len: 0 microversion: 2.1 time: 0.279596 Sep 25 01:23:34.415343 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2153/4308] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:23:34 2022] DELETE /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:34.425628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:34.426302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:34.443196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:34.443703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:34.444151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.444873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:34.445330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:34.448668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.657707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:34.670559 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c375814f-2cb5-4676-929e-60abfe2dcb31 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 200 len: 1521 microversion: 2.1 time: 0.250059 Sep 25 01:23:34.671451 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2156/4309] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:34 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:34.707402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:34.712483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:34.729364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:34.732864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:34.733899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.737633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:34.739526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:34.740197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:34.828261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab94549b-2c15-460f-aa57-e60df5b4f24f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 0.125837 Sep 25 01:23:34.832446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2154/4310] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:34 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:23:35.259957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:35.261601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:35.272383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:35.273016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:35.273587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:35.274456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:35.275212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:35.275709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:35.556465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:35.565108 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc645c44-b5d2-4470-a915-3d57e42a33d7 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1463 microversion: 2.1 time: 0.309582 Sep 25 01:23:35.566214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2157/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:35 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1463 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:35.695413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:35.695939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:35.708925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:35.709622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:35.710914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:35.712750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:35.714375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:35.716760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:35.876960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:35.893525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b80b5aad-b00f-411e-92ca-9ebb7a53c9d8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 200 len: 1521 microversion: 2.1 time: 0.199810 Sep 25 01:23:35.894133 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2158/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:35 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:35.908251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:35.911967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:35.926206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:35.926709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:35.927137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:35.930001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:35.930757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:35.931654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.006050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3c2dc7d-286d-48c2-a635-5335f94aa3c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 0.106575 Sep 25 01:23:36.006766 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2159/4313] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:35 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:36.096420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Calling method '.version_select at 0x7f7beb47da60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:36.113823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.124068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.124068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.134566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.135358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.135999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.188195 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-618566ff-f52e-4a60-b0d4-942600b0de90 tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/23809750555c4833995dcc11499fa523?start=2022-09-24T01%3A23%3A35.581245&end=2022-09-26T01%3A23%3A35.581245" status: 200 len: 695 microversion: 2.1 time: 0.602349 Sep 25 01:23:36.202494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2155/4314] 10.222.0.16 () {58 vars in 1412 bytes} [Sun Sep 25 01:23:35 2022] GET /compute/v2.1/os-simple-tenant-usage/23809750555c4833995dcc11499fa523?start=2022-09-24T01%3A23%3A35.581245&end=2022-09-26T01%3A23%3A35.581245 => generated 695 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:36.220562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '.version_select at 0x7f7bea87de50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:36.272206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.272761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.276903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.313855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.314518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.315131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.357828 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f66c7103-a46f-4d6d-a482-691c28752940 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/23809750555c4833995dcc11499fa523?start=2022-09-24T01%3A23%3A35.581245&end=2022-09-26T01%3A23%3A35.581245" status: 200 len: 695 microversion: 2.1 time: 0.147099 Sep 25 01:23:36.362290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2160/4315] 10.222.0.16 () {58 vars in 1412 bytes} [Sun Sep 25 01:23:36 2022] GET /compute/v2.1/os-simple-tenant-usage/23809750555c4833995dcc11499fa523?start=2022-09-24T01%3A23%3A35.581245&end=2022-09-26T01%3A23%3A35.581245 => generated 695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:36.378948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Calling method '.version_select at 0x7f7beae5cd30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:36.401445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.402820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.407215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.442128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.442787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.443485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.680108 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84ddd791-057b-48c8-8aee-91273a48d91b tempest-TenantUsagesTestJSON-809626633 tempest-TenantUsagesTestJSON-809626633-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-24T01%3A23%3A35.581245&end=2022-09-26T01%3A23%3A35.581245&detailed=1" status: 200 len: 51805 microversion: 2.1 time: 0.307818 Sep 25 01:23:36.681087 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2156/4316] 10.222.0.16 () {58 vars in 1335 bytes} [Sun Sep 25 01:23:36 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-24T01%3A23%3A35.581245&end=2022-09-26T01%3A23%3A35.581245&detailed=1 => generated 51805 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:23:36.743498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:36.748533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:36.755722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.756520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.757279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.758225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.759139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.759805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.793561 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:36.799185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:23:36.905269 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-97c02301-7fed-45dc-b3d1-26e263ed2066 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 204 len: 0 microversion: 2.1 time: 0.165357 Sep 25 01:23:36.906820 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2161/4317] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:23:36 2022] DELETE /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:36.917438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:36.918634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:36.920568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:36.921927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:36.929464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.930828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.931892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.933204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.934627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.936251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.945037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.949144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.949144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:36.949144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:36.952657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:36.952657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:37.178278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:37.213057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6bfdd4a-a44f-47e1-a1e5-9d82c8b4c06b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 200 len: 1479 microversion: 2.1 time: 0.297991 Sep 25 01:23:37.224382 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2162/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:36 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 1479 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:37.231392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:37.248087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:37.271435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:37.272732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:37.274893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:37.275868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:37.276560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:37.278219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:37.379560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:37.405834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f61f0cb-ed96-428b-9fda-e7a3d391b424 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1469 microversion: 2.1 time: 0.493261 Sep 25 01:23:37.407506 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2157/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:36 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1469 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:37.428148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2893fd42-8423-4912-84bd-5b87f8bc5b1e req-3de149fc-fbaf-4527-a237-5625a9555045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a74f1e-a42d-4d0c-ab75-56ab33464e32", "name": "network-vif-deleted", "tag": "61a0b284-7715-4696-8e3a-656c09793638"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:37.453239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2893fd42-8423-4912-84bd-5b87f8bc5b1e req-3de149fc-fbaf-4527-a237-5625a9555045 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:37.453876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2893fd42-8423-4912-84bd-5b87f8bc5b1e req-3de149fc-fbaf-4527-a237-5625a9555045 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:37.454386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2893fd42-8423-4912-84bd-5b87f8bc5b1e req-3de149fc-fbaf-4527-a237-5625a9555045 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:37.484090 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2893fd42-8423-4912-84bd-5b87f8bc5b1e req-3de149fc-fbaf-4527-a237-5625a9555045 service nova] Creating event network-vif-deleted:61a0b284-7715-4696-8e3a-656c09793638 for instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 on n-h1-master-1 Sep 25 01:23:37.507637 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2893fd42-8423-4912-84bd-5b87f8bc5b1e req-3de149fc-fbaf-4527-a237-5625a9555045 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083959 Sep 25 01:23:37.509208 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2158/4320] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:38.025455 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d90084c-e5a4-4ddd-a2e0-20345c0c6525 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 0.799436 Sep 25 01:23:38.030239 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2163/4321] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:37 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:38.258001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:38.261037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:38.329498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.330605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.332326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.334653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.335134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.335572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.425013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-742323759", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:38.480499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.481051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.481565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.482013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lazy-loading 'fault' on Instance uuid 18a74f1e-a42d-4d0c-ab75-56ab33464e32 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:23:38.529192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:23:38.529889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:23:38.530546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:23:38.531120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:23:38.531690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:23:38.556234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.556760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.557204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.562103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.562740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.563422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.596629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Getting quotas for project 8f9849b93b6e407682309d5585094847. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:38.603362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Getting quotas for user d3098d02a0814cf7ada5aae6bedf2771 and project 8f9849b93b6e407682309d5585094847. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:38.620180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:23:38.624167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:23:38.657127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:38.665300 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6e25672-3fe1-47dd-9973-a1f4f92f15f5 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 200 len: 1313 microversion: 2.1 time: 0.430722 Sep 25 01:23:38.669742 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2164/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:38 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:38.682111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:38.682741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:38.705175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.705692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.712469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.713499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:38.713980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:38.716955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:38.739680 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5b02d4b-0a64-42e4-8c66-3dbd98c82d8e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.836230 Sep 25 01:23:38.747733 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2159/4323] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 25 01:23:38.758725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3cdb9a7-2251-481d-a08e-871641d6f741 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:38.763336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3cdb9a7-2251-481d-a08e-871641d6f741 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:38.945543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3cdb9a7-2251-481d-a08e-871641d6f741 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:38.958843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3cdb9a7-2251-481d-a08e-871641d6f741 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:38.963509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3cdb9a7-2251-481d-a08e-871641d6f741 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:38.966450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3cdb9a7-2251-481d-a08e-871641d6f741 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387" status: 200 len: 1277 microversion: 2.47 time: 0.211976 Sep 25 01:23:38.969922 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2160/4324] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:38 2022] GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:39.243358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:39.271125 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8832e54-c5fe-45c4-a3aa-ad567143bb47 tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1469 microversion: 2.1 time: 0.597931 Sep 25 01:23:39.289804 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2165/4325] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:38 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1469 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:39.334779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1521999848", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:39.528126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:23:39.530481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:23:39.536300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:23:39.541236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:23:39.545856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:23:39.582401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:39.584519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:39.585044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:39.590538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:39.590908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:39.594129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:39.646588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Getting quotas for project 8f9849b93b6e407682309d5585094847. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:39.667533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Getting quotas for user d3098d02a0814cf7ada5aae6bedf2771 and project 8f9849b93b6e407682309d5585094847. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:39.716890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:23:39.726995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:23:39.854721 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9112c21-cd6f-48b6-a191-faafea904e86 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.545985 Sep 25 01:23:39.862305 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2166/4326] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:23:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:23:39.879929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:39.880916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:39.898380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:39.899252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:39.900374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:39.908568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:39.909308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:39.910042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:39.953091 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] HTTP exception thrown: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 HTTP/1.1 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '18a74f1e-a42d-4d0c-ab75-56ab33464e32'} Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:39.961589 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:39.965870 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:39.969707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 404 to user: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:39.970906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee1c9aa5-2060-42b6-8fe6-6e513656c136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 404 len: 111 microversion: 2.1 time: 0.107331 Sep 25 01:23:39.972305 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2167/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:39 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:23:39.984620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de35e821-4e00-4b02-a25e-48fa380d2234 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:39.991846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de35e821-4e00-4b02-a25e-48fa380d2234 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:40.118835 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de35e821-4e00-4b02-a25e-48fa380d2234 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "PUT /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 992 microversion: 2.47 time: 0.141487 Sep 25 01:23:40.128565 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2168/4328] 10.222.0.16 () {62 vars in 1297 bytes} [Sun Sep 25 01:23:39 2022] PUT /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 992 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:23:40.134913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:40.143883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.145459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:40.154588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.155619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.157173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.158596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.159357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.160108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.220071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:40.222449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:40.240738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.241253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.241728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.247772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.248271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.248716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.331662 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bcf17ad7-6810-41c5-b0ce-dfbb8030d5ec tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.201379 Sep 25 01:23:40.332604 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2169/4329] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 25 01:23:40 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:40.353760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f80b6563-a9dc-490d-bf28-7f69fa19188c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 1.319311 Sep 25 01:23:40.354990 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2161/4330] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:39 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:23:40.365515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1286c184-bb9c-4d68-91af-ca45ddfdbc67 req-225df8c8-ee46-4bec-bf6d-0a2f9f8b8cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec60e15b-799a-4b31-aa84-813592121b12", "name": "network-vif-deleted", "tag": "9d3489f9-653c-4e05-ba5e-499725e532c8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:40.371792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40d33372-5425-42ce-8b90-93f254147179 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:40.373622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40d33372-5425-42ce-8b90-93f254147179 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:40.388748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1286c184-bb9c-4d68-91af-ca45ddfdbc67 req-225df8c8-ee46-4bec-bf6d-0a2f9f8b8cca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.389777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1286c184-bb9c-4d68-91af-ca45ddfdbc67 req-225df8c8-ee46-4bec-bf6d-0a2f9f8b8cca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.391033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1286c184-bb9c-4d68-91af-ca45ddfdbc67 req-225df8c8-ee46-4bec-bf6d-0a2f9f8b8cca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.420941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1286c184-bb9c-4d68-91af-ca45ddfdbc67 req-225df8c8-ee46-4bec-bf6d-0a2f9f8b8cca service nova] Creating event network-vif-deleted:9d3489f9-653c-4e05-ba5e-499725e532c8 for instance ec60e15b-799a-4b31-aa84-813592121b12 on n-h2-master-1 Sep 25 01:23:40.442563 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1286c184-bb9c-4d68-91af-ca45ddfdbc67 req-225df8c8-ee46-4bec-bf6d-0a2f9f8b8cca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107839 Sep 25 01:23:40.450166 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2170/4331] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:40.501241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:40.502093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:40.519976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.523226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.523952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.526139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.528152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.530371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.559069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40d33372-5425-42ce-8b90-93f254147179 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.576847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40d33372-5425-42ce-8b90-93f254147179 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.585266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40d33372-5425-42ce-8b90-93f254147179 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.590868 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40d33372-5425-42ce-8b90-93f254147179 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1278 microversion: 2.47 time: 0.230672 Sep 25 01:23:40.594093 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2162/4332] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:40 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:40.612705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6174fdc-75c8-4529-9aa2-499d1bba0204 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6174fdc-75c8-4529-9aa2-499d1bba0204 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 25 01:23:40.629704 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 25 01:23:40.634479 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:40.636853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6174fdc-75c8-4529-9aa2-499d1bba0204 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:40.640180 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e6174fdc-75c8-4529-9aa2-499d1bba0204 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.042730 Sep 25 01:23:40.643748 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2163/4333] 10.222.0.16 () {58 vars in 1182 bytes} [Sun Sep 25 01:23:40 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:23:40.654040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.662973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.665302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.665756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:40.666536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lazy-loading 'fault' on Instance uuid ec60e15b-799a-4b31-aa84-813592121b12 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:23:40.690613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.699226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:40.722443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.729380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.731172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.732201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.732682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.741755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.809284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f33ca9c1d1bd4d8dbc768c1746d42e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23809750555c4833995dcc11499fa523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.819067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:23:40.823290 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8e636852-a022-48f8-88a0-1b3cfa44281a tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 200 len: 1304 microversion: 2.1 time: 0.369784 Sep 25 01:23:40.837576 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2171/4334] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:40 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 1304 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:40.878292 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4b47122-1713-473f-bc3d-b09ee5d3348b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.228358 Sep 25 01:23:40.880189 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2164/4335] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:23:40 2022] GET /compute/v2.1/servers => generated 683 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:40.898147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:40.916262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:40.918730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.servers [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Removing options 'limit' from query {{(pid=122384) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 25 01:23:40.919939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:40.936888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.938095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.940594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.942472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:40.944814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:40.945595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:40.985638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:23:41.066910 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d32f565c-de73-4640-b8db-4fc34dc0ceb2 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.173645 Sep 25 01:23:41.069503 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2172/4336] 10.222.0.16 () {58 vars in 1144 bytes} [Sun Sep 25 01:23:40 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:41.086581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe19e19d-97ba-4939-8d70-17ccc8855e58 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe19e19d-97ba-4939-8d70-17ccc8855e58 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: action_args: {} Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi '-1' Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 25 01:23:41.097933 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 25 01:23:41.103555 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.107220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe19e19d-97ba-4939-8d70-17ccc8855e58 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:41.108887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe19e19d-97ba-4939-8d70-17ccc8855e58 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.028940 Sep 25 01:23:41.113545 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2165/4337] 10.222.0.16 () {58 vars in 1142 bytes} [Sun Sep 25 01:23:41 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:23:41.124293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ffc1521f-955a-4e52-b5ed-01a371be9c3c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ffc1521f-955a-4e52-b5ed-01a371be9c3c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: action_args: {} Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi 'testing' Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 25 01:23:41.133344 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 25 01:23:41.139664 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:41.144928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ffc1521f-955a-4e52-b5ed-01a371be9c3c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:41.149112 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ffc1521f-955a-4e52-b5ed-01a371be9c3c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029203 Sep 25 01:23:41.151390 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2173/4338] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:23:41 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:23:41.166348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2ed0418-28e4-42de-bec0-3640b1de59a9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:41.178476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2ed0418-28e4-42de-bec0-3640b1de59a9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:41.197049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2ed0418-28e4-42de-bec0-3640b1de59a9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:41.245711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.servers [None req-f2ed0418-28e4-42de-bec0-3640b1de59a9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Flavor 'non_existing_flavor' could not be found {{(pid=122385) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 25 01:23:41.252880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2ed0418-28e4-42de-bec0-3640b1de59a9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.091648 Sep 25 01:23:41.256549 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2166/4339] 10.222.0.16 () {58 vars in 1178 bytes} [Sun Sep 25 01:23:41 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:41.272354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:41.283341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:41.285958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:41.302067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.303173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.304116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.305302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.307028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.307965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.366832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:41.370080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:41.384951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.385927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.388144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.391434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.394508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.395317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.410130 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:41.523975 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-52213b72-d3a9-45fd-bae5-491fcd88e5ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 14 microversion: 2.1 time: 0.161281 Sep 25 01:23:41.525161 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2167/4340] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:41 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:23:41.620455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:41.622358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:41.637997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.641594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.642453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.643384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.644032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.644672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.881097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:41.895339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:41.905536 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:41.911883 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1adf4b63-28c4-40ae-b889-4fa2040f545e tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1274 microversion: 2.47 time: 0.295089 Sep 25 01:23:41.916162 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2168/4341] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:41 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1274 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:23:41.957063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:41.961015 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] [instance: ec60e15b-799a-4b31-aa84-813592121b12] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:41.983143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.985150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.988746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:41.990081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:41.995332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:41.996774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.024127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] HTTP exception thrown: Instance ec60e15b-799a-4b31-aa84-813592121b12 could not be found. Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Request method failure captured: Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 HTTP/1.1 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL615Oqdyggo_ozlyjsW_0cyURnYeLDPdd_0ewC4l_pcX-wn9B_pTzaoMyFpZ2cOhW78vWH7Jzt-tfa1iLH1QwAuYSgq-QVLyG5PDtlZE87uKB1g846S_Wz_dXBXmQcAy9uEVCsRq6Y9XgCGj8otNiN2_pATheKPwnrurQsKYN1KbQmg Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 23809750555c4833995dcc11499fa523 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TenantUsagesTestJSON-1161573442 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23809750555c4833995dcc11499fa523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23809750555c4833995dcc11499fa523"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23809750555c4833995dcc11499fa523"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23809750555c4833995dcc11499fa523"}]}] Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TenantUsagesTestJSON-1161573442 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 23809750555c4833995dcc11499fa523 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1161573442 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TenantUsagesTestJSON-1161573442-project Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f33ca9c1d1bd4d8dbc768c1746d42e25 Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TenantUsagesTestJSON-1161573442-project Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ec60e15b-799a-4b31-aa84-813592121b12 could not be found. Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ec60e15b-799a-4b31-aa84-813592121b12'} Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec60e15b-799a-4b31-aa84-813592121b12 could not be found. Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec60e15b-799a-4b31-aa84-813592121b12 could not be found. Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:42.032866 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec60e15b-799a-4b31-aa84-813592121b12 could not be found. Sep 25 01:23:42.037763 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:42.040279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] Returning 404 to user: Instance ec60e15b-799a-4b31-aa84-813592121b12 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:42.041713 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ca18f3b-32c4-42f8-a4d0-ef54955889bf tempest-TenantUsagesTestJSON-1161573442 tempest-TenantUsagesTestJSON-1161573442-project] 10.222.0.16 "GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12" status: 404 len: 111 microversion: 2.1 time: 0.103621 Sep 25 01:23:42.044400 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2169/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:41 2022] GET /compute/v2.1/servers/ec60e15b-799a-4b31-aa84-813592121b12 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:23:42.352679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ec86ae5-382e-45de-ac97-43127531524b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 1.086310 Sep 25 01:23:42.356909 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2174/4343] 10.222.0.16 () {58 vars in 1174 bytes} [Sun Sep 25 01:23:41 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:42.367915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:42.377515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:42.382833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:42.394602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.396357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.398048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.399355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.401440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.403508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.540927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:42.544320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:42.582230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.585886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.587908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.591916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.594210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.598236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.704231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22462cf8-9cb2-464a-b9cc-77e4bf7d6469 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.339777 Sep 25 01:23:42.706609 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2170/4344] 10.222.0.16 () {58 vars in 1184 bytes} [Sun Sep 25 01:23:42 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:42.724270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:42.739397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:42.741311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:42.752072 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b9a5afcc-1267-4035-b204-569c1dae45d8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action" status: 200 len: 8205 microversion: 2.1 time: 0.216322 Sep 25 01:23:42.757213 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2175/4345] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:42 2022] POST /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d/action => generated 8205 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:42.764173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.764892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.767282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:42.768018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:42.770533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.771609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.774598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.775280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.785491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.796921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.798903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.799630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.801142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.801973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:42.845668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:23:42.905251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:42.915587 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:42.934056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:42.934554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:42.936812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.240618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.253808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2a0d8c5-09f6-46a8-ad4a-e335320146ee tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.494479 Sep 25 01:23:43.257689 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2176/4346] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:42 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:43.263815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.270256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:43.273696 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:43.286350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.287025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.294400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.295541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.296343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.297014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.464153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.467947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7fc65050-3fc1-4490-806a-43ffc628e136 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.751888 Sep 25 01:23:43.469106 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2171/4347] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:23:42 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:43.474423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.482482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.488621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:43.496578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.501134 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0116d2e-328c-4888-8334-0e6c0aaefa80 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1330 microversion: 2.47 time: 0.242174 Sep 25 01:23:43.502194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.503030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.503664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.504726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.505948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2177/4348] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:43 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1330 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:43.512468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1299ed16-c225-4619-b71f-8257cd2b99e4 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.516343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.516986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.529639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1299ed16-c225-4619-b71f-8257cd2b99e4 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.532895 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1299ed16-c225-4619-b71f-8257cd2b99e4 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025781 Sep 25 01:23:43.535754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2178/4349] 10.222.0.16 () {58 vars in 1178 bytes} [Sun Sep 25 01:23:43 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:23:43.556916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.573431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.574801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Searching by: {'deleted': False, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:23:43.602103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.604083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.604709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.607096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.607833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.611066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.677861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:23:43.799882 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-00569f8a-a2e6-4a29-89fb-177277dac49b tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.254161 Sep 25 01:23:43.802335 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2179/4350] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:23:43 2022] GET /compute/v2.1/servers => generated 683 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:43.816545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.817136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:43.832439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.833279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.833737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:43.834833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.835928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.837776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.839305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.843281 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e941e3b0-b40c-49e4-a995-f1a20f20ed99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.372731 Sep 25 01:23:43.853861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2172/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:43 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:43.870155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.871420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:43.878476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.879244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.879871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.881006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.881688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.882054 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] HTTP exception thrown: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:43.882519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 HTTP/1.1 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '18a74f1e-a42d-4d0c-ab75-56ab33464e32'} Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:43.885612 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 404 to user: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a6cb54e7-f344-42e0-86e9-1cbbf93d1e96 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 404 len: 111 microversion: 2.1 time: 0.076635 Sep 25 01:23:43.890879 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2180/4352] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:23:43 2022] DELETE /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:23:43.911559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:43.914195 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:43.939509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.940039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.943094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:43.946740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:43.947238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:43.949682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.030335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:23:44.124245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:44.129453 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:44.133568 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7dc0b24-31d2-4685-81f1-f22f6629430a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.269283 Sep 25 01:23:44.155161 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2173/4353] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:43 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:44.167253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:44.173844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.183945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.185023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.185915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.187218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.187891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.188650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.254697 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-58b92631-cab5-46e6-ab22-2552ebe23fbb tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 204 len: 0 microversion: 2.1 time: 0.359106 Sep 25 01:23:44.260692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2181/4354] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:23:43 2022] DELETE /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:44.276748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:44.277952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.293985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.294475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.294914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.298642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.298979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.299330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.348722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:23:44.437233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:44.447133 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00a7027d-4f68-4e0b-bbfc-c4db14e79e4e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.290794 Sep 25 01:23:44.451452 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2174/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:44 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:44.476342 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:44.478089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.486208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.486992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.487618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.488505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.489142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.489811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.515932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-811d16b9-fbf1-4454-8d84-20752fd715a8 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 204 len: 0 microversion: 2.1 time: 0.252444 Sep 25 01:23:44.522187 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2182/4356] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:23:44 2022] DELETE /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:44.536003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:44.540585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 18a74f1e-a42d-4d0c-ab75-56ab33464e32] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.558133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.564000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Locking {{(pid=122385) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 25 01:23:44.594778 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] HTTP exception thrown: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 HTTP/1.1 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '18a74f1e-a42d-4d0c-ab75-56ab33464e32'} Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:44.596491 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 404 to user: Instance 18a74f1e-a42d-4d0c-ab75-56ab33464e32 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eef82708-1330-400b-ab29-c4c7a19f7ab3 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32" status: 404 len: 111 microversion: 2.1 time: 0.073952 Sep 25 01:23:44.604409 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2183/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:44 2022] GET /compute/v2.1/servers/18a74f1e-a42d-4d0c-ab75-56ab33464e32 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:23:44.616326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:44.616982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.633315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.640349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.640825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.642264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.642618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.643058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.671122 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-803635d1-61d6-4914-aae9-b1a08278bdab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.199435 Sep 25 01:23:44.674890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2175/4358] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:44 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:44.682612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:44.684646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.697070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.699689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.701201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.702843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.703353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.703787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.771483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:44.780655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:44.790614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:44.798901 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9e68790-f743-401e-a1ff-3f8dea037362 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1336 microversion: 2.47 time: 0.193583 Sep 25 01:23:44.819857 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2184/4359] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:44 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1336 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:44.825744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:44.826382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:44.834088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.834479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.835153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:44.837446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:44.838230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:44.838891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.082967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:45.091188 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53215f3d-c160-4311-8cfc-fde2a0a4f7f7 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 200 len: 1522 microversion: 2.1 time: 0.417627 Sep 25 01:23:45.097257 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2176/4360] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:44 2022] GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:45.252115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:45.289065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63c1c6fb-3e20-4ff0-bdc8-f43a8f6587a5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.463951 Sep 25 01:23:45.290954 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2185/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:44 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:45.325631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:45.333935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.334431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.334877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.393559 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] HTTP exception thrown: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 is locked Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Request method failure captured: Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action HTTP/1.1 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 15 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6xuW8HdSFdqv_GymjAN0UzQNznyqDBHCXwnGH_drYTLX8b7yZZVYdzp4yTjwHCtV6pssSqZs_xkb9j7MhJBm4p4K_VE8Hrv20Knvv7-7T5TK1ekYpbuhJac_MxOempYpH6PiP-xkIPtXf_81ksvKVOoze856kORta-sjCkbgdw5Ej0 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5404f5e8a04445d08a69a14616c5e008"}]}] Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c1c655b1afc54b6c98d771d6acf81ee0 Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: {"os-stop": {}} Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 is locked Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '84fe9d37-15fe-4294-90f5-af1f4a1b89b1', 'body': {'os-stop': {}}} Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 is locked Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 is locked Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 is locked Sep 25 01:23:45.395163 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:23:45.406548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Returning 409 to user: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 is locked {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:45.406548 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b3f69ec4-5687-43e1-a1d4-9ae2dbe378cb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 409 len: 107 microversion: 2.1 time: 0.086851 Sep 25 01:23:45.406548 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2177/4362] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:45 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 107 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:23:45.407152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:45.407611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:45.416143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.418673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.422863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.426424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.428072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.432192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.601291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Unlocking {{(pid=122384) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 25 01:23:45.696018 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f499dc1-0d79-4256-93de-609eb8d2c668 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.293350 Sep 25 01:23:45.697626 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2186/4363] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:45 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:45.707582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21356912-40ce-4ccf-be31-abb07cd81d13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:45.718761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21356912-40ce-4ccf-be31-abb07cd81d13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.719868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21356912-40ce-4ccf-be31-abb07cd81d13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.720324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21356912-40ce-4ccf-be31-abb07cd81d13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.769140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21356912-40ce-4ccf-be31-abb07cd81d13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:23:45.829088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:45.829805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:45.847000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.848134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.849694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.850526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.852497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.853141 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21356912-40ce-4ccf-be31-abb07cd81d13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.149743 Sep 25 01:23:45.854171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2178/4364] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:45 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:45.857495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.867208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:45.868626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:45.879736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.880575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.881304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:45.882293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:45.882810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:45.883246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:46.193775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:46.204740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:46.210269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:46.212836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8d49550-a0ed-4289-aab4-9d1b16b7e16c tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1336 microversion: 2.47 time: 0.390820 Sep 25 01:23:46.214630 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2187/4365] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:45 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1336 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:46.241345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:46.248749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:46.262727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:46.263531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:46.264162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:46.265030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:46.265711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:46.266318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:47.126089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:47.141030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1cde9e8a-bb75-4972-8f08-b8757afc7c5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 1.281091 Sep 25 01:23:47.143114 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2179/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:45 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:47.245074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:47.246869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:47.259612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:47.271249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:47.272564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:47.273675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:47.274492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:47.275271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:47.647407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:47.661315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:47.678078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:47.679272 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f09aa011-e05e-44ec-bfb3-62f042fc291b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1336 microversion: 2.47 time: 0.438891 Sep 25 01:23:47.679848 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2180/4367] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:47 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1336 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:23:47.738445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:47.750787 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-70c2a552-a375-4c41-9f47-e3dd126b6430 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 200 len: 1522 microversion: 2.1 time: 1.516847 Sep 25 01:23:47.756618 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2188/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:46 2022] GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 1522 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:48.143488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-46158ccc-6762-4f5f-b988-bdad0a393e94 req-d951b63c-7565-4ee4-9513-b2fb31813a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785de9d1-5ca9-4ad9-8ab9-7d065abab18b", "name": "network-vif-deleted", "tag": "e6524338-db50-4050-a69f-3ae747a38f43"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:48.156980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-46158ccc-6762-4f5f-b988-bdad0a393e94 req-d951b63c-7565-4ee4-9513-b2fb31813a90 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.158167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-46158ccc-6762-4f5f-b988-bdad0a393e94 req-d951b63c-7565-4ee4-9513-b2fb31813a90 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.158763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-46158ccc-6762-4f5f-b988-bdad0a393e94 req-d951b63c-7565-4ee4-9513-b2fb31813a90 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.169971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:48.171003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:48.185478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.186676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.188993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.190125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.191355 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-46158ccc-6762-4f5f-b988-bdad0a393e94 req-d951b63c-7565-4ee4-9513-b2fb31813a90 service nova] Creating event network-vif-deleted:e6524338-db50-4050-a69f-3ae747a38f43 for instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b on n-h2-master-1 Sep 25 01:23:48.193424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.194138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.204944 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-46158ccc-6762-4f5f-b988-bdad0a393e94 req-d951b63c-7565-4ee4-9513-b2fb31813a90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064973 Sep 25 01:23:48.215006 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2181/4369] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:48.531972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:48.541040 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3de8464a-852f-49bd-884a-7749526edacb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.375706 Sep 25 01:23:48.543029 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2189/4370] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:48 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:48.714582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:48.715493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:48.728756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.729891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.732233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.734741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.737089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.738039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.763157 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:48.779327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:48.781112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:48.789757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.790632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.791244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.791983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.793450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.794174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.889499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:48.890252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:48.890848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:48.891625 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lazy-loading 'fault' on Instance uuid 785de9d1-5ca9-4ad9-8ab9-7d065abab18b {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:23:48.907623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:48.915962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:48.917444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:48.935295 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2690a9b6-2891-4d63-ac02-735d4fcba747 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1336 microversion: 2.47 time: 0.226137 Sep 25 01:23:48.938217 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2182/4371] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:48 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1336 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:49.024138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:49.033665 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa4473f9-e964-4d46-9384-b66e1b6c75d9 tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 200 len: 1313 microversion: 2.1 time: 0.259242 Sep 25 01:23:49.036787 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2190/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:48 2022] GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:49.531689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6e84ced1-9d88-423a-9ce0-a24724d8344b req-796e381b-a7de-4e7b-b89b-2500c19040df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc60efc-e7ad-43a8-ad69-cacdc58f782f", "name": "network-vif-deleted", "tag": "416a2ba2-7d4b-442c-b086-2caabb80f47d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:49.567688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6e84ced1-9d88-423a-9ce0-a24724d8344b req-796e381b-a7de-4e7b-b89b-2500c19040df service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:49.571027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:49.571724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:49.572379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6e84ced1-9d88-423a-9ce0-a24724d8344b req-796e381b-a7de-4e7b-b89b-2500c19040df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:49.573207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6e84ced1-9d88-423a-9ce0-a24724d8344b req-796e381b-a7de-4e7b-b89b-2500c19040df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:49.597666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:49.599599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:49.601123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:49.602887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:49.604723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:49.606034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:49.610743 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6e84ced1-9d88-423a-9ce0-a24724d8344b req-796e381b-a7de-4e7b-b89b-2500c19040df service nova] Creating event network-vif-deleted:416a2ba2-7d4b-442c-b086-2caabb80f47d for instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f on n-h1-master-1 Sep 25 01:23:49.632832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6e84ced1-9d88-423a-9ce0-a24724d8344b req-796e381b-a7de-4e7b-b89b-2500c19040df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105737 Sep 25 01:23:49.643571 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2183/4373] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:49.720266 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:49.954708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:49.964369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:49.965675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:49.967313 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3eebc6e-9238-4637-bdb2-759f4462a63e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.400691 Sep 25 01:23:49.974212 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2191/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:49.982941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:49.986011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:49.986489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:49.987488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:49.991757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:49.993775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.067311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:50.068922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: 785de9d1-5ca9-4ad9-8ab9-7d065abab18b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:50.109295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.113284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.114006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.114933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.115580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.117334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.150177 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] HTTP exception thrown: Instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b could not be found. Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b HTTP/1.1 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b could not be found. Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '785de9d1-5ca9-4ad9-8ab9-7d065abab18b'} Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b could not be found. Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b could not be found. Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:50.152724 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b could not be found. Sep 25 01:23:50.157163 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:50.169145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 404 to user: Instance 785de9d1-5ca9-4ad9-8ab9-7d065abab18b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:50.172743 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6ab2bae4-ae80-47c3-9021-112e11ed7c0c tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b" status: 404 len: 111 microversion: 2.1 time: 0.110415 Sep 25 01:23:50.176125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2192/4375] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:50 2022] GET /compute/v2.1/servers/785de9d1-5ca9-4ad9-8ab9-7d065abab18b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:23:50.184576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5447729a-87c3-46f4-8e5e-4295d796d220", "device": "/dev/sdb"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:50.188914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:50.211047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.211556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.211999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.212715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.213173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.213627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.290719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:50.305254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:50.320223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:50.321521 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b4a1477-d8f7-443d-b848-d869b0ed28bf tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1357 microversion: 2.47 time: 0.361606 Sep 25 01:23:50.325347 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2184/4376] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:49 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1357 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:50.330130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:50.330691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:50.349964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.350632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.351428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.352549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.353173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.354199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.394756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.396232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.397193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.397943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lazy-loading 'fault' on Instance uuid ecc60efc-e7ad-43a8-ad69-cacdc58f782f {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:23:50.448257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6b3f79b49c4c13a2fdceba3b60d09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c73d4bbb354b0fafd5f5a714f6d4a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:50.461368 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50adec92-7641-4dff-857f-c7dd8ac8df6e tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 200 len: 1313 microversion: 2.1 time: 0.134281 Sep 25 01:23:50.462627 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2185/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:50 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:50.469293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:50.473766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:50.485167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.486002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.486674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.487607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.488327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.489105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.601715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:23:50.602315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:23:50.602980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:23:50.603713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:23:50.604142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:23:50.710640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:50.736024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.736526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.736999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.737761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:50.738227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:50.738666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:50.856433 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-83a2269f-dac6-49b0-8a39-5a518ec991f0 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "POST /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288/action" status: 202 len: 1079 microversion: 2.47 time: 0.389563 Sep 25 01:23:50.859049 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2186/4378] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:23:50 2022] POST /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288/action => generated 1079 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 25 01:23:50.989531 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:51.010523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de98ade1-cf5f-46a2-9fe6-be45da6b4b7c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "POST /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831480 Sep 25 01:23:51.012149 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2193/4379] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:23:50 2022] POST /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:51.018329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:51.019443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:51.030888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:51.031707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:51.032425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:51.034063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:51.035873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:51.036549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:51.119494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:51.132200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:51.135287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:51.137959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f44492c6-2d67-4316-b5d5-487036552765 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.123839 Sep 25 01:23:51.139765 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2194/4380] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:51 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:51.146119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:51.147184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:51.156602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:51.157107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:51.158566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:51.159294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:51.159815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:51.160255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:51.222180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-199301ca-a4ea-4b07-970b-a4620c3fc8d0 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Action: 'create', calling method: .version_select at 0x7f7bebddec10>, body: {"keypair": {"name": "tempest-keypair-242486169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwroRKKTasGy4ejkkBU765/j5+vjPsDqqtHrXYF/tEmUSGlrslQbH6U/WfZLhtT2ZG/Ln1IQAe7FZGvd3VPefyhuKVeFv6f6WCpZuy/eULm/o3Kr64lAYX+uUo1AUoS3g=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:51.254499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-199301ca-a4ea-4b07-970b-a4620c3fc8d0 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:51.260432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-199301ca-a4ea-4b07-970b-a4620c3fc8d0 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for user cf95edb2c5894782b5fffa589f4091cb and project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:51.277013 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-199301ca-a4ea-4b07-970b-a4620c3fc8d0 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:23:51.362980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:51.371515 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3abb04bf-6650-4c7a-bc6c-e2c0ca943fe4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.229513 Sep 25 01:23:51.373116 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2195/4381] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:51 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:51.496624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:51.497770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] [instance: ecc60efc-e7ad-43a8-ad69-cacdc58f782f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:51.506666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:51.507499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:51.509255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:51.510127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:51.510594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:51.511025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:51.532055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] HTTP exception thrown: Instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f could not be found. Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Request method failure captured: Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f HTTP/1.1 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL610wjHKVkdzM2NrCqHYYnWKxHEmrdY6M63MKRLHqVu_Vh4pDKXhvD_aG8WELproWAJnnruiOnt-tsvFTGnVHR79dmph92Dm82BMcWOUKfKmQkgFNbu_xxj8m5cH2-Oa4SGUsp-5oggEPv7ySui5gzWUxMVAdpwlkdeOlr5ghYMrGWw Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0c73d4bbb354b0fafd5f5a714f6d4a0"}]}] Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0c73d4bbb354b0fafd5f5a714f6d4a0 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-152015672 Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0b6b3f79b49c4c13a2fdceba3b60d09f Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ListServersNegativeTestJSON-152015672-project Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f could not be found. Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ecc60efc-e7ad-43a8-ad69-cacdc58f782f'} Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f could not be found. Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f could not be found. Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:51.535038 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f could not be found. Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:23:51.539058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] Returning 404 to user: Instance ecc60efc-e7ad-43a8-ad69-cacdc58f782f could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:23:51.539715 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b178c9c3-4681-4952-bc12-d1c5d73e099a tempest-ListServersNegativeTestJSON-152015672 tempest-ListServersNegativeTestJSON-152015672-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f" status: 404 len: 111 microversion: 2.1 time: 0.051123 Sep 25 01:23:51.541010 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2196/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:51 2022] GET /compute/v2.1/servers/ecc60efc-e7ad-43a8-ad69-cacdc58f782f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:23:52.169134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:52.170656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:52.183281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:52.184037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:52.185948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:52.186930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:52.190008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:52.190876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:52.285251 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [None req-199301ca-a4ea-4b07-970b-a4620c3fc8d0 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42376. Sep 25 01:23:52.326282 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-199301ca-a4ea-4b07-970b-a4620c3fc8d0 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.465863 Sep 25 01:23:52.343718 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2187/4383] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:23:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:52.343949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:52.351668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478c757e-1f56-40f6-8607-076accd01ef7 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7bead17430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:52.353675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:52.355301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:52.362546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee1fb08a-7a22-443c-a9f6-d2c8d071834d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.198224 Sep 25 01:23:52.363253 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2197/4384] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:52 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:23:52.400756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:52.401717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:52.403255 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-478c757e-1f56-40f6-8607-076accd01ef7 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-242486169" status: 200 len: 497 microversion: 2.1 time: 0.057671 Sep 25 01:23:52.407635 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2188/4385] 10.222.0.16 () {58 vars in 1215 bytes} [Sun Sep 25 01:23:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-242486169 => generated 497 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:52.416256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:52.418258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:52.419194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:52.421115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:52.422067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:52.423962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:52.441896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84a0957a-ec9a-4a88-a959-a9dbe177112c tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7bead31940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:52.495298 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84a0957a-ec9a-4a88-a959-a9dbe177112c tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242486169" status: 202 len: 0 microversion: 2.1 time: 0.076143 Sep 25 01:23:52.497128 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2189/4386] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242486169 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:52.510122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5cc94ac-cb11-428e-8402-5f0f60af69ae tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Action: 'create', calling method: .version_select at 0x7f7beacdc940>, body: {"keypair": {"name": "tempest-keypair-2080889352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0LBFUn2szOfowolhQMmJECuljcsCG3BT/7oVLkFnqfRC3LRBSD4g7hVdfUM8HT+pIp3mWvad4dHuZvY4av9sXPVBa4POvIWcfgkYLpva/C9hjYB2DjUYWjVux4qgRX9A=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:52.564893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c5cc94ac-cb11-428e-8402-5f0f60af69ae tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:52.594033 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c5cc94ac-cb11-428e-8402-5f0f60af69ae tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for user cf95edb2c5894782b5fffa589f4091cb and project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:52.651868 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5cc94ac-cb11-428e-8402-5f0f60af69ae tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146394 Sep 25 01:23:52.653694 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2190/4387] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:23:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:52.664701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2dc085d-0c7f-4633-a4b8-9a9d62148c01 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7beacd9040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:52.696407 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2dc085d-0c7f-4633-a4b8-9a9d62148c01 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080889352" status: 202 len: 0 microversion: 2.1 time: 0.036311 Sep 25 01:23:52.703132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2191/4388] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080889352 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:23:52.709959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-242e817f-9141-4a73-9090-293b42c05eb3 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Action: 'create', calling method: .version_select at 0x7f7beacdcaf0>, body: {"keypair": {"name": "tempest-keypair-1006263656", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:52.729988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:52.730671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-242e817f-9141-4a73-9090-293b42c05eb3 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:52.738510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-242e817f-9141-4a73-9090-293b42c05eb3 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for user cf95edb2c5894782b5fffa589f4091cb and project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:52.740364 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d040b89f-5de5-49fb-9702-3c8917550b33 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.345441 Sep 25 01:23:52.741711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2198/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:52 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:52.767969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-242e817f-9141-4a73-9090-293b42c05eb3 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.063057 Sep 25 01:23:52.768872 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2192/4390] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:23:52 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:52.781180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fcbaa44a-97b1-4391-9f22-290f5190921f tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7beaa74dc0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:52.814731 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fcbaa44a-97b1-4391-9f22-290f5190921f tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006263656" status: 202 len: 0 microversion: 2.1 time: 0.037887 Sep 25 01:23:52.823471 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2199/4391] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006263656 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:52.825103 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:52.830839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aca622d5-edf1-447d-b9a0-decaaf616e9e tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Action: 'create', calling method: .version_select at 0x7f7bead31f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-841200730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBf7ONhAWTuN94BiQ4rSOMvXgiPFlvy9ZFeHvl6zAz/I+JjqFXCyHazYVvnE42VnxDksSfY9L9EBygmRiNX+fqB4XQVjq9Z8UYl2OImubC/gXMhQobVHv5Ar8cmc30LLhA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:52.873442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-aca622d5-edf1-447d-b9a0-decaaf616e9e tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:52.887790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-aca622d5-edf1-447d-b9a0-decaaf616e9e tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for user cf95edb2c5894782b5fffa589f4091cb and project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:52.943778 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aca622d5-edf1-447d-b9a0-decaaf616e9e tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.120007 Sep 25 01:23:52.944766 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2193/4392] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:23:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:23:52.960564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f073aae-7811-425f-836f-a59da850579f tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Action: 'create', calling method: .version_select at 0x7f7bea950040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1942631704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRY3/EQOu4sLDD3NdC+PmlSLhtshdpTMPFmpaf6Ga35zzKDvx7M7WVQtRLPjcq+848uUCmf0F2mGrXY8NlNaq8IqcLyZxrlDbMR4ECyQpAfjlCxp46KP7cm/32TDjaW4w=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:53.013671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6f073aae-7811-425f-836f-a59da850579f tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:53.041086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6f073aae-7811-425f-836f-a59da850579f tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for user cf95edb2c5894782b5fffa589f4091cb and project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:53.102629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f073aae-7811-425f-836f-a59da850579f tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.146915 Sep 25 01:23:53.104492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2200/4393] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:23:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:23:53.117896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d564ff58-ad08-42e6-8d17-90f9ea76dca4 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Action: 'create', calling method: .version_select at 0x7f7beaeb6820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-775669775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqRp0Ixoa+QfuzBX53rmCcKxXhoJwzsztOuYuiO70jeOH2r4q5UOEFaJ73o0xdVJ9HYH+UZer2KWvP3AhVveU0gJjiJDPEAJL7rvTZgj8o7ED6zy7eKM4/a2gEr2kGVdw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:53.134919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-d564ff58-ad08-42e6-8d17-90f9ea76dca4 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:53.136777 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:53.144973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-d564ff58-ad08-42e6-8d17-90f9ea76dca4 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Getting quotas for user cf95edb2c5894782b5fffa589f4091cb and project 95a2bdded9774dfa8422055adaede901. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:53.177158 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d564ff58-ad08-42e6-8d17-90f9ea76dca4 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.061530 Sep 25 01:23:53.179654 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2194/4394] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:23:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:53.192439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2f9e318-8d03-43df-b564-c3a7ff2be2df tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7beaa74c10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:53.197646 n-d-master-1 devstack@n-api.service[122384]: WARNING oslo_db.sqlalchemy.utils [None req-e2f9e318-8d03-43df-b564-c3a7ff2be2df tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 25 01:23:53.214382 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2f9e318-8d03-43df-b564-c3a7ff2be2df tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.027510 Sep 25 01:23:53.218550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2201/4395] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:23:53 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:53.230989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76f92057-2e19-490d-a4f1-78b2d3177f22 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7beacd90d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:53.263027 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76f92057-2e19-490d-a4f1-78b2d3177f22 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-775669775" status: 202 len: 0 microversion: 2.1 time: 0.037758 Sep 25 01:23:53.264315 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2195/4396] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:23:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-775669775 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:53.275027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f21edceb-a13e-4f05-8a5c-d7c03eeaab36 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7beaa16b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:53.327333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f21edceb-a13e-4f05-8a5c-d7c03eeaab36 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1942631704" status: 202 len: 0 microversion: 2.1 time: 0.058289 Sep 25 01:23:53.328336 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2202/4397] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 01:23:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1942631704 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:53.339741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1036562e-22f0-464d-9ae4-785eb821d888 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] Calling method '.version_select at 0x7f7beacdc9d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:53.381058 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1036562e-22f0-464d-9ae4-785eb821d888 tempest-KeyPairsV2TestJSON-1851852412 tempest-KeyPairsV2TestJSON-1851852412-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-841200730" status: 202 len: 0 microversion: 2.1 time: 0.047708 Sep 25 01:23:53.382007 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2196/4398] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:23:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-841200730 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:53.401555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:53.402903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:53.426361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:53.427071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:53.430216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:53.431259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:53.434372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:53.435117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:53.638515 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=12 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:53.769866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:53.770815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:53.806114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:53.806114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:53.806114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:53.814762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:53.815269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:53.815715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:53.871941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:53.899188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:53.904746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:53.909929 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1174d73f-560d-4b69-a501-7d879b8827e2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.512282 Sep 25 01:23:53.934296 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2203/4399] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:53 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:54.328459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:54.345189 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-066d79c3-1eff-46d2-b540-dec328623b7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.580017 Sep 25 01:23:54.362537 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2197/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:53 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:54.941135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:54.941943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:54.970243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:54.970973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:54.971601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:54.972534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:54.973005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:54.973608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:55.260762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:55.286663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:55.292006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:55.324793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-473f7490-16c2-4204-9e3a-1debb4b64215 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.377263 Sep 25 01:23:55.326590 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2204/4401] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:54 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:55.378167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:55.383148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:55.431065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:55.436967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:55.440662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:55.443870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:55.451282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:55.452200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:55.863961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:55.876258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c0cd9f5-49da-4aa7-8c37-d9b7935fb159 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.504345 Sep 25 01:23:55.878090 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2198/4402] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:55 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:56.361591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:56.363888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:56.408410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:56.422361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:56.425758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:56.431173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:56.433839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:56.436350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:56.631175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:56.649006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:56.662553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:56.671429 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92d3e5e2-044f-4fa2-8cd3-85e703acf7c6 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.314811 Sep 25 01:23:56.672603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2205/4403] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:56 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:56.900705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:56.901704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:56.922476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:56.923262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:56.923262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:56.924307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:56.928159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:56.928553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:57.442102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:57.453369 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a3772b8-e52c-477a-8cb8-770f574b6b59 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.556762 Sep 25 01:23:57.455291 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2199/4404] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:56 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:23:57.661792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dfce7b5a-2109-4cc9-a3ca-7b204f741c43 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7beaa1db80>, body: {"keypair": {"name": "tempest-keypair-2108565421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf9N40bmZDa7SCLb99YQnyUl+wkqlC2B27hAVosNPUcf1DjckplxbbTjnLApbL0IsfpPbvPr4MZsQaL0jpOnGQpi3y9vdw4IN5CyBLQx87sOUHZw29mgWyuORfIba4iZQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:57.683721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dfce7b5a-2109-4cc9-a3ca-7b204f741c43 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:57.695502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dfce7b5a-2109-4cc9-a3ca-7b204f741c43 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:57.701291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:57.701951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:57.711499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:57.711994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:57.724819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:57.725861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:57.726504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:57.727098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:57.734808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dfce7b5a-2109-4cc9-a3ca-7b204f741c43 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.253039 Sep 25 01:23:57.735747 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2206/4405] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 255 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:23:57.766461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d499423-3f74-4865-89b1-3c5f33f5e7be tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bea9509d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:57.795629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d499423-3f74-4865-89b1-3c5f33f5e7be tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-2108565421" status: 200 len: 513 microversion: 2.2 time: 0.043605 Sep 25 01:23:57.809793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2207/4406] 10.222.0.16 () {60 vars in 1258 bytes} [Sun Sep 25 01:23:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2108565421 => generated 513 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:23:57.829677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a1dd8ed-94b5-45b6-a1b8-02314f2e4927 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bea92d280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:57.874003 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:23:57.885830 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a1dd8ed-94b5-45b6-a1b8-02314f2e4927 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2108565421" status: 204 len: 0 microversion: 2.2 time: 0.064553 Sep 25 01:23:57.886692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2208/4407] 10.222.0.16 () {60 vars in 1261 bytes} [Sun Sep 25 01:23:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2108565421 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:57.900215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e24ca1a3-0dc1-4ee5-afd8-7bcd2d6390ad tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7beaa16ca0>, body: {"keypair": {"name": "tempest-keypair-286730629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1NubMwIS+Y6uRyuCIDLcaQFi5boMQD7GKpMyW7EEgOjyPEB41aLK5CixT5NiCaa7DcABpehNDdGpV7DUFnG3oCOeQNbBwOtU3v9/GUuh7zL0mcROZVHrj5xZKXjUwrkQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:57.943528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e24ca1a3-0dc1-4ee5-afd8-7bcd2d6390ad tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:57.951155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e24ca1a3-0dc1-4ee5-afd8-7bcd2d6390ad tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:57.954852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:57.973742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:57.975498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:57.985086 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-44a7fe4b-c282-49c9-873d-1b778372b719 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.285085 Sep 25 01:23:57.986090 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2200/4408] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:57 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:23:58.013589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e24ca1a3-0dc1-4ee5-afd8-7bcd2d6390ad tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.117274 Sep 25 01:23:58.016848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2209/4409] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:23:58.025671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1cac7720-e5d7-4fdc-b9a2-b138faaaac3c tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beacfaa60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.065790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1cac7720-e5d7-4fdc-b9a2-b138faaaac3c tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286730629" status: 204 len: 0 microversion: 2.2 time: 0.044031 Sep 25 01:23:58.079127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab8ab7b3-4c47-47e1-b771-84e0d1186484 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7beaa16430>, body: {"keypair": {"name": "tempest-keypair-2039545925", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:58.083645 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2201/4410] 10.222.0.16 () {60 vars in 1258 bytes} [Sun Sep 25 01:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286730629 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:58.098223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ab8ab7b3-4c47-47e1-b771-84e0d1186484 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:58.104236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-ab8ab7b3-4c47-47e1-b771-84e0d1186484 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:58.164306 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab8ab7b3-4c47-47e1-b771-84e0d1186484 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.091885 Sep 25 01:23:58.178924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e8f91caf-6c59-4595-af86-c50b7ab90d64 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bf00563a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.184561 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2210/4411] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:58 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:23:58.206143 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e8f91caf-6c59-4595-af86-c50b7ab90d64 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039545925" status: 204 len: 0 microversion: 2.2 time: 0.032372 Sep 25 01:23:58.221518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09569054-ad37-4f28-9a26-9cf1ddd1dd64 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7bea95be50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-119045184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjwLO+JLvz+VvzjZltMelBJM9EE4V1Hia82Q8fDWUw+wp5mWZF5a58aPX1d/llSSKup+i4pDthXB08QJOrNbEFx0UrvZ7yIt+/XtziblBWLifRf/p/CFcrWcKIT+7tCGw=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:58.227140 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2202/4412] 10.222.0.16 () {60 vars in 1261 bytes} [Sun Sep 25 01:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039545925 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:58.241588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-09569054-ad37-4f28-9a26-9cf1ddd1dd64 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:58.249507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-09569054-ad37-4f28-9a26-9cf1ddd1dd64 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:58.294848 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09569054-ad37-4f28-9a26-9cf1ddd1dd64 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.077641 Sep 25 01:23:58.297804 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2211/4413] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:58 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:23:58.312471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e57629d-ed3a-4840-a8e4-b082549c5342 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7beacf8e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-952494360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5F+Y7RkAfCRVxF/MAd1ATMUUtyypqlDdD+eHlPiUoefPZu3QE0e0UbpCwwp1rj1czitSmGL/TYETypY8GAQ1/hrYXBtll6vki46GYWyqiw4Fk7pnpyZ96iDOLHIXJPeg=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:58.359282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-0e57629d-ed3a-4840-a8e4-b082549c5342 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:58.372474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-0e57629d-ed3a-4840-a8e4-b082549c5342 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:58.429633 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e57629d-ed3a-4840-a8e4-b082549c5342 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.122011 Sep 25 01:23:58.431513 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2203/4414] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:58 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:23:58.444998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ff5ff96-07bf-46d4-b715-c48d79d63f7c tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7beaa1d040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-881540013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc9ypglRlOR/8vrtT+pbE+qKGO/CtEcqEgpMjW0klhdyqFbDx6RqwGuMKVAh/jinxkdh2GgVE3nuMqCP2gBGP0lUc0zT291TgyKM3KNl5SvX2JrB7BazDDYhGfln94mvw=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:58.476645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.477718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:58.485851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1ff5ff96-07bf-46d4-b715-c48d79d63f7c tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:58.492775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:58.496084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:58.497974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:58.499548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:58.500956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1ff5ff96-07bf-46d4-b715-c48d79d63f7c tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:58.503173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:58.503849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:58.558425 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ff5ff96-07bf-46d4-b715-c48d79d63f7c tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.117564 Sep 25 01:23:58.559753 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2212/4415] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:58 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:23:58.569978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f03cf4b-cf8d-430a-ba9f-446cf842d7eb tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beaa16ee0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.575344 n-d-master-1 devstack@n-api.service[122384]: WARNING oslo_db.sqlalchemy.utils [None req-1f03cf4b-cf8d-430a-ba9f-446cf842d7eb tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 25 01:23:58.591276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f03cf4b-cf8d-430a-ba9f-446cf842d7eb tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.024710 Sep 25 01:23:58.592486 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2213/4416] 10.222.0.16 () {60 vars in 1177 bytes} [Sun Sep 25 01:23:58 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:58.603635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24ccede4-a894-4152-8c91-15c45d9755c8 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bea950820>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.640359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24ccede4-a894-4152-8c91-15c45d9755c8 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-881540013" status: 204 len: 0 microversion: 2.2 time: 0.040613 Sep 25 01:23:58.641242 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2214/4417] 10.222.0.16 () {60 vars in 1318 bytes} [Sun Sep 25 01:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-881540013 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:58.649875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48a6c7f0-2121-44ed-b883-639597d1780d tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bea95b670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.676489 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48a6c7f0-2121-44ed-b883-639597d1780d tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-952494360" status: 204 len: 0 microversion: 2.2 time: 0.030980 Sep 25 01:23:58.679801 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2215/4418] 10.222.0.16 () {60 vars in 1318 bytes} [Sun Sep 25 01:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-952494360 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:23:58.689009 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ece01fbf-a82d-4d1a-9bd1-d5551e058cb9 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beaa68430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.749781 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ece01fbf-a82d-4d1a-9bd1-d5551e058cb9 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-119045184" status: 204 len: 0 microversion: 2.2 time: 0.063255 Sep 25 01:23:58.752316 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2216/4419] 10.222.0.16 () {60 vars in 1318 bytes} [Sun Sep 25 01:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-119045184 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:58.765421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a993eeb3-507c-4193-b240-c59539027d0e tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7beb1830d0>, body: {"keypair": {"name": "tempest-keypair-552575845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMQ6il1G1Y35igNISyIimCs1vHJsxNMWlCeSZLsoExPf/n0q2erKNr4+WBwwzdzEH5WgcEpcVTldJd+SARp326VoT5B5sFnvIbzmHB21KjMeslijcVDIIkTIBIJHP3qRg=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:58.801574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a993eeb3-507c-4193-b240-c59539027d0e tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:58.826038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a993eeb3-507c-4193-b240-c59539027d0e tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:58.931934 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a993eeb3-507c-4193-b240-c59539027d0e tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.171618 Sep 25 01:23:58.936965 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2217/4420] 10.222.0.16 () {62 vars in 1199 bytes} [Sun Sep 25 01:23:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 25 01:23:58.944143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3688ffa2-ff58-43d0-8466-8681bef972f9 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bea9028b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:58.972881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3688ffa2-ff58-43d0-8466-8681bef972f9 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-552575845" status: 200 len: 512 microversion: 2.2 time: 0.032501 Sep 25 01:23:58.977808 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2218/4421] 10.222.0.16 () {60 vars in 1255 bytes} [Sun Sep 25 01:23:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-552575845 => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:23:58.984659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a72dd667-944f-4afe-bc83-3bb32bd13ad4 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7bea9dc1f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:59.002047 n-d-master-1 devstack@n-api.service[122384]: WARNING oslo_db.sqlalchemy.utils [None req-a72dd667-944f-4afe-bc83-3bb32bd13ad4 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 25 01:23:59.014462 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a72dd667-944f-4afe-bc83-3bb32bd13ad4 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.033573 Sep 25 01:23:59.015562 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2219/4422] 10.222.0.16 () {60 vars in 1177 bytes} [Sun Sep 25 01:23:58 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:23:59.021060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:59.025530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:59.032330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:59.036372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:59.041539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:59.042078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:59.043755 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a38844b0-ca3b-42af-bdc9-3af238b0c3e5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1655 microversion: 2.1 time: 0.571448 Sep 25 01:23:59.044641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:59.046582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2204/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:58 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1655 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:23:59.047590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:59.048223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:59.053722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-661156b4-add4-4175-a853-5b35a2d3795b tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beacdc670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:59.094430 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-661156b4-add4-4175-a853-5b35a2d3795b tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552575845" status: 204 len: 0 microversion: 2.2 time: 0.046614 Sep 25 01:23:59.097030 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2205/4424] 10.222.0.16 () {60 vars in 1258 bytes} [Sun Sep 25 01:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552575845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:23:59.108522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dccf1a49-ee1d-4a38-8013-a881c30f3fe6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:59.122270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dccf1a49-ee1d-4a38-8013-a881c30f3fe6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:59.125664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dccf1a49-ee1d-4a38-8013-a881c30f3fe6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:59.126323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dccf1a49-ee1d-4a38-8013-a881c30f3fe6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:59.176460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dccf1a49-ee1d-4a38-8013-a881c30f3fe6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Going to try to start instance {{(pid=122385) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:23:59.254278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:59.269038 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dccf1a49-ee1d-4a38-8013-a881c30f3fe6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.169386 Sep 25 01:23:59.273707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:59.274308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:23:59.274538 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2206/4425] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:23:59 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:23:59.282062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Action: 'create', calling method: .version_select at 0x7f7bf00563a0>, body: {"keypair": {"name": "tempest-keypair-465382389", "type": "x509"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:23:59.282925 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-765c59b0-3a44-4901-9989-1b6197dd1ab7 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.264178 Sep 25 01:23:59.293469 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2220/4426] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:23:59 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:23:59.293469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:23:59.295893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:23:59.309555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:59.310191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:59.310730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:59.311766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:23:59.312332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:23:59.313059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:23:59.337193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:23:59.352957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:23:59.426461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.processutils [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpsfchdcwu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsfchdcwu/temp.key -subj /CN=f1e59b7516f1419890705219d08bc6fb -extensions v3_req_client {{(pid=122385) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 25 01:23:59.854877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.processutils [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpsfchdcwu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsfchdcwu/temp.key -subj /CN=f1e59b7516f1419890705219d08bc6fb -extensions v3_req_client" returned: 0 in 0.428s {{(pid=122385) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 25 01:23:59.856766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.processutils [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpsfchdcwu/temp.key -password pass: {{(pid=122385) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 25 01:23:59.918895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.processutils [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpsfchdcwu/temp.key -password pass:" returned: 0 in 0.061s {{(pid=122385) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 25 01:24:00.005727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:24:00.022724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Getting quotas for user f1e59b7516f1419890705219d08bc6fb and project 0a408e8689a04981ab7a8ccc52914fba. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:24:00.043704 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a60f052-5dbd-476a-9cbe-2809a41857bd tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.767272 Sep 25 01:24:00.051915 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2207/4427] 10.222.0.16 () {62 vars in 1198 bytes} [Sun Sep 25 01:23:59 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 776 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:24:00.064511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ea5cc8a-a008-4795-a620-862907c9d3f6 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beacdcb80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:00.098404 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ea5cc8a-a008-4795-a620-862907c9d3f6 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-465382389" status: 200 len: 1533 microversion: 2.2 time: 0.043727 Sep 25 01:24:00.108001 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2208/4428] 10.222.0.16 () {60 vars in 1255 bytes} [Sun Sep 25 01:24:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-465382389 => generated 1533 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:00.113941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b5bc8e8-e537-4a31-ac21-bca823da5a7b tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beacf8550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:00.137816 n-d-master-1 devstack@n-api.service[122385]: WARNING oslo_db.sqlalchemy.utils [None req-0b5bc8e8-e537-4a31-ac21-bca823da5a7b tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 25 01:24:00.139834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b5bc8e8-e537-4a31-ac21-bca823da5a7b tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.029991 Sep 25 01:24:00.140704 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2209/4429] 10.222.0.16 () {60 vars in 1177 bytes} [Sun Sep 25 01:24:00 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:00.155257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2282809c-ea8a-4820-bdf7-8ba08eb452c0 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] Calling method '.version_select at 0x7f7beace6040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:00.190732 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2282809c-ea8a-4820-bdf7-8ba08eb452c0 tempest-KeyPairsV22TestJSON-1468660195 tempest-KeyPairsV22TestJSON-1468660195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465382389" status: 204 len: 0 microversion: 2.2 time: 0.039387 Sep 25 01:24:00.192487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2210/4430] 10.222.0.16 () {60 vars in 1258 bytes} [Sun Sep 25 01:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465382389 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:24:00.295838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:00.305160 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a882ff5-a28b-43f2-b411-bc9c25b24395 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1664 microversion: 2.1 time: 1.019919 Sep 25 01:24:00.325442 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2221/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:23:59 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1664 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:00.331290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:00.337166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:00.353848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:00.355767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:00.357545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:00.361180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:00.362065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:00.362676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:00.514044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:00.529289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:00.538391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:00.542673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-916e7df5-21e0-456f-8186-9a5ce2bfbbe5 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.232210 Sep 25 01:24:00.559489 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2211/4432] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:00 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:01.346760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:01.350460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:01.365362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:01.366812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:01.368384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:01.371790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:01.373328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:01.374653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:01.580285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:01.581243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:01.600115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:01.601074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:01.601970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:01.602278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:01.602745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:01.607769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:01.815289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:01.826970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:01.828428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:01.832768 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2cbeed14-26c5-4fa8-b538-28a557be03fa tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.254713 Sep 25 01:24:01.833604 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2212/4433] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:01 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:01.911313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:01.923889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1569c8e4-b7c3-4719-8fa8-22da37cc0e72 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1664 microversion: 2.1 time: 0.584423 Sep 25 01:24:01.937521 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2222/4434] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:01 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1664 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:02.860037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:02.860656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:02.876442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:02.884604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:02.890410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:02.892438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:02.896246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:02.898828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:02.948936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:02.950171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:02.965334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:02.966208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:02.966817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:02.967702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:02.972353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:02.975331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:03.191998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:03.204447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:03.208471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:03.210168 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-71c87a87-60f0-4265-a4d9-ad053e3d6a9b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.354013 Sep 25 01:24:03.211486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2213/4435] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:02 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:03.292506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:03.306193 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3e7baa57-44af-469e-b873-7114b1ea84c5 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.361637 Sep 25 01:24:03.307172 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2223/4436] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:02 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:03.334680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:03.335319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:03.342998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:03.343502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:03.343951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:03.344675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:03.345137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:03.345609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:03.368364 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:03.788061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:03.796941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1812b29-edc4-4f15-bfd2-95217d5f3a53 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.466175 Sep 25 01:24:03.811427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2214/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:03 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:03.821812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:03.822363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:03.840418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:03.840924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:03.841364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:03.850797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:03.859306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:03.860108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.003312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Unlocking {{(pid=122384) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 25 01:24:04.169254 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a7aa432-2bbc-4403-ac51-ee1d8acbb808 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.352124 Sep 25 01:24:04.169968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2224/4438] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:24:03 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:24:04.193576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:04.195416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:04.210544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:04.212994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:04.215074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.216153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:04.217277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:04.218089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.278694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Calling method '.version_select at 0x7f7bead98940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:04.303642 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=45 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:04.324284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:04.328416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:04.328416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.328416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:04.329392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:04.329914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.374078 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d179977f-049e-454d-b1a8-b7de007aef4f tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.341546 Sep 25 01:24:04.374692 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2215/4439] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 25 01:24:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:24:04.393723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:04.394560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:04.409596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:04.422945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:04.427387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.428367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:04.429061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:04.429677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:04.670017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:04.684933 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:04.688835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:04.693696 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a3299c3-0ec1-4137-a559-602ac1881b08 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.315086 Sep 25 01:24:04.696420 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2216/4440] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:04 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:04.712954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2098717129", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:04.817167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:24:05.061816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:05.080629 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77cbd9a5-2f08-4962-b251-27c06a347925 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.899059 Sep 25 01:24:05.084388 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2225/4441] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:04 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:05.110248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:05.110462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:05.126025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:05.128514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:05.129129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:05.130373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:05.131550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:05.133067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:05.198981 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:06.309964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:06.335098 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e300d520-4f0d-4f42-b0b4-3eac468111ac tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.220636 Sep 25 01:24:06.343112 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2226/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:05 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:06.349613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:06.350240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:06.371554 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:06.373564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:06.374120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:06.375646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:06.375646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:06.375841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:06.384475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:06.392950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Getting quotas for project 2f306c688a1b4837871b0b45378e36e0. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:24:06.435928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Getting quotas for user f2d2d473604047e49affedf50c2996d7 and project 2f306c688a1b4837871b0b45378e36e0. Resources: dict_keys(['metadata_items']) {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:24:06.480993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Request method failure captured: Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 1752 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL62zjSrlXyRgPfRYFc7XPAvzvd15kHMny9MNY4LLpCPTLQGYfhqaLYlifw3OtNlzIVj933Lvh7t6epUx6NniWr6hgxsAtxGlnioYwaW3FwgXzNTUrQe-k95dANh7eXa0L0xCyF-NgJOJyiF9z_J5EM0-ogjmZLvnwUKfMb7Gp1Kiqxw Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 2f306c688a1b4837871b0b45378e36e0 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1450173600 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f306c688a1b4837871b0b45378e36e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f306c688a1b4837871b0b45378e36e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f306c688a1b4837871b0b45378e36e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f306c688a1b4837871b0b45378e36e0"}]}] Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1450173600 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 2f306c688a1b4837871b0b45378e36e0 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1450173600 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: f2d2d473604047e49affedf50c2996d7 Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2098717129", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:24:06.524679 n-d-master-1 devstack@n-api.service[122385]: exception: Maximum number of metadata items exceeds 128 Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2098717129', 'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:24:06.527526 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:24:06.530985 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-efdf699f-b620-43bf-a130-f940514c9505 tempest-AbsoluteLimitsNegativeTestJSON-1450173600 tempest-AbsoluteLimitsNegativeTestJSON-1450173600-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.830395 Sep 25 01:24:06.534612 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2217/4443] 10.222.0.16 () {60 vars in 1148 bytes} [Sun Sep 25 01:24:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 1836 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:24:06.562517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:06.563234 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:06.572408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:06.572928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:06.573832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:06.574921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:06.576259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:06.578047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:06.704367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:06.716498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:06.718054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:06.719322 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f9d4d7f-e9aa-4f90-b438-c15e7149a734 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.375155 Sep 25 01:24:06.719853 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2227/4444] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:06 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:07.252631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:07.280643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f75fd59-5a2f-4f86-a1b6-8d67cff83f87 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.743858 Sep 25 01:24:07.295165 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2218/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:06 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:07.311323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:07.311941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:07.340615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:07.341221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:07.341700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:07.347886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:07.348790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:07.363084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:07.552852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-72783936-0d29-4b0f-bb7c-9103a3ae2cdf tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.246027 Sep 25 01:24:07.555595 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2228/4446] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:24:07 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:24:07.563294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:07.563927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:07.577535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:07.590343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:07.591060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:07.592005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:07.592642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:07.593251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:07.750395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:07.751645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:07.769472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:07.769983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:07.770425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:07.771144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:07.771600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:07.772294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:08.336410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:08.370980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:08.387820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:08.392018 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-920907ff-56f2-4752-a05b-967ce5890e8d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.643653 Sep 25 01:24:08.392795 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2229/4447] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:07 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:09.424116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:09.424731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:09.428238 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=28 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:09.433146 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:09.473206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:09.475119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:09.478841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:09.480176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:09.480658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:09.481104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:09.520096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:09.534022 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e2152d8-37b7-459f-99d1-8755ce4200e6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1673 microversion: 2.1 time: 1.972256 Sep 25 01:24:09.553280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2219/4448] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:07 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1673 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:09.937336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:09.955192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:09.958494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:09.969678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e4645925-2a99-4824-b95f-6db40221b146 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.546841 Sep 25 01:24:09.970961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2230/4449] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:09 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:24:10.560738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:10.561386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:10.575666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:10.576167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:10.576614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:10.577693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:10.577825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:10.578314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:11.002189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:11.002815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:11.023355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:11.024711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:11.032279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:11.034919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:11.037667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:11.038305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:11.310504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:11.326691 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:11.328813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:11.330761 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b0f7753-7ace-4c04-940d-af8aa3ad8d99 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.332783 Sep 25 01:24:11.331866 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2231/4450] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:10 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:24:11.447664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:11.456741 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-02e901de-4f29-419a-b1f6-95ef3e937f8d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1653 microversion: 2.1 time: 0.900470 Sep 25 01:24:11.459551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2220/4451] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:10 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1653 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:11.489213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:11.492023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:11.529755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:11.530852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:11.533846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:11.539405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:11.541669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:11.544456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:11.782229 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-94fff8d7-e5e2-425b-b6f6-9d52c1818303 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.298588 Sep 25 01:24:11.790666 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2232/4452] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:24:11 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:24:11.798304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:11.798944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:11.816968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:11.817552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:11.820971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:11.822130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:11.824488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:11.828399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:12.363105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:12.364397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:12.378285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:12.379045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:12.381126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:12.382805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:12.383452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:12.384676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:12.719976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:12.734950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:12.739859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:12.741109 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f805888-5fee-4481-b670-39232d919307 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.382613 Sep 25 01:24:12.746884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2233/4453] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:12 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:24:12.973844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:12.982230 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c906709-a00f-496e-837f-b94c94b24f9c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1660 microversion: 2.1 time: 1.191478 Sep 25 01:24:12.982847 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2221/4454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:11 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1660 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:13.778595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:13.779322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:13.788569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:13.803740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:13.804932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:13.806025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:13.808304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:13.809067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:13.956712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1142207943", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8c417393-4fe3-4011-bcaf-7c3d7e3111b4"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:14.082298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] validate_networks() for [('8c417393-4fe3-4011-bcaf-7c3d7e3111b4', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:24:14.341208 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:14.719384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:14.741456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:14.744025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:14.752083 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6f0fdec-510d-4220-b05b-a90854056933 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.973023 Sep 25 01:24:14.753762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2222/4455] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:13 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:24:14.759196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:14.763567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:14.785254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:14.785556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:14.786251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:14.788576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:14.795779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:14.796421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:15.560213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:15.572621 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2f80ae2-4b32-4d10-9a74-ab0698bf8751 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.817647 Sep 25 01:24:15.579242 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2223/4456] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:14 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:15.603823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:15.605664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:15.624322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:15.633479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:15.634027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:15.639013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:15.639582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:15.643214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:16.469662 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:16.778638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:24:16.779352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:24:16.779898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:24:16.780324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:24:16.780746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:24:16.816628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:16.817118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:16.820897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:16.823104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:16.823884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:16.824567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:16.882844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Getting quotas for project 10fa7c775d924acda02fb364a1818ba2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:24:16.895270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Getting quotas for user d4b32b37164a44f3a6ab4f0b4335cfbb and project 10fa7c775d924acda02fb364a1818ba2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:24:16.910332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:16.930648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-25a1aeb5-b84c-42f2-9a8c-1d9456eed52d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.336055 Sep 25 01:24:16.945721 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2224/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:15 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:16.950256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Going to run 2 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:24:16.951721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:16.954321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:16.958199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 149349b9-bd85-4b92-9fe7-9f94444b7dc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:24:16.968073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:16.969761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:16.970410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:16.971981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:16.973950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:16.974673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.063931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=149349b9-bd85-4b92-9fe7-9f94444b7dc2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:24:17.150072 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-58ea4698-e4e9-402f-b5b1-bcd7f99bd307 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.638579 Sep 25 01:24:17.153626 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2234/4458] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:24:17.164875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:17.167239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:17.178301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:17.179563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:17.182106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.184397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:17.187420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:17.190146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.337149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:17.353259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:17.355339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:17.361049 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-26159f2f-9c85-4bad-8183-33ecfa1c42ed tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.420745 Sep 25 01:24:17.361168 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2225/4459] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:16 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:17.386793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:17.410976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:17.411988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Searching by: {'deleted': False, 'project_id': '10fa7c775d924acda02fb364a1818ba2'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:24:17.541578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:17.542169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:17.542669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.556670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:17.556670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:17.556670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.621962 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b84d64d-c064-495f-aeee-fc3c3594cfd2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.256605 Sep 25 01:24:17.634076 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2226/4460] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:24:17 2022] GET /compute/v2.1/servers => generated 677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:17.642095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0b438f1-e809-4f3e-8dce-238cde75ebd0 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:17.644016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e0b438f1-e809-4f3e-8dce-238cde75ebd0 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:17.762654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:17.772775 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ccd5d0c6-36c6-427c-8534-ea9bf3744d6f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.617187 Sep 25 01:24:17.778916 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2235/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:17 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:17.790646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e0b438f1-e809-4f3e-8dce-238cde75ebd0 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:17.804801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:17.805804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:17.817699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:17.818195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:17.820995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.822188 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0b438f1-e809-4f3e-8dce-238cde75ebd0 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1220 microversion: 2.1 time: 0.184242 Sep 25 01:24:17.822354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:17.822701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:17.826477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:17.841973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2227/4462] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:17 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1220 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:18.404334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:18.408173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:18.426794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:18.427570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:18.431100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:18.432073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:18.433322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:18.434333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:18.438357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:18.447358 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-963b89e7-339b-4dbc-85ae-550cee6ce1fb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.647036 Sep 25 01:24:18.466537 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2236/4463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:17 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:18.496931 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:18.497674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:18.512688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:18.516117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:18.517279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:18.519854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:18.523510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:18.526700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:18.728874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:18.742354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:18.744609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:18.751381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-98a4773b-470c-42f5-9d86-b26983548b2d tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.357496 Sep 25 01:24:18.756346 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2228/4464] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:18 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:18.868711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c473453e-66e3-4e9d-a45e-98f23bf900fb tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:18.869360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c473453e-66e3-4e9d-a45e-98f23bf900fb tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:19.101094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c473453e-66e3-4e9d-a45e-98f23bf900fb tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:19.112416 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c473453e-66e3-4e9d-a45e-98f23bf900fb tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1220 microversion: 2.1 time: 0.248250 Sep 25 01:24:19.117052 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2229/4465] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:18 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1220 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:19.398400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:19.412034 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38daa196-1902-4e63-ac50-598e061c9ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.935094 Sep 25 01:24:19.431942 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2237/4466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:18 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:19.441001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:19.441869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:19.458264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:19.459074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:19.459727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:19.460615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:19.461238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:19.461980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:19.788284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:19.788920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:19.814732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:19.815251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:19.818504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:19.819360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:19.822182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:19.823650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:20.212857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:20.229375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:20.247432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:20.262219 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4367cc3b-6518-4331-bbcd-a73bed428da2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 0.479047 Sep 25 01:24:20.262838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2238/4467] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:19 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:24:20.287371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:20.296229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:20.310171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:20.311101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:20.312030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:20.313271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:20.313998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:20.314624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:20.436602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:20.485719 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2905251e-2e8e-47d1-9a48-3bb0dbe624ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.050669 Sep 25 01:24:20.512364 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2230/4468] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:19 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:20.549180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:20.562704 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25d14523-536a-4aa9-b70a-86a560b8f6b8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1272 microversion: 2.1 time: 0.298743 Sep 25 01:24:20.563304 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2239/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:20 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:21.290427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:21.291412 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:21.303769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:21.305144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:21.306721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:21.314339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:21.341211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:21.345175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:21.593935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:21.595404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:21.614530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:21.616506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:21.617234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:21.619702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:21.624476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:21.626522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:23.011338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:23.028479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:23.031330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:23.037292 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8d49ae2f-35b7-46de-90f3-829e17427f7a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1366 microversion: 2.47 time: 1.751191 Sep 25 01:24:23.040658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2231/4470] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:21 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1366 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:23.167136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:23.194154 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7fce095a-431a-471d-8d8e-798ea26dd07e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1278 microversion: 2.1 time: 1.602226 Sep 25 01:24:23.198021 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2240/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:21 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1278 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:24.071462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:24.073213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:24.105918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:24.106132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:24.106587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:24.107316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:24.107783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:24.108216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:24.244000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:24.245288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:24.295051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:24.301226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:24.310134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:24.317046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:24.317655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:24.318114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:24.475150 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:25.166484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:25.178622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:25.192494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:25.199321 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bfc4b711-2fe6-469e-be22-4a4aee7f6519 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1372 microversion: 2.47 time: 1.132772 Sep 25 01:24:25.206411 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2232/4472] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:24 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1372 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:25.264546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:25.288024 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05c8b90c-10a7-459c-b550-48298acb2465 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1278 microversion: 2.1 time: 1.056972 Sep 25 01:24:25.309095 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2241/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:24 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1278 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:26.231515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:26.232314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:26.246636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:26.248520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:26.249090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:26.249965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:26.259612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:26.263579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:26.326923 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:26.327657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:26.354672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:26.355377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:26.361920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:26.365723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:26.367099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:26.370365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:26.580736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:26.637574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:26.654127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:26.662861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e8aa310-ceeb-4252-beee-7b281754ec24 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1372 microversion: 2.47 time: 0.434457 Sep 25 01:24:26.671112 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2233/4474] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:26 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:26.692294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:26.717291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d8a447d8-57f8-4a14-b854-31c2cfef878d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1278 microversion: 2.1 time: 0.389881 Sep 25 01:24:26.718380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2242/4475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:26 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1278 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:27.696360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:27.698153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:27.706645 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:27.708173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:27.708927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:27.714200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:27.715270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:27.716271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:27.716824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:27.744594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:27.746292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:27.766107 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:27.769441 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:27.775729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:27.779337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:27.782021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:27.785181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:27.786209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:27.786874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:27.927046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:27.942155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:27.943981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:27.945210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3ecfaec-58d5-40b6-adc3-63d1e2320b81 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1357 microversion: 2.47 time: 0.253918 Sep 25 01:24:27.945826 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2234/4476] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:27 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:27.976345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:27.984998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:27.985912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Searching by: {'deleted': False, 'project_id': '8f9849b93b6e407682309d5585094847'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:24:27.998106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.001317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.001811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:28.002601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.003068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.009837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:28.177103 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:28.184423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:24:28.342461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:28.370014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.370520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.370970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:28.406357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:28.418072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:28.512360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:28.533356 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a1c0dcd-7ffd-4ec6-b74b-4ced5613f62e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.793471 Sep 25 01:24:28.535586 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2243/4477] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:27 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:28.564003 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-601d833d-227e-421a-af92-8c24f6587c8a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.592158 Sep 25 01:24:28.580545 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2235/4478] 10.222.0.16 () {60 vars in 1187 bytes} [Sun Sep 25 01:24:27 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:24:28.606889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:28.607398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:28.618615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.619116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.619641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:28.620848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.621248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.621705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:28.709553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:24:28.922291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75f4f63a-e6d5-4453-b20a-e39bb58dc0ec tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 204 len: 0 microversion: 2.47 time: 0.320280 Sep 25 01:24:28.922928 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2244/4479] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:24:28 2022] DELETE /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:24:28.932670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:28.933717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:28.958837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.962798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.962798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:28.963470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:28.964067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:28.964588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:29.251525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:29.268646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:29.270526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:29.272557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ac9a710-6713-40f9-9795-9ddf75f96c76 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1363 microversion: 2.47 time: 0.344862 Sep 25 01:24:29.273787 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2236/4480] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:28 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:29.564693 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:29.565695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:29.586099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:29.586978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:29.588569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:29.589654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:29.591708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:29.592623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:30.306964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:30.307609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:30.325276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:30.325815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:30.326268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:30.327233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:30.327876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:30.328316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:30.425245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:30.443493 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ebe8de78-2db8-4d8b-a3b5-b24d42e201f1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.885224 Sep 25 01:24:30.444088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2245/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:29 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:30.652011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:30.668008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:30.670887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:30.675844 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8fadc50a-8d3f-43ed-8e09-1dd26269ec2a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1363 microversion: 2.47 time: 0.375764 Sep 25 01:24:30.678879 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2237/4482] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:30 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:31.470304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:31.470937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:31.488824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:31.489347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:31.493312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:31.494361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:31.494939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:31.495382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:31.704597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:31.705231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:31.719699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:31.721419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:31.722076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:31.725158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:31.726010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:31.726802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:31.825616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:31.826116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:31.826563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:31.827038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lazy-loading 'fault' on Instance uuid 0afca0c7-f81d-4c80-9186-1b9d17d7c288 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:24:32.394970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:32.436268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:32.438045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:32.440585 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cbde2f65-d290-42b1-9920-bd8adeb0391b tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 200 len: 1368 microversion: 2.47 time: 0.740145 Sep 25 01:24:32.442146 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2238/4483] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:31 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 1368 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:32.514256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b20876f7-7757-4652-afca-c0f3a844d6e8 req-27b8af33-03a0-4a62-9410-5abaf0d02899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149349b9-bd85-4b92-9fe7-9f94444b7dc2", "tag": "e3d04e23-a10f-4eec-92e1-2a56ca0699a0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:32.531701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b20876f7-7757-4652-afca-c0f3a844d6e8 req-27b8af33-03a0-4a62-9410-5abaf0d02899 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:32.533022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b20876f7-7757-4652-afca-c0f3a844d6e8 req-27b8af33-03a0-4a62-9410-5abaf0d02899 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:32.533813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b20876f7-7757-4652-afca-c0f3a844d6e8 req-27b8af33-03a0-4a62-9410-5abaf0d02899 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:32.579063 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b20876f7-7757-4652-afca-c0f3a844d6e8 req-27b8af33-03a0-4a62-9410-5abaf0d02899 service nova] Creating event network-changed:e3d04e23-a10f-4eec-92e1-2a56ca0699a0 for instance 149349b9-bd85-4b92-9fe7-9f94444b7dc2 on n-h2-master-1 Sep 25 01:24:32.592908 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b20876f7-7757-4652-afca-c0f3a844d6e8 req-27b8af33-03a0-4a62-9410-5abaf0d02899 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090884 Sep 25 01:24:32.595408 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2239/4484] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:24:32.950141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:32.967340 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82d0d52d-0920-4a2e-aa81-2be87e8bc3f7 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 1.502162 Sep 25 01:24:32.974648 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2246/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:31 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:33.473176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:33.474611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 0afca0c7-f81d-4c80-9186-1b9d17d7c288] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:33.499260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:33.499919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:33.505774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:33.506731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:33.507236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:33.510605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:33.595600 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] HTTP exception thrown: Instance 0afca0c7-f81d-4c80-9186-1b9d17d7c288 could not be found. Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Request method failure captured: Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 HTTP/1.1 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL62Zy3zPDVEt2Cimn1H9wbpyxhG92ywbMPYBb79CkRYDgTCiKnwUqvK_w4ivu386yF4NG9khUCqtjTRP6LcABwZZXyx54BXJv7Em5xMm-Wjg7JSP5Jl_XTR82dHXFdKF8cEUyov-d_VIn8F3Iuwm434-vjCwF08Q1m3oxQI_dulfpyA Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.47 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 8f9849b93b6e407682309d5585094847 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerShowV247Test-1916831642 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9849b93b6e407682309d5585094847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9849b93b6e407682309d5585094847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9849b93b6e407682309d5585094847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9849b93b6e407682309d5585094847"}]}] Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerShowV247Test-1916831642 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 8f9849b93b6e407682309d5585094847 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerShowV247Test-1916831642 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerShowV247Test-1916831642-project Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d3098d02a0814cf7ada5aae6bedf2771 Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerShowV247Test-1916831642-project Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0afca0c7-f81d-4c80-9186-1b9d17d7c288 could not be found. Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0afca0c7-f81d-4c80-9186-1b9d17d7c288'} Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afca0c7-f81d-4c80-9186-1b9d17d7c288 could not be found. Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afca0c7-f81d-4c80-9186-1b9d17d7c288 could not be found. Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:33.602277 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afca0c7-f81d-4c80-9186-1b9d17d7c288 could not be found. Sep 25 01:24:33.607681 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:33.617075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Returning 404 to user: Instance 0afca0c7-f81d-4c80-9186-1b9d17d7c288 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:24:33.622201 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-998ace92-93c1-4688-9ba5-44c6ead3b50a tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288" status: 404 len: 111 microversion: 2.47 time: 0.152159 Sep 25 01:24:33.627792 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2240/4486] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:33 2022] GET /compute/v2.1/servers/0afca0c7-f81d-4c80-9186-1b9d17d7c288 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:24:33.649108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:33.652179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:33.681392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:33.686079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:33.688366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:33.691679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:33.693066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:33.694002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:33.805874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:24:33.910830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-43250301", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "47ddbc7d-60bf-440b-bb2f-5522c71eaa08"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:34.065999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] validate_networks() for [('47ddbc7d-60bf-440b-bb2f-5522c71eaa08', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:24:34.763709 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ef55a5d-9a3e-49b3-b477-421e3f9967a1 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387" status: 204 len: 0 microversion: 2.47 time: 1.128982 Sep 25 01:24:34.767281 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2241/4487] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:24:33 2022] DELETE /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:24:34.781513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:34.782383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:34.807543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:34.809107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:34.811018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:34.812283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:34.814111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:34.815726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:35.142425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:35.154647 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1372d2a9-1b4f-4d5c-b308-db6826b7ae1f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.385873 Sep 25 01:24:35.159728 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2242/4488] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:34 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:35.174153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e4532d31-73d6-4ca8-a727-57ecdb914838 req-deace517-cbde-4f94-999e-510fec961917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1936b4e-883f-460a-b799-413134408ee0", "tag": "767a471c-8126-4267-b1ad-04cd169b14db"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:35.192251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e4532d31-73d6-4ca8-a727-57ecdb914838 req-deace517-cbde-4f94-999e-510fec961917 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:35.192997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e4532d31-73d6-4ca8-a727-57ecdb914838 req-deace517-cbde-4f94-999e-510fec961917 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:35.193566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e4532d31-73d6-4ca8-a727-57ecdb914838 req-deace517-cbde-4f94-999e-510fec961917 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:35.222271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e4532d31-73d6-4ca8-a727-57ecdb914838 req-deace517-cbde-4f94-999e-510fec961917 service nova] Creating event network-changed:767a471c-8126-4267-b1ad-04cd169b14db for instance a1936b4e-883f-460a-b799-413134408ee0 on n-h2-master-1 Sep 25 01:24:35.228554 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e4532d31-73d6-4ca8-a727-57ecdb914838 req-deace517-cbde-4f94-999e-510fec961917 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067480 Sep 25 01:24:35.231476 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2243/4489] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:35.240330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:35.243416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:35.278472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:35.279845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:35.280600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:35.282296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:35.283409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:35.285498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:35.361636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:24:35.362598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:24:35.363333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:24:35.365174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:24:35.365801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:24:35.403798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:35.404288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:35.404943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:35.405914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:35.406557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:35.407154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:35.427538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:35.442481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:35.448934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:35.451037 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2117439-c4b8-43c7-9928-5b12af3c6a4f tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387" status: 200 len: 1362 microversion: 2.47 time: 0.218312 Sep 25 01:24:35.455197 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2244/4490] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:35 2022] GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:35.457980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Getting quotas for project 9423abf226924bda908336987ed1ef5f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:24:35.481267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Getting quotas for user 5eb4a7652e4c4f16833ab002da950f02 and project 9423abf226924bda908336987ed1ef5f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:24:35.502268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:24:35.505352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:24:35.589968 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c9b7ace-499e-4bb6-9a66-0b99d17a3512 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086278 Sep 25 01:24:35.598659 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2247/4491] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:24:35.606214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfdc99e2-2ee5-4121-8529-b43791aaf7df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:35.607021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dfdc99e2-2ee5-4121-8529-b43791aaf7df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:35.716073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dfdc99e2-2ee5-4121-8529-b43791aaf7df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:35.728680 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfdc99e2-2ee5-4121-8529-b43791aaf7df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1213 microversion: 2.1 time: 0.128523 Sep 25 01:24:35.746408 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2245/4492] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:35 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:36.181185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:36.182062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:36.196881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:36.197471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:36.204337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:36.206249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:36.213800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:36.216346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:36.490839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:36.491560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:36.503417 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:36.543683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:36.548577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:36.550928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:36.551726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:36.558485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:36.559018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:36.632713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:36.646836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-66ea5554-abec-4940-bbec-e13de38d59e1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.473193 Sep 25 01:24:36.654009 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2248/4493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:36 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:36.736942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:36.755143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:36.756800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:36.758025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-621a41e2-0413-4cc9-99a5-935d03563cd2 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387" status: 200 len: 1362 microversion: 2.47 time: 0.276601 Sep 25 01:24:36.761784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:36.763217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:36.773573 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2246/4494] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:36 2022] GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:36.775735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:36.778749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:36.780333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:36.783087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:36.784752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:36.786425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.048582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:37.049258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:37.061077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.062093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.062561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.064788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:37.066548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.067548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.068014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.080261 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83b3c235-040c-4372-924d-640900c10bc2 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1217 microversion: 2.1 time: 0.324129 Sep 25 01:24:37.093493 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2249/4495] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:36 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1217 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:37.276107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lazy-loading 'services' on Instance uuid 9f14386a-fe75-43fb-9c4e-dc27f52e4099 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:24:37.417459 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30de0f67-7808-40af-bd3b-639790ca594a tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099/os-volume_attachments/5447729a-87c3-46f4-8e5e-4295d796d220" status: 202 len: 0 microversion: 2.1 time: 0.372964 Sep 25 01:24:37.428171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2247/4496] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:24:37 2022] DELETE /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099/os-volume_attachments/5447729a-87c3-46f4-8e5e-4295d796d220 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:24:37.678448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:37.679506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:37.724004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.724733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.726499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.727419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.727889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.728329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.788022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:37.789672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:37.805751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.807998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.808826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.810019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.810734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.811398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.903476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:37.904196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:37.904691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:37.905173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lazy-loading 'fault' on Instance uuid 1aac43c1-5c74-4605-8ce0-158b08b16387 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:24:38.089463 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:38.214005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:38.223339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:38.227142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3098d02a0814cf7ada5aae6bedf2771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9849b93b6e407682309d5585094847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:38.228376 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2736bc8-b8e5-4663-9da3-5d9236d45924 tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387" status: 200 len: 1367 microversion: 2.47 time: 0.447094 Sep 25 01:24:38.253429 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2248/4497] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:37 2022] GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:24:38.253429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:38.253429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:38.258783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:38.259290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:38.259743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:38.261130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:38.261683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:38.262127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:38.751221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:38.762473 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9bbc411-64e3-4aa1-8eaa-1c9e82da9244 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1283 microversion: 2.1 time: 0.518669 Sep 25 01:24:38.766656 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2249/4498] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:38 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1283 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:38.799927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:38.820430 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b2e13e5-b727-4733-aa31-46ba44f31651 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 1.150956 Sep 25 01:24:38.823539 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2250/4499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:37 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:39.277125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:39.278368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] [instance: 1aac43c1-5c74-4605-8ce0-158b08b16387] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:39.299989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:39.302460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:39.304101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:39.308111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:39.310157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:39.311010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:39.352744 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] HTTP exception thrown: Instance 1aac43c1-5c74-4605-8ce0-158b08b16387 could not be found. Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Request method failure captured: Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 HTTP/1.1 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL62Zy3zPDVEt2Cimn1H9wbpyxhG92ywbMPYBb79CkRYDgTCiKnwUqvK_w4ivu386yF4NG9khUCqtjTRP6LcABwZZXyx54BXJv7Em5xMm-Wjg7JSP5Jl_XTR82dHXFdKF8cEUyov-d_VIn8F3Iuwm434-vjCwF08Q1m3oxQI_dulfpyA Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.47 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 8f9849b93b6e407682309d5585094847 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerShowV247Test-1916831642 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9849b93b6e407682309d5585094847"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9849b93b6e407682309d5585094847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9849b93b6e407682309d5585094847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9849b93b6e407682309d5585094847"}]}] Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerShowV247Test-1916831642 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 8f9849b93b6e407682309d5585094847 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerShowV247Test-1916831642 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerShowV247Test-1916831642-project Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d3098d02a0814cf7ada5aae6bedf2771 Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerShowV247Test-1916831642-project Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 1aac43c1-5c74-4605-8ce0-158b08b16387 could not be found. Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1aac43c1-5c74-4605-8ce0-158b08b16387'} Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aac43c1-5c74-4605-8ce0-158b08b16387 could not be found. Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aac43c1-5c74-4605-8ce0-158b08b16387 could not be found. Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:39.360305 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aac43c1-5c74-4605-8ce0-158b08b16387 could not be found. Sep 25 01:24:39.365123 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:39.374887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] Returning 404 to user: Instance 1aac43c1-5c74-4605-8ce0-158b08b16387 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:24:39.376054 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22fe20bf-a842-4caa-ac11-e5d8a73456ef tempest-ServerShowV247Test-1916831642 tempest-ServerShowV247Test-1916831642-project] 10.222.0.16 "GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387" status: 404 len: 111 microversion: 2.47 time: 0.110948 Sep 25 01:24:39.377423 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2250/4500] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:24:39 2022] GET /compute/v2.1/servers/1aac43c1-5c74-4605-8ce0-158b08b16387 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:24:39.794791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:39.795456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:39.804199 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:39.828006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:39.830173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:39.830973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:39.832550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:39.833361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:39.834201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:39.857932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:39.859295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:39.876637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:39.884765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:39.887474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:39.895660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:39.899741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:39.900968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:40.569120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:40.594656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86797b9f-db26-4546-b46e-9b8fb476a4d5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.747389 Sep 25 01:24:40.600859 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2251/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:39 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:40.812735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:40.824985 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a03633fc-d831-4a7e-8224-1e61a4f316c0 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 1.036269 Sep 25 01:24:40.844883 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2251/4502] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:39 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:41.628272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:41.630319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:41.651335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:41.654440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:41.657385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:41.660675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:41.662022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:41.664796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:41.684217 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:41.850882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:41.851496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:41.862733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:41.866996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:41.867943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:41.868962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:41.869657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:41.873996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:42.437910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:42.453214 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-863bef1b-2a5e-4421-a881-7f46595dd62d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.829472 Sep 25 01:24:42.454864 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2252/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:41 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:42.652140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1873c81a-b440-49bf-a85e-82f833fdd79e req-4e9c3b29-a309-47dc-81f0-7d584a216a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66ad9c5-f1a2-4535-b549-7f953fa9589e", "tag": "898b02c2-f2af-4f52-9068-17cfa2c0a7de"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:42.679211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1873c81a-b440-49bf-a85e-82f833fdd79e req-4e9c3b29-a309-47dc-81f0-7d584a216a94 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:42.681167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1873c81a-b440-49bf-a85e-82f833fdd79e req-4e9c3b29-a309-47dc-81f0-7d584a216a94 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:42.684813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1873c81a-b440-49bf-a85e-82f833fdd79e req-4e9c3b29-a309-47dc-81f0-7d584a216a94 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:42.723474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1873c81a-b440-49bf-a85e-82f833fdd79e req-4e9c3b29-a309-47dc-81f0-7d584a216a94 service nova] Creating event network-changed:898b02c2-f2af-4f52-9068-17cfa2c0a7de for instance c66ad9c5-f1a2-4535-b549-7f953fa9589e on n-h1-master-1 Sep 25 01:24:42.730268 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1873c81a-b440-49bf-a85e-82f833fdd79e req-4e9c3b29-a309-47dc-81f0-7d584a216a94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081304 Sep 25 01:24:42.734669 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2253/4504] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:24:43.111577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:43.128228 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5602c6fb-0c8f-41d4-9bb6-8e5c7a215c6f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 1.281125 Sep 25 01:24:43.131508 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2252/4505] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:41 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:43.481173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:43.482319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:43.496296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:43.502229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:43.503153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:43.504070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:43.514119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:43.520060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:43.530482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:43.535846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:43.569554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:43.573259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:43.574111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:43.576089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:43.577697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:43.592250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:43.816904 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a42cf17-6cf2-4ef8-bc39-c5bea72d8c13 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.287620 Sep 25 01:24:43.818608 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2253/4506] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:24:43 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:24:43.832001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:43.833151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:43.851054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:43.852550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:43.856733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:43.857852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:43.858552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:43.860299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:45.432416 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:45.490826 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:45.572783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:45.582529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:45.597930 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40517023-eb88-453f-b436-52cb690c29ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1670 microversion: 2.1 time: 1.774944 Sep 25 01:24:45.601197 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fc9822e0-6e05-4a57-8091-79f1c6ee4569 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 2.125059 Sep 25 01:24:45.603059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2254/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:43 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:45.618100 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2254/4508] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:43 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1670 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:45.623283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:45.624882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-52c66daf-e2a2-49a1-997d-63925b64c6a7 req-aec6ecd8-94c4-4cda-98a3-9f615ea5d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149349b9-bd85-4b92-9fe7-9f94444b7dc2", "name": "network-vif-plugged", "status": "completed", "tag": "e3d04e23-a10f-4eec-92e1-2a56ca0699a0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:45.633590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:45.655301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:45.655885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:45.656359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:45.656976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-52c66daf-e2a2-49a1-997d-63925b64c6a7 req-aec6ecd8-94c4-4cda-98a3-9f615ea5d3df service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:45.657111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:45.657601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:45.657969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-52c66daf-e2a2-49a1-997d-63925b64c6a7 req-aec6ecd8-94c4-4cda-98a3-9f615ea5d3df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:45.658106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:45.658677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-52c66daf-e2a2-49a1-997d-63925b64c6a7 req-aec6ecd8-94c4-4cda-98a3-9f615ea5d3df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:45.716689 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-52c66daf-e2a2-49a1-997d-63925b64c6a7 req-aec6ecd8-94c4-4cda-98a3-9f615ea5d3df service nova] Creating event network-vif-plugged:e3d04e23-a10f-4eec-92e1-2a56ca0699a0 for instance 149349b9-bd85-4b92-9fe7-9f94444b7dc2 on n-h2-master-1 Sep 25 01:24:45.731558 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:45.741744 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-52c66daf-e2a2-49a1-997d-63925b64c6a7 req-aec6ecd8-94c4-4cda-98a3-9f615ea5d3df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120507 Sep 25 01:24:45.743547 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2255/4509] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:46.364150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Calling method '.version_select at 0x7f7beb9b9b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:46.370217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.371101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.375304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:46.413646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.415051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.416334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:46.441329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.443398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:46.447065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.447919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:46.464314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07767cd3-a80b-48f3-97fb-e066caa6418d tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 0.853568 Sep 25 01:24:46.469839 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2255/4510] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:45 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:46.470928 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:46.480095 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b3ef7510-0e81-4091-8ed6-99e82aa80587 tempest-PortsAdminExtendedAttrsTestJSON-2067446868 tempest-PortsAdminExtendedAttrsTestJSON-2067446868-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.487642 Sep 25 01:24:46.502257 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2256/4511] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:24:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:46.630210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:46.630661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:46.630838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:46.631331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:46.641368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.641991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.642520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.646228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:46.647530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.648977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.649301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.649916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:46.650637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:46.651465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:46.652074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:46.652686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:47.257187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:47.267373 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de65172e-94ee-4d87-a259-309f234f938c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1670 microversion: 2.1 time: 0.640918 Sep 25 01:24:47.271420 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2256/4512] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:46 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1670 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:47.284901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5363a23-d6b3-41f1-af1f-364ea6bc7d71 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaeaa280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:47.405798 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5363a23-d6b3-41f1-af1f-364ea6bc7d71 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2c0265d7-3649-41e4-b650-77203d663c6a" status: 200 len: 351 microversion: 2.1 time: 0.128023 Sep 25 01:24:47.406769 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2257/4513] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:24:47 2022] GET /compute/v2.1/os-volumes/2c0265d7-3649-41e4-b650-77203d663c6a => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:47.491158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:47.492389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:47.511853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:47.512375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:47.512836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:47.513908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:47.514701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:47.515413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:47.643565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:47.660531 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a01db7d1-5e19-4e93-b547-475dc5ec48bc tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 1.031262 Sep 25 01:24:47.661246 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2257/4514] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:46 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:48.256331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:48.269199 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-159face0-835b-45a0-9fd4-b6bb7bf6bd56 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 0.780233 Sep 25 01:24:48.270661 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2258/4515] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:47 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:48.298259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:48.299345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:48.322713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:48.325395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:48.326500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:48.327652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:48.328135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:48.330739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:48.558432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4dd1ec57-8307-4695-8918-ccfd753676c1 req-e928977b-5efd-460d-a0dd-3f375e3ea301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1936b4e-883f-460a-b799-413134408ee0", "name": "network-vif-plugged", "status": "completed", "tag": "767a471c-8126-4267-b1ad-04cd169b14db"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:48.588705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4dd1ec57-8307-4695-8918-ccfd753676c1 req-e928977b-5efd-460d-a0dd-3f375e3ea301 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:48.589192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4dd1ec57-8307-4695-8918-ccfd753676c1 req-e928977b-5efd-460d-a0dd-3f375e3ea301 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:48.594734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4dd1ec57-8307-4695-8918-ccfd753676c1 req-e928977b-5efd-460d-a0dd-3f375e3ea301 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:48.624379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4dd1ec57-8307-4695-8918-ccfd753676c1 req-e928977b-5efd-460d-a0dd-3f375e3ea301 service nova] Creating event network-vif-plugged:767a471c-8126-4267-b1ad-04cd169b14db for instance a1936b4e-883f-460a-b799-413134408ee0 on n-h2-master-1 Sep 25 01:24:48.638065 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4dd1ec57-8307-4695-8918-ccfd753676c1 req-e928977b-5efd-460d-a0dd-3f375e3ea301 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083521 Sep 25 01:24:48.641556 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2259/4516] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:48.685639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:48.687205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:48.702652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:48.703919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:48.706625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:48.707798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:48.710240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:48.712389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:48.750982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:48.760960 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6cddb2b2-27b2-4663-ad83-a2dcce17ecb6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1675 microversion: 2.1 time: 0.467309 Sep 25 01:24:48.786888 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2258/4517] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:48 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1675 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:49.193848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:49.204394 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-acab4eae-cbdf-482d-b5b2-562a112f047c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.521451 Sep 25 01:24:49.206800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2260/4518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:48 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:49.225282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:49.226267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:49.234237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.235200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.235815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.236949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.237607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.238447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.269481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:24:49.300326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:49.301432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:49.313333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.314919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.315077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.320169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.323047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.324811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.428617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15097569-187c-40e3-a783-f80aca5bc89f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 204 len: 0 microversion: 2.1 time: 0.226796 Sep 25 01:24:49.429712 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2259/4519] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:24:49 2022] DELETE /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:24:49.448609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:49.449479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:49.458025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.458599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.459103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.460048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.460569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.461132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.655295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:49.665253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ebac9af4-ef22-4708-8291-941404c502e8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 0.368725 Sep 25 01:24:49.673806 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2261/4520] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:49 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:49.793661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:49.794730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:49.808694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.809651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.810380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.812552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:49.813252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:49.815601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:49.844430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:49.860432 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6cf8524a-f721-49ca-8563-71d192f885fe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1514 microversion: 2.1 time: 0.424377 Sep 25 01:24:49.861451 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2260/4521] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:49 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1514 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:50.138692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:50.146670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-385c32b4-c3c1-4a91-a1ae-38bdba58d2a1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.357346 Sep 25 01:24:50.148166 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2262/4522] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:50.249875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:50.250531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:50.268407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.268901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.269336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:50.270308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.270947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.271374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:50.455898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:50.466898 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b9d1cccb-c04c-4bf2-8f3a-f808f13a28aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1320 microversion: 2.1 time: 0.237773 Sep 25 01:24:50.468285 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2261/4523] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:50 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:50.483908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce371309-14e6-4862-ae6a-5d1f96b7e5c3 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaba5820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:50.551405 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce371309-14e6-4862-ae6a-5d1f96b7e5c3 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/858c2152-682d-4954-9015-17eff60af38d" status: 200 len: 351 microversion: 2.1 time: 0.084347 Sep 25 01:24:50.552828 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2263/4524] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:24:50 2022] GET /compute/v2.1/os-volumes/858c2152-682d-4954-9015-17eff60af38d => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:24:50.667739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-58e36009-09cf-4afe-8b6b-ace581309e3b req-54210da3-bc9c-486c-bd3e-5d32bdb6fd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66ad9c5-f1a2-4535-b549-7f953fa9589e", "name": "network-vif-plugged", "status": "completed", "tag": "898b02c2-f2af-4f52-9068-17cfa2c0a7de"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:50.683520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-58e36009-09cf-4afe-8b6b-ace581309e3b req-54210da3-bc9c-486c-bd3e-5d32bdb6fd53 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.684278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-58e36009-09cf-4afe-8b6b-ace581309e3b req-54210da3-bc9c-486c-bd3e-5d32bdb6fd53 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.684947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-58e36009-09cf-4afe-8b6b-ace581309e3b req-54210da3-bc9c-486c-bd3e-5d32bdb6fd53 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:50.696290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:50.697265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:50.703088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-58e36009-09cf-4afe-8b6b-ace581309e3b req-54210da3-bc9c-486c-bd3e-5d32bdb6fd53 service nova] Creating event network-vif-plugged:898b02c2-f2af-4f52-9068-17cfa2c0a7de for instance c66ad9c5-f1a2-4535-b549-7f953fa9589e on n-h1-master-1 Sep 25 01:24:50.709159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.710013 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-58e36009-09cf-4afe-8b6b-ace581309e3b req-54210da3-bc9c-486c-bd3e-5d32bdb6fd53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047393 Sep 25 01:24:50.711163 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2262/4525] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:24:50.717040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.717618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:50.719349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.720605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.721023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:50.882633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:50.888536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:50.889817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:50.895771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6e14913-4dc2-43b1-95ba-148f5b573973 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 0.203416 Sep 25 01:24:50.902716 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2264/4526] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:50 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:50.910656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.912088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.918158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:50.920274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:50.921307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:50.923250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:51.119998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:51.128829 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa04445e-5d41-4cf4-9ee6-1b36b73ec848 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1514 microversion: 2.1 time: 0.247891 Sep 25 01:24:51.129451 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2263/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:50 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:51.494829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:51.495878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:51.512360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:51.515967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:51.516748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:51.518466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:51.520151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:51.523180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:51.923789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:51.928249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:51.928880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:51.937795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:51.938514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:51.939142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:51.940060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:51.940689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:51.940820 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ef6f691-5b7a-49df-a1a9-e3bee67f4d74 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 200 len: 1509 microversion: 2.1 time: 0.452106 Sep 25 01:24:51.941397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:51.950792 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2265/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:51 2022] GET /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:51.969106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:51.969881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 149349b9-bd85-4b92-9fe7-9f94444b7dc2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:51.977340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:51.979472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:51.980111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:51.981388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:51.982056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:51.982657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.307147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:52.315239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91ba30a3-cc8f-4c57-b36b-d3c9a7c0ef3b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/149349b9-bd85-4b92-9fe7-9f94444b7dc2" status: 200 len: 1508 microversion: 2.1 time: 0.354967 Sep 25 01:24:52.316057 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2266/4529] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:51 2022] GET /compute/v2.1/servers/149349b9-bd85-4b92-9fe7-9f94444b7dc2 => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:52.334716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:52.336963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:52.343717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:52.357069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.359087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.359593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.360522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.364036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.366155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.376534 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9b061e9-10c1-482e-8bc3-77440dcf6d80 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1313 microversion: 2.1 time: 0.451387 Sep 25 01:24:52.391219 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2264/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:51 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:52.416704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:52.422083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 149349b9-bd85-4b92-9fe7-9f94444b7dc2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:52.436458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.437238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.437915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.438980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.439631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.440350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.471989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:52.473655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 149349b9-bd85-4b92-9fe7-9f94444b7dc2] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:24:52.485684 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-99706835-b34d-4187-88be-9e8e99dffa40 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 200 len: 1472 microversion: 2.1 time: 0.167897 Sep 25 01:24:52.487143 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2267/4531] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:52 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:52.498840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-019704f1-d9bf-4e10-9331-dad99bcf3301 req-a4a9edaa-9ef2-4708-83d4-7ae91ebd15eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f14386a-fe75-43fb-9c4e-dc27f52e4099", "name": "network-vif-deleted", "tag": "88212245-9e1b-4a5c-b750-49c686036f3b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:52.514876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-019704f1-d9bf-4e10-9331-dad99bcf3301 req-a4a9edaa-9ef2-4708-83d4-7ae91ebd15eb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.515666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-019704f1-d9bf-4e10-9331-dad99bcf3301 req-a4a9edaa-9ef2-4708-83d4-7ae91ebd15eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.516558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-019704f1-d9bf-4e10-9331-dad99bcf3301 req-a4a9edaa-9ef2-4708-83d4-7ae91ebd15eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.530530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-019704f1-d9bf-4e10-9331-dad99bcf3301 req-a4a9edaa-9ef2-4708-83d4-7ae91ebd15eb service nova] Creating event network-vif-deleted:88212245-9e1b-4a5c-b750-49c686036f3b for instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 on n-h1-master-1 Sep 25 01:24:52.538915 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-019704f1-d9bf-4e10-9331-dad99bcf3301 req-a4a9edaa-9ef2-4708-83d4-7ae91ebd15eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050531 Sep 25 01:24:52.540171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2268/4532] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:52.624840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a964aaa-87ab-46ce-8af1-7fc644f1f92c tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/149349b9-bd85-4b92-9fe7-9f94444b7dc2" status: 204 len: 0 microversion: 2.1 time: 0.228029 Sep 25 01:24:52.626737 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2265/4533] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:24:52 2022] DELETE /compute/v2.1/servers/149349b9-bd85-4b92-9fe7-9f94444b7dc2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:24:52.637453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:52.639299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:52.657939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.659027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.660783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.661594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:52.662295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:52.662958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:52.720357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: a1936b4e-883f-460a-b799-413134408ee0] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:24:52.895428 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-78f04ac8-9697-4596-a86c-2b0e7ff7ac20 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0" status: 204 len: 0 microversion: 2.1 time: 0.263617 Sep 25 01:24:52.919773 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2269/4534] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:24:52 2022] DELETE /compute/v2.1/servers/a1936b4e-883f-460a-b799-413134408ee0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:24:53.083683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-442862639", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8c417393-4fe3-4011-bcaf-7c3d7e3111b4"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:53.161496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] validate_networks() for [('8c417393-4fe3-4011-bcaf-7c3d7e3111b4', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:24:53.214820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f317ff4-6114-4b03-bb17-a776f6f6c330 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaba5670>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:53.302031 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f317ff4-6114-4b03-bb17-a776f6f6c330 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0563899f-dd18-48cc-a1c2-0a7cd8cc9026" status: 200 len: 351 microversion: 2.1 time: 0.092328 Sep 25 01:24:53.302997 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2270/4535] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:24:53 2022] GET /compute/v2.1/os-volumes/0563899f-dd18-48cc-a1c2-0a7cd8cc9026 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:53.320478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6e8ef1a-76f7-48ed-bed8-a3563f4e073c tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaea0550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:53.452508 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6e8ef1a-76f7-48ed-bed8-a3563f4e073c tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.139784 Sep 25 01:24:53.453338 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2271/4536] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:24:53 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:53.460633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:53.461619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:53.468458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:53.469194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:53.469836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:53.470697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:53.471333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:53.471917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:53.873432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:53.886189 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92113659-4a64-4884-a090-cf801ee36e6a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1501 microversion: 2.1 time: 0.429946 Sep 25 01:24:53.890229 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2272/4537] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:53 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1501 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:53.905970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91b210c7-f58d-4a08-aa8e-1d6460d1f4a8 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaeb6f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:54.011192 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91b210c7-f58d-4a08-aa8e-1d6460d1f4a8 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.117551 Sep 25 01:24:54.012233 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2273/4538] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:24:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:54.017343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:54.018139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 9f14386a-fe75-43fb-9c4e-dc27f52e4099] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:54.025882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.026363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.026813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.027528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.028136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.028575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.035358 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:24:54.048464 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] HTTP exception thrown: Instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 could not be found. Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Request method failure captured: Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 HTTP/1.1 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6zbHDM2DoPh4-GtnseE3mp_tWf6X9cR-wt5rXEOTncrgfGMnMyjaGBs23JyNA_Vv8pUqdv5NWK64zH1iRwrMJSY0fCk_8H8rNF4URURTfyink-9q-rJo1782z4jJwodTvNUcTXygVhKEU51thocIGL0T4SaX3p74Ik7Tptc0_IsHzw Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31367060596548b59603860aafed267f Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1937337897 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31367060596548b59603860aafed267f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31367060596548b59603860aafed267f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31367060596548b59603860aafed267f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31367060596548b59603860aafed267f"}]}] Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesSnapshotTestJSON-1937337897 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31367060596548b59603860aafed267f Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1937337897 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesSnapshotTestJSON-1937337897-project Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2f080bae0ec94a5b88128dd69c8a3e74 Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesSnapshotTestJSON-1937337897-project Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 could not be found. Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9f14386a-fe75-43fb-9c4e-dc27f52e4099'} Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 could not be found. Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 could not be found. Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:24:54.050463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 could not be found. Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Returning 404 to user: Instance 9f14386a-fe75-43fb-9c4e-dc27f52e4099 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:24:54.055793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-99946ea0-7f26-4ee9-bfcf-c34e07ec1ea0 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099" status: 404 len: 111 microversion: 2.1 time: 0.038462 Sep 25 01:24:54.059862 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2274/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:54 2022] GET /compute/v2.1/servers/9f14386a-fe75-43fb-9c4e-dc27f52e4099 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:24:54.064915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:54.065573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:54.076765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.077279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.077766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.078508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.079029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.079467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.353375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:24:54.354014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:24:54.354628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:24:54.355047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:24:54.355464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:24:54.378756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.379490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.380337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.381535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.383729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.385164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.411149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Getting quotas for project 10fa7c775d924acda02fb364a1818ba2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:24:54.425446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Getting quotas for user d4b32b37164a44f3a6ab4f0b4335cfbb and project 10fa7c775d924acda02fb364a1818ba2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:24:54.446438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Going to run 2 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:24:54.450579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:24:54.458319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:54.469051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e86bb85-6057-4c1e-86f8-e017da0ef05f tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1501 microversion: 2.1 time: 0.409372 Sep 25 01:24:54.486682 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2275/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:54 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1501 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:54.496074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfb2902a-0d9b-445b-ba21-256af2c4ceff tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaba5430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:54.548117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=5c477aaa-fb92-4d98-9668-3eef82293af5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:24:54.616016 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfb2902a-0d9b-445b-ba21-256af2c4ceff tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.127520 Sep 25 01:24:54.618126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2276/4541] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 25 01:24:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:54.625498 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:54.626268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:54.648547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.655082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.657441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.661505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:54.662521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:54.665575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:54.694733 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34637604-af59-4574-a4a4-34c42b9a34a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.616071 Sep 25 01:24:54.696158 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2266/4542] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:24:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 1619 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 25 01:24:54.702582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa50f24c-d148-4017-b887-76abf4db63e9 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7bea899550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:54.745437 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lazy-loading 'flavor' on Instance uuid c66ad9c5-f1a2-4535-b549-7f953fa9589e {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:24:54.944994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-962c0186-0579-400a-8d1e-defed6f54278 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action" status: 202 len: 0 microversion: 2.1 time: 0.325053 Sep 25 01:24:54.948675 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2277/4543] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:24:54 2022] POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:24:54.966376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:54.984140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:54.988400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Searching by: {'deleted': False, 'project_id': '10fa7c775d924acda02fb364a1818ba2'} {{(pid=122385) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:24:55.012387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa50f24c-d148-4017-b887-76abf4db63e9 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.313930 Sep 25 01:24:55.012959 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2267/4544] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 25 01:24:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:55.019039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:55.028222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:55.028640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:55.029614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:55.031158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:55.032791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:55.034488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:55.035416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:55.046740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:55.048350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:55.049374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:55.051752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:55.052337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:55.053140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:55.107467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.multi_cell_list [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:24:55.194451 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ffe33e9-1b10-4f7a-afed-79a7d28257a8 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.239275 Sep 25 01:24:55.222548 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2278/4545] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 01:24:54 2022] GET /compute/v2.1/servers => generated 1335 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:55.248708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f684680e-1b0b-4e93-bdf9-190541d6771d tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaeb63a0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:55.565632 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f684680e-1b0b-4e93-bdf9-190541d6771d tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.340460 Sep 25 01:24:55.576217 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2279/4546] 10.222.0.16 () {58 vars in 1170 bytes} [Sun Sep 25 01:24:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:55.578316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e529682e-cf5f-42c0-8e5f-ddcbc4589777 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:55.579136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e529682e-cf5f-42c0-8e5f-ddcbc4589777 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:56.230877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e529682e-cf5f-42c0-8e5f-ddcbc4589777 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:56.243054 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e529682e-cf5f-42c0-8e5f-ddcbc4589777 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1217 microversion: 2.1 time: 0.671926 Sep 25 01:24:56.243795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2280/4547] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:55 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1217 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:56.257324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3673b23c-9c98-4c82-be3b-fdc17e22ea1e tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaba5dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:56.441924 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3673b23c-9c98-4c82-be3b-fdc17e22ea1e tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.196723 Sep 25 01:24:56.444303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2281/4548] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:24:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:56.458727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-194e65b5-c552-463a-91c3-b1b256c752c1 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beaeaa040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:56.629999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-194e65b5-c552-463a-91c3-b1b256c752c1 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.175347 Sep 25 01:24:56.631099 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2282/4549] 10.222.0.16 () {58 vars in 1188 bytes} [Sun Sep 25 01:24:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:56.645796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9473092c-16ee-4188-bcee-8a60a2eeda96 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] Calling method '.version_select at 0x7f7beae89b80>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:56.735845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:56.749889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b78bbc6-4470-47af-b4e7-ac34ae06d111 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1509 microversion: 2.1 time: 1.735193 Sep 25 01:24:56.752667 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2268/4550] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:55 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1509 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:56.832185 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9473092c-16ee-4188-bcee-8a60a2eeda96 tempest-VolumesTestJSON-724599957 tempest-VolumesTestJSON-724599957-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.190822 Sep 25 01:24:56.842818 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2283/4551] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:24:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:57.275312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:57.278450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:57.317156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:57.319007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:57.320114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:57.323049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:57.324880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:57.325578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:57.545701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:57.586322 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f5ee7851-00fc-480f-be01-b63e9be64e8b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1269 microversion: 2.1 time: 0.319150 Sep 25 01:24:57.587518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2269/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:57 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1269 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:57.776675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:57.782416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:57.817738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:57.818854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:57.819530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:57.820489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:57.821199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:57.821962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:58.434658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e76f0223-874e-456a-bec7-515286f8f288 req-6a335535-b18c-47a4-b0e8-bf8e0d45b333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1936b4e-883f-460a-b799-413134408ee0", "name": "network-vif-deleted", "tag": "767a471c-8126-4267-b1ad-04cd169b14db"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:58.458888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e76f0223-874e-456a-bec7-515286f8f288 req-6a335535-b18c-47a4-b0e8-bf8e0d45b333 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:58.459550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e76f0223-874e-456a-bec7-515286f8f288 req-6a335535-b18c-47a4-b0e8-bf8e0d45b333 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:58.460002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e76f0223-874e-456a-bec7-515286f8f288 req-6a335535-b18c-47a4-b0e8-bf8e0d45b333 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:58.526765 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e76f0223-874e-456a-bec7-515286f8f288 req-6a335535-b18c-47a4-b0e8-bf8e0d45b333 service nova] Creating event network-vif-deleted:767a471c-8126-4267-b1ad-04cd169b14db for instance a1936b4e-883f-460a-b799-413134408ee0 on n-h2-master-1 Sep 25 01:24:58.534808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e76f0223-874e-456a-bec7-515286f8f288 req-6a335535-b18c-47a4-b0e8-bf8e0d45b333 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108150 Sep 25 01:24:58.537168 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2270/4553] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:24:58.613849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:58.614835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:58.627854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:58.628624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:58.629296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:58.630289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:58.634050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:58.635346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:58.644486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:58.675745 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93e5d6ef-a036-4908-a972-e902d475d203 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1492 microversion: 2.1 time: 0.899372 Sep 25 01:24:58.676628 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2284/4554] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:57 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1492 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:58.708785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:24:58.711517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:58.741005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:58.745819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:58.747008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:58.747763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:58.750004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:58.751222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:58.864120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:58.875173 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd2ae919-f40a-434a-8deb-66f459ce802e tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1275 microversion: 2.1 time: 0.265561 Sep 25 01:24:58.879333 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2271/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:58 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:24:59.067714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7df734bd-cddc-426a-ae07-af531627b026 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action" status: 202 len: 0 microversion: 2.1 time: 0.362704 Sep 25 01:24:59.071030 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2285/4556] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:24:58 2022] POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:24:59.078336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:59.079146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:59.091621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:59.092422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:59.093472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:59.096430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:59.097706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:59.098539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:59.504355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:24:59.533516 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ffa3f2f1-266d-43f0-91b0-c9f173e5f544 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1498 microversion: 2.1 time: 0.460169 Sep 25 01:24:59.538779 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2272/4557] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:59 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1498 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:24:59.907035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:24:59.908779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:24:59.925684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:59.927174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:59.928649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:24:59.932071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:24:59.934838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:24:59.935525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:00.447977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:00.459276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-718e4667-ebb1-4e6e-ace8-25271b126ec4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.558061 Sep 25 01:25:00.460603 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2286/4558] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:24:59 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:00.569095 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:00.570456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:00.608319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:00.609181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:00.612409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:00.615450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:00.624472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:00.625734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:00.664006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-30c8a406-fedc-4efb-84d7-1e8a811b7d71 req-17fd383a-b1f8-495b-91dc-a2e090791fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149349b9-bd85-4b92-9fe7-9f94444b7dc2", "name": "network-vif-deleted", "tag": "e3d04e23-a10f-4eec-92e1-2a56ca0699a0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:00.701009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-30c8a406-fedc-4efb-84d7-1e8a811b7d71 req-17fd383a-b1f8-495b-91dc-a2e090791fe9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:00.701800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-30c8a406-fedc-4efb-84d7-1e8a811b7d71 req-17fd383a-b1f8-495b-91dc-a2e090791fe9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:00.702402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-30c8a406-fedc-4efb-84d7-1e8a811b7d71 req-17fd383a-b1f8-495b-91dc-a2e090791fe9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:00.706620 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:00.722413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-30c8a406-fedc-4efb-84d7-1e8a811b7d71 req-17fd383a-b1f8-495b-91dc-a2e090791fe9 service nova] Creating event network-vif-deleted:e3d04e23-a10f-4eec-92e1-2a56ca0699a0 for instance 149349b9-bd85-4b92-9fe7-9f94444b7dc2 on n-h2-master-1 Sep 25 01:25:00.729779 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-30c8a406-fedc-4efb-84d7-1e8a811b7d71 req-17fd383a-b1f8-495b-91dc-a2e090791fe9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078314 Sep 25 01:25:00.732180 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2287/4559] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:01.209970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:01.231506 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6d33d85-6bba-4dbc-89bd-f70a51a1ef1e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1498 microversion: 2.1 time: 0.666545 Sep 25 01:25:01.237857 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2273/4560] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:00 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1498 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:01.484822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:01.485713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:01.502305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:01.503424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:01.504044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:01.504985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:01.505435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:01.505859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:02.034998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:02.044861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f85ad0d7-a78a-4f30-89d1-d3cc5528e02f tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.564722 Sep 25 01:25:02.049725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2288/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:01 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:02.262111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:02.263493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:02.283268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:02.283947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:02.284544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:02.285996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:02.286603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:02.287205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:02.810469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:02.818345 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c5e99c8b-c57e-49b2-b26b-f2466ac587b1 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1498 microversion: 2.1 time: 0.560914 Sep 25 01:25:02.819493 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2274/4562] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:02 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:03.076855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:03.078164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:03.113709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:03.114274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:03.114728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:03.115479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:03.115940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:03.117960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:03.498753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:03.508044 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-134da6b3-61f7-4451-b7bd-708071e06c9d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.435782 Sep 25 01:25:03.514519 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2289/4563] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:03 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:03.847131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:03.847700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:03.860463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:03.860966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:03.861430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:03.862139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:03.862592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:03.876172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.255788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:04.277134 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f80233f-7304-4ea0-9eb1-1095f003d0cd tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1501 microversion: 2.1 time: 0.434420 Sep 25 01:25:04.280224 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2275/4564] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:03 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1501 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:04.306381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:04.307569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:04.331219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:04.331998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:04.332604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.333604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:04.334411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:04.335025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.373114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lazy-loading 'flavor' on Instance uuid c66ad9c5-f1a2-4535-b549-7f953fa9589e {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:25:04.540491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:04.546387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:04.569254 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:04.570936 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:04.578536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:04.579396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:04.580110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.581079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:04.581812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:04.582486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.728637 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60eb2250-41b9-4971-b217-0bf787dfc8df tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action" status: 202 len: 0 microversion: 2.1 time: 0.422278 Sep 25 01:25:04.732898 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2290/4565] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:25:04 2022] POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:25:04.755879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:04.757277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:04.773880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:04.776424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:04.777392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.780948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:04.781847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:04.782458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:04.974573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:05.018600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-49f9418d-b131-4d2d-bf0e-0350f360b1c2 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.482677 Sep 25 01:25:05.021299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2276/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:04 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:05.042730 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:05.141260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:05.152130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4c2e9ed-21f0-4a2b-a9dc-bdd127d07fcc tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1509 microversion: 2.1 time: 0.413319 Sep 25 01:25:05.167471 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2291/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:04 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:06.009739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1481848926", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "f56f4e0d-1c79-4103-b373-56422d49e8f1"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:06.048809 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:06.050085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:06.066964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:06.067466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:06.076194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:06.076969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:06.077462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:06.077895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:06.166170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] validate_networks() for [('f56f4e0d-1c79-4103-b373-56422d49e8f1', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:25:06.236134 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:06.568265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:06.577305 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c4700ba-fd81-494a-b2c3-821dc449117b tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.534852 Sep 25 01:25:06.587839 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2292/4568] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:06 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:06.602115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9dcf083f-d324-4083-80f6-2f85159ec41c req-60ecddd3-bec1-4368-a6bc-28709237e115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4239732f-db6e-4c4f-a61b-e4036532f0cb", "tag": "b960f2f9-c344-4a6f-8c67-b0816c106eca"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:06.622560 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:06.624790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9dcf083f-d324-4083-80f6-2f85159ec41c req-60ecddd3-bec1-4368-a6bc-28709237e115 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:06.625788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9dcf083f-d324-4083-80f6-2f85159ec41c req-60ecddd3-bec1-4368-a6bc-28709237e115 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:06.635255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9dcf083f-d324-4083-80f6-2f85159ec41c req-60ecddd3-bec1-4368-a6bc-28709237e115 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:06.654010 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9dcf083f-d324-4083-80f6-2f85159ec41c req-60ecddd3-bec1-4368-a6bc-28709237e115 service nova] Creating event network-changed:b960f2f9-c344-4a6f-8c67-b0816c106eca for instance 4239732f-db6e-4c4f-a61b-e4036532f0cb on n-h2-master-1 Sep 25 01:25:06.658920 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9dcf083f-d324-4083-80f6-2f85159ec41c req-60ecddd3-bec1-4368-a6bc-28709237e115 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067444 Sep 25 01:25:06.659533 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2293/4569] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:06.683822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:06.684527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:06.706576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:06.707283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:06.707884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:06.708767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:06.709381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:06.709989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:06.714761 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:07.215466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:25:07.215964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:25:07.216354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:25:07.216776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:25:07.217200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:25:07.236229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.236727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.237232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.238017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.238462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.238898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.248532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:07.256595 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1d60a3fd-1dcb-4766-847e-cd38b2b1c983 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1492 microversion: 2.1 time: 0.595928 Sep 25 01:25:07.257190 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2294/4570] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:06 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1492 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:07.287377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:07.287929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:07.312043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.312568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.313008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.313753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.314215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.314648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.322300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Getting quotas for project 31367060596548b59603860aafed267f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:25:07.340472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Getting quotas for user 2f080bae0ec94a5b88128dd69c8a3e74 and project 31367060596548b59603860aafed267f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:25:07.378838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:25:07.381200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:25:07.477018 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b451b83b-7938-47c6-a504-51405d440024 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action" status: 202 len: 0 microversion: 2.1 time: 0.193698 Sep 25 01:25:07.478260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2295/4571] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:25:07 2022] POST /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:25:07.512446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:07.515021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:07.535355 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-88df289b-9e0e-4bea-aab7-255a39500286 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530375 Sep 25 01:25:07.540145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.540780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.541229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.541978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.542367 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2277/4572] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:25:07.542503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.542848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.589243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74c67bd8-f027-4223-95de-d35aa8cf9108 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:07.590936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74c67bd8-f027-4223-95de-d35aa8cf9108 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:07.630697 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:07.826877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74c67bd8-f027-4223-95de-d35aa8cf9108 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:07.840346 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74c67bd8-f027-4223-95de-d35aa8cf9108 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1219 microversion: 2.1 time: 0.288678 Sep 25 01:25:07.855147 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2278/4573] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:07 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:07.875061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:07.876176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:07.922947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.923456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.923908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:07.929425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:07.929944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:07.930387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:09.010433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:09.023431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2977906-3aca-4139-952a-d5ca50bfa443 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 1.163905 Sep 25 01:25:09.024043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2279/4574] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:07 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:09.034118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:09.040387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:09.041027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:09.047485 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8e826a3-046a-404d-ae4f-a1e8fc2a1947 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1498 microversion: 2.1 time: 1.555558 Sep 25 01:25:09.051614 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2296/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:07 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1498 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:09.067128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:09.070672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:09.072257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:09.073680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:09.074378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:09.074983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:09.137854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9b98a621-6503-4622-a791-a2d4d2d42c1b req-b6f53bdd-66a2-4c09-a776-e3954dc5abc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c477aaa-fb92-4d98-9668-3eef82293af5", "tag": "3bc4acbb-12c8-427d-9237-40d36740b267"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:09.150966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9b98a621-6503-4622-a791-a2d4d2d42c1b req-b6f53bdd-66a2-4c09-a776-e3954dc5abc3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:09.151476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9b98a621-6503-4622-a791-a2d4d2d42c1b req-b6f53bdd-66a2-4c09-a776-e3954dc5abc3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:09.152169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9b98a621-6503-4622-a791-a2d4d2d42c1b req-b6f53bdd-66a2-4c09-a776-e3954dc5abc3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:09.168990 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9b98a621-6503-4622-a791-a2d4d2d42c1b req-b6f53bdd-66a2-4c09-a776-e3954dc5abc3 service nova] Creating event network-changed:3bc4acbb-12c8-427d-9237-40d36740b267 for instance 5c477aaa-fb92-4d98-9668-3eef82293af5 on n-h1-master-1 Sep 25 01:25:09.177962 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9b98a621-6503-4622-a791-a2d4d2d42c1b req-b6f53bdd-66a2-4c09-a776-e3954dc5abc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047253 Sep 25 01:25:09.179472 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2297/4576] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:25:09.222588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:09.240218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74acfd5d-f2a6-4897-bf0e-0d2c7bb5f4bf tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1271 microversion: 2.1 time: 0.212253 Sep 25 01:25:09.242094 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2280/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:09 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:10.053749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:10.054622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:10.067265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:10.075461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:10.076317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:10.077609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:10.078424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:10.079906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:10.080597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:10.081198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:10.090480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:10.093987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:10.094566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:10.095419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:10.097843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:10.098517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:10.411359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:10.424621 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c0bab5c-189a-4366-a752-8a9c6329a154 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1498 microversion: 2.1 time: 0.353060 Sep 25 01:25:10.437133 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2281/4578] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:10 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1498 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:10.453516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:10.454137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:10.466169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:10.468347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:10.469945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:10.470748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:10.471232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:10.476587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:10.479251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:10.493652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-288655f9-8d14-42cc-8070-0c881f03dd36 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.445445 Sep 25 01:25:10.498241 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2298/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:10 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:10.626096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:10.643081 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff3cae49-5339-4c54-bb32-c5fd29f55cad tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1271 microversion: 2.1 time: 0.200835 Sep 25 01:25:10.643714 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2282/4580] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:10 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:11.470645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:11.474500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:11.487265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:11.488123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:11.488811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:11.490260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:11.491002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:11.491651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:11.521986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:11.522881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:11.556817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:11.556817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:11.556817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:11.557293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:11.557448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:11.558081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:12.129255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:12.142892 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3218c196-2703-4060-b95d-a4b96df4c3a8 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1501 microversion: 2.1 time: 0.682136 Sep 25 01:25:12.146373 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2299/4581] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:11 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1501 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:12.153815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:12.154815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:12.164707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:12.166577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:12.167359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:12.168393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:12.169088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:12.169805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:12.273991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:12.281926 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-966067cc-c682-49ba-a2d3-0d20005c1f83 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.764464 Sep 25 01:25:12.298138 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2283/4582] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:11 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:12.303555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:12.304065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:12.315869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:12.317301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:12.317892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:12.319806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:12.320403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:12.320954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:12.366161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:25:12.395708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:12.408590 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51675dcf-c26d-41bb-a15f-9a3bc9169911 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1277 microversion: 2.1 time: 0.260165 Sep 25 01:25:12.411554 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2300/4583] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:12 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:12.543754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd55dd72-0d13-4f97-ac79-4ad1bf7aaeee tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 204 len: 0 microversion: 2.1 time: 0.242618 Sep 25 01:25:12.547359 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2284/4584] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:25:12 2022] DELETE /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:25:12.555318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:12.556113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:12.563610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:12.564096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:12.564728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:12.565463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:12.565917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:12.566522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:13.088205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:13.100432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48c20a8c-650c-4014-a4e0-0cad417dc19e tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1507 microversion: 2.1 time: 0.548874 Sep 25 01:25:13.101029 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2301/4585] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:12 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:13.310539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:13.311840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:13.319077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:13.319763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:13.320399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:13.322315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:13.323170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:13.323766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:13.441983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:13.442620 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:13.454501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:13.455417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:13.456055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:13.456977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:13.457636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:13.458513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:13.665817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:13.688617 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3805cf60-521d-4542-b899-c3d3cf8d2c7e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1277 microversion: 2.1 time: 0.246891 Sep 25 01:25:13.693176 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2302/4586] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:13 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:13.898504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:13.916273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f635719-35f6-4783-97c9-ea761ef52e47 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.614263 Sep 25 01:25:13.932452 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2285/4587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:13 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:14.126472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:14.127339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:14.138187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:14.143932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:14.146032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:14.148453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:14.150200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:14.150857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:14.730946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:14.732653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:14.753994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:14.754488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:14.759687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:14.760773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:14.761440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:14.762041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:15.016774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:15.028298 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-627a375a-6a19-4edb-b77c-752b50a88551 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1507 microversion: 2.1 time: 0.906883 Sep 25 01:25:15.031594 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2303/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:14 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1507 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:15.042926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:15.046405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:15.078404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:15.078953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:15.079406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:15.080137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:15.080602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:15.081030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:15.192412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:15.201939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37b598e7-7b45-40c1-8ea1-8b04a5eab733 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 0.490948 Sep 25 01:25:15.203433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2286/4589] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:14 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:15.439841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:15.451438 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d2080035-fbfd-4823-85a9-375932c72629 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.417415 Sep 25 01:25:15.452343 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2304/4590] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:15 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:16.059414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:16.060302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:16.083597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:16.084000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:16.084435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:16.085140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:16.097833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:16.098732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:16.227644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:16.228555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:16.248005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:16.249767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:16.252807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:16.261262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:16.263170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:16.266100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:17.276271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:17.285363 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d8b5701-2c83-4c73-a635-ea5d390fbb16 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1507 microversion: 2.1 time: 1.230912 Sep 25 01:25:17.293419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:17.302081 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73dbef93-6c4f-4d50-8f37-163ec3ffb903 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 1.078572 Sep 25 01:25:17.303019 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2287/4591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:16 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1507 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:17.309282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f119ab17-9e24-4ab8-89dd-3a7253044dcd req-601d4c56-a130-463d-bc7c-74c21829169e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c477aaa-fb92-4d98-9668-3eef82293af5", "name": "network-vif-plugged", "status": "completed", "tag": "3bc4acbb-12c8-427d-9237-40d36740b267"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:17.310501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2305/4592] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:16 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:17.325237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:17.328281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:17.333937 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:17.348863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:17.349685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:17.350292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:17.353397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f119ab17-9e24-4ab8-89dd-3a7253044dcd req-601d4c56-a130-463d-bc7c-74c21829169e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:17.354502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:17.355138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:17.355862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:17.359370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f119ab17-9e24-4ab8-89dd-3a7253044dcd req-601d4c56-a130-463d-bc7c-74c21829169e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:17.365831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f119ab17-9e24-4ab8-89dd-3a7253044dcd req-601d4c56-a130-463d-bc7c-74c21829169e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:17.392122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f119ab17-9e24-4ab8-89dd-3a7253044dcd req-601d4c56-a130-463d-bc7c-74c21829169e service nova] Creating event network-vif-plugged:3bc4acbb-12c8-427d-9237-40d36740b267 for instance 5c477aaa-fb92-4d98-9668-3eef82293af5 on n-h1-master-1 Sep 25 01:25:17.401062 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f119ab17-9e24-4ab8-89dd-3a7253044dcd req-601d4c56-a130-463d-bc7c-74c21829169e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096143 Sep 25 01:25:17.404817 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2288/4593] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:17.427462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f2ee0197-1fed-4a7d-83f6-9e762443c4ae req-2838f2d9-3301-41d4-8699-8915f97a840f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66ad9c5-f1a2-4535-b549-7f953fa9589e", "name": "network-vif-deleted", "tag": "898b02c2-f2af-4f52-9068-17cfa2c0a7de"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:17.451840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2ee0197-1fed-4a7d-83f6-9e762443c4ae req-2838f2d9-3301-41d4-8699-8915f97a840f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:17.453494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2ee0197-1fed-4a7d-83f6-9e762443c4ae req-2838f2d9-3301-41d4-8699-8915f97a840f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:17.456248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f2ee0197-1fed-4a7d-83f6-9e762443c4ae req-2838f2d9-3301-41d4-8699-8915f97a840f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:17.495078 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f2ee0197-1fed-4a7d-83f6-9e762443c4ae req-2838f2d9-3301-41d4-8699-8915f97a840f service nova] Creating event network-vif-deleted:898b02c2-f2af-4f52-9068-17cfa2c0a7de for instance c66ad9c5-f1a2-4535-b549-7f953fa9589e on n-h1-master-1 Sep 25 01:25:17.506943 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f2ee0197-1fed-4a7d-83f6-9e762443c4ae req-2838f2d9-3301-41d4-8699-8915f97a840f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095134 Sep 25 01:25:17.508852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2289/4594] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:17.653615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:17.662755 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4db5c1b5-b35f-44b6-bd04-0921556bb42a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.351019 Sep 25 01:25:17.667132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2306/4595] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:17 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:17.722524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4120b1e5-52e8-4978-b1ed-b34a0772fafa req-7534d76d-124b-4e58-b37f-48a289348222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38de3aea-59ea-44bb-b9e3-71e964ad5d4a", "tag": "3be13b67-37ac-43bb-b167-1a0e81b3a51c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:17.764158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4120b1e5-52e8-4978-b1ed-b34a0772fafa req-7534d76d-124b-4e58-b37f-48a289348222 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:17.765085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4120b1e5-52e8-4978-b1ed-b34a0772fafa req-7534d76d-124b-4e58-b37f-48a289348222 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:17.765591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4120b1e5-52e8-4978-b1ed-b34a0772fafa req-7534d76d-124b-4e58-b37f-48a289348222 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:17.804066 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4120b1e5-52e8-4978-b1ed-b34a0772fafa req-7534d76d-124b-4e58-b37f-48a289348222 service nova] Creating event network-changed:3be13b67-37ac-43bb-b167-1a0e81b3a51c for instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a on n-h2-master-1 Sep 25 01:25:17.821804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4120b1e5-52e8-4978-b1ed-b34a0772fafa req-7534d76d-124b-4e58-b37f-48a289348222 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104248 Sep 25 01:25:17.824306 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2290/4596] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:18.330002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:18.331452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:18.332354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:18.332554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:18.344260 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:18.347450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.348774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.349007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.349533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.350075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.350691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.351151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.353569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.354489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.356498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.357134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.358300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.447942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.448438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.450266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.450871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lazy-loading 'fault' on Instance uuid c66ad9c5-f1a2-4535-b549-7f953fa9589e {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:25:18.591721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb4a7652e4c4f16833ab002da950f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9423abf226924bda908336987ed1ef5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:18.604051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f696ba4-4cb8-4e93-8bfd-9fba2de9ec5a tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 200 len: 1303 microversion: 2.1 time: 0.277639 Sep 25 01:25:18.605122 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2307/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:18 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 1303 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:18.694587 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:18.695650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:18.722334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.725995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.728893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.730537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:18.733215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:18.737696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:18.881961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:18.886264 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:18.892294 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e409999-188f-4bd8-9ffe-42ddf4be0659 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 0.564871 Sep 25 01:25:18.895492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2291/4598] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:18 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:19.289368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:19.302682 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f9c8727-32ca-46ed-a714-4dd863e685aa tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.616091 Sep 25 01:25:19.303751 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2308/4599] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:18 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:19.430519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a0a20a0c-2f61-4152-ba44-cece2c2b9498 req-d8ad8cd3-8b5a-4675-8bc3-f636135c1100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4239732f-db6e-4c4f-a61b-e4036532f0cb", "name": "network-vif-plugged", "status": "completed", "tag": "b960f2f9-c344-4a6f-8c67-b0816c106eca"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:19.445334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a0a20a0c-2f61-4152-ba44-cece2c2b9498 req-d8ad8cd3-8b5a-4675-8bc3-f636135c1100 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:19.446188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a0a20a0c-2f61-4152-ba44-cece2c2b9498 req-d8ad8cd3-8b5a-4675-8bc3-f636135c1100 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:19.447711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a0a20a0c-2f61-4152-ba44-cece2c2b9498 req-d8ad8cd3-8b5a-4675-8bc3-f636135c1100 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:19.464667 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a0a20a0c-2f61-4152-ba44-cece2c2b9498 req-d8ad8cd3-8b5a-4675-8bc3-f636135c1100 service nova] Creating event network-vif-plugged:b960f2f9-c344-4a6f-8c67-b0816c106eca for instance 4239732f-db6e-4c4f-a61b-e4036532f0cb on n-h2-master-1 Sep 25 01:25:19.472369 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a0a20a0c-2f61-4152-ba44-cece2c2b9498 req-d8ad8cd3-8b5a-4675-8bc3-f636135c1100 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046106 Sep 25 01:25:19.473284 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2292/4600] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:19.629014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:19.629687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] [instance: c66ad9c5-f1a2-4535-b549-7f953fa9589e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:19.640061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:19.640563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:19.641012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:19.641753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:19.642214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:19.642638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:19.670110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] HTTP exception thrown: Instance c66ad9c5-f1a2-4535-b549-7f953fa9589e could not be found. Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Request method failure captured: Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e HTTP/1.1 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL63JkBiM3Wo9VhM7tRUDLcuOQrlcbjv2VG6XEe8xQbIN1PrIGMV6QP4ysz0YX7WPhwlnQsi-kGW3QZO_3FhocRzCoC04s92GlR4MPvUBzp_w1y9UjQrhC3faGeERQVZNECbv464IvvTVxXaeRo4vw8aWAEmIaaM0t0glJ80o95dlyDY Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 9423abf226924bda908336987ed1ef5f Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestServerAdvancedOps-1685653638 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9423abf226924bda908336987ed1ef5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9423abf226924bda908336987ed1ef5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9423abf226924bda908336987ed1ef5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9423abf226924bda908336987ed1ef5f"}]}] Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestServerAdvancedOps-1685653638 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 9423abf226924bda908336987ed1ef5f Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestServerAdvancedOps-1685653638 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestServerAdvancedOps-1685653638-project Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 5eb4a7652e4c4f16833ab002da950f02 Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestServerAdvancedOps-1685653638-project Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: exception: Instance c66ad9c5-f1a2-4535-b549-7f953fa9589e could not be found. Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'c66ad9c5-f1a2-4535-b549-7f953fa9589e'} Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66ad9c5-f1a2-4535-b549-7f953fa9589e could not be found. Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66ad9c5-f1a2-4535-b549-7f953fa9589e could not be found. Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:25:19.671692 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66ad9c5-f1a2-4535-b549-7f953fa9589e could not be found. Sep 25 01:25:19.676103 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:25:19.683728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] Returning 404 to user: Instance c66ad9c5-f1a2-4535-b549-7f953fa9589e could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:25:19.684843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c233aada-ec1a-4037-a0ab-ebc745f26e89 tempest-TestServerAdvancedOps-1685653638 tempest-TestServerAdvancedOps-1685653638-project] 10.222.0.16 "GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e" status: 404 len: 111 microversion: 2.1 time: 0.060261 Sep 25 01:25:19.686391 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2309/4601] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:19 2022] GET /compute/v2.1/servers/c66ad9c5-f1a2-4535-b549-7f953fa9589e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:25:19.925676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:19.926454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:19.942561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:19.943466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:19.948907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:19.950859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:19.952326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:19.955674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:20.302797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:20.315523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c700e624-3673-47da-ac63-8ccba8d9120b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 0.397513 Sep 25 01:25:20.319412 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2293/4602] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:19 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:20.329581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:20.330214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:20.338260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:20.338763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:20.339215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:20.339934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:20.341581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:20.342030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:21.036183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:21.044788 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:21.050493 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-72ceba55-c29d-4c31-9836-2dc7c662f08a tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.724732 Sep 25 01:25:21.056127 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2310/4603] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:20 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:21.346399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:21.347178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:21.368894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:21.369653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:21.370107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:21.379527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:21.380039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:21.380495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:22.083943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:22.084675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:22.098679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:22.099170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:22.099601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:22.104578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:22.105233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:22.112835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:22.534970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:22.548058 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1478dd5f-59d8-4e09-8970-a05068e8c10d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 1.205636 Sep 25 01:25:22.552210 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2294/4604] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:21 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:22.793050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:22.809670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3745b51b-5f26-4254-b4c7-5f2b15aec7f5 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1317 microversion: 2.1 time: 0.731785 Sep 25 01:25:22.812638 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2311/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:22 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:22.892817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:22.894078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:22.913813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:22.916665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:22.917938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:22.919835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:22.920957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:22.926315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:23.578417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:23.579266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:23.595284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:23.597233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:23.598704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:23.600775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:23.604264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:23.606291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:24.041320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:24.049521 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b70548f-7aa6-426e-ad98-9d9736ae7734 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 1.163121 Sep 25 01:25:24.049966 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2295/4606] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:22 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:24.080890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:24.083454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:24.090536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:24.091277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:24.092146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:24.097909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:24.098624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:24.099417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:25.216226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:25.229546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-389fd4e5-5bab-4950-9003-4320527a2c62 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1505 microversion: 2.1 time: 1.166846 Sep 25 01:25:25.230159 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2296/4607] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:24 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1505 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:25.256881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:25.262351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:25.284640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:25.287231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:25.287677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:25.290440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:25.302339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:25.303175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:25.401237 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:25.443117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-732c61d7-5204-43be-bd02-5337f990bf7f tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 1.861439 Sep 25 01:25:25.444902 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2312/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:23 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:25.474966 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-792cc9ea-5442-4381-a609-5b1acd80bf8a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Action: 'create', calling method: .version_select at 0x7f7beb47dc10>, body: {"keypair": {"name": "tempest-keypair-1278627785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9LW1/eavdDFiMsS0JqdljoYI7w9AufTkE+lQXLBRb45PuRQIyFVoriyW+RKDGTisQ6KtANBKsWeXWE6qDj1JOa7AkkxloYjMkgvlv15wirB5eraTZpD2UMT9KSFM+4OA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:25.540505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-792cc9ea-5442-4381-a609-5b1acd80bf8a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Getting quotas for project 1af93ee90d9d415b850745b7374348b8. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:25:25.560527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-792cc9ea-5442-4381-a609-5b1acd80bf8a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Getting quotas for user 45ae26af1d0d4104850875f565485d49 and project 1af93ee90d9d415b850745b7374348b8. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:25:25.610834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-792cc9ea-5442-4381-a609-5b1acd80bf8a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.164412 Sep 25 01:25:25.611495 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2313/4609] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:25:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:25:25.625528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:25.626352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:25.642728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:25.643863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:25.644635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:25.647287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:25.650350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:25.651061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.007053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:26.019147 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b8b0cf9-fef1-4684-b7a3-536a1f03559e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.779350 Sep 25 01:25:26.022809 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2297/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:25 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:26.059346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:26.060298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:26.086036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.087391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.087660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.088674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.089656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.090269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.256914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:26.271307 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c9b524e7-a3b4-45f7-8815-61cdd903591d tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5" status: 200 len: 1505 microversion: 2.1 time: 0.651275 Sep 25 01:25:26.273565 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2314/4611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:25 2022] GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5 => generated 1505 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:26.298905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:26.299671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:26.308627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.309423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.310129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.311430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.312119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.312771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.345086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:25:26.455735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:26.468346 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08eea935-b336-4b4e-8c81-1b8765a5f538 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.426940 Sep 25 01:25:26.479090 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2298/4612] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:26 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:26.479090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:26.479090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:26.505924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.507595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.510928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.512169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.513018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.514067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.614894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97bddd29-6125-4fc5-9117-d4c38ac72ec3 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5" status: 204 len: 0 microversion: 2.1 time: 0.320101 Sep 25 01:25:26.618486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2315/4613] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:25:26 2022] DELETE /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:25:26.673604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:26.674838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:26.684504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.685318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.686069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:26.687025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:26.688325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:26.689492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:27.387496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:27.414596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9129bdaf-ace6-4404-8cc0-09891c0a51ab tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.789348 Sep 25 01:25:27.419157 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2316/4614] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:26 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:27.434680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:27.435215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:27.464052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:27.466472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:27.467649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:27.469555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:27.471268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:27.472736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:27.562172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:25:27.775600 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8841df8a-b2c1-4fef-976d-48b5d05ea7a1 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 204 len: 0 microversion: 2.1 time: 0.354869 Sep 25 01:25:27.776331 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2317/4615] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:25:27 2022] DELETE /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:25:27.791748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:27.803116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1171805769", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "bd392121-2ba2-4140-9dd3-57e5e13ec24b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:27.806290 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aeede9ab-b8a0-4575-a058-47b248dbd77b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 1.332974 Sep 25 01:25:27.827041 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2299/4616] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:26 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:27.832701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:27.832701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:27.855747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:27.856650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:27.857338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:27.858425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:27.859054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:27.859730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:27.930085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] validate_networks() for [('bd392121-2ba2-4140-9dd3-57e5e13ec24b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:25:28.320500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:28.335271 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84a49676-9bf3-4fb1-b191-9ed285c38b60 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5" status: 200 len: 1511 microversion: 2.1 time: 0.506409 Sep 25 01:25:28.349796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2300/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:27 2022] GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:28.633595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0ed1a5e6-cdb8-4bdc-9f54-20f60863f34c req-e7b65c81-fd4d-4548-8b21-64d076c9cafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38de3aea-59ea-44bb-b9e3-71e964ad5d4a", "name": "network-vif-plugged", "status": "completed", "tag": "3be13b67-37ac-43bb-b167-1a0e81b3a51c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:28.651668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0ed1a5e6-cdb8-4bdc-9f54-20f60863f34c req-e7b65c81-fd4d-4548-8b21-64d076c9cafb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:28.652991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0ed1a5e6-cdb8-4bdc-9f54-20f60863f34c req-e7b65c81-fd4d-4548-8b21-64d076c9cafb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:28.654159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0ed1a5e6-cdb8-4bdc-9f54-20f60863f34c req-e7b65c81-fd4d-4548-8b21-64d076c9cafb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:28.678107 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0ed1a5e6-cdb8-4bdc-9f54-20f60863f34c req-e7b65c81-fd4d-4548-8b21-64d076c9cafb service nova] Creating event network-vif-plugged:3be13b67-37ac-43bb-b167-1a0e81b3a51c for instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a on n-h2-master-1 Sep 25 01:25:28.686523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0ed1a5e6-cdb8-4bdc-9f54-20f60863f34c req-e7b65c81-fd4d-4548-8b21-64d076c9cafb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058987 Sep 25 01:25:28.687929 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2301/4618] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:25:29.210153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:29.212276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:29.225203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:29.226275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:29.229152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:29.230561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:29.231214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:29.231816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.651615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:30.665608 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9cccf4ec-d4f5-44ed-9616-4565d8b0d81b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 1.835773 Sep 25 01:25:30.667592 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2302/4619] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:28 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:30.673983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:30.674883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:30.695146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:30.695644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:30.696884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.697851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:30.703064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:30.703560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.771313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:30.772013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:30.772715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.774860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lazy-loading 'fault' on Instance uuid 5c477aaa-fb92-4d98-9668-3eef82293af5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:25:30.833101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:25:30.838722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:25:30.839518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:25:30.839946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:25:30.840557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:25:30.853101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:30.854168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:30.854839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.855969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:30.856423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:30.857261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.877641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:25:30.882779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:30.886453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for user c1c655b1afc54b6c98d771d6acf81ee0 and project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:25:30.902877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:25:30.905565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:25:30.910984 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af78d1e2-439b-4520-8608-c8e44fde8902 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5" status: 200 len: 1307 microversion: 2.1 time: 0.241990 Sep 25 01:25:30.912376 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2303/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:30 2022] GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:30.926481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-eb8bb6a1-52a8-4d3d-b14b-b7dc3d53757a req-2213e11e-42bc-4bf8-a268-1b53114ae01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c477aaa-fb92-4d98-9668-3eef82293af5", "name": "network-vif-deleted", "tag": "3bc4acbb-12c8-427d-9237-40d36740b267"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:30.953396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eb8bb6a1-52a8-4d3d-b14b-b7dc3d53757a req-2213e11e-42bc-4bf8-a268-1b53114ae01c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:30.954642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eb8bb6a1-52a8-4d3d-b14b-b7dc3d53757a req-2213e11e-42bc-4bf8-a268-1b53114ae01c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:30.955574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eb8bb6a1-52a8-4d3d-b14b-b7dc3d53757a req-2213e11e-42bc-4bf8-a268-1b53114ae01c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:30.967808 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1245e8fe-3039-47b5-a72b-e7df9aa522a9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.189027 Sep 25 01:25:30.968690 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2318/4621] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:25:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:25:30.973720 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1168442353", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7f88ee0d-9a42-4b86-b132-380444ddb623"}, {"port": "743ce183-c7c8-48a8-9f40-a771e107b1af", "tag": "port-1"}, {"port": "b03ec708-b0f5-485e-9883-56cacce60459", "tag": "port-2"}, {"uuid": "97185632-d831-427a-b60f-e00ac8a25448", "tag": "net-1"}, {"uuid": "97185632-d831-427a-b60f-e00ac8a25448"}, {"uuid": "3682a83f-8e9d-4729-b9ef-7d8b6335a6d5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3682a83f-8e9d-4729-b9ef-7d8b6335a6d5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "439dcc2f-813a-49d1-83a0-e58752560b22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a9e7a1ce-927e-4de6-88eb-0700c811b155", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1b2a6e6d-86d5-4c12-8b6f-c23b0654afa9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1108801355"}], "key_name": "tempest-keypair-1278627785", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:30.978916 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-eb8bb6a1-52a8-4d3d-b14b-b7dc3d53757a req-2213e11e-42bc-4bf8-a268-1b53114ae01c service nova] Creating event network-vif-deleted:3bc4acbb-12c8-427d-9237-40d36740b267 for instance 5c477aaa-fb92-4d98-9668-3eef82293af5 on n-h1-master-1 Sep 25 01:25:30.984495 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-eb8bb6a1-52a8-4d3d-b14b-b7dc3d53757a req-2213e11e-42bc-4bf8-a268-1b53114ae01c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069841 Sep 25 01:25:30.986117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2304/4622] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:30.993626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-506b83ae-f892-4c0d-adfa-5ca10440899c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:30.994912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-506b83ae-f892-4c0d-adfa-5ca10440899c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:31.178325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-506b83ae-f892-4c0d-adfa-5ca10440899c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:31.192525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-506b83ae-f892-4c0d-adfa-5ca10440899c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1215 microversion: 2.1 time: 0.204273 Sep 25 01:25:31.194736 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2305/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:30 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:31.371484 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] validate_networks() for [('7f88ee0d-9a42-4b86-b132-380444ddb623', None, None, None, None, None), (None, None, '743ce183-c7c8-48a8-9f40-a771e107b1af', None, None, None), (None, None, 'b03ec708-b0f5-485e-9883-56cacce60459', None, None, None), ('97185632-d831-427a-b60f-e00ac8a25448', None, None, None, None, None), ('97185632-d831-427a-b60f-e00ac8a25448', None, None, None, None, None), ('3682a83f-8e9d-4729-b9ef-7d8b6335a6d5', '10.2.2.100', None, None, None, None), ('3682a83f-8e9d-4729-b9ef-7d8b6335a6d5', '10.2.2.200', None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:25:31.692928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:31.693703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:31.704491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:31.710425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:31.712759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:31.713773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:31.714469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:31.715111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.465773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:32.479200 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b5e516a-e2f8-485a-8b7a-cfc0c4580c56 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1319 microversion: 2.1 time: 0.790079 Sep 25 01:25:32.481078 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2306/4624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:31 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1319 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:32.486975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:32.488434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 5c477aaa-fb92-4d98-9668-3eef82293af5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:32.499563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.500305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.500811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.501617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.511197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.511959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.541041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] HTTP exception thrown: Instance 5c477aaa-fb92-4d98-9668-3eef82293af5 could not be found. Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Request method failure captured: Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5 HTTP/1.1 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL629-iUZcLefQkDlWAztEaqw0JD01uSfKgHJNJlXUO71rLztTWPFG8ly-hA56gXP-wjKDi-ITUct89H7a8_Y_ox4kUN3YE2zkX2kEtYZDbToc0SPKVsDbdq52XbPoTf3d8A1KTLFjYH2qF-SeKDCwu8NhDKVmdL9KADsbHqZVie-CWg Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 10fa7c775d924acda02fb364a1818ba2 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateTestJSON-1378481026 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10fa7c775d924acda02fb364a1818ba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10fa7c775d924acda02fb364a1818ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10fa7c775d924acda02fb364a1818ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10fa7c775d924acda02fb364a1818ba2"}]}] Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateTestJSON-1378481026 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 10fa7c775d924acda02fb364a1818ba2 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1378481026 Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateTestJSON-1378481026-project Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d4b32b37164a44f3a6ab4f0b4335cfbb Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateTestJSON-1378481026-project Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 5c477aaa-fb92-4d98-9668-3eef82293af5 could not be found. Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '5c477aaa-fb92-4d98-9668-3eef82293af5'} Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c477aaa-fb92-4d98-9668-3eef82293af5 could not be found. Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c477aaa-fb92-4d98-9668-3eef82293af5 could not be found. Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:25:32.545651 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c477aaa-fb92-4d98-9668-3eef82293af5 could not be found. Sep 25 01:25:32.553960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:32.557274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Returning 404 to user: Instance 5c477aaa-fb92-4d98-9668-3eef82293af5 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:25:32.574148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b33b8dd-a4a4-4575-8d41-c752591f7ac4 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5" status: 404 len: 111 microversion: 2.1 time: 0.087868 Sep 25 01:25:32.575196 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2307/4625] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:32 2022] GET /compute/v2.1/servers/5c477aaa-fb92-4d98-9668-3eef82293af5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:25:32.588949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:32.593612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:32.609783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.610623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.612333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.613290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.614364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.615030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.881774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:32.892328 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74506ed3-bc05-47a6-a7f7-50c7ec9d316b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1267 microversion: 2.1 time: 0.313292 Sep 25 01:25:32.892950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2308/4626] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:32 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:32.898121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a9f2fa02-7526-4924-8773-87463c47527f req-2407b63f-a14e-4bf3-bb5d-2eb793c24d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4239732f-db6e-4c4f-a61b-e4036532f0cb", "name": "network-vif-deleted", "tag": "b960f2f9-c344-4a6f-8c67-b0816c106eca"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:32.915430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9f2fa02-7526-4924-8773-87463c47527f req-2407b63f-a14e-4bf3-bb5d-2eb793c24d8b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.916225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9f2fa02-7526-4924-8773-87463c47527f req-2407b63f-a14e-4bf3-bb5d-2eb793c24d8b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.917500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9f2fa02-7526-4924-8773-87463c47527f req-2407b63f-a14e-4bf3-bb5d-2eb793c24d8b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.942847 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a9f2fa02-7526-4924-8773-87463c47527f req-2407b63f-a14e-4bf3-bb5d-2eb793c24d8b service nova] Creating event network-vif-deleted:b960f2f9-c344-4a6f-8c67-b0816c106eca for instance 4239732f-db6e-4c4f-a61b-e4036532f0cb on n-h2-master-1 Sep 25 01:25:32.956745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a9f2fa02-7526-4924-8773-87463c47527f req-2407b63f-a14e-4bf3-bb5d-2eb793c24d8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062018 Sep 25 01:25:32.957454 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2309/4627] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:32.963063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:32.963819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:32.970244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.970741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.971175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:32.971879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:32.972614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:32.973041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:33.017343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:33.017874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:33.019643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:33.020458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lazy-loading 'fault' on Instance uuid 4239732f-db6e-4c4f-a61b-e4036532f0cb {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:25:33.289833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b32b37164a44f3a6ab4f0b4335cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10fa7c775d924acda02fb364a1818ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:33.300387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06fe1386-68d5-4184-b72f-468f22992659 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 200 len: 1307 microversion: 2.1 time: 0.341134 Sep 25 01:25:33.302436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2310/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:32 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:33.507366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:33.509116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:33.516482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:33.517396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:33.518463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:33.519622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:33.520471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:33.521655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:34.380282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:34.420924 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c8ff1a13-c55c-4d7b-bc61-70faeddcaa4c tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1507 microversion: 2.1 time: 0.908547 Sep 25 01:25:34.421643 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2311/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:33 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1507 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:34.427299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:34.438472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:34.447311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:34.447810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:34.448251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:34.448968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:34.459894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:34.460615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:34.465807 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:34.957284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:34.966619 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9dede0c7-3061-4332-bb84-97ad377ed599 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1315 microversion: 2.1 time: 0.543139 Sep 25 01:25:34.968218 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2312/4630] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:34 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:34.973791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:34.975161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] [instance: 4239732f-db6e-4c4f-a61b-e4036532f0cb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:34.987546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:34.988309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:34.988819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:34.990647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:34.991114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:34.993359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:35.012277 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] HTTP exception thrown: Instance 4239732f-db6e-4c4f-a61b-e4036532f0cb could not be found. Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Request method failure captured: Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb HTTP/1.1 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL629-iUZcLefQkDlWAztEaqw0JD01uSfKgHJNJlXUO71rLztTWPFG8ly-hA56gXP-wjKDi-ITUct89H7a8_Y_ox4kUN3YE2zkX2kEtYZDbToc0SPKVsDbdq52XbPoTf3d8A1KTLFjYH2qF-SeKDCwu8NhDKVmdL9KADsbHqZVie-CWg Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 10fa7c775d924acda02fb364a1818ba2 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-MultipleCreateTestJSON-1378481026 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10fa7c775d924acda02fb364a1818ba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10fa7c775d924acda02fb364a1818ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10fa7c775d924acda02fb364a1818ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10fa7c775d924acda02fb364a1818ba2"}]}] Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-MultipleCreateTestJSON-1378481026 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 10fa7c775d924acda02fb364a1818ba2 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1378481026 Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-MultipleCreateTestJSON-1378481026-project Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d4b32b37164a44f3a6ab4f0b4335cfbb Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-MultipleCreateTestJSON-1378481026-project Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4239732f-db6e-4c4f-a61b-e4036532f0cb could not be found. Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4239732f-db6e-4c4f-a61b-e4036532f0cb'} Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4239732f-db6e-4c4f-a61b-e4036532f0cb could not be found. Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4239732f-db6e-4c4f-a61b-e4036532f0cb could not be found. Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:25:35.015412 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4239732f-db6e-4c4f-a61b-e4036532f0cb could not be found. Sep 25 01:25:35.020891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:25:35.023777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] Returning 404 to user: Instance 4239732f-db6e-4c4f-a61b-e4036532f0cb could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:25:35.024953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-98afbc6f-1005-4c2b-b46c-895e58845f19 tempest-MultipleCreateTestJSON-1378481026 tempest-MultipleCreateTestJSON-1378481026-project] 10.222.0.16 "GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb" status: 404 len: 111 microversion: 2.1 time: 0.055552 Sep 25 01:25:35.026080 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2313/4631] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:34 2022] GET /compute/v2.1/servers/4239732f-db6e-4c4f-a61b-e4036532f0cb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:25:35.035545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcec6570-d77a-45a4-a0cb-9f0d00e4f8cb", "device": "/dev/sdb"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:35.038701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:35.047289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:35.047779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:35.048271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:35.049002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:35.049471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:35.049939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:35.442536 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1beb07f-0a9b-4790-8955-783c9dee14e7 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "POST /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414526 Sep 25 01:25:35.444797 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2314/4632] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:25:35 2022] POST /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:35.453251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ee8aec40-50eb-4326-bae9-8440d211dcdb req-54cffb67-b794-4652-bd7a-e890797d123b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89b5823-aba5-4266-819c-561c62e33e30", "tag": "9beee822-a967-4ad3-8a9f-9ed6763a059d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:35.472558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ee8aec40-50eb-4326-bae9-8440d211dcdb req-54cffb67-b794-4652-bd7a-e890797d123b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:35.473338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ee8aec40-50eb-4326-bae9-8440d211dcdb req-54cffb67-b794-4652-bd7a-e890797d123b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:35.474048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ee8aec40-50eb-4326-bae9-8440d211dcdb req-54cffb67-b794-4652-bd7a-e890797d123b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:35.493675 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ee8aec40-50eb-4326-bae9-8440d211dcdb req-54cffb67-b794-4652-bd7a-e890797d123b service nova] Creating event network-changed:9beee822-a967-4ad3-8a9f-9ed6763a059d for instance b89b5823-aba5-4266-819c-561c62e33e30 on n-h1-master-1 Sep 25 01:25:35.500324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ee8aec40-50eb-4326-bae9-8440d211dcdb req-54cffb67-b794-4652-bd7a-e890797d123b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053387 Sep 25 01:25:35.501582 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2315/4633] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:35.992283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:35.993188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:36.010007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:36.010506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:36.011010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:36.011854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:36.012321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:36.012753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:36.825097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:36.846500 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95d36d06-af47-48cb-80c8-0c17e73beede tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1315 microversion: 2.1 time: 0.858517 Sep 25 01:25:36.857759 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2316/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:35 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:37.878142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:37.879762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:37.887099 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:37.888934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:37.890002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:37.890906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:37.892106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:37.892798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:37.893488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:38.479855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:38.494998 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b85b2059-b59d-4036-9d5d-09226a6327da tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1315 microversion: 2.1 time: 0.623252 Sep 25 01:25:38.495964 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2317/4635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:37 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:39.312418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:25:39.313031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:25:39.313895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:25:39.314581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:25:39.315180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:25:39.318550 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:39.345258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:39.351598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:39.354027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:39.355370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:39.357609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:39.358286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:39.416458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Getting quotas for project 1af93ee90d9d415b850745b7374348b8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:25:39.432298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Getting quotas for user 45ae26af1d0d4104850875f565485d49 and project 1af93ee90d9d415b850745b7374348b8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:25:39.519856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:39.521231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:39.530682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:39.531588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:39.534209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:39.536221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:39.537148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:39.538839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:39.762522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:25:39.765917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='439dcc2f-813a-49d1-83a0-e58752560b22',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a9e7a1ce-927e-4de6-88eb-0700c811b155',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b2a6e6d-86d5-4c12-8b6f-c23b0654afa9',volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:25:40.834283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:40.844444 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ba9883f-483b-4f33-a0d4-605ef888f9be tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1315 microversion: 2.1 time: 1.329391 Sep 25 01:25:40.848443 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2318/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:39 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1315 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:41.010318 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a76d4701-7adf-48db-a52a-030fac699656 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 10.039802 Sep 25 01:25:41.014344 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2319/4637] 10.222.0.16 () {62 vars in 1189 bytes} [Sun Sep 25 01:25:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 10045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:25:41.028241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ca378d1d-4e98-4193-b507-ae5429674b55 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:41.029200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ca378d1d-4e98-4193-b507-ae5429674b55 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:41.187605 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:41.733366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca378d1d-4e98-4193-b507-ae5429674b55 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:41.780376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca378d1d-4e98-4193-b507-ae5429674b55 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:41.811414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca378d1d-4e98-4193-b507-ae5429674b55 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:41.814438 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ca378d1d-4e98-4193-b507-ae5429674b55 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1286 microversion: 2.32 time: 0.791851 Sep 25 01:25:41.827868 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2319/4638] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:41 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1286 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:41.868900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:41.869890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:41.882608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:41.886175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:41.886888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:41.888015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:41.890004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:41.892135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:42.514773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:42.530910 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec8bbb0d-f41b-4c92-a653-3a36321d8777 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1315 microversion: 2.1 time: 0.666026 Sep 25 01:25:42.534374 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2320/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:41 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:42.855183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:42.855999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:42.902008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:42.903831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:42.906784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:42.911573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:42.913458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:42.916125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:43.129185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-42452048-a573-4dac-86ad-b3b3d139d05a req-a0bb5503-4a4f-47d5-8b46-83b235670bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89b5823-aba5-4266-819c-561c62e33e30", "name": "network-vif-plugged", "status": "completed", "tag": "9beee822-a967-4ad3-8a9f-9ed6763a059d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:43.154284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-42452048-a573-4dac-86ad-b3b3d139d05a req-a0bb5503-4a4f-47d5-8b46-83b235670bc9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:43.154682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-42452048-a573-4dac-86ad-b3b3d139d05a req-a0bb5503-4a4f-47d5-8b46-83b235670bc9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:43.155125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-42452048-a573-4dac-86ad-b3b3d139d05a req-a0bb5503-4a4f-47d5-8b46-83b235670bc9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:43.186416 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-42452048-a573-4dac-86ad-b3b3d139d05a req-a0bb5503-4a4f-47d5-8b46-83b235670bc9 service nova] Creating event network-vif-plugged:9beee822-a967-4ad3-8a9f-9ed6763a059d for instance b89b5823-aba5-4266-819c-561c62e33e30 on n-h1-master-1 Sep 25 01:25:43.216483 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-42452048-a573-4dac-86ad-b3b3d139d05a req-a0bb5503-4a4f-47d5-8b46-83b235670bc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090830 Sep 25 01:25:43.217299 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2321/4640] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:25:43.253441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:43.268082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:43.273415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:43.293169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2dbbdd0-e1d7-467f-b806-581c1985c231 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1576 microversion: 2.32 time: 0.448405 Sep 25 01:25:43.314170 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2320/4641] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:42 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1576 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:43.564743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:43.566221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:43.584013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:43.584515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:43.584959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:43.585700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:43.586196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:43.586875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:44.322496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:44.324432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:44.340478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:44.343199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:44.344063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:44.345639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:44.346264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:44.346960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:44.584395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:44.596851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6919dc7-51a5-4ff9-98b3-a386a0881182 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1315 microversion: 2.1 time: 1.034891 Sep 25 01:25:44.597822 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2322/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:43 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:44.599126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:44.611454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:44.613586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:44.616102 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c7fa600-7e61-4807-8c77-e1db62474ded tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1594 microversion: 2.32 time: 0.297898 Sep 25 01:25:44.622081 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2321/4643] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:44 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1594 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:45.620549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:45.621175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:45.639090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:45.639583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:45.640014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:45.651389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:45.651781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:45.652223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:45.652999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:45.653763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:45.671624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:45.677015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:45.680524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:45.681784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:45.682375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:45.684295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:45.913763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:45.927685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:45.935588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:45.937262 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9ce1900-7999-4ef6-8a54-66fc3ec5a65c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1594 microversion: 2.32 time: 0.290534 Sep 25 01:25:45.939828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2322/4644] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:45 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1594 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:46.825069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:46.837381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1692f516-2b88-408e-810d-5d690ae4cc36 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1502 microversion: 2.1 time: 1.220927 Sep 25 01:25:46.838589 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2323/4645] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:45 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1502 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:46.869162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:46.869922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:46.913169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:46.914800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:46.915561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:46.916710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:46.917977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:46.918621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:46.967255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:46.968240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:46.987827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:46.988410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:46.988865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:46.989641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:46.990101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:46.990529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:47.276928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:47.298637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:47.307501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:47.311149 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-566f60d2-f402-4684-83de-03b71dd342e6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1594 microversion: 2.32 time: 0.345914 Sep 25 01:25:47.331832 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2324/4646] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:46 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1594 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:47.533297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.network.security_group_api [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Removing security group 6badb7b8-ff3e-4015-9f9f-95116594bfbb from port 9beee822-a967-4ad3-8a9f-9ed6763a059d Sep 25 01:25:48.345522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:48.345945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:48.361151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.361704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.362155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:48.363949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.364497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.366212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:48.470057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55a00e83-678a-4978-b735-e37aa50590a0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30/action" status: 202 len: 0 microversion: 2.1 time: 1.606764 Sep 25 01:25:48.474574 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2323/4647] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:25:46 2022] POST /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30/action => generated 0 bytes in 1612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:25:48.483510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:48.486050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:48.511519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.512432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.513470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:48.514848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.515682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.516328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:48.829054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:48.839029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f2b64c6-d6a1-4f06-aec2-771b9a98bfa8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1460 microversion: 2.1 time: 0.361074 Sep 25 01:25:48.850477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:48.855867 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2324/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:48 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1460 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:48.867247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d22964f4-f126-4ddf-a0c3-ac7ede61ace3 req-12ab7f6b-ce24-406d-8c61-b094249322a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89b5823-aba5-4266-819c-561c62e33e30", "tag": "9beee822-a967-4ad3-8a9f-9ed6763a059d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:48.869343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:48.874005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:48.877494 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31a8c31e-b8ad-4414-9c18-a07baec9973d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1662 microversion: 2.32 time: 0.537569 Sep 25 01:25:48.883672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d22964f4-f126-4ddf-a0c3-ac7ede61ace3 req-12ab7f6b-ce24-406d-8c61-b094249322a4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.885328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d22964f4-f126-4ddf-a0c3-ac7ede61ace3 req-12ab7f6b-ce24-406d-8c61-b094249322a4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.886439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d22964f4-f126-4ddf-a0c3-ac7ede61ace3 req-12ab7f6b-ce24-406d-8c61-b094249322a4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:48.903880 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d22964f4-f126-4ddf-a0c3-ac7ede61ace3 req-12ab7f6b-ce24-406d-8c61-b094249322a4 service nova] Creating event network-changed:9beee822-a967-4ad3-8a9f-9ed6763a059d for instance b89b5823-aba5-4266-819c-561c62e33e30 on n-h1-master-1 Sep 25 01:25:48.904817 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2325/4649] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:48 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1662 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:48.910792 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d22964f4-f126-4ddf-a0c3-ac7ede61ace3 req-12ab7f6b-ce24-406d-8c61-b094249322a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053798 Sep 25 01:25:48.911848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2325/4650] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:25:48.914250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:48.921103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:48.932315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.935981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.937579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:48.940210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:48.942033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:48.942704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:49.270140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:49.282737 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d0a06d8-3b06-47bb-af82-db30362d6706 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.376696 Sep 25 01:25:49.283331 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2326/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:48 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:49.320919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:49.322647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:49.338260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:49.339091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:49.340558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:49.342303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:49.346287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:49.347851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:49.912903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:49.913559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:49.922538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:49.929361 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:49.931031 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=16 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:49.936274 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-afd62e57-7561-4c82-b49d-cc65a7c22daa tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.621390 Sep 25 01:25:49.938770 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2326/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:49.948180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:49.949646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:49.950121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:49.950882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:49.951343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:49.951773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:49.970621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:49.972363 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:49.977758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:49.996620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:49.998098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:50.000098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:50.002953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:50.003703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:50.004361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:50.456982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:50.465449 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-edf96cba-96e9-4bfc-8c44-4da665b4d0ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.503255 Sep 25 01:25:50.478114 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2327/4653] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:50.494100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:50.494735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:50.511246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:50.512080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:50.512537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:50.513227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:50.513708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:50.514135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:50.956766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:50.981752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:50.989149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:50.995673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62d3b520-c2bc-48e8-af9d-12e2239d759a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1709 microversion: 2.32 time: 1.086759 Sep 25 01:25:51.000512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2327/4654] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:49 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1709 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:51.063548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:51.072982 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae0325c9-eecf-4062-9e5b-9cb15a806099 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.584980 Sep 25 01:25:51.073599 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2328/4655] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:50 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:51.326475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-26373007", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "bd392121-2ba2-4140-9dd3-57e5e13ec24b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:25:51.465994 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] validate_networks() for [('bd392121-2ba2-4140-9dd3-57e5e13ec24b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:25:52.031204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:52.031990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:52.059537 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:52.071307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:52.072810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:52.075908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:52.080733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:52.081226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:52.083446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:52.787757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:25:52.788318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:25:52.788670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:25:52.790900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:25:52.792479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:25:52.821127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:52.825437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:52.828850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:52.831579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:52.834779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:52.837541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:52.895938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:25:52.908061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Getting quotas for user c1c655b1afc54b6c98d771d6acf81ee0 and project 5404f5e8a04445d08a69a14616c5e008. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:25:52.938018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:25:52.940516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:25:52.957360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:52.978210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:52.983252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:52.984926 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e867a6b-670e-412d-bbfe-eba4860ac4c7 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1709 microversion: 2.32 time: 0.959190 Sep 25 01:25:52.986226 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2329/4656] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:52 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1709 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:53.042305 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-46561536-b3c7-4804-b52f-cafeefcd2b46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724703 Sep 25 01:25:53.054070 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2328/4657] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:25:53.057269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5a4e515-dd5b-4ff9-9fdf-2b59677ead24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:53.058072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d5a4e515-dd5b-4ff9-9fdf-2b59677ead24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:53.185371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5a4e515-dd5b-4ff9-9fdf-2b59677ead24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:53.203667 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5a4e515-dd5b-4ff9-9fdf-2b59677ead24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1213 microversion: 2.1 time: 0.151528 Sep 25 01:25:53.206128 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2330/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:53 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:54.021461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:54.028595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:54.047085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:54.047601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:54.048191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:54.049058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:54.051014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:54.051503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:54.236475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:54.239702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:54.276844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:54.277378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:54.277857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:54.278611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:54.279068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:54.279493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:54.608771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:54.613350 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:25:54.628968 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a9063c60-362e-461e-99cb-2aed2d0b8279 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1209 microversion: 2.1 time: 0.404227 Sep 25 01:25:54.629678 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2331/4659] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:54 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1209 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:55.487722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:55.515789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:55.524878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:55.526315 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-489371fd-ae96-4895-b2e3-3de2a85415c1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1756 microversion: 2.32 time: 1.510119 Sep 25 01:25:55.526920 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2329/4660] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:54 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1756 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:55.654283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:55.655759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:55.694494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:55.698026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:55.698504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:55.699615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:55.700092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:55.703187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:56.043310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:56.055489 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-000c111a-4381-4a4a-b5a8-26b91a0bcb4d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1271 microversion: 2.1 time: 0.406061 Sep 25 01:25:56.062621 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2332/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:55 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1271 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:25:56.555684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:56.556399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:56.594733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:56.595248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:56.595712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:56.596425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:56.596881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:56.597312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:57.100725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:57.102682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:57.118534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:57.119335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:57.120018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:57.121874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:57.122561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:57.123424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:57.215891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:57.240468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:57.263340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:57.274911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15a1d469-b11a-40bf-bb34-2f15beb8662c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1803 microversion: 2.32 time: 0.721695 Sep 25 01:25:57.277773 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2330/4662] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:56 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1803 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:57.427789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:57.443214 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c94e7db-d8cc-4ca7-b563-1cee26a50ce6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1271 microversion: 2.1 time: 0.348649 Sep 25 01:25:57.444559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2333/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:57 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:25:58.308066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:58.309331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:58.316273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:58.317071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:58.317738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:58.318705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:58.324984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:58.325873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:58.468516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:25:58.469314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:25:58.482056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:58.482564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:58.483010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:58.490230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:25:58.490741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:25:58.491195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:25:59.537045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:59.613286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:59.623829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:59.628853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16894541-cc14-4528-ab73-01a883af08e8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1803 microversion: 2.32 time: 1.326229 Sep 25 01:25:59.630607 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2331/4664] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:25:58 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1803 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:25:59.795060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:25:59.811346 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0badf88f-356c-4f7f-8964-d3ddeba05d40 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 1.346854 Sep 25 01:25:59.815065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2334/4665] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:25:58 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:00.657180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:00.658634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:00.676632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:00.681203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:00.682088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:00.684201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:00.686801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:00.688478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:00.838589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:00.840547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:00.858699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:00.859435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:00.860181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:00.864946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:00.865760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:00.866426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:01.480592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:01.498099 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a71f32b-3a99-4565-96d7-4676523a6154 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 0.662143 Sep 25 01:26:01.499981 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2335/4666] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:00 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:01.568602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:01.595073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:01.600207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:01.604263 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8906a691-cdbd-4b9d-97a4-5ab2f4966a3c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1850 microversion: 2.32 time: 0.949396 Sep 25 01:26:01.607162 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2332/4667] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:00 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1850 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:02.275054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-239422d0-a144-4aa9-9808-8ce28da4b20e req-d9b1adf2-0f3f-46f9-962c-1aafb82fe67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "b13e3d91-cda7-431a-9493-45c4469e5b7a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:02.307157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-239422d0-a144-4aa9-9808-8ce28da4b20e req-d9b1adf2-0f3f-46f9-962c-1aafb82fe67f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:02.314432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-239422d0-a144-4aa9-9808-8ce28da4b20e req-d9b1adf2-0f3f-46f9-962c-1aafb82fe67f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:02.314890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-239422d0-a144-4aa9-9808-8ce28da4b20e req-d9b1adf2-0f3f-46f9-962c-1aafb82fe67f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:02.352529 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-239422d0-a144-4aa9-9808-8ce28da4b20e req-d9b1adf2-0f3f-46f9-962c-1aafb82fe67f service nova] Creating event network-changed:b13e3d91-cda7-431a-9493-45c4469e5b7a for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:02.368852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-239422d0-a144-4aa9-9808-8ce28da4b20e req-d9b1adf2-0f3f-46f9-962c-1aafb82fe67f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098575 Sep 25 01:26:02.373829 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2336/4668] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:02.527110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:02.527735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:02.541142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:02.556264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:02.557087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:02.559198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:02.559881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:02.560493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:02.635001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:02.635933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:02.650065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:02.650670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:02.650992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:02.651712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:02.652165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:02.652590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:02.859391 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:02.927457 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:03.195959 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:04.312323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:04.322006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:04.323385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:04.334936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba58ccf9-c738-42d4-919b-acb98999d2ff tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1850 microversion: 2.32 time: 1.705114 Sep 25 01:26:04.350497 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2337/4669] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:02 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1850 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:04.363508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7f1aa674-7696-4ea5-bf95-0e46563d9061 req-98dbaccd-fe3f-444c-8ff5-f42bd4224384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c9e6231-840e-467e-bb2d-4273269b15e4", "tag": "89eb1cdd-a4ac-4b66-bf6f-c750ce03c162"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:04.386386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f1aa674-7696-4ea5-bf95-0e46563d9061 req-98dbaccd-fe3f-444c-8ff5-f42bd4224384 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:04.393349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f1aa674-7696-4ea5-bf95-0e46563d9061 req-98dbaccd-fe3f-444c-8ff5-f42bd4224384 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:04.394048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7f1aa674-7696-4ea5-bf95-0e46563d9061 req-98dbaccd-fe3f-444c-8ff5-f42bd4224384 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:04.407156 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7f1aa674-7696-4ea5-bf95-0e46563d9061 req-98dbaccd-fe3f-444c-8ff5-f42bd4224384 service nova] Creating event network-changed:89eb1cdd-a4ac-4b66-bf6f-c750ce03c162 for instance 4c9e6231-840e-467e-bb2d-4273269b15e4 on n-h1-master-1 Sep 25 01:26:04.412621 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7f1aa674-7696-4ea5-bf95-0e46563d9061 req-98dbaccd-fe3f-444c-8ff5-f42bd4224384 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060499 Sep 25 01:26:04.413622 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2338/4670] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:04.526177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:04.535848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-415ded46-d19a-4a8e-a5e0-3691e1c9d28f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 2.012877 Sep 25 01:26:04.540549 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2333/4671] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:02 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:05.374113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:05.375245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:05.397576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:05.399905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:05.400494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:05.402992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:05.405462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:05.405946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:05.564434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:05.565174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:05.578515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:05.579349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:05.580187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:05.584803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:05.586115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:05.586798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:06.441078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:06.475453 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9097afd-75f0-4829-90d0-1ea781d2ecc2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 0.912735 Sep 25 01:26:06.478856 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2334/4672] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:05 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:06.771992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:06.796465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:06.799537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:06.806593 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab09924a-5784-4de1-9b5d-a5a35b0e7a1c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1871 microversion: 2.32 time: 1.441554 Sep 25 01:26:06.807603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2339/4673] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:05 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1871 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:07.501737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:07.503735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:07.516475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:07.526011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:07.526743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:07.534486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:07.535250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:07.540903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:07.542844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:07.543297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:07.549398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:07.549902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:07.550336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:07.551072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:07.551525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:07.551948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:07.707870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lazy-loading 'services' on Instance uuid 38de3aea-59ea-44bb-b9e3-71e964ad5d4a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:26:07.876281 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e9a7a44-bc83-4d4b-8445-09d29a46199d tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a/os-volume_attachments/bcec6570-d77a-45a4-a0cb-9f0d00e4f8cb" status: 202 len: 0 microversion: 2.1 time: 0.337889 Sep 25 01:26:07.888505 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2340/4674] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:26:07 2022] DELETE /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a/os-volume_attachments/bcec6570-d77a-45a4-a0cb-9f0d00e4f8cb => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:26:07.902359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:07.903075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:07.918166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:07.919187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:07.934050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:07.935094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:07.935939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:07.937939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:09.238741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:09.247012 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d2a7542-5334-483e-bd52-34ad19bd3362 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 1.749290 Sep 25 01:26:09.249574 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2335/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:07 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:09.257253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-17f23221-bbf4-46c2-83a9-e148666a511c req-5bf67a84-906f-4aaa-a565-c073285ff6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "743ce183-c7c8-48a8-9f40-a771e107b1af"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:09.287771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-17f23221-bbf4-46c2-83a9-e148666a511c req-5bf67a84-906f-4aaa-a565-c073285ff6c0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:09.288520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-17f23221-bbf4-46c2-83a9-e148666a511c req-5bf67a84-906f-4aaa-a565-c073285ff6c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:09.289486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-17f23221-bbf4-46c2-83a9-e148666a511c req-5bf67a84-906f-4aaa-a565-c073285ff6c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:09.313958 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-17f23221-bbf4-46c2-83a9-e148666a511c req-5bf67a84-906f-4aaa-a565-c073285ff6c0 service nova] Creating event network-changed:743ce183-c7c8-48a8-9f40-a771e107b1af for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:09.327900 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-17f23221-bbf4-46c2-83a9-e148666a511c req-5bf67a84-906f-4aaa-a565-c073285ff6c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076889 Sep 25 01:26:09.328816 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2336/4676] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:09.594368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:09.614210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:09.618893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:09.621793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0310a0bc-cbc0-4b43-94d1-121de84ef044 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1871 microversion: 2.32 time: 1.731956 Sep 25 01:26:09.624987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2341/4677] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:07 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1871 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:10.276421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:10.277804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:10.291463 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:10.293430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:10.295432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:10.297852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:10.299133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:10.300253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:10.301167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:10.654080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:10.654705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:10.666682 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=54 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:10.668992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:10.670377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:10.676109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:10.677086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:10.677906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:10.678518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:11.248064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:11.264189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:11.266639 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3413733-73ff-4d89-b802-9824b8bb9401 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 0.995582 Sep 25 01:26:11.269207 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2337/4678] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:10 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:11.282659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ae6193cb-a3d8-47c7-bce5-1f55ecccbc29 req-ddba6350-e4ed-4c31-9b66-8105c8d20394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9e6231-840e-467e-bb2d-4273269b15e4", "name": "network-vif-plugged", "status": "completed", "tag": "89eb1cdd-a4ac-4b66-bf6f-c750ce03c162"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:11.287287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:11.298557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:11.302774 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba7d4832-6594-46a0-bc56-c6a65985e2a9 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1871 microversion: 2.32 time: 0.650502 Sep 25 01:26:11.317427 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2342/4679] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:10 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1871 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:11.358619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ae6193cb-a3d8-47c7-bce5-1f55ecccbc29 req-ddba6350-e4ed-4c31-9b66-8105c8d20394 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:11.363258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ae6193cb-a3d8-47c7-bce5-1f55ecccbc29 req-ddba6350-e4ed-4c31-9b66-8105c8d20394 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:11.363720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ae6193cb-a3d8-47c7-bce5-1f55ecccbc29 req-ddba6350-e4ed-4c31-9b66-8105c8d20394 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:11.398035 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ae6193cb-a3d8-47c7-bce5-1f55ecccbc29 req-ddba6350-e4ed-4c31-9b66-8105c8d20394 service nova] Creating event network-vif-plugged:89eb1cdd-a4ac-4b66-bf6f-c750ce03c162 for instance 4c9e6231-840e-467e-bb2d-4273269b15e4 on n-h1-master-1 Sep 25 01:26:11.416694 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ae6193cb-a3d8-47c7-bce5-1f55ecccbc29 req-ddba6350-e4ed-4c31-9b66-8105c8d20394 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140146 Sep 25 01:26:11.418528 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2338/4680] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:12.296496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:12.299365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:12.318661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:12.326486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:12.327714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:12.329810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:12.330844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:12.331535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:12.336729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:12.341535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:12.351464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:12.352329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:12.352989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:12.354029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:12.354667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:12.356779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:13.443623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:13.459040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:13.463957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:13.465713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:13.466936 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82feac6a-2dc1-427e-baed-a9cd383f5bf5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1892 microversion: 2.32 time: 1.134496 Sep 25 01:26:13.467523 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2339/4681] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:12 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1892 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:13.505069 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9fd0ac00-b40e-427c-8fa6-705f766a6881 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1313 microversion: 2.1 time: 1.209983 Sep 25 01:26:13.508135 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2343/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:12 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1313 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:13.764579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-53084cdd-9c67-4b70-8fe3-93c0d11aacda req-bacd6d7d-a624-46e0-8fdc-54cad9d4a3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "b03ec708-b0f5-485e-9883-56cacce60459"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:13.781219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-53084cdd-9c67-4b70-8fe3-93c0d11aacda req-bacd6d7d-a624-46e0-8fdc-54cad9d4a3d9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:13.783393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-53084cdd-9c67-4b70-8fe3-93c0d11aacda req-bacd6d7d-a624-46e0-8fdc-54cad9d4a3d9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:13.785786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-53084cdd-9c67-4b70-8fe3-93c0d11aacda req-bacd6d7d-a624-46e0-8fdc-54cad9d4a3d9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:13.821070 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-53084cdd-9c67-4b70-8fe3-93c0d11aacda req-bacd6d7d-a624-46e0-8fdc-54cad9d4a3d9 service nova] Creating event network-changed:b03ec708-b0f5-485e-9883-56cacce60459 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:13.828610 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-53084cdd-9c67-4b70-8fe3-93c0d11aacda req-bacd6d7d-a624-46e0-8fdc-54cad9d4a3d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359879 Sep 25 01:26:13.835884 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2340/4683] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:14.499464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:14.500145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:14.514268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:14.516058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:14.520458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:14.521473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:14.522139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:14.523878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:14.533647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:14.534984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:14.553051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:14.555121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:14.557547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:14.558533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:14.561698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:14.562629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:14.971726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:14.987049 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d60b1144-e4a6-4f3e-9619-1f02a0de4a82 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1500 microversion: 2.1 time: 0.455621 Sep 25 01:26:14.987714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2341/4684] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:14 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1500 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:15.128113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:15.161342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:15.167851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:15.173712 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95de7007-d6fa-4472-a043-02f5b782d454 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1892 microversion: 2.32 time: 0.678828 Sep 25 01:26:15.175892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2344/4685] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:14 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1892 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:15.198849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:15.200372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:15.225461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:15.228534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:15.229661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:15.233699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:15.236570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:15.240424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:15.349993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1518967132", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:15.398671 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b613d40-cddc-4b7f-b3ac-f13ffabd39bb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4/action" status: 202 len: 0 microversion: 2.1 time: 0.217526 Sep 25 01:26:15.450278 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2345/4686] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:26:15 2022] POST /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:26:15.458354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:15.459075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:15.500937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:15.501541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:15.501892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:15.505295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] validate_networks() for [('1d31a52a-db57-4249-8200-b9927eb1bafe', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:26:15.507825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:15.508320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:15.508975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:16.828287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:16.846465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a1a8c8b-c5f4-4473-9ae4-d5e2b2ef37ec tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1505 microversion: 2.1 time: 1.391922 Sep 25 01:26:16.861716 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2346/4687] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:15 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1505 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:16.864926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d905544c-fefa-49b5-9e63-a836198413d5 req-cbe32387-85f7-4054-b8dd-1434a0c0b884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "7aa07162-4d0d-4aed-bf40-436e8b476ed3"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:16.892303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d905544c-fefa-49b5-9e63-a836198413d5 req-cbe32387-85f7-4054-b8dd-1434a0c0b884 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:16.892958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d905544c-fefa-49b5-9e63-a836198413d5 req-cbe32387-85f7-4054-b8dd-1434a0c0b884 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:16.893420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d905544c-fefa-49b5-9e63-a836198413d5 req-cbe32387-85f7-4054-b8dd-1434a0c0b884 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:16.919355 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d905544c-fefa-49b5-9e63-a836198413d5 req-cbe32387-85f7-4054-b8dd-1434a0c0b884 service nova] Creating event network-changed:7aa07162-4d0d-4aed-bf40-436e8b476ed3 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:16.940305 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d905544c-fefa-49b5-9e63-a836198413d5 req-cbe32387-85f7-4054-b8dd-1434a0c0b884 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089124 Sep 25 01:26:16.940960 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2347/4688] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:16.961340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:16.962217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:16.984412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:17.002120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:17.005808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:17.007598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:17.010008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:17.010451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:17.764668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:26:17.765279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:26:17.765588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:26:17.766193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:26:17.767027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:26:17.792293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:17.803416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:17.804144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:17.806337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:17.807435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:17.808455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:17.881062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for project 24b293fd2bf248f0a714067e48ea0792. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:26:17.895914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for user 88a281617be64d1b85a6b7d8a708876a and project 24b293fd2bf248f0a714067e48ea0792. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:26:17.929167 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:26:17.938193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:26:18.098467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-080615a5-dc40-44a0-aa3a-3fd118fd2640 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.107267 Sep 25 01:26:18.114431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2342/4689] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:26:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:26:18.126629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:18.163377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:18.188030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:18.188532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:18.188977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:18.189724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:18.190183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:18.190613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:18.354217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:18.360836 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:18.380107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:18.398250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:18.402670 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29f2b779-13d8-4633-add4-5e51d7074a36 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1892 microversion: 2.32 time: 1.460454 Sep 25 01:26:18.436642 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2348/4690] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:16 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1892 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:18.460301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38e508be-42ac-4311-9b36-f2415752d788 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:18.462537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38e508be-42ac-4311-9b36-f2415752d788 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:18.737478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38e508be-42ac-4311-9b36-f2415752d788 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:18.747546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38e508be-42ac-4311-9b36-f2415752d788 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1222 microversion: 2.1 time: 0.300345 Sep 25 01:26:18.749210 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2349/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:18 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1222 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:19.024693 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-607019302", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:19.027314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:19.035513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31e22510-1c1e-4800-bb7c-1e3d3ea30692 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1485 microversion: 2.1 time: 0.918531 Sep 25 01:26:19.051815 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2343/4692] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:18 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1485 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:19.077765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:19.079892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:19.087725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:19.088580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:19.089423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:19.090360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:19.091121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:19.110458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:19.187370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] validate_networks() for [('1d31a52a-db57-4249-8200-b9927eb1bafe', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:26:19.189078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lazy-loading 'flavor' on Instance uuid 4c9e6231-840e-467e-bb2d-4273269b15e4 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:26:19.534014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f3230a6-53c5-49ed-8fd0-62981abaca20 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4/action" status: 202 len: 0 microversion: 2.1 time: 0.472310 Sep 25 01:26:19.538817 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2344/4693] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:26:19 2022] POST /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:26:19.547047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1fad2b0e-7d39-4978-80e7-b2fbe9f27be2 req-4f1815d8-5962-42cd-a043-6e82c61fcb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "fde1c7f4-0458-4853-a17f-067df54210fd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:19.581320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1fad2b0e-7d39-4978-80e7-b2fbe9f27be2 req-4f1815d8-5962-42cd-a043-6e82c61fcb68 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:19.583486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1fad2b0e-7d39-4978-80e7-b2fbe9f27be2 req-4f1815d8-5962-42cd-a043-6e82c61fcb68 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:19.584139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1fad2b0e-7d39-4978-80e7-b2fbe9f27be2 req-4f1815d8-5962-42cd-a043-6e82c61fcb68 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:19.590672 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:19.619258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1fad2b0e-7d39-4978-80e7-b2fbe9f27be2 req-4f1815d8-5962-42cd-a043-6e82c61fcb68 service nova] Creating event network-changed:fde1c7f4-0458-4853-a17f-067df54210fd for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:19.641974 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1fad2b0e-7d39-4978-80e7-b2fbe9f27be2 req-4f1815d8-5962-42cd-a043-6e82c61fcb68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100407 Sep 25 01:26:19.645861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2345/4694] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:19.664514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:19.665678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:19.676699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:19.679315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:19.679997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:19.681284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:19.681990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:19.682698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:21.418249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:21.428300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:21.430801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:21.432029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-262cf94e-2fa3-4051-b434-02fd4363d6e4 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1892 microversion: 2.32 time: 1.784687 Sep 25 01:26:21.432600 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2346/4695] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:19 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1892 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:21.453846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:21.454473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:21.465103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:21.467819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:21.468526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:21.469589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:21.474463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:21.475951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.006383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:22.022145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e4d24a0-76d5-45d3-a240-e17e90af0d77 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1512 microversion: 2.1 time: 0.582667 Sep 25 01:26:22.039912 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2347/4696] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:21 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:22.050646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:22.051502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:22.077904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.078793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.079480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.080717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.083332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.087566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.158670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:26:22.329914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:26:22.330967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:26:22.331678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:26:22.332328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:26:22.333053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:26:22.351997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.354024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.354475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.356932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.357947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.359437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.395863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b91bab7a-6bd9-49c7-a5dd-69fe7e2ae3bc tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "DELETE /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 204 len: 0 microversion: 2.1 time: 0.350527 Sep 25 01:26:22.400287 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2348/4697] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:26:22 2022] DELETE /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:26:22.414651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for project 24b293fd2bf248f0a714067e48ea0792. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:26:22.422151 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for user 88a281617be64d1b85a6b7d8a708876a and project 24b293fd2bf248f0a714067e48ea0792. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:26:22.426664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:22.427468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:22.436837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.438118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.438620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.439336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.440104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.440535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.452156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:26:22.464692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:26:22.580738 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b070fe27-67d1-425b-a448-a16bf7b6ac9d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.563268 Sep 25 01:26:22.582161 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2350/4698] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:26:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:26:22.597857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:22.598871 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:22.617269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.618787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.619483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:22.620452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:22.621153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:22.625456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:23.560953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:23.572454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-256218c3-a4e6-4712-a28a-1fd06012515b tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1513 microversion: 2.1 time: 1.164443 Sep 25 01:26:23.577606 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2349/4699] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:22 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1513 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:23.590427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:23.591066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:23.618281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:23.618571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:23.619036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:23.619754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:23.620219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:23.620655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:23.706265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:23.718485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:23.719881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:23.725585 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a75e0a8-8d04-4a2f-bfa5-3ede864da41b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1892 microversion: 2.32 time: 1.141958 Sep 25 01:26:23.729748 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2351/4700] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:22 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1892 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:23.750774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:23.755286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:23.775872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:23.777950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:23.778401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:23.779978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:23.784868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:23.785327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:24.236294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:24.281361 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-149b8cc0-4c1d-4371-b9a1-f0be35d83a12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1217 microversion: 2.1 time: 0.697880 Sep 25 01:26:24.286305 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2350/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:23 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1217 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:24.547391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-be584a05-800e-41af-9981-627fed2de00d req-e47a6f8a-0020-4fbc-b817-7b237c90a943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "7256f32a-8cf9-4e46-9caa-e40fd569b94c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:24.577605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-be584a05-800e-41af-9981-627fed2de00d req-e47a6f8a-0020-4fbc-b817-7b237c90a943 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:24.581213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-be584a05-800e-41af-9981-627fed2de00d req-e47a6f8a-0020-4fbc-b817-7b237c90a943 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:24.582788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-be584a05-800e-41af-9981-627fed2de00d req-e47a6f8a-0020-4fbc-b817-7b237c90a943 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:24.624999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-be584a05-800e-41af-9981-627fed2de00d req-e47a6f8a-0020-4fbc-b817-7b237c90a943 service nova] Creating event network-changed:7256f32a-8cf9-4e46-9caa-e40fd569b94c for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:24.637544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-be584a05-800e-41af-9981-627fed2de00d req-e47a6f8a-0020-4fbc-b817-7b237c90a943 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105720 Sep 25 01:26:24.638167 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2351/4702] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:24.644555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:24.644909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:24.645269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:24.655021 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0cc75007-81aa-4778-b725-860c165d6aef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.923556 Sep 25 01:26:24.656494 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2352/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:23 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:24.667012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:24.667856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:24.668536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:24.669507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:24.670225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:24.670866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:24.758528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:24.760281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:24.768667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:24.769642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:24.770773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:24.771750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:24.773309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:24.774026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:25.765676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:25.776859 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2cc7f12f-42c4-4aaf-a970-ad140095ebfe tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1513 microversion: 2.1 time: 1.136169 Sep 25 01:26:25.793633 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2352/4704] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:24 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1513 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:25.798880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-abd02bb9-3dc3-46b3-923f-e15800c16b59 req-4fba2ab1-9a88-4271-be7e-138b7a8323b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9e6231-840e-467e-bb2d-4273269b15e4", "name": "network-vif-plugged", "status": "completed", "tag": "89eb1cdd-a4ac-4b66-bf6f-c750ce03c162"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:25.821803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-abd02bb9-3dc3-46b3-923f-e15800c16b59 req-4fba2ab1-9a88-4271-be7e-138b7a8323b4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:25.826177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-abd02bb9-3dc3-46b3-923f-e15800c16b59 req-4fba2ab1-9a88-4271-be7e-138b7a8323b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:25.826873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-abd02bb9-3dc3-46b3-923f-e15800c16b59 req-4fba2ab1-9a88-4271-be7e-138b7a8323b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:25.855006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-abd02bb9-3dc3-46b3-923f-e15800c16b59 req-4fba2ab1-9a88-4271-be7e-138b7a8323b4 service nova] Creating event network-vif-plugged:89eb1cdd-a4ac-4b66-bf6f-c750ce03c162 for instance 4c9e6231-840e-467e-bb2d-4273269b15e4 on n-h1-master-1 Sep 25 01:26:25.869286 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-abd02bb9-3dc3-46b3-923f-e15800c16b59 req-4fba2ab1-9a88-4271-be7e-138b7a8323b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073854 Sep 25 01:26:25.870602 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2353/4705] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:25.879178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:25.890509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:25.898646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:25.899441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:25.900070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:25.901646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:25.916005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:25.916831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:25.955421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:25.985492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:25.987791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:25.989260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e7022bf3-2344-4215-bd0f-97751fd7dd0a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.235996 Sep 25 01:26:25.992641 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2353/4706] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:24 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:26.010933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:26.014795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:26.033244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:26.034165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:26.035198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:26.036116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:26.036755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:26.045051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:26.984445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:26.999441 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5fced35-1f3a-4076-b2b1-7041dfc50a8d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1279 microversion: 2.1 time: 1.127353 Sep 25 01:26:27.015978 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2354/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:25 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1279 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:27.031164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:27.034002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:27.047311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:27.047818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:27.048266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:27.054408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:27.054747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:27.055208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:27.265710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f080bae0ec94a5b88128dd69c8a3e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31367060596548b59603860aafed267f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:27.276890 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff5f21bb-76af-4c78-b103-e6cbeec1aa51 tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 200 len: 1471 microversion: 2.1 time: 0.259704 Sep 25 01:26:27.277522 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2355/4708] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:27 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:27.305871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:27.306494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:27.326597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:27.327533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:27.329361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:27.332937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:27.333737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:27.334354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:27.715882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:27.742720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d7adea47-dc10-4b30-b4f3-85af43678e5d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 1.748343 Sep 25 01:26:27.752261 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2354/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:25 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:27.772042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9b2baf20-1ec7-47a3-b710-57c95f73d346 req-623fd335-6f5e-4a5f-b45f-73b19b19eed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38de3aea-59ea-44bb-b9e3-71e964ad5d4a", "name": "network-vif-deleted", "tag": "3be13b67-37ac-43bb-b167-1a0e81b3a51c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:27.798196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9b2baf20-1ec7-47a3-b710-57c95f73d346 req-623fd335-6f5e-4a5f-b45f-73b19b19eed9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:27.798711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9b2baf20-1ec7-47a3-b710-57c95f73d346 req-623fd335-6f5e-4a5f-b45f-73b19b19eed9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:27.799159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9b2baf20-1ec7-47a3-b710-57c95f73d346 req-623fd335-6f5e-4a5f-b45f-73b19b19eed9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:27.826530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9b2baf20-1ec7-47a3-b710-57c95f73d346 req-623fd335-6f5e-4a5f-b45f-73b19b19eed9 service nova] Creating event network-vif-deleted:3be13b67-37ac-43bb-b167-1a0e81b3a51c for instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a on n-h2-master-1 Sep 25 01:26:27.837370 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9b2baf20-1ec7-47a3-b710-57c95f73d346 req-623fd335-6f5e-4a5f-b45f-73b19b19eed9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078938 Sep 25 01:26:27.840514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2355/4710] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:27.845699 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:27.916770 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:27.931570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:27.958459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:27.962487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:27.967904 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3cfb5d0a-7037-485f-a7a1-a4de840f1e16 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.669111 Sep 25 01:26:27.973104 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2356/4711] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:27 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:28.030476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:28.031122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:28.044408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:28.044979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:28.045457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:28.046204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:28.046723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:28.047162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:28.213997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:28.230822 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5cc12d02-4fcb-498e-a69d-620a11e2fac0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1279 microversion: 2.1 time: 0.204992 Sep 25 01:26:28.232110 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2356/4712] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:28 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:28.305779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:28.307138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] [instance: 38de3aea-59ea-44bb-b9e3-71e964ad5d4a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:28.325626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:28.326132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:28.331962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:28.336313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:28.337512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:28.355240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:28.387068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] HTTP exception thrown: Instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a could not be found. Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Request method failure captured: Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a HTTP/1.1 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6zbHDM2DoPh4-GtnseE3mp_tWf6X9cR-wt5rXEOTncrgfGMnMyjaGBs23JyNA_Vv8pUqdv5NWK64zH1iRwrMJSY0fCk_8H8rNF4URURTfyink-9q-rJo1782z4jJwodTvNUcTXygVhKEU51thocIGL0T4SaX3p74Ik7Tptc0_IsHzw Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 31367060596548b59603860aafed267f Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1937337897 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31367060596548b59603860aafed267f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31367060596548b59603860aafed267f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31367060596548b59603860aafed267f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31367060596548b59603860aafed267f"}]}] Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesSnapshotTestJSON-1937337897 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 31367060596548b59603860aafed267f Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1937337897 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesSnapshotTestJSON-1937337897-project Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2f080bae0ec94a5b88128dd69c8a3e74 Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesSnapshotTestJSON-1937337897-project Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a could not be found. Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '38de3aea-59ea-44bb-b9e3-71e964ad5d4a'} Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a could not be found. Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a could not be found. Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:26:28.390687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a could not be found. Sep 25 01:26:28.396194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:26:28.399477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] Returning 404 to user: Instance 38de3aea-59ea-44bb-b9e3-71e964ad5d4a could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:26:28.402206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d381f84-ab59-40f0-8611-de1510aeef1e tempest-VolumesSnapshotTestJSON-1937337897 tempest-VolumesSnapshotTestJSON-1937337897-project] 10.222.0.16 "GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a" status: 404 len: 111 microversion: 2.1 time: 0.101321 Sep 25 01:26:28.406916 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2357/4713] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:28 2022] GET /compute/v2.1/servers/38de3aea-59ea-44bb-b9e3-71e964ad5d4a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:26:28.780519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:28.781101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:28.795881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:28.796880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:28.797338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:28.799635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:28.801275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:28.801768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:28.996436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:28.997299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:29.015930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:29.016709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:29.017815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:29.018758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:29.019400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:29.020468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:29.448740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:29.458601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b42b5b3-0f7e-4921-98f8-7f436746ab2e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.682440 Sep 25 01:26:29.461358 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2357/4714] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:28 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:29.478445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:29.479330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:29.489333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:29.492960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:29.493666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:29.494629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:29.497737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:29.498619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:29.701481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:29.709369 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-382e6d6d-fb62-4595-8408-0add3ccbf93f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1279 microversion: 2.1 time: 0.246688 Sep 25 01:26:29.741829 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2358/4715] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:29 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:30.103241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:30.124208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:30.146289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:30.149522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-afcb1165-07c4-4a31-af4f-3adb5b97bc1e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.157040 Sep 25 01:26:30.163252 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2358/4716] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:28 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:30.490490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:30.492558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:30.505041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:30.511103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:30.513663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:30.514717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:30.515446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:30.517987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:30.560932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-74f25c83-aa69-4d8a-a89e-129b40c4193a req-6927401b-0945-44c0-b9dd-3addaa99f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4556d3-2b56-4e23-b0a9-0dd123052772", "tag": "bb20be38-c4d7-484d-85ed-1c5abb628e57"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:30.602679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-74f25c83-aa69-4d8a-a89e-129b40c4193a req-6927401b-0945-44c0-b9dd-3addaa99f6eb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:30.605937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-74f25c83-aa69-4d8a-a89e-129b40c4193a req-6927401b-0945-44c0-b9dd-3addaa99f6eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:30.608940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-74f25c83-aa69-4d8a-a89e-129b40c4193a req-6927401b-0945-44c0-b9dd-3addaa99f6eb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:30.657723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-74f25c83-aa69-4d8a-a89e-129b40c4193a req-6927401b-0945-44c0-b9dd-3addaa99f6eb service nova] Creating event network-changed:bb20be38-c4d7-484d-85ed-1c5abb628e57 for instance fe4556d3-2b56-4e23-b0a9-0dd123052772 on n-h2-master-1 Sep 25 01:26:30.697612 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-74f25c83-aa69-4d8a-a89e-129b40c4193a req-6927401b-0945-44c0-b9dd-3addaa99f6eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134266 Sep 25 01:26:30.700906 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2359/4717] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:30.748960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:30.749987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:30.761787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:30.762599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:30.763247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:30.764188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:30.766000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:30.766678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:31.833448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:31.855502 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b3e230c8-0965-48cb-916c-0c51deba2755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 1.368886 Sep 25 01:26:31.879261 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2359/4718] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:30 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:31.887609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:31.890612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:31.909156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:31.911176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:31.912790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:31.913617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:31.916281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:31.916943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:31.974432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:31.987875 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dcc634aa-cecc-4a6a-9888-e01cd7bfa21c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 1.243079 Sep 25 01:26:31.989086 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2360/4719] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:30 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:32.402490 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:32.444776 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:32.888084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:32.889018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:32.899880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:32.906918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:32.907654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:32.908594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:32.909237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:32.909881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:33.835039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:33.865258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:33.867792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:33.869000 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37e46704-2d7c-4110-be69-b08ecb26949d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 2.000906 Sep 25 01:26:33.869974 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2360/4720] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:31 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:33.873945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:33.884134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:33.884977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:33.889229 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84101aee-67f9-4433-a8cd-a4869f52e662 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 1.003472 Sep 25 01:26:33.892338 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2361/4721] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:32 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:33.903529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e3e4ef65-fe95-41db-b70e-24a73bd843ea req-3293aaf0-1336-40aa-8240-f37731500ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "5aa39579-ad32-4392-a851-b602c17f48a0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:33.914205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:33.914989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:33.915613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:33.916658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:33.918778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:33.921364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:33.932612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e3e4ef65-fe95-41db-b70e-24a73bd843ea req-3293aaf0-1336-40aa-8240-f37731500ff2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:33.933105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e3e4ef65-fe95-41db-b70e-24a73bd843ea req-3293aaf0-1336-40aa-8240-f37731500ff2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:33.933570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e3e4ef65-fe95-41db-b70e-24a73bd843ea req-3293aaf0-1336-40aa-8240-f37731500ff2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:33.973702 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e3e4ef65-fe95-41db-b70e-24a73bd843ea req-3293aaf0-1336-40aa-8240-f37731500ff2 service nova] Creating event network-changed:5aa39579-ad32-4392-a851-b602c17f48a0 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:26:33.989292 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e3e4ef65-fe95-41db-b70e-24a73bd843ea req-3293aaf0-1336-40aa-8240-f37731500ff2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095370 Sep 25 01:26:33.990521 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2362/4722] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:34.281580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:34.294734 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05f2fef7-ea30-4086-b73b-f8d37f858dee tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 0.423389 Sep 25 01:26:34.301268 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2361/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:33 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:34.903131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:34.904653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:34.916995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:34.918839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:34.929908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:34.930420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:34.933830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:34.934333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:34.934749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:34.936311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:34.937127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:34.938363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:34.938818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:34.941741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:34.942287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:34.942839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:35.714791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:35.726847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:35.754000 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d622d065-ea32-4671-8ee5-cf37284c18ba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.841539 Sep 25 01:26:35.759029 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2362/4724] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:34 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:35.777138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:35.781941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:35.788124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:35.788732 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b1b6a8f-1bbf-4017-8b69-464f5e5a1ceb tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.891049 Sep 25 01:26:35.789957 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2363/4725] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:34 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:35.790861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:35.798798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:35.799569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:35.800196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:35.801134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:35.801859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:35.802462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:36.028743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f00e9a3a-433d-42a6-8102-dcb662a9150d req-64b07200-eff7-4bf4-8f3a-4881d69d2459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07503bd-d487-460b-8d5f-368c97591164", "tag": "54de02a8-a9bc-4b97-a598-85b12ac5f73f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:36.047415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f00e9a3a-433d-42a6-8102-dcb662a9150d req-64b07200-eff7-4bf4-8f3a-4881d69d2459 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:36.048275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f00e9a3a-433d-42a6-8102-dcb662a9150d req-64b07200-eff7-4bf4-8f3a-4881d69d2459 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:36.049023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f00e9a3a-433d-42a6-8102-dcb662a9150d req-64b07200-eff7-4bf4-8f3a-4881d69d2459 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:36.063940 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:36.066981 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f00e9a3a-433d-42a6-8102-dcb662a9150d req-64b07200-eff7-4bf4-8f3a-4881d69d2459 service nova] Creating event network-changed:54de02a8-a9bc-4b97-a598-85b12ac5f73f for instance e07503bd-d487-460b-8d5f-368c97591164 on n-h1-master-1 Sep 25 01:26:36.077880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f00e9a3a-433d-42a6-8102-dcb662a9150d req-64b07200-eff7-4bf4-8f3a-4881d69d2459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052610 Sep 25 01:26:36.081388 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2364/4726] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:36.450604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:36.461077 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84683088-3c53-4dc1-8734-d106b30b65e1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 0.681771 Sep 25 01:26:36.464045 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2363/4727] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:35 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:36.789373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:36.790270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:36.803253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:36.804503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:36.805037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:36.808287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:36.809089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:36.809656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:36.819251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:36.820465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:36.827968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:36.828749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:36.829390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:36.830785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:36.832770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:36.833695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:37.572954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:37.583659 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-360a78fd-d265-4b59-871a-42b6b4aa21d6 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.800560 Sep 25 01:26:37.588423 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2365/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:36 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:37.597868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:37.598832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:37.626149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:37.628211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:37.628870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:37.636805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:37.637561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:37.638203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:37.687177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:37.705731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:37.707443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:37.708518 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0a12ee0-b725-4175-8ada-a028109f83fe tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.893247 Sep 25 01:26:37.710527 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2364/4729] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:36 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:38.038909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:38.052944 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d75a4a23-f55e-4fe3-b649-e4d5d3d591d2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 0.463161 Sep 25 01:26:38.054127 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2366/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:37 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:38.616757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:38.617371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:38.639009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:38.639515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:38.639959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:38.640695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:38.641148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:38.647845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:38.740156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:38.741387 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:38.755179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:38.755685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:38.756132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:38.757504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:38.757967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:38.761384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:39.575915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:39.591258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b06c6932-5514-4a53-a8ec-f572e44f12c1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.979011 Sep 25 01:26:39.592620 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2365/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:38 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:39.597419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:39.598433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:39.624184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:39.628179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:39.630543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:39.631880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:39.632577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:39.638998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:39.643602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:39.660565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:39.668300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:39.683351 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-775cde52-76d5-4c45-87b0-d768dc682a26 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.941911 Sep 25 01:26:39.700281 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2367/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:38 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:40.618142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:40.618775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:40.622144 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:40.628651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:40.635695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:40.636205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:40.636659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:40.637384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:40.637874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:40.638306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:40.646192 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81dc3d55-a203-4042-a433-5195716d71de tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 1.052180 Sep 25 01:26:40.650019 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2366/4733] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:39 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:40.718340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:40.719364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:40.738812 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:40.741833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:40.745080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:40.746187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:40.751087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:40.754811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:40.759304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:41.238143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:41.255589 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40f54bf5-2d7e-4d56-b784-0bf3dd86e11e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.641245 Sep 25 01:26:41.269494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2368/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:40 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:41.304956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:41.310368 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:41.336628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:41.338350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:41.348999 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-30a80c9b-5bda-4185-8672-8c45c07d97bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.636256 Sep 25 01:26:41.351832 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2367/4735] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:40 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:41.682143 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:41.687826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:41.703798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:41.704500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:41.705123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:41.706309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:41.707086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:41.707743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:41.903157 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-23ccae32-b284-4743-a02d-380b244d197e req-a2290821-543b-4f18-b2d8-cc2115fb6282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4556d3-2b56-4e23-b0a9-0dd123052772", "name": "network-vif-plugged", "status": "completed", "tag": "bb20be38-c4d7-484d-85ed-1c5abb628e57"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:41.943937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-23ccae32-b284-4743-a02d-380b244d197e req-a2290821-543b-4f18-b2d8-cc2115fb6282 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:41.944435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-23ccae32-b284-4743-a02d-380b244d197e req-a2290821-543b-4f18-b2d8-cc2115fb6282 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:41.944877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-23ccae32-b284-4743-a02d-380b244d197e req-a2290821-543b-4f18-b2d8-cc2115fb6282 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:41.989035 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-23ccae32-b284-4743-a02d-380b244d197e req-a2290821-543b-4f18-b2d8-cc2115fb6282 service nova] Creating event network-vif-plugged:bb20be38-c4d7-484d-85ed-1c5abb628e57 for instance fe4556d3-2b56-4e23-b0a9-0dd123052772 on n-h2-master-1 Sep 25 01:26:42.010085 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-23ccae32-b284-4743-a02d-380b244d197e req-a2290821-543b-4f18-b2d8-cc2115fb6282 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573965 Sep 25 01:26:42.018578 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2369/4736] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:42.292611 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:42.295440 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:42.309827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:42.323611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:42.324396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:42.325337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:42.326002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:42.328047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:42.573627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:42.583697 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4b90679-90d9-49eb-9ea8-91ef87e9a5eb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 0.907025 Sep 25 01:26:42.588720 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2368/4737] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:41 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:42.603051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:42.604367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:42.617654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:42.618428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:42.619089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:42.621222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:42.629827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:42.630785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:43.025085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:43.046416 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0662095d-6b62-4f50-8b1f-e2d10385427e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.762121 Sep 25 01:26:43.063479 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2370/4738] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:42 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:43.160368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:43.174751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:43.176245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:43.177482 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1e35e183-da28-490e-8c58-f30209a75147 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.587388 Sep 25 01:26:43.178689 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2369/4739] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:42 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:43.613922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:43.615184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:43.637772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:43.638838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:43.640820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:43.641872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:43.645945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:43.647264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:43.944372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:43.954596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c238f786-02e8-42df-9792-8284fda48061 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 0.344129 Sep 25 01:26:43.955574 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2371/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:43 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:44.027841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-cd363341-8058-4beb-96bf-22504be7c994 req-fa843af0-b39c-401e-8c1f-7803e7c65a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07503bd-d487-460b-8d5f-368c97591164", "name": "network-vif-plugged", "status": "completed", "tag": "54de02a8-a9bc-4b97-a598-85b12ac5f73f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:44.049365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cd363341-8058-4beb-96bf-22504be7c994 req-fa843af0-b39c-401e-8c1f-7803e7c65a21 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:44.050272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cd363341-8058-4beb-96bf-22504be7c994 req-fa843af0-b39c-401e-8c1f-7803e7c65a21 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:44.050575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cd363341-8058-4beb-96bf-22504be7c994 req-fa843af0-b39c-401e-8c1f-7803e7c65a21 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:44.079818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-cd363341-8058-4beb-96bf-22504be7c994 req-fa843af0-b39c-401e-8c1f-7803e7c65a21 service nova] Creating event network-vif-plugged:54de02a8-a9bc-4b97-a598-85b12ac5f73f for instance e07503bd-d487-460b-8d5f-368c97591164 on n-h1-master-1 Sep 25 01:26:44.090766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:44.091521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:44.103630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:44.105644 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-cd363341-8058-4beb-96bf-22504be7c994 req-fa843af0-b39c-401e-8c1f-7803e7c65a21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081503 Sep 25 01:26:44.110276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:44.110899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:44.112453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:44.112880 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2370/4741] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:26:44.113480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:44.114207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:44.206229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:44.207025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:44.229342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:44.234597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:44.235058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:44.236004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:44.241635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:44.242265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:45.156213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:45.171040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9927d2d-cbda-44aa-9775-991dba503d7a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 1.084646 Sep 25 01:26:45.174328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2372/4742] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:44 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:45.181586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:45.184510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:45.199381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:45.200298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:45.205001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:45.206251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:45.206899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:45.207509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:45.232804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:45.250469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:45.252296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:45.259952 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5599b8cb-59e1-40fe-8638-4ae2f12cc360 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.058019 Sep 25 01:26:45.261140 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2371/4743] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:44 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:45.874223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:45.892108 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9912eebd-7d39-4b75-bbb5-7aa6cfec4fad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1321 microversion: 2.1 time: 0.716439 Sep 25 01:26:45.905786 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2373/4744] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:45 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:46.211885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:46.212529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:46.236706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:46.237476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:46.240269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:46.241437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:46.242165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:46.242780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:46.289486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:46.290742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:46.302740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:46.303500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:46.304141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:46.311787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:46.316344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:46.317009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:46.878229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:46.903465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6bad3397-def3-4be2-aeaf-d99696e99f9d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.705139 Sep 25 01:26:46.906314 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2372/4745] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:46 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:46.928057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:46.929226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:46.938743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:46.942465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:46.944578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:46.945984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:46.947885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:46.950044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:46.958831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:46.977528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:46.979287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:46.980790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bdd7081d-29c1-433b-98cf-43fb5a075df6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.695284 Sep 25 01:26:46.983872 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2374/4746] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:46 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:47.167427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:47.186379 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51f2c3cc-d982-46f9-a874-fc2e690fd0d6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1515 microversion: 2.1 time: 0.262711 Sep 25 01:26:47.187746 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2373/4747] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:46 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:47.218435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:47.220954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:47.234911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:47.235616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:47.236329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:47.237268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:47.237965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:47.250132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:47.287851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lazy-loading 'flavor' on Instance uuid e07503bd-d487-460b-8d5f-368c97591164 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:26:47.543792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad3a97b1-5384-4315-ab17-3a81c3a53662 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action" status: 200 len: 32 microversion: 2.1 time: 0.305653 Sep 25 01:26:47.554663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:47.556233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:47.558645 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2375/4748] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:26:47 2022] POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:26:47.573198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:47.577349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:47.578407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:47.581051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:47.583100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:47.583891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:47.956044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:47.958109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:47.998653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:48.010478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:48.014267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:48.022416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:48.026647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:48.027293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:48.437074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:48.448609 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-74270113-21f0-41cd-9ecf-e0140c327fbd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.898484 Sep 25 01:26:48.450702 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2374/4749] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:47 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:48.456175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:48.456805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:48.473790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:48.487426 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73ba9b06-4887-40d3-afb3-07425134d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.544624 Sep 25 01:26:48.495275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:48.495506 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2376/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:47 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:48.496374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:48.504147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:48.504949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:48.505446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:48.505886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:49.371446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:49.387664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:49.389676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:49.391753 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-203aa477-6543-46ec-8468-859e3228bd52 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.938831 Sep 25 01:26:49.395488 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2375/4751] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:48 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:49.487049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:49.488289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:49.500899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:49.501681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:49.502202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:49.503654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:49.504059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:49.505015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:49.521110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:49.522336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:49.532148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:49.532680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:49.534043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:49.535148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:49.536145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:49.538126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:49.950456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:49.962284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eb5fd4f3-24f2-4202-b63f-2a1e64f03634 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.481909 Sep 25 01:26:49.963128 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2377/4752] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:49 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:49.967984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:49.980260 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-32730c77-f936-4667-8bb0-0ba5252b93df tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1504 microversion: 2.1 time: 0.463918 Sep 25 01:26:49.994268 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2376/4753] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:49 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:50.420989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:50.421648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:50.428582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:50.429829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:50.430672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:50.431623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:50.432297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:50.433195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:50.812429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:50.828746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:50.834997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:50.842376 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a06635cb-2f41-493a-bd9e-d48099f1b58d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.421270 Sep 25 01:26:50.844610 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2378/4754] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:50 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:50.987378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:50.988076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:51.000684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:51.002398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:51.004373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:51.005031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:51.005323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:51.006820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:51.008866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:51.012664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:51.016034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:51.016555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:51.019013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:51.023877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:51.024915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:51.026866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:51.531356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:51.541111 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0a94db7-035e-4a0a-9403-b36ece19cd18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.557923 Sep 25 01:26:51.542062 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2377/4755] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:50 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:51.576613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:51.585755 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-26495af5-683b-4d1e-a0d3-3d21c98d4d24 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1504 microversion: 2.1 time: 0.586647 Sep 25 01:26:51.601802 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2379/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:50 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:51.878436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:51.880016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:51.907150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:51.907527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:51.907970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:51.908688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:51.909532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:51.910273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:52.298568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:52.316703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:52.320562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:52.321820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2b100525-5a29-482d-b96c-f19a57c60e5d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.449297 Sep 25 01:26:52.324094 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2378/4757] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:51 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:52.565281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:52.565938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:52.576986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:52.582336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:52.583047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:52.584195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:52.585036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:52.585702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:52.591489 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:52.609925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:52.610764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:52.630468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:52.631414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:52.633882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:52.634647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:52.635117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:52.635546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:52.999960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.014664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aea34639-4173-4e98-8b2b-7bea98dc47d1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.454353 Sep 25 01:26:53.030180 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2380/4758] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:52 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:53.061692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.078041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9b3248f-9c67-4446-8db6-aa631c4b45d2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 200 len: 1507 microversion: 2.1 time: 0.469818 Sep 25 01:26:53.095819 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2379/4759] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:52 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:53.106820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:53.107631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:53.116552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.117364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.118161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.119309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.119873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.120414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.336589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.349234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:53.350646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:53.356355 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b851375d-8169-4935-be1e-4e1721cef6ef tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.254492 Sep 25 01:26:53.356938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2381/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:53 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:53.380557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.381462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.382069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.382995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.383621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.390808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.396975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:53.397880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:53.404624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.405454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.406069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.407008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.407644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.408247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.756807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.768348 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c693f32-0645-45ea-82dd-e18a8051bbf2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.373197 Sep 25 01:26:53.769209 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2382/4761] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:53 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:53.774144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.777695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b2f06fe1-2f71-4190-904f-006c0951692c req-2949ef7a-4b52-4560-af60-611901ecc9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9e6231-840e-467e-bb2d-4273269b15e4", "name": "network-vif-unplugged", "status": "completed", "tag": "89eb1cdd-a4ac-4b66-bf6f-c750ce03c162"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:53.786634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.789865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:53.791635 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10fc53e6-d16b-4839-9b2e-4fef83c39767 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.446841 Sep 25 01:26:53.792524 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2380/4762] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:53 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:26:53.796523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b2f06fe1-2f71-4190-904f-006c0951692c req-2949ef7a-4b52-4560-af60-611901ecc9ed service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.797009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b2f06fe1-2f71-4190-904f-006c0951692c req-2949ef7a-4b52-4560-af60-611901ecc9ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.797660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b2f06fe1-2f71-4190-904f-006c0951692c req-2949ef7a-4b52-4560-af60-611901ecc9ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.798221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:53.798919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:53.805631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.806266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.806930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.807962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:53.808796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:53.809785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:53.824371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.server_external_events [req-b2f06fe1-2f71-4190-904f-006c0951692c req-2949ef7a-4b52-4560-af60-611901ecc9ed service nova] Unable to find a host for instance 4c9e6231-840e-467e-bb2d-4273269b15e4. Dropping event network-vif-unplugged {{(pid=122385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 01:26:53.825579 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b2f06fe1-2f71-4190-904f-006c0951692c req-2949ef7a-4b52-4560-af60-611901ecc9ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055153 Sep 25 01:26:53.826908 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2383/4763] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 01:26:54.002569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:54.016113 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d447b1bc-6ab2-472b-b785-d23711a38ed1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.222169 Sep 25 01:26:54.017627 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2381/4764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:53 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:54.040219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:54.041054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:54.046322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:54.047264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:54.059193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.062666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.062988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.064895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.065471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.066119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.067664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.067808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.068184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.070393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.071468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.072422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.394502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:54.419529 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fc3f3d18-6b44-4ced-8952-5d137767fd0b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.368462 Sep 25 01:26:54.425233 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2382/4765] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:54 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:54.476383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:54.491498 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7248b2ee-9db7-4b83-9ee9-04f0250270d4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.452196 Sep 25 01:26:54.492559 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2384/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:54 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:54.517860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a25ada2-7940-4ceb-831b-7182cb2dfca2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:26:54.528399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a25ada2-7940-4ceb-831b-7182cb2dfca2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.532517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a25ada2-7940-4ceb-831b-7182cb2dfca2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.533346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a25ada2-7940-4ceb-831b-7182cb2dfca2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.584632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a25ada2-7940-4ceb-831b-7182cb2dfca2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Going to try to stop instance {{(pid=122384) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:26:54.662033 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a25ada2-7940-4ceb-831b-7182cb2dfca2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.149213 Sep 25 01:26:54.666991 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2383/4767] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:26:54 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:26:54.676777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:54.680189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:54.700049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.702005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.702643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.703576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.705500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.706259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.838523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:54.840685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:54.856388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.857911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.858906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.861694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:54.864303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:54.864983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:54.926915 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:26:54.931188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:54.940526 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9bc1c9b1-1ad1-4a0b-95cf-d9b53b60666f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.271964 Sep 25 01:26:54.941136 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2385/4768] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:54 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:55.190001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:55.201703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:55.203548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:55.204932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-65033bff-9608-4e98-a5d8-9cacb2e63ece tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.384405 Sep 25 01:26:55.205985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2384/4769] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:54 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:55.449519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:55.450454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:55.481742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:55.482260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:55.487889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:55.489881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:55.491101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:55.493364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:55.906824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:55.926839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfcf293a-b03a-46be-968a-ad21cdc76cb4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.483389 Sep 25 01:26:55.927553 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2386/4770] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:55 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:55.979348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:55.979973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:55.988366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:55.989304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:55.989964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:55.990732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:55.991192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:55.991617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:56.233251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:56.235073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:56.245292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:56.245907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:56.246360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:56.247082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:56.247560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:56.247978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:56.298911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:56.309899 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b8b7682e-4b9e-4f8e-b15e-538dd683e85d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.342120 Sep 25 01:26:56.311086 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2385/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:55 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:56.590067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:56.619567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:56.622480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:56.624129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-59d7f5fc-76bb-4549-9c11-dd09bd02de65 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.395903 Sep 25 01:26:56.639274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2387/4772] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:56 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:56.978263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:56.984315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:57.008742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:57.011286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:57.015960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:57.018366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:57.022170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:57.024897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:57.337056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:57.337731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:57.347745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:57.348243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:57.348690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:57.349472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:57.350642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:57.351329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:57.793444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:57.810166 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8be018af-8555-46bf-a0c5-5e566cb596f8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.845569 Sep 25 01:26:57.826541 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2386/4773] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:56 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:57.836970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:57.837879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:57.845985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:57.853272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:57.854063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:57.855723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:57.856176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:57.856590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:57.923848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:57.955363 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbcafa20-dac6-4096-a76a-b278b102f762 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.606273 Sep 25 01:26:57.958338 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2388/4774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:57 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:58.231623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:58.244371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:58.247093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:58.248979 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-031b2d61-8770-4bf8-92db-6ff73a4034bf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.421051 Sep 25 01:26:58.249881 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2387/4775] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:57 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:26:58.844690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:58.846787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:58.874133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:58.875051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:58.875724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:58.876982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:58.877684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:58.878693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:58.981620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:58.982628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:58.990950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:58.991982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:58.993167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:58.998011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:58.998491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:58.998929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:59.222743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:59.233971 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fdf85f23-a8d6-468e-bc44-44c13cd10d12 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.397315 Sep 25 01:26:59.234824 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2389/4776] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:58 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:26:59.260162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:59.269147 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-580f7f44-32e8-4e12-bc74-01ceab6f21ff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.292195 Sep 25 01:26:59.280504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:26:59.281258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:26:59.285887 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2388/4777] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:26:58 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:26:59.293783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:59.294281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:59.294722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:59.295807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:26:59.296266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:26:59.296969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:26:59.548102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:59.567186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:59.569239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:26:59.570709 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31707334-5d40-4d15-8c68-ecd8f2e46069 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.295564 Sep 25 01:26:59.586930 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2390/4778] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:26:59 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:00.260673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:00.261349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:00.269062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:00.269812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:00.270921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:00.271991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:00.273599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:00.274842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:00.293688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:00.294927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:00.307947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:00.310134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:00.311912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:00.314827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:00.315757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:00.317651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:00.762638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:00.780630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:00.788048 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-044bfb08-f273-4750-a804-5d5d1704068f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.531630 Sep 25 01:27:00.799312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1cde9f36-a4a6-4561-87f2-110e92087b5b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.510788 Sep 25 01:27:00.799909 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2391/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:00 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:00.804113 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2389/4780] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:00 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:00.813745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:00.814745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:00.822141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:00.822863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:00.824305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:00.825437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:00.825901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:00.826517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:01.092197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:01.108909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:01.110896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:01.113886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d20392d-d3f5-41d2-906c-c15febb0e17f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.308589 Sep 25 01:27:01.116040 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2390/4781] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:00 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:01.817986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:01.817986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:01.824014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:01.824643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:01.830486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:01.832133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:01.833482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:01.837051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:01.838093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:01.838454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:01.838999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:01.839389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:01.840112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:01.840486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:01.840627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:01.840993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:02.264193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:02.274013 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-edabc401-b1ef-430a-9a64-ec73e76bc416 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.460783 Sep 25 01:27:02.274161 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2392/4782] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:01 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:02.292429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:02.293067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:02.317911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:02.318702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:02.319163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:02.319880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:02.320341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:02.320769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:02.362934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:02.372359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95e214ca-e4b4-4374-808e-f2d293e1b509 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.552877 Sep 25 01:27:02.374754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2391/4783] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:01 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:02.699064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:02.713431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:02.715126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:02.716604 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a75eaec-e751-49a7-abe7-5aa3d75a5559 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.441569 Sep 25 01:27:02.730095 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2393/4784] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:02 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:03.296465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:03.297267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:03.325233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:03.325762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:03.326972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:03.330649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:03.331161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:03.333881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:03.398677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:03.399973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:03.415560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:03.416286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:03.417210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:03.418373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:03.419723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:03.420338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:03.777266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:03.790068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-603ca735-d7fc-4654-ba1d-1f441d11c395 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.497705 Sep 25 01:27:03.792410 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2392/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:03 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:03.817606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:03.819778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:03.830505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:03.843519 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9b5c7d3e-3ac1-4ea4-9a3b-b6411cde07ae tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.450197 Sep 25 01:27:03.844167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:03.846538 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2394/4786] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:03 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:03.847066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:03.847657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:03.850682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:03.851238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:03.851719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:04.815435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:04.817305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:04.834989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:04.836190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:04.837267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:04.845014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:04.845776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:04.846453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:05.003416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:05.068982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:05.089527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:05.101546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64e5b7c2-ada7-4a23-9b7a-991db2ac08cf tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.304482 Sep 25 01:27:05.107880 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2393/4787] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:03 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:05.144021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:05.146961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:05.179302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:05.183709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:05.187051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:05.191519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:05.196439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:05.200458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:05.505375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:05.526551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6bd417a1-4ebc-4794-a189-389ca90b7951 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.714105 Sep 25 01:27:05.547093 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2395/4788] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:04 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:05.567761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:05.577359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b97be929-0020-424b-8ad6-20dbc01fe378 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1678 microversion: 2.1 time: 0.459592 Sep 25 01:27:05.580897 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2394/4789] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:05 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1678 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:06.167179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:06.167951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:06.187726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:06.189160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:06.190869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:06.192194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:06.197072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:06.199151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:06.553321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:06.553993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:06.567278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:06.570101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:06.570774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:06.574279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:06.574941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:06.577152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:06.920248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:06.941614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:06.944117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:06.950446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-199efa8a-e982-4b4f-ae61-d0bb8281414d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.812817 Sep 25 01:27:06.953858 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2396/4790] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:06 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:06.977379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:06.978404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:06.994852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:06.997253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:06.998064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:06.999768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:07.001074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:07.004200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:07.026380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:07.044099 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:07.049830 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1afc8560-64d0-4ae2-9229-f6b33480e903 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.500912 Sep 25 01:27:07.062651 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2395/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:06 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:07.195984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:07.205655 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-adbdb133-8280-46e2-b4cd-c0809953beff tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1655 microversion: 2.1 time: 0.241752 Sep 25 01:27:07.206515 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2397/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:06 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1655 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:07.229325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3c71984-1e93-434b-b171-1a447c3d8c4c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:07.236566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3c71984-1e93-434b-b171-1a447c3d8c4c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:07.237385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3c71984-1e93-434b-b171-1a447c3d8c4c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:07.238295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3c71984-1e93-434b-b171-1a447c3d8c4c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:07.266541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3c71984-1e93-434b-b171-1a447c3d8c4c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Going to try to start instance {{(pid=122384) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:27:07.325452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3c71984-1e93-434b-b171-1a447c3d8c4c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.100116 Sep 25 01:27:07.327723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2396/4793] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:07 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:07.339764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:07.341155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:07.371711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:07.374682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:07.379735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:07.379735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:07.385421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:07.388357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:07.750623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:07.779261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d2d989b-0f6a-4c2a-9b5f-e8c773d51b65 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1664 microversion: 2.1 time: 0.445703 Sep 25 01:27:07.785599 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2398/4794] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:07 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1664 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:07.976434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:07.978414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:07.992623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:07.993460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:07.994069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:07.994957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:07.995577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:07.998416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:08.078363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:08.080198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:08.099409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:08.101220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:08.102069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:08.103156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:08.103831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:08.105031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:08.631217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:08.644189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:08.650270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:08.651666 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-90f608fc-614b-448f-a7b1-66e3aaaad542 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.680485 Sep 25 01:27:08.666568 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2397/4795] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:07 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:08.703462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:08.713214 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8deb4260-7ee0-4658-b8f5-471b2119b8ef tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.642413 Sep 25 01:27:08.720198 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2399/4796] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:08 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:08.809442 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:08.810211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:08.820483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:08.830399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:08.831221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:08.833116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:08.839518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:08.840340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:09.290057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:09.317375 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a0ccf31-6013-4717-a3dd-ec6f55a3c66a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1664 microversion: 2.1 time: 0.497768 Sep 25 01:27:09.317375 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2398/4797] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:08 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1664 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:09.685878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:09.686844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:09.698944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:09.700364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:09.701018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:09.706973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:09.713065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:09.719478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:09.750571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:09.751192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:09.781068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:09.782953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:09.785497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:09.786256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:09.789042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:09.791397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:10.931438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:10.961028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:10.962743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:10.963976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7aad9ebe-f478-48d6-9a2f-a8540e50a5e1 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.283469 Sep 25 01:27:10.964546 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2400/4798] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:09 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:10.974722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:10.975528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:10.980931 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=66 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:10.982382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:10.982872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:10.983393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:10.984280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:10.984732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:10.985326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:11.065980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:11.070919 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:11.085730 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fff4f8f0-96bb-491e-87b7-76202c08e844 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 1.337940 Sep 25 01:27:11.086740 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2399/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:09 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:11.361512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:11.370231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-28c2cc9d-9e69-4e42-bb76-81f0895600b2 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.404658 Sep 25 01:27:11.370831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2401/4800] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:10 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:11.402951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:11.404286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:11.410420 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=66 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:11.423190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:11.424006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:11.424755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:11.425752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:11.426557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:11.427269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:11.764090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:11.780439 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-789f12fe-d63c-4f7a-abdb-ed2448ff188b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.379425 Sep 25 01:27:11.782683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2400/4801] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:11 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:11.815479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:11.818644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:11.827526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:11.828226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:11.828839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:11.830112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:11.830748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:11.831410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.001665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:12.003854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:12.020741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:12.021684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:12.024080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.025383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:12.031783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:12.032852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.463443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:12.486972 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d02155a-7c50-4b81-8fa1-efc99784aa03 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.676504 Sep 25 01:27:12.512731 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2402/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:11 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:12.528346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:12.529162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:12.541723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:12.542462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:12.543114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.548943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:12.549897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:12.550553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.562698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:12.577150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:12.578736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:12.580155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-478a022e-0e8c-4704-854b-6a4cb894e500 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.591824 Sep 25 01:27:12.582815 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2401/4803] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:11 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:12.588886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:12.591320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:12.598581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:12.599946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:12.600599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.605212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:12.608756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:12.611038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:12.928269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:12.942313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-265915d8-1a40-411e-a7a5-5190539ba82e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.427696 Sep 25 01:27:12.943502 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2403/4804] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:12 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:13.002819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:13.017705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1c35f55a-bfb3-4f03-8f1e-82c0d2c88c19 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.433498 Sep 25 01:27:13.021214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2402/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:12 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:13.045452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:13.046417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:13.053908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.054753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.055478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.056612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.058038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.058806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.325520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:13.339474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b80e2426-9528-49b9-8e24-becae1566602 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.299476 Sep 25 01:27:13.358788 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2404/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:13 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:13.370086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:13.370706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:13.401445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.406329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.407041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.408907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.409610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.411253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.468234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lazy-loading 'flavor' on Instance uuid 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:27:13.609747 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c99edfc8-869e-4209-9aff-a28aae862a3d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.243059 Sep 25 01:27:13.612431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:13.612897 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2403/4807] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:13 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:13.613864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:13.622783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.625913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.626636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.627560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.630925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.631171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:13.634537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.636886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:13.655656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.656695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.658173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:13.659185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:13.661088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:13.661681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:14.160855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:14.190153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:14.193464 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:14.195595 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a887b0a-3b5a-4a93-8acf-61d3e6c4fa4d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.587221 Sep 25 01:27:14.202978 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2405/4808] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:13 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:27:14.205052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:14.216581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:14.222516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:14.222655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d447ed77-6b23-4ed1-adb0-7098f005d43f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1676 microversion: 2.1 time: 0.602219 Sep 25 01:27:14.229108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:14.229320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2404/4809] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:13 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1676 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:14.230088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:14.230564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:14.231174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:14.231816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:14.232251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:14.457555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:14.468073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b679f649-04c7-4169-8a96-1b2d732f7812 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.263921 Sep 25 01:27:14.477928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2406/4810] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:14 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:15.229593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:15.231225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:15.254477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.256519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:15.257331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:15.258090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.258641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.259513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.262070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.262636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.272547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.275425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.279338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.280416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.281096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.281750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.769752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:15.786373 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-372722e5-11bb-484e-9eaf-5c7a9c836595 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1659 microversion: 2.1 time: 0.536170 Sep 25 01:27:15.787705 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2407/4811] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:15 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1659 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:15.797051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:15.798848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:15.799481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:15.813437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:15.815148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:15.816528 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9bddf1e-6305-452b-b658-b69295b5602f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.591593 Sep 25 01:27:15.817611 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2405/4812] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:15 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:15.822192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.822698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.823152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.823895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.824355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.824786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.826092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:15.826793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:15.835882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.836553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.837164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.838082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:15.847338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:15.848089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:15.979812 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bad52880-596c-406c-b4ab-63e8f1c97a0f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action" status: 202 len: 0 microversion: 2.1 time: 0.159746 Sep 25 01:27:15.980733 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2406/4813] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:15 2022] POST /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:15.993366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:15.995179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:16.016881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:16.020156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:16.020962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:16.022883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:16.023868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:16.024754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:16.526247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:16.534791 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f994735-beb1-4f30-a685-9e031c2e7ea3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 0.745869 Sep 25 01:27:16.545784 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2408/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:15 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:16.617824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:16.637628 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f82a1644-fba7-498d-b577-0509f757ecdc tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1665 microversion: 2.1 time: 0.651708 Sep 25 01:27:16.638241 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2407/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:15 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1665 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:16.850832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:16.851461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:16.876839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:16.877612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:16.878511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:16.882378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:16.883129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:16.883795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:17.565131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:17.566085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:17.584358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:17.593358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:17.594263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:17.598423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:17.599703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:17.602932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:17.669711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:17.690562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:17.694613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:17.696037 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b3f7b671-5e62-4a7f-be34-d64041aa8696 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.850236 Sep 25 01:27:17.710274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2409/4816] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:16 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:17.725182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:17.726038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:17.733847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:17.734868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:17.735593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:17.736925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:17.737935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:17.738518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:18.485495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:18.494340 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6285605d-2cde-4b58-8376-0ec3eb00f2f0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1665 microversion: 2.1 time: 0.782562 Sep 25 01:27:18.500900 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2410/4817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:17 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1665 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:18.674726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:18.698630 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd34b7d6-dcee-41a3-b83b-084b0089ad0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1521 microversion: 2.1 time: 1.136410 Sep 25 01:27:18.732354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:18.733218 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2408/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:17 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1521 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:18.734005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:18.755744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:18.763138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:18.765507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:18.770403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:18.771136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:18.771693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:18.878417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-592ef39e-8b0f-4390-af61-d35c7fe89a5e req-e19f27cb-d98e-4c6d-8d0d-115f8c3a0ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "5aa39579-ad32-4392-a851-b602c17f48a0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:18.934154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-592ef39e-8b0f-4390-af61-d35c7fe89a5e req-e19f27cb-d98e-4c6d-8d0d-115f8c3a0ae3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:18.935922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-592ef39e-8b0f-4390-af61-d35c7fe89a5e req-e19f27cb-d98e-4c6d-8d0d-115f8c3a0ae3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:18.937053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-592ef39e-8b0f-4390-af61-d35c7fe89a5e req-e19f27cb-d98e-4c6d-8d0d-115f8c3a0ae3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:18.982202 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-592ef39e-8b0f-4390-af61-d35c7fe89a5e req-e19f27cb-d98e-4c6d-8d0d-115f8c3a0ae3 service nova] Creating event network-vif-plugged:5aa39579-ad32-4392-a851-b602c17f48a0 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:19.010210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-592ef39e-8b0f-4390-af61-d35c7fe89a5e req-e19f27cb-d98e-4c6d-8d0d-115f8c3a0ae3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140183 Sep 25 01:27:19.012374 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2409/4819] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:27:19.471995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:19.487854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:19.491884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:19.497456 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d207775c-1b5f-4389-bc82-220c987d292e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.768264 Sep 25 01:27:19.498110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2411/4820] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:18 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:19.525306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:19.526491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:19.539433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:19.540415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:19.541087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:19.542785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:19.543971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:19.544682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:19.739945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:19.740612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:19.751269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:19.752985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:19.754225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:19.755784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:19.757545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:19.758312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:20.378570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:20.388011 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62920d65-29f6-4549-aa5d-43902a0b5481 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1501 microversion: 2.1 time: 0.652934 Sep 25 01:27:20.392759 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2412/4821] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:19 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1501 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:20.446093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:20.447770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:20.451603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:20.468840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f5773ed1-c8b6-4462-80e8-78cfa307ebb9 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.949488 Sep 25 01:27:20.478294 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2410/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:19 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:20.480322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:20.481089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:20.481816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:20.482975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:20.483680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:20.486105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:20.509545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:20.510564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:20.516907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:20.517760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:20.518445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:20.519450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:20.520158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:20.520866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:20.990637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:21.003526 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8a041f4d-6ce5-4bd5-aaae-bf14010f7332 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1516 microversion: 2.1 time: 0.579042 Sep 25 01:27:21.007457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2413/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:20 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1516 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:21.017594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:21.018642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:21.038665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:21.048223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.049001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.050220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a6f2d5e7-f96f-48a6-8ba2-0f1a5c36cb32 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1668 microversion: 2.1 time: 0.545206 Sep 25 01:27:21.051360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.063859 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2411/4824] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:20 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1668 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:21.065120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.067195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.068041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.094765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-716d84b9-8edb-4f4a-8d77-8e926cbd7aa0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:21.097836 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:21.102140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-716d84b9-8edb-4f4a-8d77-8e926cbd7aa0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: 21c082a9-d195-4a78-b941-1ea4273fe775] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:21.135216 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-716d84b9-8edb-4f4a-8d77-8e926cbd7aa0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Instance 21c082a9-d195-4a78-b941-1ea4273fe775 could not be found. Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-716d84b9-8edb-4f4a-8d77-8e926cbd7aa0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/21c082a9-d195-4a78-b941-1ea4273fe775/action HTTP/1.1 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 14 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: {"rescue": {}} Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 21c082a9-d195-4a78-b941-1ea4273fe775 could not be found. Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '21c082a9-d195-4a78-b941-1ea4273fe775', 'body': {'rescue': {}}} Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c082a9-d195-4a78-b941-1ea4273fe775 could not be found. Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c082a9-d195-4a78-b941-1ea4273fe775 could not be found. Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:21.149702 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:21.154761 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:21.154761 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:21.154761 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:21.154761 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:21.154761 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c082a9-d195-4a78-b941-1ea4273fe775 could not be found. Sep 25 01:27:21.154761 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:21.158825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-716d84b9-8edb-4f4a-8d77-8e926cbd7aa0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 404 to user: Instance 21c082a9-d195-4a78-b941-1ea4273fe775 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:21.160568 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-716d84b9-8edb-4f4a-8d77-8e926cbd7aa0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/21c082a9-d195-4a78-b941-1ea4273fe775/action" status: 404 len: 111 microversion: 2.1 time: 0.094519 Sep 25 01:27:21.166768 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2412/4825] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:21 2022] POST /compute/v2.1/servers/21c082a9-d195-4a78-b941-1ea4273fe775/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:21.180792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d7dc8d93-be9d-45f8-9487-75c54bbe4406 req-08e8e7ce-9dad-43f4-b327-f3890dcf921e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "743ce183-c7c8-48a8-9f40-a771e107b1af"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:21.235669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d7dc8d93-be9d-45f8-9487-75c54bbe4406 req-08e8e7ce-9dad-43f4-b327-f3890dcf921e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.238415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d7dc8d93-be9d-45f8-9487-75c54bbe4406 req-08e8e7ce-9dad-43f4-b327-f3890dcf921e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.245997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d7dc8d93-be9d-45f8-9487-75c54bbe4406 req-08e8e7ce-9dad-43f4-b327-f3890dcf921e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.275917 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d7dc8d93-be9d-45f8-9487-75c54bbe4406 req-08e8e7ce-9dad-43f4-b327-f3890dcf921e service nova] Creating event network-vif-plugged:743ce183-c7c8-48a8-9f40-a771e107b1af for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:21.288106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d7dc8d93-be9d-45f8-9487-75c54bbe4406 req-08e8e7ce-9dad-43f4-b327-f3890dcf921e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117666 Sep 25 01:27:21.289209 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2413/4826] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:21.295451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:21.296391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:21.303611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.304423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.305119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.306298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.306999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.307665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.357147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:27:21.364881 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Working on deleting snapshot f75561d2-a0cd-4fb0-9026-edc5a36a3a91 from shelved instance... Sep 25 01:27:21.562998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:21.580716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:21.585278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:21.590175 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61f3e8fd-42e7-4c55-9d8b-d08e4ead849c tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.579783 Sep 25 01:27:21.604427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2414/4827] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:21 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:21.626801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:21.627358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:21.644059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.646479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.647344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.648620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.651192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.654572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.819046 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a49cd295-f3bc-4b7b-aebc-f3417f909847 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action" status: 202 len: 0 microversion: 2.1 time: 0.212908 Sep 25 01:27:21.826425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2415/4828] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:21 2022] POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:21.842283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:21.846534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:21.861843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.862898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.864254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:21.865895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:21.868512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:21.869154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:22.210314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:22.228398 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5eab6d8-03d0-4498-84ce-1b3f837c4187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1521 microversion: 2.1 time: 0.399779 Sep 25 01:27:22.235439 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2416/4829] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:21 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:22.638291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:22.638836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:22.665697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:22.667489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:22.670409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:22.671194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:22.673835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:22.675085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:22.798256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Doing local delete in cell 565278a3-bcc6-4580-bd99-37100e140af1(cell1) {{(pid=122384) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 25 01:27:22.800162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:22.803769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:22.808351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:22.809029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 25 01:27:22.817117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] deallocate_for_instance() {{(pid=122384) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 25 01:27:23.790370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:23.806184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:23.810256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:23.813826 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67f63381-3ca3-4b4c-bac2-b898fa2a489f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.184443 Sep 25 01:27:23.818862 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2417/4830] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:22 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:23.843480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:23.845350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:23.865365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:23.867245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:23.868455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:23.871108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:23.872134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:23.872894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:24.259420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:24.279672 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8b9597d5-c7f5-409a-9e26-56502d7e02fc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1501 microversion: 2.1 time: 0.455270 Sep 25 01:27:24.287582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2418/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:23 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1501 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:24.304913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-48c29168-ca57-4ee4-8b54-738de6ca7b90 req-106c537b-ce96-40a2-9fb2-358693146e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "fde1c7f4-0458-4853-a17f-067df54210fd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:24.341088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-48c29168-ca57-4ee4-8b54-738de6ca7b90 req-106c537b-ce96-40a2-9fb2-358693146e42 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:24.343024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-48c29168-ca57-4ee4-8b54-738de6ca7b90 req-106c537b-ce96-40a2-9fb2-358693146e42 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:24.345361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-48c29168-ca57-4ee4-8b54-738de6ca7b90 req-106c537b-ce96-40a2-9fb2-358693146e42 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:24.387234 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-48c29168-ca57-4ee4-8b54-738de6ca7b90 req-106c537b-ce96-40a2-9fb2-358693146e42 service nova] Creating event network-vif-plugged:fde1c7f4-0458-4853-a17f-067df54210fd for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:24.405150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-48c29168-ca57-4ee4-8b54-738de6ca7b90 req-106c537b-ce96-40a2-9fb2-358693146e42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113691 Sep 25 01:27:24.406262 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2419/4832] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:24.424247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:24.432349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:24.465767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:24.470021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:24.470877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:24.471909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:24.473145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:24.474117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:24.526057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lazy-loading 'flavor' on Instance uuid fe4556d3-2b56-4e23-b0a9-0dd123052772 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:27:24.584221 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Cannot 'rescue' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state paused Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action HTTP/1.1 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 14 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: {"rescue": {}} Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'rescue' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state paused Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'fe4556d3-2b56-4e23-b0a9-0dd123052772', 'body': {'rescue': {}}} Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 in vm_state paused. Cannot rescue while the instance is in this state. Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state paused Sep 25 01:27:24.589640 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state paused Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:24.596815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 409 to user: Cannot 'rescue' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state paused {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:24.599301 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1d5b316c-24cc-47c1-a9db-65b68615d4f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action" status: 409 len: 144 microversion: 2.1 time: 0.187506 Sep 25 01:27:24.601420 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2420/4833] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:24 2022] POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action => generated 144 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:27:24.611682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:24.617548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:24.631537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:24.632059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:24.632508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:24.633228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:24.637156 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:24.638592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:24.639406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:24.644645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Updating instance_info_cache with network_info: [] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:27:24.880486 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a600404-3a9c-406e-b771-ab23d741985b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action" status: 202 len: 0 microversion: 2.1 time: 0.273162 Sep 25 01:27:24.885723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2421/4834] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:24 2022] POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:24.894648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f7f816e4-42fe-4f74-99a0-90445865f986 req-cebf4cbf-b155-44e7-bdaf-ce4c8b1162ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9e6231-840e-467e-bb2d-4273269b15e4", "name": "network-vif-deleted", "tag": "89eb1cdd-a4ac-4b66-bf6f-c750ce03c162"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:24.955803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f7f816e4-42fe-4f74-99a0-90445865f986 req-cebf4cbf-b155-44e7-bdaf-ce4c8b1162ac service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:24.959877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f7f816e4-42fe-4f74-99a0-90445865f986 req-cebf4cbf-b155-44e7-bdaf-ce4c8b1162ac service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:24.960346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f7f816e4-42fe-4f74-99a0-90445865f986 req-cebf4cbf-b155-44e7-bdaf-ce4c8b1162ac service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:25.015724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.server_external_events [req-f7f816e4-42fe-4f74-99a0-90445865f986 req-cebf4cbf-b155-44e7-bdaf-ce4c8b1162ac service nova] Unable to find a host for instance 4c9e6231-840e-467e-bb2d-4273269b15e4. Dropping event network-vif-deleted {{(pid=122385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 01:27:25.016657 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f7f816e4-42fe-4f74-99a0-90445865f986 req-cebf4cbf-b155-44e7-bdaf-ce4c8b1162ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.129364 Sep 25 01:27:25.040649 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2422/4835] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 154 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 01:27:25.063220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:25.069996 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:25.089885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:25.092108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:25.093055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:25.102977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:25.105782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:25.107070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:25.462147 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b6d69997-a587-4737-9e80-17e0b639706e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 204 len: 0 microversion: 2.1 time: 4.171371 Sep 25 01:27:25.465645 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2414/4836] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:27:21 2022] DELETE /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 0 bytes in 4176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:27:25.481804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:25.483313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:25.512573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:25.513439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:25.514961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:25.516564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:25.520361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:25.521722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:25.938161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:25.965342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6848130e-56ed-4d9e-8fe8-7168710d7fbe tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1516 microversion: 2.1 time: 0.492865 Sep 25 01:27:25.966299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2415/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:25 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:25.977818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:25.983149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 4c9e6231-840e-467e-bb2d-4273269b15e4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:25.996208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:25.996964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:25.997729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:25.998897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:25.999608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:26.000267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:26.035024 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] HTTP exception thrown: Instance 4c9e6231-840e-467e-bb2d-4273269b15e4 could not be found. Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Request method failure captured: Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 HTTP/1.1 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6xuW8HdSFdqv_GymjAN0UzQNznyqDBHCXwnGH_drYTLX8b7yZZVYdzp4yTjwHCtV6pssSqZs_xkb9j7MhJBm4p4K_VE8Hrv20Knvv7-7T5TK1ekYpbuhJac_MxOempYpH6PiP-xkIPtXf_81ksvKVOoze856kORta-sjCkbgdw5Ej0 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5404f5e8a04445d08a69a14616c5e008"}]}] Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c1c655b1afc54b6c98d771d6acf81ee0 Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4c9e6231-840e-467e-bb2d-4273269b15e4 could not be found. Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4c9e6231-840e-467e-bb2d-4273269b15e4'} Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9e6231-840e-467e-bb2d-4273269b15e4 could not be found. Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9e6231-840e-467e-bb2d-4273269b15e4 could not be found. Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:26.045658 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9e6231-840e-467e-bb2d-4273269b15e4 could not be found. Sep 25 01:27:26.053748 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:26.057219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Returning 404 to user: Instance 4c9e6231-840e-467e-bb2d-4273269b15e4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:26.059439 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d7c93ec-2668-4056-ad4e-419aab962e46 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4" status: 404 len: 111 microversion: 2.1 time: 0.086044 Sep 25 01:27:26.070318 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2416/4838] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:25 2022] GET /compute/v2.1/servers/4c9e6231-840e-467e-bb2d-4273269b15e4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:26.075929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:26.077586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:26.094671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:26.101848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:26.104994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:26.106085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:26.108558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:26.109322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:26.198745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:27:26.283884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:26.307746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:26.325241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:26.328432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-483f7ca7-82e8-445f-a62d-7b48f4323bc5 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 1.277064 Sep 25 01:27:26.334905 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2423/4839] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:25 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:26.362274 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86188655-8ac5-4b15-8f85-4f1dd1cc6b99 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 204 len: 0 microversion: 2.1 time: 0.287620 Sep 25 01:27:26.368603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2417/4840] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:27:26 2022] DELETE /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:27:26.376782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:26.378438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:26.406315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:26.406833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:26.407280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:26.408004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:26.408469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:26.408902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:26.588886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "7256f32a-8cf9-4e46-9caa-e40fd569b94c"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "b03ec708-b0f5-485e-9883-56cacce60459"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "b13e3d91-cda7-431a-9493-45c4469e5b7a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:26.615334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:26.616226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:26.621107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:26.663375 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Creating event network-vif-plugged:7256f32a-8cf9-4e46-9caa-e40fd569b94c for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:26.665063 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Creating event network-vif-plugged:b03ec708-b0f5-485e-9883-56cacce60459 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:26.666914 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] Creating event network-vif-plugged:b13e3d91-cda7-431a-9493-45c4469e5b7a for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:26.686311 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9fac3cef-64dd-49f4-b1c1-edf987f6b8f9 req-cb5bb307-98ce-4b60-a24a-e38bea4aee49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.102960 Sep 25 01:27:26.688480 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2418/4841] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:26.694552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:26.703473 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-19170dda-62fb-43a7-8239-cb35ff1cbda0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1466 microversion: 2.1 time: 0.330558 Sep 25 01:27:26.704097 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2424/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:26 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1466 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:27.359345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:27.360046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:27.367573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:27.375665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:27.376340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:27.379022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:27.381913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:27.383239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:27.728936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:27.729701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:27.752093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:27.752609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:27.753468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:27.754259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:27.754736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:27.755992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:27.988507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:28.003822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d27cb24-1889-41a9-9ac9-b0a88668d2c0 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1466 microversion: 2.1 time: 0.280603 Sep 25 01:27:28.007706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2425/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:27 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:28.068191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:28.078217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:28.080242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:28.082031 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8961f08c-fcad-45db-b1b1-4ce4c06109b6 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.726802 Sep 25 01:27:28.083912 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2419/4844] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:27 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:28.928114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b396be95-1204-4796-a2c9-fd9c238e0ed8 req-65ecec2c-2324-4aba-a9ba-be3e3cc68381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-plugged", "status": "completed", "tag": "7aa07162-4d0d-4aed-bf40-436e8b476ed3"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:28.962946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b396be95-1204-4796-a2c9-fd9c238e0ed8 req-65ecec2c-2324-4aba-a9ba-be3e3cc68381 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:28.970221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b396be95-1204-4796-a2c9-fd9c238e0ed8 req-65ecec2c-2324-4aba-a9ba-be3e3cc68381 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:28.971246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b396be95-1204-4796-a2c9-fd9c238e0ed8 req-65ecec2c-2324-4aba-a9ba-be3e3cc68381 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.026353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b396be95-1204-4796-a2c9-fd9c238e0ed8 req-65ecec2c-2324-4aba-a9ba-be3e3cc68381 service nova] Creating event network-vif-plugged:7aa07162-4d0d-4aed-bf40-436e8b476ed3 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:29.027679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:29.028303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:29.039648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b396be95-1204-4796-a2c9-fd9c238e0ed8 req-65ecec2c-2324-4aba-a9ba-be3e3cc68381 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115807 Sep 25 01:27:29.039945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.040436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.041372 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2426/4845] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:29.047813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.049159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.049840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.050439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.054992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:29.059066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:29.070293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.071206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.071902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.072872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.074403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.075113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.116990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lazy-loading 'flavor' on Instance uuid fe4556d3-2b56-4e23-b0a9-0dd123052772 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:27:29.294467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-225addcb-75a1-4094-b398-68ed9ad52afc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action" status: 200 len: 32 microversion: 2.1 time: 0.237825 Sep 25 01:27:29.296008 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2427/4846] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:29 2022] POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:27:29.310753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:29.312030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:29.321697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.335216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.338757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.339964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.340595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.342645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.532973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:29.547401 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a980da4-9c69-4b91-9eac-5d21b1541755 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 200 len: 1466 microversion: 2.1 time: 0.523564 Sep 25 01:27:29.548901 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2420/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:29 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 1466 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:29.556674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-10ef6ac9-505f-459f-8017-4afd35faf164 req-b10b88dc-e01f-43ca-bf12-f6266e131480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89b5823-aba5-4266-819c-561c62e33e30", "name": "network-vif-deleted", "tag": "9beee822-a967-4ad3-8a9f-9ed6763a059d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:29.586097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-10ef6ac9-505f-459f-8017-4afd35faf164 req-b10b88dc-e01f-43ca-bf12-f6266e131480 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.586589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-10ef6ac9-505f-459f-8017-4afd35faf164 req-b10b88dc-e01f-43ca-bf12-f6266e131480 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.587027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-10ef6ac9-505f-459f-8017-4afd35faf164 req-b10b88dc-e01f-43ca-bf12-f6266e131480 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.615242 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-10ef6ac9-505f-459f-8017-4afd35faf164 req-b10b88dc-e01f-43ca-bf12-f6266e131480 service nova] Creating event network-vif-deleted:9beee822-a967-4ad3-8a9f-9ed6763a059d for instance b89b5823-aba5-4266-819c-561c62e33e30 on n-h1-master-1 Sep 25 01:27:29.627550 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-10ef6ac9-505f-459f-8017-4afd35faf164 req-b10b88dc-e01f-43ca-bf12-f6266e131480 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072607 Sep 25 01:27:29.629925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2421/4848] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:29.650814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:29.653318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:29.669075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.671029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.671734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:29.672708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:29.673371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:29.673977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:30.011917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:30.019778 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45628662-af08-42bd-9a25-16a513d0ad4f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.385571 Sep 25 01:27:30.025359 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2422/4849] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:29 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:30.055359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:30.057921 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:30.076313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:30.078824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:30.087504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-575c7240-7961-460f-a7e1-542ca82133de tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.783583 Sep 25 01:27:30.088347 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2428/4850] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:29 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:30.573210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:30.574018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: b89b5823-aba5-4266-819c-561c62e33e30] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:30.592956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:30.593608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:30.595157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:30.597634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:30.598132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:30.601122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:30.651029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] HTTP exception thrown: Instance b89b5823-aba5-4266-819c-561c62e33e30 could not be found. Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Request method failure captured: Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 HTTP/1.1 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6xuW8HdSFdqv_GymjAN0UzQNznyqDBHCXwnGH_drYTLX8b7yZZVYdzp4yTjwHCtV6pssSqZs_xkb9j7MhJBm4p4K_VE8Hrv20Knvv7-7T5TK1ekYpbuhJac_MxOempYpH6PiP-xkIPtXf_81ksvKVOoze856kORta-sjCkbgdw5Ej0 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5404f5e8a04445d08a69a14616c5e008"}]}] Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c1c655b1afc54b6c98d771d6acf81ee0 Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: exception: Instance b89b5823-aba5-4266-819c-561c62e33e30 could not be found. Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b89b5823-aba5-4266-819c-561c62e33e30'} Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89b5823-aba5-4266-819c-561c62e33e30 could not be found. Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89b5823-aba5-4266-819c-561c62e33e30 could not be found. Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:30.656475 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89b5823-aba5-4266-819c-561c62e33e30 could not be found. Sep 25 01:27:30.662876 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:30.666189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Returning 404 to user: Instance b89b5823-aba5-4266-819c-561c62e33e30 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:30.667276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-932a6a7e-9b0f-4ad1-9911-4425919e61c4 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30" status: 404 len: 111 microversion: 2.1 time: 0.100739 Sep 25 01:27:30.675576 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2423/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:30 2022] GET /compute/v2.1/servers/b89b5823-aba5-4266-819c-561c62e33e30 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:30.678864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:30.679224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:30.689607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:30.690122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:30.690572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:30.691292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:30.691810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:30.692225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:30.766059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:27:30.924547 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b1002a5-9742-4752-8c41-e0ace670b9ed tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 204 len: 0 microversion: 2.1 time: 0.246870 Sep 25 01:27:30.939589 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2429/4852] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:27:30 2022] DELETE /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:27:30.956156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:30.956787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:30.978586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:30.978586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:30.978586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:30.978586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:30.978586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:30.978586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:31.048790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:31.049708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:31.066398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:31.066947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:31.074470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:31.075621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:31.079060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:31.083144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:31.514763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:31.526481 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9bb0d2c3-f4b6-4a0e-a614-f611e02cbad5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.481963 Sep 25 01:27:31.527006 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2430/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:31 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:31.530256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:31.539858 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-698b7d55-17de-4653-bca7-9445b03f522a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1509 microversion: 2.1 time: 0.595312 Sep 25 01:27:31.544422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:31.545773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:31.557607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2424/4854] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:30 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:31.567441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:31.568710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:31.569373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:31.570807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:31.572046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:31.572372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:31.907039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:31.935770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:31.943228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:31.945110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f91633d3-c0ac-4b4c-afcf-3762dadc3a1a tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1880 microversion: 2.32 time: 0.414015 Sep 25 01:27:31.965914 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2431/4855] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:31 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1880 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:32.558545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:32.559185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:32.569191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:32.569849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:32.597156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:32.600141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:32.604141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:32.604882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:32.605888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:32.611766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:32.612440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:32.612936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:32.613757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:32.615994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:32.616486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:32.616925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:33.563320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:33.576882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0627168-12c1-4a92-9d6a-40ab6996e96e tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1509 microversion: 2.1 time: 1.011273 Sep 25 01:27:33.580858 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2432/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:32 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1509 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:33.595199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:33.596281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:33.607369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:33.608136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:33.608764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:33.609889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:33.610513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:33.611239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:33.850898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:33.889162 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0a42a01-13e2-4c92-a008-6192f7dcc804 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 1.337070 Sep 25 01:27:33.902714 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2425/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:32 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:34.612269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:34.614802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:34.629953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:34.632287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:34.634380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:34.644223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:34.650704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:34.652063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:34.658915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:34.697718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:34.710771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:34.718160 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-426e1759-7389-4d79-8423-d830d088b684 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2832 microversion: 2.32 time: 1.131119 Sep 25 01:27:34.723252 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2433/4858] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:27:33 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2832 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:34.763054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:34.765151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:34.795096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:34.796641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:34.798122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:34.801066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:34.804247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:34.805369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:35.669766 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ee075fd6-f01b-4d88-8d53-8115aedce00f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.925305 Sep 25 01:27:35.670606 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2434/4859] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:27:34 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d/os-interface => generated 1831 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:27:35.675159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:35.675774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:35.685014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:35.685901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:35.686564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:35.687641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:35.688284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:35.688888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:35.834450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:35.860237 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23b2d2d1-678f-48e4-83fa-eea4134a4507 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1509 microversion: 2.1 time: 1.259073 Sep 25 01:27:35.861804 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2426/4860] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:34 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1509 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:36.187785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-814be9a2-d3c0-4b33-a5ca-907b24d48f48 req-6b8710e2-21f2-4539-b61d-b328333e3961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c89cb86-01d6-47d4-8a84-7e318ffa267d", "name": "network-vif-deleted", "tag": "44a6911c-24d3-4412-908b-95b8ba905e5e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:36.220336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-814be9a2-d3c0-4b33-a5ca-907b24d48f48 req-6b8710e2-21f2-4539-b61d-b328333e3961 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:36.221385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-814be9a2-d3c0-4b33-a5ca-907b24d48f48 req-6b8710e2-21f2-4539-b61d-b328333e3961 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:36.222268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-814be9a2-d3c0-4b33-a5ca-907b24d48f48 req-6b8710e2-21f2-4539-b61d-b328333e3961 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:36.254267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-814be9a2-d3c0-4b33-a5ca-907b24d48f48 req-6b8710e2-21f2-4539-b61d-b328333e3961 service nova] Creating event network-vif-deleted:44a6911c-24d3-4412-908b-95b8ba905e5e for instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d on n-h2-master-1 Sep 25 01:27:36.269815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-814be9a2-d3c0-4b33-a5ca-907b24d48f48 req-6b8710e2-21f2-4539-b61d-b328333e3961 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086874 Sep 25 01:27:36.271397 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2427/4861] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:27:36.847934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:36.867030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7723a32a-cfe0-4e06-b51e-c062e11952ad tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 1.192719 Sep 25 01:27:36.870290 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2435/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:35 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:36.886367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:36.887745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:36.906202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:36.908147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:36.910475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:36.912681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:36.914530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:36.916803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:36.995489 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=80,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=15,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:37.063831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:37.069927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:37.073921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:37.077237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lazy-loading 'fault' on Instance uuid 8c89cb86-01d6-47d4-8a84-7e318ffa267d {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:27:37.242988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:37.259402 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3e0cd57-d290-4d86-a465-3166c287c1b1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 200 len: 1305 microversion: 2.1 time: 0.378422 Sep 25 01:27:37.260068 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2428/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:36 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 1305 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:37.894250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:37.895871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:37.910388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:37.911680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:37.912153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:37.912893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:37.913358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:37.926181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.262017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:38.280641 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5dc57490-f7fd-4b5f-9b4b-266ed7720528 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.390241 Sep 25 01:27:38.284537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:38.301909 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2436/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:37 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:38.302212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 8c89cb86-01d6-47d4-8a84-7e318ffa267d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:38.308380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.308934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.309392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.310177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.310642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.311078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.331753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-857c219e-fc63-45f1-91a5-001543dc2089 req-a45a237f-b4ed-4078-9741-b042d8577cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "tag": "b13e3d91-cda7-431a-9493-45c4469e5b7a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:38.343816 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] HTTP exception thrown: Instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d could not be found. Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Request method failure captured: Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d HTTP/1.1 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6xuW8HdSFdqv_GymjAN0UzQNznyqDBHCXwnGH_drYTLX8b7yZZVYdzp4yTjwHCtV6pssSqZs_xkb9j7MhJBm4p4K_VE8Hrv20Knvv7-7T5TK1ekYpbuhJac_MxOempYpH6PiP-xkIPtXf_81ksvKVOoze856kORta-sjCkbgdw5Ej0 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5404f5e8a04445d08a69a14616c5e008"}]}] Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c1c655b1afc54b6c98d771d6acf81ee0 Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d could not be found. Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8c89cb86-01d6-47d4-8a84-7e318ffa267d'} Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d could not be found. Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d could not be found. Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:38.349759 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d could not be found. Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Returning 404 to user: Instance 8c89cb86-01d6-47d4-8a84-7e318ffa267d could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bed042e2-a92d-4d8d-b6d1-b7f6ebdf29e1 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d" status: 404 len: 111 microversion: 2.1 time: 0.070727 Sep 25 01:27:38.355440 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2429/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:38 2022] GET /compute/v2.1/servers/8c89cb86-01d6-47d4-8a84-7e318ffa267d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:38.363251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-857c219e-fc63-45f1-91a5-001543dc2089 req-a45a237f-b4ed-4078-9741-b042d8577cbd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.363768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-857c219e-fc63-45f1-91a5-001543dc2089 req-a45a237f-b4ed-4078-9741-b042d8577cbd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.364258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-857c219e-fc63-45f1-91a5-001543dc2089 req-a45a237f-b4ed-4078-9741-b042d8577cbd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.365222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:38.365778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:38.381059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.381583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.386141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.388714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.389505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.392232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.398927 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-857c219e-fc63-45f1-91a5-001543dc2089 req-a45a237f-b4ed-4078-9741-b042d8577cbd service nova] Creating event network-changed:b13e3d91-cda7-431a-9493-45c4469e5b7a for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:27:38.432850 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-857c219e-fc63-45f1-91a5-001543dc2089 req-a45a237f-b4ed-4078-9741-b042d8577cbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097525 Sep 25 01:27:38.433948 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2437/4866] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:27:38.469309 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:27:38.653809 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-616910ad-067f-41f8-a56c-9d2a2021caba tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 204 len: 0 microversion: 2.1 time: 0.292273 Sep 25 01:27:38.654710 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2430/4867] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:27:38 2022] DELETE /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:27:38.665479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:38.667376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:38.708217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.713661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.718529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:38.719549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:38.723717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:38.727820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:39.151272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:39.160083 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95018b2e-06f1-4516-9032-71a323b3badb tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1496 microversion: 2.1 time: 0.501187 Sep 25 01:27:39.166495 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2438/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:38 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1496 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:39.310639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:39.312333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:39.320734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:39.321598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:39.322288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:39.323225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:39.323889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:39.324529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:39.878349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:39.892496 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1313a2a1-1b22-4922-a109-0bbf2df4fa0a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.583267 Sep 25 01:27:39.893264 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2431/4869] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:39 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:40.200557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:40.201853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:40.218556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:40.219315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:40.219971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:40.220686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:40.221325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:40.221775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:40.715574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-15a6ffa4-819f-4b14-be0e-6ee8b59ac9e9 req-27594085-4cf3-43d2-953c-884889be93d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e125d906-0565-4287-b3d8-82a6ea23ed89", "name": "network-vif-deleted", "tag": "6d189d35-76a2-45c5-abf9-bc5345e3335c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:40.733586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-15a6ffa4-819f-4b14-be0e-6ee8b59ac9e9 req-27594085-4cf3-43d2-953c-884889be93d0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:40.738197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-15a6ffa4-819f-4b14-be0e-6ee8b59ac9e9 req-27594085-4cf3-43d2-953c-884889be93d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:40.745367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-15a6ffa4-819f-4b14-be0e-6ee8b59ac9e9 req-27594085-4cf3-43d2-953c-884889be93d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:40.761259 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-15a6ffa4-819f-4b14-be0e-6ee8b59ac9e9 req-27594085-4cf3-43d2-953c-884889be93d0 service nova] Creating event network-vif-deleted:6d189d35-76a2-45c5-abf9-bc5345e3335c for instance e125d906-0565-4287-b3d8-82a6ea23ed89 on n-h1-master-1 Sep 25 01:27:40.767405 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-15a6ffa4-819f-4b14-be0e-6ee8b59ac9e9 req-27594085-4cf3-43d2-953c-884889be93d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055861 Sep 25 01:27:40.771255 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2432/4870] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:40.928882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:40.929926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:40.943613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:40.944819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:40.945530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:40.946516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:40.948316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:40.949108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:41.460780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:41.484980 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9e82af23-660f-4917-b38f-28ee5e8a9f3d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.571403 Sep 25 01:27:41.490536 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2433/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:40 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:41.518855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:41.539706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ac716f37-a988-4083-aff1-ce9cc48e8fea tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 200 len: 1496 microversion: 2.1 time: 1.335268 Sep 25 01:27:41.540670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2439/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:40 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 1496 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:42.515088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:42.516326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:42.534142 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:42.563808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.564095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:42.565261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: e125d906-0565-4287-b3d8-82a6ea23ed89] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:42.565726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.567859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.568922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.569202 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:42.573199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.574158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.580925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.587199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.587890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.588825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.589675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.590288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.625828 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] HTTP exception thrown: Instance e125d906-0565-4287-b3d8-82a6ea23ed89 could not be found. Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Request method failure captured: Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 HTTP/1.1 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6xuW8HdSFdqv_GymjAN0UzQNznyqDBHCXwnGH_drYTLX8b7yZZVYdzp4yTjwHCtV6pssSqZs_xkb9j7MhJBm4p4K_VE8Hrv20Knvv7-7T5TK1ekYpbuhJac_MxOempYpH6PiP-xkIPtXf_81ksvKVOoze856kORta-sjCkbgdw5Ej0 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5404f5e8a04445d08a69a14616c5e008"}]}] Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c1c655b1afc54b6c98d771d6acf81ee0 Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e125d906-0565-4287-b3d8-82a6ea23ed89 could not be found. Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e125d906-0565-4287-b3d8-82a6ea23ed89'} Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e125d906-0565-4287-b3d8-82a6ea23ed89 could not be found. Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e125d906-0565-4287-b3d8-82a6ea23ed89 could not be found. Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:42.633468 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e125d906-0565-4287-b3d8-82a6ea23ed89 could not be found. Sep 25 01:27:42.641795 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:42.643927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Returning 404 to user: Instance e125d906-0565-4287-b3d8-82a6ea23ed89 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:42.644840 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-94c94be3-e709-4088-9984-907b2ebc9672 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89" status: 404 len: 111 microversion: 2.1 time: 0.084581 Sep 25 01:27:42.645709 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2440/4873] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:42 2022] GET /compute/v2.1/servers/e125d906-0565-4287-b3d8-82a6ea23ed89 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:42.655262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:42.655790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:42.664087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.664322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.664780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.665684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.666034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.666472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.704086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:27:42.818578 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50675b77-9847-4c84-ab3f-cdcfe25d906c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 204 len: 0 microversion: 2.1 time: 0.167423 Sep 25 01:27:42.820284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2441/4874] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:27:42 2022] DELETE /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:27:42.836117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:42.838122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:42.854784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.857700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.858473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:42.861276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:42.862243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:42.863559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:43.344655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:43.357753 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-93b19f83-4f6c-4f90-aef5-d48758b22341 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.848686 Sep 25 01:27:43.359229 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2434/4875] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:42 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:43.470882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:43.486137 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-473cf54f-67ba-42da-8aca-503e8dbc841f tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1674 microversion: 2.1 time: 0.661103 Sep 25 01:27:43.486980 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2442/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:42 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1674 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:44.386360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:44.387636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:44.397910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:44.398849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:44.399500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:44.400401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:44.401028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:44.401671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:44.527385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:44.528891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:44.543778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:44.544563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:44.545245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:44.546376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:44.547179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:44.548160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:45.057905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:45.066687 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a120b8e4-7ede-4323-9765-09422ea96ef2 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.684700 Sep 25 01:27:45.072871 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2435/4877] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:44 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:45.155560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:45.163011 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:27:45.177105 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9e6d4d75-8e7a-481f-8423-2195e11d8a8c tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1674 microversion: 2.1 time: 0.664690 Sep 25 01:27:45.191119 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2443/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:44 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1674 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:46.100413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:46.101810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:46.109266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:46.110204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:46.110895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:46.111946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:46.112886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:46.113613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:46.205926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:46.207164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:46.217432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:46.218456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:46.219248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:46.220398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:46.221170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:46.222029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:46.843512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:46.855948 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6877714-edea-4c0e-8fd3-db56d6222c0b tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1674 microversion: 2.1 time: 0.652985 Sep 25 01:27:46.856592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2444/4879] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:46 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1674 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:46.898815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:46.926534 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82fa6c47-d906-429e-9630-e5808ed7883e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.816033 Sep 25 01:27:46.931294 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2436/4880] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:46 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:47.878861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:47.879532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:47.896953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:47.897481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:47.897925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:47.898909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:47.899366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:47.899794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:47.957597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:47.960429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:47.986630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:47.987143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:47.996924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:47.997727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:47.998209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:47.998648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.198225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:48.208391 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb459601-1fa6-425e-ae7a-2c420b2c3f4a tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1608 microversion: 2.1 time: 0.332847 Sep 25 01:27:48.215831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2445/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:47 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1608 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:48.374811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cf35f05f-e8e8-4916-9aba-c72a38c4a000 req-bcf426b1-4e4e-4c08-8688-71b5bb4a2d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fe9d37-15fe-4294-90f5-af1f4a1b89b1", "name": "network-vif-deleted", "tag": "f02be859-61d0-483e-9e9f-49eb267fe327"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:48.424014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cf35f05f-e8e8-4916-9aba-c72a38c4a000 req-bcf426b1-4e4e-4c08-8688-71b5bb4a2d20 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.426412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cf35f05f-e8e8-4916-9aba-c72a38c4a000 req-bcf426b1-4e4e-4c08-8688-71b5bb4a2d20 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.427818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cf35f05f-e8e8-4916-9aba-c72a38c4a000 req-bcf426b1-4e4e-4c08-8688-71b5bb4a2d20 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.469794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cf35f05f-e8e8-4916-9aba-c72a38c4a000 req-bcf426b1-4e4e-4c08-8688-71b5bb4a2d20 service nova] Creating event network-vif-deleted:f02be859-61d0-483e-9e9f-49eb267fe327 for instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 on n-h1-master-1 Sep 25 01:27:48.482435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cf35f05f-e8e8-4916-9aba-c72a38c4a000 req-bcf426b1-4e4e-4c08-8688-71b5bb4a2d20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112445 Sep 25 01:27:48.483385 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2446/4882] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:27:48.542869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:48.552617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5bae81df-88a0-498f-ae09-de062381e918 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1502 microversion: 2.1 time: 0.600309 Sep 25 01:27:48.559026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2437/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:47 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1502 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:48.589708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6d8ab42-d517-402a-82fc-8577e9b6b086"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:48.592912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:48.603228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.603738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.604190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.604918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.608753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.609668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.651070 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Cannot 'attach_volume' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state rescued Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/os-volume_attachments HTTP/1.1 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 74 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: {"volumeAttachment": {"volumeId": "b6d8ab42-d517-402a-82fc-8577e9b6b086"}} Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'attach_volume' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state rescued Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': 'fe4556d3-2b56-4e23-b0a9-0dd123052772', 'body': {'volumeAttachment': {'volumeId': 'b6d8ab42-d517-402a-82fc-8577e9b6b086'}}} Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 25 01:27:48.654400 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state rescued Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state rescued Sep 25 01:27:48.663019 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:27:48.669749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 409 to user: Cannot 'attach_volume' instance fe4556d3-2b56-4e23-b0a9-0dd123052772 while it is in vm_state rescued {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:48.670615 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69653b9a-8be3-4743-82e6-30d3533874fb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.085493 Sep 25 01:27:48.673242 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2447/4884] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:27:48 2022] POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:27:48.691148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:48.694912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:48.709712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.710418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.711201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.712098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.712793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.713521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.830415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f4f6f36-37c6-453b-b369-60e9c369a441 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action" status: 202 len: 0 microversion: 2.1 time: 0.151469 Sep 25 01:27:48.836387 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2438/4885] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:27:48 2022] POST /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:48.841680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:48.842454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:48.853918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.856060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.856836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:48.861473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:48.862362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:48.863032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:49.242576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:49.243290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:49.260960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:49.262419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:49.263067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:49.264852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:49.265655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:49.266428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:49.328594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:49.329094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:49.329565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:49.330024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lazy-loading 'fault' on Instance uuid 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:27:49.484510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c655b1afc54b6c98d771d6acf81ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404f5e8a04445d08a69a14616c5e008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:49.493808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c66bb12d-aa57-4b75-9929-b05fb78336c8 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 200 len: 1328 microversion: 2.1 time: 0.259706 Sep 25 01:27:49.500225 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2439/4886] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:49 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 1328 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:49.715535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:49.752117 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eea1e297-0820-4bd8-b2ae-b506b0abdd2d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1510 microversion: 2.1 time: 0.912091 Sep 25 01:27:49.769673 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2448/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:48 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1510 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:27:50.527628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:50.529320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] [instance: 84fe9d37-15fe-4294-90f5-af1f4a1b89b1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:50.541752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:50.544606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:50.546099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:50.547059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:50.547812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:50.548415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:50.569067 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] HTTP exception thrown: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 could not be found. Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Request method failure captured: Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 HTTP/1.1 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6xuW8HdSFdqv_GymjAN0UzQNznyqDBHCXwnGH_drYTLX8b7yZZVYdzp4yTjwHCtV6pssSqZs_xkb9j7MhJBm4p4K_VE8Hrv20Knvv7-7T5TK1ekYpbuhJac_MxOempYpH6PiP-xkIPtXf_81ksvKVOoze856kORta-sjCkbgdw5Ej0 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5404f5e8a04445d08a69a14616c5e008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5404f5e8a04445d08a69a14616c5e008"}]}] Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 5404f5e8a04445d08a69a14616c5e008 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641673071 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c1c655b1afc54b6c98d771d6acf81ee0 Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1641673071-project Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 could not be found. Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '84fe9d37-15fe-4294-90f5-af1f4a1b89b1'} Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 could not be found. Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 could not be found. Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:27:50.571913 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 could not be found. Sep 25 01:27:50.578797 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:27:50.584562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Returning 404 to user: Instance 84fe9d37-15fe-4294-90f5-af1f4a1b89b1 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:27:50.586055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e7afd12-3679-42eb-afca-851598def35d tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1" status: 404 len: 111 microversion: 2.1 time: 0.062469 Sep 25 01:27:50.587767 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2440/4888] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:50 2022] GET /compute/v2.1/servers/84fe9d37-15fe-4294-90f5-af1f4a1b89b1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:27:50.596945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4297290-6aa8-44c9-9d4e-7f1d32034580 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] Calling method '.version_select at 0x7f7bf0827790>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:50.626291 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4297290-6aa8-44c9-9d4e-7f1d32034580 tempest-ServerActionsTestJSON-1641673071 tempest-ServerActionsTestJSON-1641673071-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798217540" status: 202 len: 0 microversion: 2.1 time: 0.033942 Sep 25 01:27:50.631963 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2449/4889] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:27:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798217540 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:27:50.784678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:50.786232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:50.799055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:50.799556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:50.809670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:50.810750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:50.811201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:50.811723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:51.229251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:51.241497 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f30c9098-207a-4add-864f-94164869beb6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1510 microversion: 2.1 time: 0.459767 Sep 25 01:27:51.242943 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2441/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:50 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:52.268178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:52.268803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:52.281050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:52.281588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:52.282029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:52.282748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:52.283199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:52.283628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:52.620132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:52.635632 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae01971d-30eb-4efc-8281-0bba0cfe28d9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1510 microversion: 2.1 time: 0.371456 Sep 25 01:27:52.637246 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2450/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:52 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:53.663039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:27:53.663734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:27:53.681839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:53.682349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:53.682824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:53.684061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:27:53.684611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:27:53.685215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:27:53.954008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:27:53.973291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea177139-0d97-44e2-b406-2a430967a728 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1516 microversion: 2.1 time: 0.313258 Sep 25 01:27:53.977001 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2442/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:27:53 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:27:56.764525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95ceb593-2ec6-4631-852b-9a2617c2fcf1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'create', calling method: .version_select at 0x7f7bebfe4160>, body: {"keypair": {"name": "tempest-keypair-1773730416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVElKEKt/r2PIFXxUxLL8g7CZMIVC3OxG/nwGec5hIZ75C2d9tQ7i39H1FF4vhxKIQH/VgIhjZXGl8PGxeecLzlRe7/370A2RKzOOakfDolI0QsSaaFFZJo8HjyBVlNXw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:27:56.789721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-95ceb593-2ec6-4631-852b-9a2617c2fcf1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for project 24b293fd2bf248f0a714067e48ea0792. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:27:56.789721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-95ceb593-2ec6-4631-852b-9a2617c2fcf1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for user 88a281617be64d1b85a6b7d8a708876a and project 24b293fd2bf248f0a714067e48ea0792. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:27:56.847403 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95ceb593-2ec6-4631-852b-9a2617c2fcf1 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085789 Sep 25 01:27:56.848690 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2451/4893] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:27:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:01.455074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-554738631", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d31a52a-db57-4249-8200-b9927eb1bafe"}], "security_groups": [{"name": "tempest-securitygroup--1191840945"}], "key_name": "tempest-keypair-1773730416", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:01.804411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] validate_networks() for [('1d31a52a-db57-4249-8200-b9927eb1bafe', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:28:03.540782 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:28:03.542310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:28:03.543003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:28:03.543859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:28:03.544298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:28:03.562039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:03.563388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:03.564206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:03.565662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:03.566786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:03.568260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:03.611395 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for project 24b293fd2bf248f0a714067e48ea0792. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:28:03.626271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Getting quotas for user 88a281617be64d1b85a6b7d8a708876a and project 24b293fd2bf248f0a714067e48ea0792. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:28:03.661634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:28:03.664315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:28:03.727650 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5fd72462-c06a-4c0b-a3be-8357614244c5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.277768 Sep 25 01:28:03.734951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2443/4894] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:28:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:28:03.737658 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=31 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:03.742943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c9af7b4c-1542-48bb-a4bd-809e6bf6ad5f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:03.743466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c9af7b4c-1542-48bb-a4bd-809e6bf6ad5f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:03.949226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c9af7b4c-1542-48bb-a4bd-809e6bf6ad5f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:03.972249 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c9af7b4c-1542-48bb-a4bd-809e6bf6ad5f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1245 microversion: 2.1 time: 0.233150 Sep 25 01:28:03.977432 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2452/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:03 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1245 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:05.004348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:05.005481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:05.039493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:05.043015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:05.043550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:05.044822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:05.046345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:05.049993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:05.074283 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:05.334011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:05.355258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-47eaeca3-171e-449c-a92d-bab4eea1a4b4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1297 microversion: 2.1 time: 0.352104 Sep 25 01:28:05.357558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2444/4896] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:04 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1297 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:06.383090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:06.384447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:06.405714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:06.406574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:06.407307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:06.408286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:06.408989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:06.409671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:06.662095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:06.687555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e75ea040-a0e2-4615-9660-ff8cd82ef7e0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1303 microversion: 2.1 time: 0.308161 Sep 25 01:28:06.690228 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2453/4897] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:06 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1303 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:07.718503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:07.721303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:07.752353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:07.756119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:07.758436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:07.761827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:07.762618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:07.765083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:08.016630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:08.029435 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-257f14f8-8ec8-46b6-87d4-6bc539df605e tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1303 microversion: 2.1 time: 0.315490 Sep 25 01:28:08.030783 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2445/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:07 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1303 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:09.060771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:09.061516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:09.079868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:09.080355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:09.080806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:09.083912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:09.084610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:09.085152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:09.966587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1274160594", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:10.061591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:28:10.670046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:10.681332 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d01292b4-5a0d-4c7a-ab32-c6724406afe7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 1.624686 Sep 25 01:28:10.699948 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2454/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:09 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:11.228087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:28:11.229170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:28:11.229880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:28:11.230541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:28:11.231799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:28:11.257962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:11.259556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:11.262599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:11.263805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:11.267618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:11.269717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:11.332379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Getting quotas for project 709cede638de4bb18c0aae5c5f1c205b. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:28:11.349986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Getting quotas for user 3ca4422887dc47cea8da884bb8130146 and project 709cede638de4bb18c0aae5c5f1c205b. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:28:11.379464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:28:11.382076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:28:11.456145 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5247c7f-68df-41ae-a85a-d41f25a6574b tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495615 Sep 25 01:28:11.457583 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2446/4900] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:28:11.469177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-183b6346-3ac1-41a3-b6b6-ca2b16f4cbf6 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:11.469850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-183b6346-3ac1-41a3-b6b6-ca2b16f4cbf6 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:11.608814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-183b6346-3ac1-41a3-b6b6-ca2b16f4cbf6 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:11.622272 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-183b6346-3ac1-41a3-b6b6-ca2b16f4cbf6 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1215 microversion: 2.1 time: 0.157191 Sep 25 01:28:11.622866 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2455/4901] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:11 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:11.717924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:11.720676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:11.754889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:11.756388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:11.758933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:11.761033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:11.764817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:11.765567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:12.649330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:12.650842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:12.672760 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:12.674710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:12.675367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:12.676619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:12.677526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:12.678753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:12.682988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:12.795272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:12.807310 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4dcec21-42cc-4b61-afe1-9524eece8124 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 1.104145 Sep 25 01:28:12.824021 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2447/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:11 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:12.916856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:12.924729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-551f0cab-8367-4d0d-844b-7e8ec18a0d65 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1211 microversion: 2.1 time: 0.280327 Sep 25 01:28:12.925315 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2456/4903] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:12 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1211 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:13.781338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e5ceb4bf-a254-409f-b553-37e96747e62e req-ecadd38f-b08d-4c08-86d9-489a28be74b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e302d703-9875-41fe-a761-c059edf4ead9", "tag": "d65b427c-d3cb-4557-bdec-1c826de4e774"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:13.799788 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:13.810562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5ceb4bf-a254-409f-b553-37e96747e62e req-ecadd38f-b08d-4c08-86d9-489a28be74b4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:13.821726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5ceb4bf-a254-409f-b553-37e96747e62e req-ecadd38f-b08d-4c08-86d9-489a28be74b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:13.822752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e5ceb4bf-a254-409f-b553-37e96747e62e req-ecadd38f-b08d-4c08-86d9-489a28be74b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:13.834123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:13.834748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:13.844436 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e5ceb4bf-a254-409f-b553-37e96747e62e req-ecadd38f-b08d-4c08-86d9-489a28be74b4 service nova] Creating event network-changed:d65b427c-d3cb-4557-bdec-1c826de4e774 for instance e302d703-9875-41fe-a761-c059edf4ead9 on n-h1-master-1 Sep 25 01:28:13.850574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:13.852158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:13.855061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:13.855782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:13.856257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:13.856693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:13.868432 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e5ceb4bf-a254-409f-b553-37e96747e62e req-ecadd38f-b08d-4c08-86d9-489a28be74b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090886 Sep 25 01:28:13.869848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2448/4904] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:13.954506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:13.955907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:13.972437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:13.982113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:13.984625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:13.986397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:13.989284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:13.991456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:14.322103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:14.342113 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-601c22af-6d9e-4ff7-97ed-e83cdfc1be1a tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1273 microversion: 2.1 time: 0.394566 Sep 25 01:28:14.344749 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2449/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:13 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:14.741535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:14.759014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ca68ce6-614b-4337-9a82-770130434b77 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 0.931074 Sep 25 01:28:14.761914 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2457/4906] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:13 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:15.368266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:15.369751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:15.386595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:15.387429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:15.388179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:15.389169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:15.389859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:15.390529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:15.515037 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:15.530645 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-630470e1-8de8-4fc8-9720-2133e4880648 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1273 microversion: 2.1 time: 0.168199 Sep 25 01:28:15.532730 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2450/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:15 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:15.783227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:15.784675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:15.796948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:15.798044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:15.805874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:15.806862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:15.808094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:15.808751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:16.556585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:16.557223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:16.574390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:16.576979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:16.577705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:16.580454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:16.581147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:16.584259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:16.903135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:16.916504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ea291fa-3384-463b-aecd-12db2bb707a8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 1.135458 Sep 25 01:28:16.917354 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2458/4908] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:15 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:17.143134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:17.154736 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a765c0c8-ffa4-4504-80ae-b7cdd28b26e7 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1273 microversion: 2.1 time: 0.603126 Sep 25 01:28:17.155271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2451/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:16 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1273 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:17.947097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:17.948384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:17.957148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:17.958075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:17.959772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:17.960668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:17.961309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:17.961870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:18.184298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:18.185437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:18.225609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:18.226336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:18.227085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:18.227948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:18.229295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:18.231247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:18.898084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:18.920646 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af37934f-369a-449b-b0f6-98615ecb8a53 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 0.979917 Sep 25 01:28:18.932619 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2459/4910] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:17 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:19.240223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-92301381", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "d018ce7e-28fc-414a-84f6-a84e1c842e3b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:19.385351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] validate_networks() for [('d018ce7e-28fc-414a-84f6-a84e1c842e3b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:28:19.389847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:19.415205 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-30af3bc6-f251-4241-ad7a-a865ee121736 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 1.235748 Sep 25 01:28:19.436003 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2452/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:18 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:19.446525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:19.451716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:19.467416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:19.468191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:19.468835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:19.470656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:19.473339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:19.473995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:20.394875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:20.419367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:20.423184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:20.431370 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-132388d6-f24b-4290-b4ad-eab38090531f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2951 microversion: 2.32 time: 0.993641 Sep 25 01:28:20.432139 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2453/4912] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:28:19 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2951 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:28:20.444219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:20.445111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:20.453966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:20.456232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:20.457440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:20.458318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:20.460721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:20.461460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:21.101683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:21.119433 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-864c1c2a-49c5-4ba2-a15a-3b26390e8d18 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 0.679773 Sep 25 01:28:21.140961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2454/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:20 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:21.150603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:21.151821 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:21.167233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:21.167988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:21.169034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:21.170090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:21.171347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:21.172176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:21.299880 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:21.372395 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=12 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:21.594960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:21.607907 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6710f88-e760-4428-a937-1e71decab33c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.464828 Sep 25 01:28:21.608518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2455/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:21 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:21.613707 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:21.620013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:21.620521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:21.637870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:21.638282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:21.638725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:21.639449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:21.639906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:21.640336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:21.822516 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ebfb434-2a76-4513-8661-e5b39c9aab50 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.212892 Sep 25 01:28:21.823665 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2456/4915] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:28:21 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d/os-interface => generated 1831 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:28:22.131730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:28:22.132483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:28:22.133786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:28:22.134423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:28:22.135150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:28:22.143751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:22.144425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:22.158271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:22.159037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:22.159750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:22.161512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:22.162090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:22.162702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:22.163133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:22.163348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:22.164296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:22.164906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:22.165024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:22.165592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:22.209735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Getting quotas for project a5c020f7dd2f4748b22baae3c5628137. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:28:22.224349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Getting quotas for user e05eaa044506481ebb431d7f01301a32 and project a5c020f7dd2f4748b22baae3c5628137. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:28:22.266455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:28:22.269374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:28:22.372658 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a47cb39-c355-402e-aab2-6b48365f0e08 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.449614 Sep 25 01:28:22.375981 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2460/4916] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:28:22.387961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-065db8f3-bece-437a-948c-1878bb1c4e69 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:22.392882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-065db8f3-bece-437a-948c-1878bb1c4e69 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:22.661588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-065db8f3-bece-437a-948c-1878bb1c4e69 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:22.676354 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-065db8f3-bece-437a-948c-1878bb1c4e69 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1215 microversion: 2.1 time: 0.293071 Sep 25 01:28:22.680354 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2461/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:22 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:22.704974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:22.715266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:22.758024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:22.758548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:22.758997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:22.764158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:22.764834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:22.765364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:23.556002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:23.576475 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f986bb1c-875b-46e1-a1bf-401688739367 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 1.436466 Sep 25 01:28:23.580665 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2457/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:22 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:23.707393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:23.708326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:23.719401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:23.720648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:23.721369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:23.723032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:23.725306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:23.727651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:23.918384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:23.930011 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4289ec5a-9f1e-4e72-b2ef-97516fc2bb06 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 1.248259 Sep 25 01:28:23.931448 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2462/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:22 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:23.965533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:23.973503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc654656-d768-4cf5-b651-3cfeadea68ec tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1211 microversion: 2.1 time: 0.273181 Sep 25 01:28:23.974088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2458/4920] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:23 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:24.332186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-141292c0-d1fd-4279-8bb8-49ba15bc66bb req-4ab966b8-e035-4673-b2cf-e8914426085c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e302d703-9875-41fe-a761-c059edf4ead9", "name": "network-vif-plugged", "status": "completed", "tag": "d65b427c-d3cb-4557-bdec-1c826de4e774"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:24.369185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-141292c0-d1fd-4279-8bb8-49ba15bc66bb req-4ab966b8-e035-4673-b2cf-e8914426085c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:24.369751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-141292c0-d1fd-4279-8bb8-49ba15bc66bb req-4ab966b8-e035-4673-b2cf-e8914426085c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:24.370191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-141292c0-d1fd-4279-8bb8-49ba15bc66bb req-4ab966b8-e035-4673-b2cf-e8914426085c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:24.399379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-141292c0-d1fd-4279-8bb8-49ba15bc66bb req-4ab966b8-e035-4673-b2cf-e8914426085c service nova] Creating event network-vif-plugged:d65b427c-d3cb-4557-bdec-1c826de4e774 for instance e302d703-9875-41fe-a761-c059edf4ead9 on n-h1-master-1 Sep 25 01:28:24.419335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-141292c0-d1fd-4279-8bb8-49ba15bc66bb req-4ab966b8-e035-4673-b2cf-e8914426085c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093865 Sep 25 01:28:24.420503 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2463/4921] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:28:24.608876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:24.609672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:24.621741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b435704a-18bd-44e8-8a60-5f8fd5f68678 req-a0da68d2-bb4f-4028-9c64-727b9e19096e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697faf66-367f-4e56-b7e5-2e9db2022c6a", "tag": "888be19f-d417-40f5-89e5-213783dac053"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:24.631649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:24.635086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:24.635611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:24.637987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:24.643611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:24.644714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b435704a-18bd-44e8-8a60-5f8fd5f68678 req-a0da68d2-bb4f-4028-9c64-727b9e19096e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:24.645293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:24.653853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b435704a-18bd-44e8-8a60-5f8fd5f68678 req-a0da68d2-bb4f-4028-9c64-727b9e19096e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:24.654645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b435704a-18bd-44e8-8a60-5f8fd5f68678 req-a0da68d2-bb4f-4028-9c64-727b9e19096e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:24.668799 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b435704a-18bd-44e8-8a60-5f8fd5f68678 req-a0da68d2-bb4f-4028-9c64-727b9e19096e service nova] Creating event network-changed:888be19f-d417-40f5-89e5-213783dac053 for instance 697faf66-367f-4e56-b7e5-2e9db2022c6a on n-h2-master-1 Sep 25 01:28:24.687971 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b435704a-18bd-44e8-8a60-5f8fd5f68678 req-a0da68d2-bb4f-4028-9c64-727b9e19096e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072943 Sep 25 01:28:24.689059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2464/4922] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:28:24.955277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:24.956740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:24.972961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:24.974352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:24.978238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:24.979190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:24.980257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:24.980855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:26.158270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:26.178946 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-973c2f19-a5b0-4205-98c5-7106af1f41a4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1371 microversion: 2.1 time: 1.573412 Sep 25 01:28:26.197843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2459/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:24 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1371 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:26.204539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:26.205521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:26.216738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:26.217952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:26.218783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:26.220642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:26.221668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:26.222357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:26.229109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:26.242642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4eb5190e-22b3-4360-bfa9-1d163ea9f279 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 1.291528 Sep 25 01:28:26.243766 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2465/4924] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:24 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:26.627316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:26.647361 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-896a0b73-9d91-41fa-841b-c28963e50340 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1273 microversion: 2.1 time: 0.447469 Sep 25 01:28:26.648845 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2460/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:26 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:27.207054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:27.208773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:27.219476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.220503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.221302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.222607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.223369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.224068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.268762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:27.269504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:27.285321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.286440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.288170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.289244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.289958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.290606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.719978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:27.730433 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-846607dc-9305-4205-b81d-d15219c45967 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1566 microversion: 2.1 time: 0.529709 Sep 25 01:28:27.731351 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2466/4926] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:27 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1566 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:27.736535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:27.737456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:27.744979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.745762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.746432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.749087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.750905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.751424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.769977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:27.788339 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b088632-1430-49b0-be46-d5f312b334b3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.523669 Sep 25 01:28:27.789817 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2461/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:27 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:27.804142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:27.805791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:27.816975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.817909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.820675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.821724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:27.823083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:27.826356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:27.834917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:27.854503 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80f6436b-7272-4599-878f-c5f18fa3fdc7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1273 microversion: 2.1 time: 0.120967 Sep 25 01:28:27.862042 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:27.868968 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2467/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:27 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:27.957567 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd3e3f17-b011-4b46-8b87-fed70fa8fe91 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166070 Sep 25 01:28:27.958205 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2462/4929] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:28:27 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:28.814370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:28.815022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:28.822219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:28.823032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:28.823826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:28.824739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:28.825436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:28.826080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:28.883580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:28.884536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:28.898627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:28.899908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:28.902149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:28.903332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:28.907124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:28.908060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:29.470299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:29.481710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff1b4cee-92a4-4374-9c44-34978e120c9c tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.671726 Sep 25 01:28:29.482867 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2468/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:28 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:29.643119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:29.655348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-607c132b-c9bc-42c7-9f89-b9b89c99e38a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.779375 Sep 25 01:28:29.658556 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2463/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:28 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:30.512251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:30.513034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:30.526483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:30.526991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:30.527447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:30.528169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:30.540017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:30.540921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:30.682468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:30.683729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:30.693647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:30.694369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:30.694912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:30.695733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:30.696490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:30.698794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:31.461639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:31.475943 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11334a2a-b04d-4cdf-963f-87b81e80ae8d tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.967977 Sep 25 01:28:31.477342 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2469/4932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:30 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:31.500647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-417e1b4e-906a-4aac-b457-1e0f1f37157f req-f2f861c3-59e5-425e-9a41-a3f24f03750d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ebe53c-487e-4bd1-bba1-98bceb000d72", "tag": "537528cc-042a-469d-a99a-12ee535ff0c6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:31.517727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-417e1b4e-906a-4aac-b457-1e0f1f37157f req-f2f861c3-59e5-425e-9a41-a3f24f03750d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:31.518990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-417e1b4e-906a-4aac-b457-1e0f1f37157f req-f2f861c3-59e5-425e-9a41-a3f24f03750d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:31.519642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-417e1b4e-906a-4aac-b457-1e0f1f37157f req-f2f861c3-59e5-425e-9a41-a3f24f03750d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:31.535557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-417e1b4e-906a-4aac-b457-1e0f1f37157f req-f2f861c3-59e5-425e-9a41-a3f24f03750d service nova] Creating event network-changed:537528cc-042a-469d-a99a-12ee535ff0c6 for instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 on n-h1-master-1 Sep 25 01:28:31.542425 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-417e1b4e-906a-4aac-b457-1e0f1f37157f req-f2f861c3-59e5-425e-9a41-a3f24f03750d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046725 Sep 25 01:28:31.543944 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2470/4933] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:31.631358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:31.645698 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6cf9bc6-d35b-44da-a3b7-172cac6931a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.968638 Sep 25 01:28:31.648299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2464/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:30 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:32.501454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:32.503224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:32.510607 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:32.513312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:32.515790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:32.519490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:32.520317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:32.522635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:32.523378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:32.670112 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:32.670329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:32.671477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:32.684495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:32.684994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:32.697971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:32.699273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:32.703267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:32.704757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:33.039582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:33.049314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0c5614d-f1e8-45c6-a3fa-25e7f5d5569f tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.552226 Sep 25 01:28:33.051720 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2471/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:32 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:33.164526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:33.182003 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c59721b-1590-4689-8efb-84aea25c3cc5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.515673 Sep 25 01:28:33.183101 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2465/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:32 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:33.578394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a2148093-49f1-41dd-9607-e28af6f22565 req-b75e83a8-825c-4f01-bf61-0c5aebc8cdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e302d703-9875-41fe-a761-c059edf4ead9", "tag": "d65b427c-d3cb-4557-bdec-1c826de4e774"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:33.595800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a2148093-49f1-41dd-9607-e28af6f22565 req-b75e83a8-825c-4f01-bf61-0c5aebc8cdda service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:33.597164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a2148093-49f1-41dd-9607-e28af6f22565 req-b75e83a8-825c-4f01-bf61-0c5aebc8cdda service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:33.597877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a2148093-49f1-41dd-9607-e28af6f22565 req-b75e83a8-825c-4f01-bf61-0c5aebc8cdda service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:33.614281 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a2148093-49f1-41dd-9607-e28af6f22565 req-b75e83a8-825c-4f01-bf61-0c5aebc8cdda service nova] Creating event network-changed:d65b427c-d3cb-4557-bdec-1c826de4e774 for instance e302d703-9875-41fe-a761-c059edf4ead9 on n-h1-master-1 Sep 25 01:28:33.623611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a2148093-49f1-41dd-9607-e28af6f22565 req-b75e83a8-825c-4f01-bf61-0c5aebc8cdda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048627 Sep 25 01:28:33.625116 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2472/4937] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:34.074169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:34.075250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:34.090641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:34.091139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:34.091580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:34.103086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:34.103588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:34.104032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:34.213221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:34.214438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:34.224405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:34.228459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:34.229522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:34.230442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:34.233115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:34.233779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:34.241466 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=89 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:34.655825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:34.660716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:34.676593 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb8a59c3-2bb4-486e-a5ad-00e1270ea2b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.606931 Sep 25 01:28:34.677204 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2466/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:34 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:34.681191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e333f14-2ed4-4c76-bf53-e13086ec5fe5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.480687 Sep 25 01:28:34.681814 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2473/4939] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:34 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:34.689619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-af542695-ac27-4a6a-99aa-f48c69dbc15e req-db0832cd-3af3-427f-a9c5-26efdb89ed35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697faf66-367f-4e56-b7e5-2e9db2022c6a", "name": "network-vif-plugged", "status": "completed", "tag": "888be19f-d417-40f5-89e5-213783dac053"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:34.707004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-af542695-ac27-4a6a-99aa-f48c69dbc15e req-db0832cd-3af3-427f-a9c5-26efdb89ed35 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:34.707778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-af542695-ac27-4a6a-99aa-f48c69dbc15e req-db0832cd-3af3-427f-a9c5-26efdb89ed35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:34.708376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-af542695-ac27-4a6a-99aa-f48c69dbc15e req-db0832cd-3af3-427f-a9c5-26efdb89ed35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:34.721150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-af542695-ac27-4a6a-99aa-f48c69dbc15e req-db0832cd-3af3-427f-a9c5-26efdb89ed35 service nova] Creating event network-vif-plugged:888be19f-d417-40f5-89e5-213783dac053 for instance 697faf66-367f-4e56-b7e5-2e9db2022c6a on n-h2-master-1 Sep 25 01:28:34.734339 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-af542695-ac27-4a6a-99aa-f48c69dbc15e req-db0832cd-3af3-427f-a9c5-26efdb89ed35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051658 Sep 25 01:28:34.735290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2467/4940] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:35.706472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:35.707140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:35.707983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:35.708393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:35.724242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:35.728720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:35.729607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:35.730810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:35.731056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:35.731638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:35.732547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:35.733446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:35.734078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:35.734697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:35.735488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:35.736067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:36.159679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:36.169065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:36.171708 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67c92563-b410-4c86-b75e-5b9a915f7b1a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.467555 Sep 25 01:28:36.172329 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2468/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:35 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:28:36.194136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-feb3c9a3-0f98-4192-9150-a57196ee05b9 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1315 microversion: 2.1 time: 0.497811 Sep 25 01:28:36.208122 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2474/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:35 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:37.199775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:37.201386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:37.209476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:37.219276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:37.220642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:37.230224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:37.230685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:37.231450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:37.231627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:37.231914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:37.232345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:37.232704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:37.233322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:37.234410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:37.235301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:37.236219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:37.824786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:37.838266 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c8c84da-683a-49d3-a8a3-60b0fd23430f tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.643921 Sep 25 01:28:37.853428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2469/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:37 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:37.857914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:37.867643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3740361a-e385-430e-9a37-1399407a61b5 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1464 microversion: 2.1 time: 0.652965 Sep 25 01:28:37.868840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2475/4944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:37 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1464 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:37.923039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:37.923795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:37.932086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:37.932928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:37.933807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:37.934773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:37.935439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:37.936066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:37.970544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:28:38.079922 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f059e33-33e8-46c6-91b2-fd2885207242 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "DELETE /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 204 len: 0 microversion: 2.1 time: 0.161432 Sep 25 01:28:38.084746 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2470/4945] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:28:37 2022] DELETE /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:28:38.090085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:38.090578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:38.102986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:38.103588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:38.104042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:38.104769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:38.105235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:38.105718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:38.258513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:38.267664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27f683ce-3955-4c9e-8d39-a3f200690ff1 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1470 microversion: 2.1 time: 0.181438 Sep 25 01:28:38.268264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2476/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:38 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:38.625683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-976359d4-fc97-40d6-bcf9-a0e35fb0d421 req-e6c9ed89-6a58-4d26-a4eb-c4d3230c57be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ebe53c-487e-4bd1-bba1-98bceb000d72", "name": "network-vif-plugged", "status": "completed", "tag": "537528cc-042a-469d-a99a-12ee535ff0c6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:38.649428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-976359d4-fc97-40d6-bcf9-a0e35fb0d421 req-e6c9ed89-6a58-4d26-a4eb-c4d3230c57be service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:38.650195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-976359d4-fc97-40d6-bcf9-a0e35fb0d421 req-e6c9ed89-6a58-4d26-a4eb-c4d3230c57be service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:38.650785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-976359d4-fc97-40d6-bcf9-a0e35fb0d421 req-e6c9ed89-6a58-4d26-a4eb-c4d3230c57be service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:38.672396 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-976359d4-fc97-40d6-bcf9-a0e35fb0d421 req-e6c9ed89-6a58-4d26-a4eb-c4d3230c57be service nova] Creating event network-vif-plugged:537528cc-042a-469d-a99a-12ee535ff0c6 for instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 on n-h1-master-1 Sep 25 01:28:38.680621 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-976359d4-fc97-40d6-bcf9-a0e35fb0d421 req-e6c9ed89-6a58-4d26-a4eb-c4d3230c57be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063978 Sep 25 01:28:38.681827 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2471/4947] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:28:38.860223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:38.861102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:38.875393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:38.875918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:38.876333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:38.877096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:38.877552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:38.878019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:39.120997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:39.134882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-594969ea-f24e-4c5d-869b-14188eec033a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.278157 Sep 25 01:28:39.149463 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2477/4948] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:38 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:39.294169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:39.294882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:39.301855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:39.302502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:39.302946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:39.303659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:39.304162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:39.304631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:39.618335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:39.627214 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b1ff6eb-b7b5-4a72-9a55-92c53b315690 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1470 microversion: 2.1 time: 0.338351 Sep 25 01:28:39.627935 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2472/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:39 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:40.163120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:40.164569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:40.172407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:40.173263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:40.174062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:40.177374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:40.180090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:40.180667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:40.527771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:40.538201 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-787c4b4d-3ef6-4867-923f-fbca89198ca5 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1315 microversion: 2.1 time: 0.379477 Sep 25 01:28:40.545791 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2478/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:40 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:40.660189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:40.662029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:40.673866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:40.675633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:40.676731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:40.677667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:40.679202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:40.679827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:40.817447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca4422887dc47cea8da884bb8130146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709cede638de4bb18c0aae5c5f1c205b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:40.830594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4fdca278-7d46-4a99-9729-b3962abf2bb3 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 200 len: 1428 microversion: 2.1 time: 0.173074 Sep 25 01:28:40.831731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2473/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:40 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 1428 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:40.902019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c4942874-842e-4fa1-bc59-0b4d6900fa60 req-43480c42-b75d-444a-b7a5-da475cd1e740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697faf66-367f-4e56-b7e5-2e9db2022c6a", "name": "network-vif-deleted", "tag": "888be19f-d417-40f5-89e5-213783dac053"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:40.917184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c4942874-842e-4fa1-bc59-0b4d6900fa60 req-43480c42-b75d-444a-b7a5-da475cd1e740 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:40.924002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c4942874-842e-4fa1-bc59-0b4d6900fa60 req-43480c42-b75d-444a-b7a5-da475cd1e740 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:40.924472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c4942874-842e-4fa1-bc59-0b4d6900fa60 req-43480c42-b75d-444a-b7a5-da475cd1e740 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:40.940575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c4942874-842e-4fa1-bc59-0b4d6900fa60 req-43480c42-b75d-444a-b7a5-da475cd1e740 service nova] Creating event network-vif-deleted:888be19f-d417-40f5-89e5-213783dac053 for instance 697faf66-367f-4e56-b7e5-2e9db2022c6a on n-h2-master-1 Sep 25 01:28:40.955661 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c4942874-842e-4fa1-bc59-0b4d6900fa60 req-43480c42-b75d-444a-b7a5-da475cd1e740 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057533 Sep 25 01:28:40.956846 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2479/4952] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:41.565352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:41.566564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:41.576745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:41.577707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:41.578505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:41.579465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:41.580336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:41.582502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:41.857454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:41.858369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] [instance: 697faf66-367f-4e56-b7e5-2e9db2022c6a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:41.873966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:41.874816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:41.875738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:41.876747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:41.879277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:41.880264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:41.896258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] HTTP exception thrown: Instance 697faf66-367f-4e56-b7e5-2e9db2022c6a could not be found. Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Request method failure captured: Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a HTTP/1.1 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL66m62mrVmYqqsVjx5G_n67Wxdbg7UIARwZFDT3latAzUHNFypXMc5ZBHfaJLz1PEVN5uulvptvC0HKBqnqjWw9Nr4z2NrJDqq5V75HS_7EXm0ms0bEhLeZDu7vy7_aM_qcvvwpPeDQdU0k8CuGcOKS1QbMqhLpJSP7OKsoTj2RqDcM Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 709cede638de4bb18c0aae5c5f1c205b Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesNegativeTest-135520850 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/709cede638de4bb18c0aae5c5f1c205b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/709cede638de4bb18c0aae5c5f1c205b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/709cede638de4bb18c0aae5c5f1c205b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_709cede638de4bb18c0aae5c5f1c205b"}]}] Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesNegativeTest-135520850 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 709cede638de4bb18c0aae5c5f1c205b Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesNegativeTest-135520850 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesNegativeTest-135520850-project Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3ca4422887dc47cea8da884bb8130146 Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesNegativeTest-135520850-project Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 697faf66-367f-4e56-b7e5-2e9db2022c6a could not be found. Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '697faf66-367f-4e56-b7e5-2e9db2022c6a'} Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697faf66-367f-4e56-b7e5-2e9db2022c6a could not be found. Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697faf66-367f-4e56-b7e5-2e9db2022c6a could not be found. Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:28:41.897931 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697faf66-367f-4e56-b7e5-2e9db2022c6a could not be found. Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] Returning 404 to user: Instance 697faf66-367f-4e56-b7e5-2e9db2022c6a could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-276e0c3f-943d-4148-9cc4-5a52f9bc9c47 tempest-VolumesNegativeTest-135520850 tempest-VolumesNegativeTest-135520850-project] 10.222.0.16 "GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a" status: 404 len: 111 microversion: 2.1 time: 0.047480 Sep 25 01:28:41.902446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2480/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:41 2022] GET /compute/v2.1/servers/697faf66-367f-4e56-b7e5-2e9db2022c6a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:28:41.911867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:41.921987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dfffe239-b7fd-4c1e-a028-c6abd135770a tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1504 microversion: 2.1 time: 0.363960 Sep 25 01:28:41.939303 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2474/4954] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:41 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:41.946589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:41.947284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:41.954354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:41.955492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:41.957363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:41.958483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:41.959522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:41.960243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.001774 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-860ce718-65a2-452f-964f-ad884e98120d tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72/ips" status: 200 len: 109 microversion: 2.1 time: 0.058703 Sep 25 01:28:42.004819 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2481/4955] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:28:41 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72/ips => generated 109 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:42.022479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:42.022979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:42.029550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.030041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.030641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.031926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.032537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.033275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.080696 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a7c1bff-9515-44ce-b32b-7239d5a4d881 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72/ips" status: 200 len: 109 microversion: 2.1 time: 0.062776 Sep 25 01:28:42.082211 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2475/4956] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:28:42 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72/ips => generated 109 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:42.093133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:42.094482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:42.102552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.103052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.103499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.104699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.109164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.109815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.177241 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1d388ba8-edb3-4089-a493-ed87ac103538 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72/ips/tempest-ServerAddressesTestJSON-131463393-network" status: 200 len: 94 microversion: 2.1 time: 0.087949 Sep 25 01:28:42.178059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2482/4957] 10.222.0.16 () {58 vars in 1398 bytes} [Sun Sep 25 01:28:42 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72/ips/tempest-ServerAddressesTestJSON-131463393-network => generated 94 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:28:42.190798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:42.191998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:42.202984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.203649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.204280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.204995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.205475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.206020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.260913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:28:42.406525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-954d2795-e10e-4f3e-8994-ce3c1db4e2e2 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 204 len: 0 microversion: 2.1 time: 0.219683 Sep 25 01:28:42.407290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2476/4958] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:28:42 2022] DELETE /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:28:42.421665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:42.423134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:42.430009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.430515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.430950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.431657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:42.432116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:42.432544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:42.718667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:42.741184 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da88d0a5-e4e0-4d91-8522-869ac11e11a7 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1510 microversion: 2.1 time: 0.327162 Sep 25 01:28:42.744315 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2483/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:42 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:43.766301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:43.766928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:43.778715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:43.779217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:43.780383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:43.782205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:43.792632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:43.793321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:44.043943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:44.052041 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:44.065183 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e070ee5a-168d-41fe-93e6-b1b32337925e tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1510 microversion: 2.1 time: 0.303124 Sep 25 01:28:44.066258 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2477/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:43 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:44.964661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2a14a085-fb49-4e5d-b3ad-850ae1d45fc7 req-a484d94d-700d-4c14-a67d-63e64fe67543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ebe53c-487e-4bd1-bba1-98bceb000d72", "name": "network-vif-deleted", "tag": "537528cc-042a-469d-a99a-12ee535ff0c6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:44.988514 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:44.995453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2a14a085-fb49-4e5d-b3ad-850ae1d45fc7 req-a484d94d-700d-4c14-a67d-63e64fe67543 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:44.997555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2a14a085-fb49-4e5d-b3ad-850ae1d45fc7 req-a484d94d-700d-4c14-a67d-63e64fe67543 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:44.998355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2a14a085-fb49-4e5d-b3ad-850ae1d45fc7 req-a484d94d-700d-4c14-a67d-63e64fe67543 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:45.075913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2a14a085-fb49-4e5d-b3ad-850ae1d45fc7 req-a484d94d-700d-4c14-a67d-63e64fe67543 service nova] Creating event network-vif-deleted:537528cc-042a-469d-a99a-12ee535ff0c6 for instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 on n-h1-master-1 Sep 25 01:28:45.085330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2a14a085-fb49-4e5d-b3ad-850ae1d45fc7 req-a484d94d-700d-4c14-a67d-63e64fe67543 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298986 Sep 25 01:28:45.119776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:45.121869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:45.126303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2484/4961] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:28:45.127515 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:45.160311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:45.161903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:45.162816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:45.168055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:45.169036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:45.170872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:45.287213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:45.288145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:45.289159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:45.290062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lazy-loading 'fault' on Instance uuid 09ebe53c-487e-4bd1-bba1-98bceb000d72 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:28:45.389613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05eaa044506481ebb431d7f01301a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c020f7dd2f4748b22baae3c5628137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:28:45.411023 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-747b8e94-13ec-4891-84c5-ae58a49cfd94 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 200 len: 1305 microversion: 2.1 time: 0.319113 Sep 25 01:28:45.428004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2478/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:45 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 1305 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:28:46.444461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:28:46.445727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] [instance: 09ebe53c-487e-4bd1-bba1-98bceb000d72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:28:46.467135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:46.468778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:46.469726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:46.471828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:28:46.473229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:28:46.475033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:28:46.522025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] HTTP exception thrown: Instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 could not be found. Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Request method failure captured: Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 HTTP/1.1 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL66y7UYvCt3XHhR6m860NiozejyB3AgPd8ocEfgb_HHbPLLEmCeuoG9ALp9YcgazmwahpkcyjYouR8eAaZlwUijSLiHn-dUvunr4Yovbm-8p8zdnPZad16mpyaqa7c7-cPW_vrfs9kziVZuTWOjJ9n__bDRfECR0TYGlbmXtxEXruhQ Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: a5c020f7dd2f4748b22baae3c5628137 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerAddressesTestJSON-836888197 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5c020f7dd2f4748b22baae3c5628137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5c020f7dd2f4748b22baae3c5628137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5c020f7dd2f4748b22baae3c5628137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5c020f7dd2f4748b22baae3c5628137"}]}] Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerAddressesTestJSON-836888197 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: a5c020f7dd2f4748b22baae3c5628137 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerAddressesTestJSON-836888197 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerAddressesTestJSON-836888197-project Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: e05eaa044506481ebb431d7f01301a32 Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerAddressesTestJSON-836888197-project Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 could not be found. Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '09ebe53c-487e-4bd1-bba1-98bceb000d72'} Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 could not be found. Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 could not be found. Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:28:46.523928 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 could not be found. Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] Returning 404 to user: Instance 09ebe53c-487e-4bd1-bba1-98bceb000d72 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-87a2d392-eb55-495e-a60a-85e743591f15 tempest-ServerAddressesTestJSON-836888197 tempest-ServerAddressesTestJSON-836888197-project] 10.222.0.16 "GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72" status: 404 len: 111 microversion: 2.1 time: 0.089861 Sep 25 01:28:46.528560 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2485/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:28:46 2022] GET /compute/v2.1/servers/09ebe53c-487e-4bd1-bba1-98bceb000d72 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:28:55.282079 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:55.397811 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:28:55.691323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-148ffcac-a3db-4eec-b9b3-488ebdfc0e08 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Action: 'create', calling method: .version_select at 0x7f7beaab7310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1298653349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEMQHZdwd88h/ot03Jd+BEjmydRShwRqiM8MaMY437Lt9/iLYeTzB/ohY4FxNPOZgOB0TG+hK4coWqohLjmNJ8j3emd4gZdX3ohXuPy96RnuLl0RN/G4IRYmSzRK6SozA=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:28:55.709179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-148ffcac-a3db-4eec-b9b3-488ebdfc0e08 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Getting quotas for project dc6eecfc22d54d30a11c63b0d7518e4a. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:28:55.714581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-148ffcac-a3db-4eec-b9b3-488ebdfc0e08 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Getting quotas for user aa5f2510f105430fb01974c7a6e1579e and project dc6eecfc22d54d30a11c63b0d7518e4a. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:28:55.741823 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-148ffcac-a3db-4eec-b9b3-488ebdfc0e08 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.495367 Sep 25 01:28:55.742607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2479/4964] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:28:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:29:05.104581 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:05.107121 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=57 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:05.118433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c3bd98-6f30-401a-8362-d6dc615f458c"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:05.121601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:05.133699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:05.134500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:05.135185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:05.136253 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:05.136991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:05.139283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:05.731484 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-997839487", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "da5dcb7b-5d48-47af-932b-a1114b7fa34d"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:05.744232 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63fe9021-36d1-451a-8980-4d48bce23d44 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636287 Sep 25 01:29:05.750149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2486/4965] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:29:05 2022] POST /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:29:05.770219 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:05.771766 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:05.868952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] validate_networks() for [('da5dcb7b-5d48-47af-932b-a1114b7fa34d', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:29:07.239622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:29:07.240284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:29:07.240511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:29:07.240903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:29:07.241572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:29:07.264041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:07.265539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:07.266161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:07.271186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:07.271916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:07.272535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:07.320477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Getting quotas for project d0f7aff60fed41988176a7b46c5f2953. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:29:07.337444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Getting quotas for user 9ac2837cd4e04995a4b7aa33aa7b5ecf and project d0f7aff60fed41988176a7b46c5f2953. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:29:07.361003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:29:07.364301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:29:07.437530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf9447ca-953e-414a-a464-aa52e6e71794 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.851768 Sep 25 01:29:07.448816 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2480/4966] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:29:07.456746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92b3a975-a1d5-4d0a-96e1-e25f99b7afc5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:07.457646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92b3a975-a1d5-4d0a-96e1-e25f99b7afc5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:07.597722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92b3a975-a1d5-4d0a-96e1-e25f99b7afc5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:07.610165 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92b3a975-a1d5-4d0a-96e1-e25f99b7afc5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1224 microversion: 2.1 time: 0.158844 Sep 25 01:29:07.610716 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2487/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:07 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:29:07.769621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1815331837-access_point-57909022", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "28461626-8cb0-4db2-ad49-122ded14bed1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1298653349", "security_groups": [{"name": "tempest-secgroup_access--314524826"}, {"name": "tempest-secgroup_general--807801535"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:08.122198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] validate_networks() for [('28461626-8cb0-4db2-ad49-122ded14bed1', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:29:08.634656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:08.635280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:08.647104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:08.650079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:08.653692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:08.654668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:08.655304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:08.655924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:08.830196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:08.845340 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4e5a56b-e713-4401-aa47-d32778dcdfb5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1220 microversion: 2.1 time: 0.214496 Sep 25 01:29:08.846714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2488/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:08 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1220 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:09.108004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:29:09.109242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:29:09.110194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:29:09.110818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:29:09.112420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:29:09.122982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:09.123799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:09.124572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:09.125734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:09.126411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:09.127110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:09.150808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Getting quotas for project dc6eecfc22d54d30a11c63b0d7518e4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:29:09.159175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Getting quotas for user aa5f2510f105430fb01974c7a6e1579e and project dc6eecfc22d54d30a11c63b0d7518e4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:29:09.174647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:29:09.177082 n-d-master-1 devstack@n-api.service[122384]: WARNING nova.utils [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1815331837-access_point-57909022 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1815331837-ac Sep 25 01:29:09.178124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:29:09.285240 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f504889-ba0d-4401-88f6-457d0e91cbe5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.514468 Sep 25 01:29:09.286702 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2481/4969] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:29:07 2022] POST /compute/v2.1/servers => generated 456 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:29:09.299134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d868ac94-5e22-476c-b386-dac9b6252979 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:09.300317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d868ac94-5e22-476c-b386-dac9b6252979 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:09.463978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d868ac94-5e22-476c-b386-dac9b6252979 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:09.472788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d868ac94-5e22-476c-b386-dac9b6252979 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1293 microversion: 2.1 time: 0.178331 Sep 25 01:29:09.476429 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2489/4970] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:09 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:09.873990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:09.874841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:09.895986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:09.900859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:09.901584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:09.902539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:09.905148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:09.905977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:10.192086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:10.204481 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dce7002a-5497-49e1-ab0c-1f319027a22e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1282 microversion: 2.1 time: 0.334859 Sep 25 01:29:10.209797 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2482/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:09 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1282 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:10.504175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:10.504820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:10.536551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:10.543398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:10.549930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:10.555951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:10.556695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:10.557145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:10.772462 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:10.805671 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f7f2a098-9d7d-4804-b0a5-0f46046bbc8e tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1297 microversion: 2.1 time: 0.306217 Sep 25 01:29:10.821520 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2490/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:10 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1297 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:11.234113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:11.234730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:11.242341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:11.254432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:11.255120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:11.256058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:11.258760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:11.260268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:11.835659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:11.836899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:11.848876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:11.863703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:11.864198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7dba5ba-9348-4ab8-a980-75ede2062958 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 0.628755 Sep 25 01:29:11.865024 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2483/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:11 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:11.873638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:11.874301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:11.875212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:11.882148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:11.882839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:12.057881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:12.078977 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c82574b-9410-4ca2-a5d1-553798565356 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1363 microversion: 2.1 time: 0.247348 Sep 25 01:29:12.094890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2491/4974] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:11 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:12.891985 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:12.893559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:12.932232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:12.932738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:12.933180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:12.933933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:12.934380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:12.947625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:13.107231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:13.108466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:13.124035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:13.128491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:13.131168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:13.132122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:13.132751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:13.138406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:13.548079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:13.565341 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90bab251-1875-4565-b591-85c1cbc2ca62 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1351 microversion: 2.1 time: 0.461015 Sep 25 01:29:13.566640 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2492/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:13 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1351 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:13.600137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-04da2825-add1-4f18-8da1-b02821a2623c req-95257e9e-1a08-409b-91a4-f031bd21b133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff42b87f-24fa-4f64-b53d-d93c446a1f26", "tag": "9fc19143-54b6-4907-af5f-16bfede49d5c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:13.652962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-04da2825-add1-4f18-8da1-b02821a2623c req-95257e9e-1a08-409b-91a4-f031bd21b133 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:13.653691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-04da2825-add1-4f18-8da1-b02821a2623c req-95257e9e-1a08-409b-91a4-f031bd21b133 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:13.654540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-04da2825-add1-4f18-8da1-b02821a2623c req-95257e9e-1a08-409b-91a4-f031bd21b133 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:13.679804 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-04da2825-add1-4f18-8da1-b02821a2623c req-95257e9e-1a08-409b-91a4-f031bd21b133 service nova] Creating event network-changed:9fc19143-54b6-4907-af5f-16bfede49d5c for instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 on n-h2-master-1 Sep 25 01:29:13.699001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-04da2825-add1-4f18-8da1-b02821a2623c req-95257e9e-1a08-409b-91a4-f031bd21b133 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129663 Sep 25 01:29:13.699860 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2493/4976] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:29:14.123118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:14.132853 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6fd35b3e-eb21-423b-a3ae-812c46387cd5 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 1.247117 Sep 25 01:29:14.142528 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2484/4977] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:12 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:14.593331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:14.595953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:14.608110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:14.609004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:14.610029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:14.615641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:14.616374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:14.616996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:14.781686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:14.798012 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-42bb9ebd-1697-402e-80bf-4fa6f2fb65b2 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1351 microversion: 2.1 time: 0.209649 Sep 25 01:29:14.801363 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2494/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:14 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:15.172018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:15.173759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:15.195634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:15.196364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:15.197139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:15.198055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:15.198659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:15.199388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:15.611158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:15.625949 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d8dab7cb-873f-4b42-b78b-61ac1fc0877a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 0.464459 Sep 25 01:29:15.630479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2485/4979] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:15 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:15.827349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:15.828032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:15.857093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:15.859244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:15.859913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:15.860674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:15.861295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:15.862349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:16.591313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:16.600040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c45625e0-cc83-4d92-a8d7-3868ee82d1df tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1469 microversion: 2.1 time: 0.777641 Sep 25 01:29:16.600637 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2495/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:15 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1469 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:16.650983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:16.651616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:16.664892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:16.665601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:16.667023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:16.667928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:16.669573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:16.672933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:17.332515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:17.341658 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-85eb0acc-995d-45de-94d3-cd052647391d tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 0.695370 Sep 25 01:29:17.342938 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2486/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:16 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:17.483085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fd038cf5-a268-4f31-b016-f44217130328 req-a632de8a-d8c8-4528-a662-20eea773dac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694eaee5-7311-479d-816b-b14df6828b7c", "tag": "26f0e7ae-f692-4e66-a64d-38ce3ac14280"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:17.507338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd038cf5-a268-4f31-b016-f44217130328 req-a632de8a-d8c8-4528-a662-20eea773dac2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:17.508176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd038cf5-a268-4f31-b016-f44217130328 req-a632de8a-d8c8-4528-a662-20eea773dac2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:17.509359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd038cf5-a268-4f31-b016-f44217130328 req-a632de8a-d8c8-4528-a662-20eea773dac2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:17.520920 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fd038cf5-a268-4f31-b016-f44217130328 req-a632de8a-d8c8-4528-a662-20eea773dac2 service nova] Creating event network-changed:26f0e7ae-f692-4e66-a64d-38ce3ac14280 for instance 694eaee5-7311-479d-816b-b14df6828b7c on n-h1-master-1 Sep 25 01:29:17.537173 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fd038cf5-a268-4f31-b016-f44217130328 req-a632de8a-d8c8-4528-a662-20eea773dac2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058247 Sep 25 01:29:17.538395 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2496/4982] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:29:17.626480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:17.627599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:17.634827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:17.635898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:17.636839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:17.637859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:17.638577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:17.639241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:18.287507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:18.300529 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37fe6b8a-c093-4d6b-b69d-787ca9119944 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1469 microversion: 2.1 time: 0.676759 Sep 25 01:29:18.303965 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2487/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:17 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1469 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:18.365574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:18.366552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:18.372909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:18.373676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:18.374316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:18.375202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:18.375822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:18.376411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:18.833937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:18.851546 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-942325ed-615e-4b9b-a1ce-8ad33507d9e1 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 0.490327 Sep 25 01:29:18.852347 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2497/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:18 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:19.326665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:19.334281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:19.341572 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:19.344289 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=12 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:19.348391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:19.351577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:19.358884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:19.359992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:19.360691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:19.361605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:19.676960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:19.685983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a00d61db-4e0d-46cc-a906-bac7c1bb8f5a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1469 microversion: 2.1 time: 0.362765 Sep 25 01:29:19.686948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2488/4985] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:19 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:19.879561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:19.881212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:19.889645 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:19.894500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:19.895266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:19.896026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:19.897084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:19.898352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:19.899103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:20.461845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8a548101-cd45-40d3-a0f2-2b38ac9c62fc req-5d6a3ef8-c278-479d-9aec-f44eecbdb880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff42b87f-24fa-4f64-b53d-d93c446a1f26", "name": "network-vif-plugged", "status": "completed", "tag": "9fc19143-54b6-4907-af5f-16bfede49d5c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:20.479711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8a548101-cd45-40d3-a0f2-2b38ac9c62fc req-5d6a3ef8-c278-479d-9aec-f44eecbdb880 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:20.481241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8a548101-cd45-40d3-a0f2-2b38ac9c62fc req-5d6a3ef8-c278-479d-9aec-f44eecbdb880 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:20.482071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8a548101-cd45-40d3-a0f2-2b38ac9c62fc req-5d6a3ef8-c278-479d-9aec-f44eecbdb880 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:20.504987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8a548101-cd45-40d3-a0f2-2b38ac9c62fc req-5d6a3ef8-c278-479d-9aec-f44eecbdb880 service nova] Creating event network-vif-plugged:9fc19143-54b6-4907-af5f-16bfede49d5c for instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 on n-h2-master-1 Sep 25 01:29:20.510923 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8a548101-cd45-40d3-a0f2-2b38ac9c62fc req-5d6a3ef8-c278-479d-9aec-f44eecbdb880 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052574 Sep 25 01:29:20.512156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2489/4986] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:29:20.620997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:20.633608 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-742d2e1a-c69c-417a-a0fa-7eb0ccc7157e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 0.758606 Sep 25 01:29:20.641504 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2498/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:19 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:20.712325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:20.713228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:20.722441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:20.723922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:20.725039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:20.725942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:20.726523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:20.727117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:21.170737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:21.189879 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f2946b7c-f08b-4c49-b2ca-7af75372d17c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1469 microversion: 2.1 time: 0.480453 Sep 25 01:29:21.191009 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2490/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:20 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1469 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:21.655225 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:21.656507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:21.664458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:21.665182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:21.665641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:21.666506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:21.667106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:21.667529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:21.933561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:21.943771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-278e6f4b-0b41-4ecd-a25f-faf17cd216b3 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1324 microversion: 2.1 time: 0.292502 Sep 25 01:29:21.957011 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2499/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:21 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:29:22.215937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:22.216724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:22.230653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.231156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.231598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:22.232320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.237242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.238880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:22.550873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-74d932d8-7abb-4918-8f27-2423eb62d541 req-c9d2e67b-1f5b-49d4-9ea1-173b050a89cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694eaee5-7311-479d-816b-b14df6828b7c", "name": "network-vif-plugged", "status": "completed", "tag": "26f0e7ae-f692-4e66-a64d-38ce3ac14280"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:22.570052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-74d932d8-7abb-4918-8f27-2423eb62d541 req-c9d2e67b-1f5b-49d4-9ea1-173b050a89cf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.570951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-74d932d8-7abb-4918-8f27-2423eb62d541 req-c9d2e67b-1f5b-49d4-9ea1-173b050a89cf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.571853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-74d932d8-7abb-4918-8f27-2423eb62d541 req-c9d2e67b-1f5b-49d4-9ea1-173b050a89cf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:22.622780 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-74d932d8-7abb-4918-8f27-2423eb62d541 req-c9d2e67b-1f5b-49d4-9ea1-173b050a89cf service nova] Creating event network-vif-plugged:26f0e7ae-f692-4e66-a64d-38ce3ac14280 for instance 694eaee5-7311-479d-816b-b14df6828b7c on n-h1-master-1 Sep 25 01:29:22.651862 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-74d932d8-7abb-4918-8f27-2423eb62d541 req-c9d2e67b-1f5b-49d4-9ea1-173b050a89cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099280 Sep 25 01:29:22.657838 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2500/4990] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:29:22.719382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:22.735223 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d8084759-4356-4dbb-9876-bcb39215d77b tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1469 microversion: 2.1 time: 0.523866 Sep 25 01:29:22.736980 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2491/4991] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:22 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:22.821967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:22.824708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:22.832403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.833169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.833857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:22.834567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.835219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.835799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:22.862902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lazy-loading 'flavor' on Instance uuid e302d703-9875-41fe-a761-c059edf4ead9 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:29:22.969623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:22.971043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:22.986734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.987603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.988208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:22.990720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:22.992579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:22.997778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.090753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9ae782da-e17b-44e3-b812-b35e6e050b29 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/action" status: 200 len: 32 microversion: 2.1 time: 0.261690 Sep 25 01:29:23.091449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2501/4992] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:29:22 2022] POST /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:29:23.108231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:23.109996 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:23.118523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.119098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.119805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.120631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.121195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.121885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.382939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:23.403469 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d1adb89c-2161-444e-b738-2aa007996005 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1521 microversion: 2.1 time: 0.438311 Sep 25 01:29:23.404670 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2492/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:22 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:29:23.446227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:23.449284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:23.465040 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:23.476862 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2605a48-e5ea-4336-b0e2-5075889e8a97 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.378719 Sep 25 01:29:23.479230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.479948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.480607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.481417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.481922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.482462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.491407 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2502/4994] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:23 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:23.514337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] HTTP exception thrown: Instance is not a member of specified network Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Request method failure captured: Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26/ips/invalid HTTP/1.1 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL67hcFNxBLTXKQOrG6DVwpwWfl1aENk8FfFCUCKrOb7DTwkNPjkc6G1k5ARTVcwVIbS1iR3kEoXJxJPA9lQJ1ytJr8WhiR7doswfyg0iMaA09ksjj8DzLq5sPWgVH8B-fNmeXcKI4zUNRKAADzYRLxr0f-jUuYTm1iZtqHikqfgyrSQ Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0f7aff60fed41988176a7b46c5f2953 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0f7aff60fed41988176a7b46c5f2953"}]}] Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0f7aff60fed41988176a7b46c5f2953 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerAddressesNegativeTestJSON-2009801224-project Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9ac2837cd4e04995a4b7aa33aa7b5ecf Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2009801224-project Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: exception: Instance is not a member of specified network Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': 'ff42b87f-24fa-4f64-b53d-d93c446a1f26', 'id': 'invalid'} Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 25 01:29:23.524054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.531094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:29:23.533800 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8674023e-9765-4308-ac43-2ce40efbb9ab tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.103949 Sep 25 01:29:23.535941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2493/4995] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:29:23 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26/ips/invalid => generated 91 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:29:23.545477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c437149-1a92-4334-bbc8-d9cdceb519fe tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:23.546073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1c437149-1a92-4334-bbc8-d9cdceb519fe tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Failed to fetch instance by id 999 {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 25 01:29:23.546673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-1c437149-1a92-4334-bbc8-d9cdceb519fe tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] HTTP exception thrown: Instance 999 could not be found. Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c437149-1a92-4334-bbc8-d9cdceb519fe tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Request method failure captured: Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL67hcFNxBLTXKQOrG6DVwpwWfl1aENk8FfFCUCKrOb7DTwkNPjkc6G1k5ARTVcwVIbS1iR3kEoXJxJPA9lQJ1ytJr8WhiR7doswfyg0iMaA09ksjj8DzLq5sPWgVH8B-fNmeXcKI4zUNRKAADzYRLxr0f-jUuYTm1iZtqHikqfgyrSQ Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: d0f7aff60fed41988176a7b46c5f2953 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0f7aff60fed41988176a7b46c5f2953"}]}] Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: d0f7aff60fed41988176a7b46c5f2953 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerAddressesNegativeTestJSON-2009801224-project Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9ac2837cd4e04995a4b7aa33aa7b5ecf Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2009801224-project Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 999 could not be found. Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': '999'} Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 25 01:29:23.548778 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:23.554455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c437149-1a92-4334-bbc8-d9cdceb519fe tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:29:23.554455 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1c437149-1a92-4334-bbc8-d9cdceb519fe tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.011541 Sep 25 01:29:23.558124 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2503/4996] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 25 01:29:23 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:29:23.564910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:23.566069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:23.572911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.573490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.573938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.574715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.575169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.575792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.605047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:29:23.693433 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cba59039-c9d0-47cf-9619-4907cdb9b47a tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 204 len: 0 microversion: 2.1 time: 0.132632 Sep 25 01:29:23.694135 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2494/4997] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:29:23 2022] DELETE /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:29:23.706515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:23.707833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:23.716421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.717317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.718047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.719145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.719848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.721198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.728637 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:23.768775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:23.769704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:23.779501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.779994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.782897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:23.783960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:23.784649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:23.785193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:24.031243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:24.039742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cdb1c80b-22fc-4b5e-a870-7651ff98f30b tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1527 microversion: 2.1 time: 0.340215 Sep 25 01:29:24.040610 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2504/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:23 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1527 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:24.081471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:24.090698 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5047406a-1e0a-4d66-bba1-fbbf31c85a3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1469 microversion: 2.1 time: 0.329979 Sep 25 01:29:24.092007 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2495/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:23 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1469 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:24.506706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:24.507559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:24.520900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:24.522144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:24.522862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:24.523827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:24.524936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:24.529305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:24.724169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:24.749258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb97166d-462b-41b2-9444-76b79ea6997d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.242548 Sep 25 01:29:24.757261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2505/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:24 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:25.068101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:25.068722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:25.075301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.075792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.076225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.076920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.077367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.078024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.115979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:25.116844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:25.124992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.125755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.126300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.127140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.127694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.128124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.452927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:25.467452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b71bacf-03af-4870-97d2-152ae50fa4cd tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1527 microversion: 2.1 time: 0.403395 Sep 25 01:29:25.471488 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2496/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:25 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1527 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:25.528623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:25.539091 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b520276b-ee41-4f60-ad2c-783d0bd34cf6 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1640 microversion: 2.1 time: 0.429767 Sep 25 01:29:25.542660 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2506/5002] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:25 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1640 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:29:25.567559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:25.568747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:25.582064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.586199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.586986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.587956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.588645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.589284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.596828 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:25.780508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:25.781133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:25.791056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.792080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.792864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:25.794236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:25.796921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:25.797603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:26.210954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:26.225059 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9abb833-03f0-418d-bf50-28e431be26fa tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1640 microversion: 2.1 time: 0.663708 Sep 25 01:29:26.225694 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2497/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:25 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1640 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:26.248666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:26.249568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:26.260451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:26.261653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:26.262670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:26.263733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:26.264444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:26.265333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:26.272576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:26.284872 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-efeb12ad-d039-4fc6-88fd-94371bf47388 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.508105 Sep 25 01:29:26.288663 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2507/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:25 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:29:26.490653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:26.491283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:26.499412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:26.499907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:26.501719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:26.502634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:26.503265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:26.504017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:27.323420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:27.343887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f0e7615-4ba7-41d0-9350-5a5ecba31858 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1527 microversion: 2.1 time: 0.857634 Sep 25 01:29:27.362541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2508/5005] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:26 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1527 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:29:27.367726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:27.368355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:27.403501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:27.404021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:27.404633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:27.406542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:27.407163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:27.409033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:27.531468 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d7566fe-3601-4eb0-8826-889306c22783 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1791 microversion: 2.1 time: 1.282788 Sep 25 01:29:27.533679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2498/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:26 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1791 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:27.766513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9f98ef1b-b0ef-49ae-b502-afabb673f4ae req-434af6e3-539b-47c6-9fb2-446b87a178f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff42b87f-24fa-4f64-b53d-d93c446a1f26", "name": "network-vif-deleted", "tag": "9fc19143-54b6-4907-af5f-16bfede49d5c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:27.790931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9f98ef1b-b0ef-49ae-b502-afabb673f4ae req-434af6e3-539b-47c6-9fb2-446b87a178f7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:27.791503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9f98ef1b-b0ef-49ae-b502-afabb673f4ae req-434af6e3-539b-47c6-9fb2-446b87a178f7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:27.792111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9f98ef1b-b0ef-49ae-b502-afabb673f4ae req-434af6e3-539b-47c6-9fb2-446b87a178f7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:27.805575 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9f98ef1b-b0ef-49ae-b502-afabb673f4ae req-434af6e3-539b-47c6-9fb2-446b87a178f7 service nova] Creating event network-vif-deleted:9fc19143-54b6-4907-af5f-16bfede49d5c for instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 on n-h2-master-1 Sep 25 01:29:27.813665 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9f98ef1b-b0ef-49ae-b502-afabb673f4ae req-434af6e3-539b-47c6-9fb2-446b87a178f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053820 Sep 25 01:29:27.815758 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2499/5007] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:29:27.873797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:27.885961 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-411dfa4a-5986-444e-9613-f2688194b147 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.522087 Sep 25 01:29:27.898697 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2509/5008] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:27 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:28.383102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:28.383748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:28.397030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:28.401377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:28.402163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:28.402680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:28.403381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:28.405279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:28.461136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:28.462070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:28.462667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:28.463309 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lazy-loading 'fault' on Instance uuid ff42b87f-24fa-4f64-b53d-d93c446a1f26 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:29:28.541542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac2837cd4e04995a4b7aa33aa7b5ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7aff60fed41988176a7b46c5f2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:28.557964 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5c1fc78-3c5b-4a20-87d8-51c493b2bd18 tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 200 len: 1314 microversion: 2.1 time: 0.192303 Sep 25 01:29:28.564634 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2500/5009] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:28 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:28.913463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:28.914902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:28.922297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:28.923124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:28.924576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:28.925610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:28.926301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:28.926934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:29.244543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:29.286315 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4919419a-74bd-4b31-9807-1137271ae2f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.376891 Sep 25 01:29:29.301435 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2510/5010] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:28 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:29.586483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:29.587839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] [instance: ff42b87f-24fa-4f64-b53d-d93c446a1f26] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:29.595532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:29.596454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:29.597107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:29.598377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:29.599067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:29.600854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:29.617466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] HTTP exception thrown: Instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 could not be found. Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Request method failure captured: Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 HTTP/1.1 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL67hcFNxBLTXKQOrG6DVwpwWfl1aENk8FfFCUCKrOb7DTwkNPjkc6G1k5ARTVcwVIbS1iR3kEoXJxJPA9lQJ1ytJr8WhiR7doswfyg0iMaA09ksjj8DzLq5sPWgVH8B-fNmeXcKI4zUNRKAADzYRLxr0f-jUuYTm1iZtqHikqfgyrSQ Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: d0f7aff60fed41988176a7b46c5f2953 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0f7aff60fed41988176a7b46c5f2953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0f7aff60fed41988176a7b46c5f2953"}]}] Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: d0f7aff60fed41988176a7b46c5f2953 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2009801224 Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerAddressesNegativeTestJSON-2009801224-project Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9ac2837cd4e04995a4b7aa33aa7b5ecf Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2009801224-project Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 could not be found. Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ff42b87f-24fa-4f64-b53d-d93c446a1f26'} Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 could not be found. Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 could not be found. Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:29.619665 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 could not be found. Sep 25 01:29:29.623874 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:29.625707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] Returning 404 to user: Instance ff42b87f-24fa-4f64-b53d-d93c446a1f26 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:29:29.627889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3582afd-7f45-404c-9d88-223c8f8a494e tempest-ServerAddressesNegativeTestJSON-2009801224 tempest-ServerAddressesNegativeTestJSON-2009801224-project] 10.222.0.16 "GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26" status: 404 len: 111 microversion: 2.1 time: 0.045386 Sep 25 01:29:29.629110 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2501/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:29 2022] GET /compute/v2.1/servers/ff42b87f-24fa-4f64-b53d-d93c446a1f26 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:29:30.314048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:30.314681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:30.333115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:30.333675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:30.334088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:30.334815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:30.337126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:30.337602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:31.074907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:31.114834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be8631c6-addc-48e7-a337-f7c224f6f855 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.804667 Sep 25 01:29:31.116639 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2511/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:30 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:31.446851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4a4d4db5-92dc-4bec-882c-34920b8d4faf req-c14e4960-090c-4f43-a34b-956be385aade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694eaee5-7311-479d-816b-b14df6828b7c", "tag": "26f0e7ae-f692-4e66-a64d-38ce3ac14280"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:31.473062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4a4d4db5-92dc-4bec-882c-34920b8d4faf req-c14e4960-090c-4f43-a34b-956be385aade service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:31.473873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4a4d4db5-92dc-4bec-882c-34920b8d4faf req-c14e4960-090c-4f43-a34b-956be385aade service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:31.476059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4a4d4db5-92dc-4bec-882c-34920b8d4faf req-c14e4960-090c-4f43-a34b-956be385aade service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:31.493987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4a4d4db5-92dc-4bec-882c-34920b8d4faf req-c14e4960-090c-4f43-a34b-956be385aade service nova] Creating event network-changed:26f0e7ae-f692-4e66-a64d-38ce3ac14280 for instance 694eaee5-7311-479d-816b-b14df6828b7c on n-h1-master-1 Sep 25 01:29:31.510679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4a4d4db5-92dc-4bec-882c-34920b8d4faf req-c14e4960-090c-4f43-a34b-956be385aade service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068195 Sep 25 01:29:31.511804 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2502/5013] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:29:32.143413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:32.147307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:32.162319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:32.163516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:32.164132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:32.180488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:32.181439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:32.182126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:32.978280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:32.996427 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b8d2f60-ca1b-4567-ba9c-4ad59f931265 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.858222 Sep 25 01:29:32.999703 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2512/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:32 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:34.026562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:34.027878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:34.035966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:34.036715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:34.037324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:34.038246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:34.038894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:34.039485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:34.492480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:34.507125 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-544e0013-9bd9-4f29-8270-05b37cdf1187 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.484974 Sep 25 01:29:34.509004 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2503/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:34 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:35.536859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:35.539372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:35.558904 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=57 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:35.565369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:35.566203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:35.566802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:35.567755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:35.568434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:35.569259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:35.866935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:35.886925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a735c334-80a1-46b8-8a73-2b9af637c07c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.354755 Sep 25 01:29:35.888602 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2513/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:35 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:36.911495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:36.912123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:36.916645 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:36.927887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:36.928389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:36.928832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:36.929594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:36.930057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:36.930490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:37.424804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:37.439038 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d31d3bf1-c1a0-41a7-875c-970b3ae6803f tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.530195 Sep 25 01:29:37.439873 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2504/5017] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:36 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:38.466308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:38.467555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:38.475424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:38.476486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:38.477143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:38.479607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:38.480826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:38.483509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:38.949912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:38.971753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db0f19e6-d208-419a-a138-a411c141bbc8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.509539 Sep 25 01:29:38.974027 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2514/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:38 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:40.002456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:40.003092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:40.015164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:40.015658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:40.019100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:40.020754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:40.022800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:40.029030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:40.542964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:40.571679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7dd16418-29eb-49b3-90dd-af9a5d0cfd69 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.573473 Sep 25 01:29:40.575082 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2505/5019] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:39 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:41.602063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:41.602703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:41.615136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:41.622530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:41.623037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:41.623811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:41.624289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:41.624729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:41.989172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:42.009066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5a7b5dcd-b36d-45ff-975e-209cbad09e85 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.403673 Sep 25 01:29:42.009808 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2515/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:41 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:43.038504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:43.040538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:43.054612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:43.058500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:43.059391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:43.060881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:43.064385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:43.065108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:43.861516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:43.875354 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9384535-5dd5-4965-84d5-6209c506f118 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.841686 Sep 25 01:29:43.878481 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2506/5021] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:43 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:44.910155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:44.912616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:44.925673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:44.926552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:44.927179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:44.928731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:44.929358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:44.929969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:45.435049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:45.455855 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0e4e94f-a007-4b11-bbda-02c4131da083 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.552131 Sep 25 01:29:45.471075 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2516/5022] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:44 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:46.481896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:46.482679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:46.495291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:46.500121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:46.501491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:46.502372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:46.502959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:46.503495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:47.808194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:47.830161 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ca643f1-bb11-4064-9e92-f2d18a5a56da tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 1.352443 Sep 25 01:29:47.833677 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2507/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:46 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:48.858190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:48.870952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:48.883208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:48.890217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:48.895864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:48.897038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:48.902122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:48.905351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:49.230401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a35447f1-2fc5-4596-855b-dd72ad8b9260 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Action: 'create', calling method: .version_select at 0x7f7bea9d9940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:49.284894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a35447f1-2fc5-4596-855b-dd72ad8b9260 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Getting quotas for project 2d08c63381bf4c438f6c384826265c65. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:29:49.306787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a35447f1-2fc5-4596-855b-dd72ad8b9260 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Getting quotas for user a9547b1dc9c84b9d8b3c03a87815643b and project 2d08c63381bf4c438f6c384826265c65. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:29:49.450411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a35447f1-2fc5-4596-855b-dd72ad8b9260 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Getting quotas for project 2d08c63381bf4c438f6c384826265c65. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:29:49.482093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a35447f1-2fc5-4596-855b-dd72ad8b9260 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Getting quotas for user a9547b1dc9c84b9d8b3c03a87815643b and project 2d08c63381bf4c438f6c384826265c65. Resources: {'server_groups'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:29:49.502008 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a35447f1-2fc5-4596-855b-dd72ad8b9260 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.563936 Sep 25 01:29:49.508407 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2508/5024] 10.222.0.16 () {62 vars in 1214 bytes} [Sun Sep 25 01:29:48 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:29:49.515868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b36304f5-fdb2-4e65-9173-034f14949af7 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:49.530298 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b36304f5-fdb2-4e65-9173-034f14949af7 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018988 Sep 25 01:29:49.540270 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2509/5025] 10.222.0.16 () {60 vars in 1193 bytes} [Sun Sep 25 01:29:49 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:29:49.545337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e83b4356-d3a5-40a5-9f48-0f4991393da3 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:49.562245 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e83b4356-d3a5-40a5-9f48-0f4991393da3 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946" status: 200 len: 235 microversion: 2.64 time: 0.020526 Sep 25 01:29:49.563641 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2510/5026] 10.222.0.16 () {60 vars in 1304 bytes} [Sun Sep 25 01:29:49 2022] GET /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946 => generated 235 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:29:49.574357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1c1715aa-30be-4031-953f-36badc481b71 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:49.603337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1c1715aa-30be-4031-953f-36badc481b71 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946" status: 204 len: 0 microversion: 2.64 time: 0.032660 Sep 25 01:29:49.604719 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2511/5027] 10.222.0.16 () {60 vars in 1307 bytes} [Sun Sep 25 01:29:49 2022] DELETE /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:29:49.619197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee50ebf4-c1c3-47d4-8ef7-ba196d1f2bc5 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:49.626947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ee50ebf4-c1c3-47d4-8ef7-ba196d1f2bc5 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] HTTP exception thrown: Instance group 8c5bddec-b315-4556-a0bb-4943b7d6b946 could not be found. Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee50ebf4-c1c3-47d4-8ef7-ba196d1f2bc5 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Request method failure captured: Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946 HTTP/1.1 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL68MGiJCW-Y20V3WYDY5mVONcwgNpCNY-9efcTyD3AbIuMdpBGJClnUFZs58Prc8DFWc4gpybt9ovD-FRF8zmaN4Xff3mpzO37nJRSYDcsN9NyyPMFcUStUCXDNCtKUlm8MBawz788ZV7Ko2Ga0nfCGWzgY8z5-AyV7EmU-nSTFPQV4 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.64 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 2d08c63381bf4c438f6c384826265c65 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerGroup264TestJSON-183740280 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2d08c63381bf4c438f6c384826265c65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2d08c63381bf4c438f6c384826265c65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2d08c63381bf4c438f6c384826265c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2d08c63381bf4c438f6c384826265c65"}]}] Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerGroup264TestJSON-183740280 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 2d08c63381bf4c438f6c384826265c65 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerGroup264TestJSON-183740280 Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerGroup264TestJSON-183740280-project Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: a9547b1dc9c84b9d8b3c03a87815643b Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerGroup264TestJSON-183740280-project Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: exception: Instance group 8c5bddec-b315-4556-a0bb-4943b7d6b946 could not be found. Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8c5bddec-b315-4556-a0bb-4943b7d6b946'} Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8c5bddec-b315-4556-a0bb-4943b7d6b946 could not be found. Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8c5bddec-b315-4556-a0bb-4943b7d6b946 could not be found. Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:49.629023 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:49.632891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:49.632891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:49.632891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:29:49.632891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:29:49.632891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8c5bddec-b315-4556-a0bb-4943b7d6b946 could not be found. Sep 25 01:29:49.632891 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:29:49.634032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee50ebf4-c1c3-47d4-8ef7-ba196d1f2bc5 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] Returning 404 to user: Instance group 8c5bddec-b315-4556-a0bb-4943b7d6b946 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:29:49.635044 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee50ebf4-c1c3-47d4-8ef7-ba196d1f2bc5 tempest-ServerGroup264TestJSON-183740280 tempest-ServerGroup264TestJSON-183740280-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946" status: 404 len: 117 microversion: 2.64 time: 0.025252 Sep 25 01:29:49.636137 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2512/5028] 10.222.0.16 () {60 vars in 1307 bytes} [Sun Sep 25 01:29:49 2022] DELETE /compute/v2.1/os-server-groups/8c5bddec-b315-4556-a0bb-4943b7d6b946 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:29:49.752616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:49.775666 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5479b2a2-37db-4ca4-842a-c1980730b020 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.921398 Sep 25 01:29:49.777305 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2517/5029] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:48 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:50.801955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:50.802583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:50.810293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:50.822262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:50.822986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:50.823952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:50.824697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:50.825322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:51.090310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:51.100125 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22b930f5-dc18-4801-a112-06d9303a3225 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.302555 Sep 25 01:29:51.103795 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2513/5030] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:50 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:52.125045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:52.125826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:52.133664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:52.150280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:52.150992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:52.156532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:52.158065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:52.158687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:52.505670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:52.520656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e3178e6-f106-478e-a162-204a45ddd365 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1736 microversion: 2.1 time: 0.399562 Sep 25 01:29:52.521486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2518/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:52 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1736 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:53.545285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:53.546057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:53.559365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:53.560883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:53.561548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:53.566367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:53.567600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:53.568217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:54.012559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:54.022140 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1eb5101a-1551-4837-bce0-09025785ec17 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1716 microversion: 2.1 time: 0.481392 Sep 25 01:29:54.023072 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2514/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:53 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1716 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:54.194554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:54.195636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:54.202997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:54.203775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:54.204555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:54.205663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:54.206287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:54.206882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:54.226019 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=89 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:54.341080 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Cannot 'detach_volume' instance e302d703-9875-41fe-a761-c059edf4ead9 while it is in vm_state rescued Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments/c0c3bd98-6f30-401a-8362-d6dc615f458c HTTP/1.1 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: exception: Cannot 'detach_volume' instance e302d703-9875-41fe-a761-c059edf4ead9 while it is in vm_state rescued Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': 'e302d703-9875-41fe-a761-c059edf4ead9', 'id': 'c0c3bd98-6f30-401a-8362-d6dc615f458c'} Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e302d703-9875-41fe-a761-c059edf4ead9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e302d703-9875-41fe-a761-c059edf4ead9 while it is in vm_state rescued Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:54.343369 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:29:54.347476 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:29:54.347476 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:29:54.347476 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:29:54.347476 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:29:54.347476 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e302d703-9875-41fe-a761-c059edf4ead9 while it is in vm_state rescued Sep 25 01:29:54.347476 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:29:54.357675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 409 to user: Cannot 'detach_volume' instance e302d703-9875-41fe-a761-c059edf4ead9 while it is in vm_state rescued {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:29:54.358909 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be8db109-2f28-4eb8-a8a8-bd4a4395bb7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments/c0c3bd98-6f30-401a-8362-d6dc615f458c" status: 409 len: 152 microversion: 2.1 time: 0.168867 Sep 25 01:29:54.361518 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2519/5033] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:29:54 2022] DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments/c0c3bd98-6f30-401a-8362-d6dc615f458c => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:29:54.374035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:29:54.377973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:54.402689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:54.403422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:54.404085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:54.405011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:54.405821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:54.406446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:54.533577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea4d96d8-c486-4d4e-a8b9-4c6cde7f7ff5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/action" status: 202 len: 0 microversion: 2.1 time: 0.166529 Sep 25 01:29:54.535550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2515/5034] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:29:54 2022] POST /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:29:54.551600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:54.553524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:54.574903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:54.575954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:54.576558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:54.577906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:54.578530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:54.580114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:55.513979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:55.533780 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7eac58d3-669b-431b-97e4-74c19af72c9c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1724 microversion: 2.1 time: 0.993348 Sep 25 01:29:55.534382 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2520/5035] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:54 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1724 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:56.565536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:56.567148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:56.575170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:56.576181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:56.576928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:56.578243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:56.580236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:56.580914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:56.632449 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:57.055888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:57.077846 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9167da1-509f-4516-b74e-495b410a896d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1724 microversion: 2.1 time: 0.521073 Sep 25 01:29:57.080433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2516/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:56 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1724 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:58.112559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:58.114820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:58.127550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:58.128267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:58.128874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:58.129957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:58.130736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:58.131383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:58.493894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:29:58.505590 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db2d174e-8c53-4416-9b2c-47cd07a888c8 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1724 microversion: 2.1 time: 0.405052 Sep 25 01:29:58.506671 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2521/5037] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:58 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:29:59.538847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:29:59.543129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:29:59.551924 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:29:59.569004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:59.569004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:59.572579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:29:59.573793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:29:59.574631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:29:59.576814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:00.103701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:00.117501 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2b179e0-9f43-4ce7-9a69-de73db149c5d tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1730 microversion: 2.1 time: 0.590868 Sep 25 01:30:00.138066 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2517/5038] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:29:59 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1730 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:00.145968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:00.146646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:00.154205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:00.155048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:00.155743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:00.156727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:00.157436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:00.158098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:00.299871 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4dd4a0b4-49c0-411c-8be8-39cbafca3e7c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159441 Sep 25 01:30:00.310034 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2522/5039] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:30:00 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:03.575444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d8a56a94-c726-49c3-8731-8c2fb7805949 req-3b5dd122-a62d-4b82-8623-8f0ea08806b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e302d703-9875-41fe-a761-c059edf4ead9", "tag": "d65b427c-d3cb-4557-bdec-1c826de4e774"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:03.599426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d8a56a94-c726-49c3-8731-8c2fb7805949 req-3b5dd122-a62d-4b82-8623-8f0ea08806b6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:03.600082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d8a56a94-c726-49c3-8731-8c2fb7805949 req-3b5dd122-a62d-4b82-8623-8f0ea08806b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:03.601017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d8a56a94-c726-49c3-8731-8c2fb7805949 req-3b5dd122-a62d-4b82-8623-8f0ea08806b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:03.620566 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d8a56a94-c726-49c3-8731-8c2fb7805949 req-3b5dd122-a62d-4b82-8623-8f0ea08806b6 service nova] Creating event network-changed:d65b427c-d3cb-4557-bdec-1c826de4e774 for instance e302d703-9875-41fe-a761-c059edf4ead9 on n-h1-master-1 Sep 25 01:30:03.626932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d8a56a94-c726-49c3-8731-8c2fb7805949 req-3b5dd122-a62d-4b82-8623-8f0ea08806b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055340 Sep 25 01:30:03.628331 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2518/5040] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:05.728320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cb053ec3-e124-4551-abc6-ac5d53a24069 req-7bca5f73-a664-4646-8bc3-c35fc99dedeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e302d703-9875-41fe-a761-c059edf4ead9", "tag": "d65b427c-d3cb-4557-bdec-1c826de4e774"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:05.746392 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=20 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:05.763042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cb053ec3-e124-4551-abc6-ac5d53a24069 req-7bca5f73-a664-4646-8bc3-c35fc99dedeb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:05.763535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cb053ec3-e124-4551-abc6-ac5d53a24069 req-7bca5f73-a664-4646-8bc3-c35fc99dedeb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:05.764153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cb053ec3-e124-4551-abc6-ac5d53a24069 req-7bca5f73-a664-4646-8bc3-c35fc99dedeb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:05.799656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cb053ec3-e124-4551-abc6-ac5d53a24069 req-7bca5f73-a664-4646-8bc3-c35fc99dedeb service nova] Creating event network-changed:d65b427c-d3cb-4557-bdec-1c826de4e774 for instance e302d703-9875-41fe-a761-c059edf4ead9 on n-h1-master-1 Sep 25 01:30:05.814199 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cb053ec3-e124-4551-abc6-ac5d53a24069 req-7bca5f73-a664-4646-8bc3-c35fc99dedeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091551 Sep 25 01:30:05.815223 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2523/5041] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:09.605680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-338662525", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:09.620525 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:09.698263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] validate_networks() for [('71e4e1be-67ed-48d4-ace9-d9390c58c6ba', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:30:11.943785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:30:11.945790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:30:11.947644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:30:11.949802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:30:11.952166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:30:12.042959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:12.045117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:12.046383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:12.048319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:12.049349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:12.055364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:12.100416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Getting quotas for project ba17f9b214fc4a1b8b543d1bf96cb68a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:30:12.116095 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Getting quotas for user 830045557dd94ea5947df0c661c2a069 and project ba17f9b214fc4a1b8b543d1bf96cb68a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:30:12.134062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:30:12.137489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:30:12.213431 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-936449e3-88f8-4882-8938-bcea90e0f45e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.844776 Sep 25 01:30:12.214744 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2519/5042] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:30:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:30:12.228156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c30704d-cdc3-4e8e-ab05-4c79036154a5 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:12.228869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c30704d-cdc3-4e8e-ab05-4c79036154a5 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:13.131191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c30704d-cdc3-4e8e-ab05-4c79036154a5 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:13.140217 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c30704d-cdc3-4e8e-ab05-4c79036154a5 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1222 microversion: 2.1 time: 0.917613 Sep 25 01:30:13.147111 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2524/5043] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:12 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1222 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:14.164934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:14.166242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:14.181184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:14.181820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:14.182445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:14.183643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:14.193454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:14.197497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:14.320588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:14.333710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b33669a-d9e2-4318-88b5-cce4c1182627 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1274 microversion: 2.1 time: 0.169424 Sep 25 01:30:14.334833 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2520/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:14 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:14.626345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1091080383", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "29c670bc-9133-4929-883b-0cc26463c2da"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1298653349", "security_groups": []}, "os:scheduler_hints": {"different_host": ["694eaee5-7311-479d-816b-b14df6828b7c"]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:14.713048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] validate_networks() for [('29c670bc-9133-4929-883b-0cc26463c2da', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:30:15.366671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:15.368060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:15.378588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:15.379088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:15.382104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:15.383433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:15.383919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:15.384688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:15.733136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:15.756242 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0aca54f1-a25b-41bb-8f6d-1ee1d30eb878 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1280 microversion: 2.1 time: 0.393080 Sep 25 01:30:15.757108 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2521/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:15 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1280 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:15.783299 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=23 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:16.160453 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:30:16.160896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:30:16.161389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:30:16.161835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:30:16.162256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:30:16.192398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:16.192908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:16.193354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:16.194129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:16.194598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:16.195033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:16.253490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Getting quotas for project dc6eecfc22d54d30a11c63b0d7518e4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:30:16.272880 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Getting quotas for user aa5f2510f105430fb01974c7a6e1579e and project dc6eecfc22d54d30a11c63b0d7518e4a. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:30:16.301551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:30:16.305166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:30:16.431734 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-258b153d-672c-404d-8800-3b46c5aa8bd7 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.809530 Sep 25 01:30:16.439512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2525/5046] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:30:14 2022] POST /compute/v2.1/servers => generated 361 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:30:16.445261 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4bf0427-c94d-4152-b354-02a30df81241 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:16.447150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4bf0427-c94d-4152-b354-02a30df81241 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:16.782147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:16.783056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:16.798245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:16.798897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:16.799630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:16.800585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:16.801057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:16.805598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:16.854616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4bf0427-c94d-4152-b354-02a30df81241 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:16.862690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4bf0427-c94d-4152-b354-02a30df81241 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1242 microversion: 2.1 time: 0.421960 Sep 25 01:30:16.868456 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2522/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:16 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1242 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:17.021148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:17.032745 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9725876-c97a-4006-91a5-dfd574b2aed3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1280 microversion: 2.1 time: 0.256231 Sep 25 01:30:17.033354 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2526/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:16 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:17.887864 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:17.891524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:17.899692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:17.900685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:17.901280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:17.902201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:17.902817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:17.903482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:18.056219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:18.057553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:18.069211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:18.070860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:18.071551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:18.073620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:18.075008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:18.086178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:18.822207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:18.835148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dfd64fed-6153-4c45-b161-65e99ac22650 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1294 microversion: 2.1 time: 0.953288 Sep 25 01:30:18.836242 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2523/5049] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:17 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1294 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:19.538048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:19.567187 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec8cdf3a-c8cb-4081-98f9-98ce8821f386 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 1.514815 Sep 25 01:30:19.569169 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2527/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:18 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:19.863028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:19.863657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:19.878076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:19.878572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:19.879013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:19.879727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:19.885181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:19.885711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:20.283124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:20.299464 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b09efcd-4bef-4363-81b3-d2a1f6513679 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.443248 Sep 25 01:30:20.300991 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2524/5051] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:19 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:20.594732 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:20.595976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:20.608721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:20.612739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:20.613479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:20.616319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:20.616964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:20.617603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:21.115137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:21.123327 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fa394cb9-e8ca-4d83-b24b-5b0f7204dfeb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.536213 Sep 25 01:30:21.124658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2528/5052] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:20 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:21.328113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:21.329268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:21.341749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:21.342245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:21.342800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:21.343689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:21.344145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:21.344632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:21.512413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:21.523184 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b18af64e-316f-4f34-b3c5-11179476baf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.201581 Sep 25 01:30:21.523184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2525/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:21 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:21.801796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bc41fdb7-f379-4409-82db-fd5af7b1c0de req-029b2456-6528-4606-9045-312c11e64b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:21.824738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bc41fdb7-f379-4409-82db-fd5af7b1c0de req-029b2456-6528-4606-9045-312c11e64b03 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:21.825169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bc41fdb7-f379-4409-82db-fd5af7b1c0de req-029b2456-6528-4606-9045-312c11e64b03 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:21.825672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bc41fdb7-f379-4409-82db-fd5af7b1c0de req-029b2456-6528-4606-9045-312c11e64b03 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:21.848523 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bc41fdb7-f379-4409-82db-fd5af7b1c0de req-029b2456-6528-4606-9045-312c11e64b03 service nova] Creating event network-changed:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:30:21.856118 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bc41fdb7-f379-4409-82db-fd5af7b1c0de req-029b2456-6528-4606-9045-312c11e64b03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071431 Sep 25 01:30:21.857039 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2529/5054] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:22.144876 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:22.154171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:22.155267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:22.164895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:22.165707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:22.166485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:22.167427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:22.168088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:22.169308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:22.546671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:22.548350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:22.558885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:22.559672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:22.560535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:22.561974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:22.563281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:22.563943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:22.861828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:22.870829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11f681cf-3c83-4f70-89fc-52fe276aae3a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.329025 Sep 25 01:30:22.871514 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2530/5055] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:22 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:23.018611 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:23.028203 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-208644ec-6404-40f2-8c1b-74a0098f9768 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.883987 Sep 25 01:30:23.029338 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2526/5056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:22 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:23.895814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:23.897096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:23.904689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:23.905443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:23.906627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:23.907585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:23.908051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:23.908490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:24.053365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:24.054011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:24.061966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:24.062668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:24.063577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:24.064993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:24.065651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:24.066863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:24.110302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:24.118723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7be2be54-2685-4af4-8a0e-ffdc61256a94 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.227820 Sep 25 01:30:24.133431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2531/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:23 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:24.401776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-297322d2-910e-43f9-853b-79a259a4aa26 req-b894107c-b6a0-4330-aff8-f6111285b96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed948d8-07f6-4cba-afb9-ff3b7231fa65", "tag": "86d4b538-a0f4-4c56-b4ff-29f5ce5a00b4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:24.423782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-297322d2-910e-43f9-853b-79a259a4aa26 req-b894107c-b6a0-4330-aff8-f6111285b96e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:24.424284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-297322d2-910e-43f9-853b-79a259a4aa26 req-b894107c-b6a0-4330-aff8-f6111285b96e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:24.424726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-297322d2-910e-43f9-853b-79a259a4aa26 req-b894107c-b6a0-4330-aff8-f6111285b96e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:24.426556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:24.440246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-297322d2-910e-43f9-853b-79a259a4aa26 req-b894107c-b6a0-4330-aff8-f6111285b96e service nova] Creating event network-changed:86d4b538-a0f4-4c56-b4ff-29f5ce5a00b4 for instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 on n-h2-master-1 Sep 25 01:30:24.444157 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4e86273-1cab-4e26-89d7-979ac1472acc tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.395486 Sep 25 01:30:24.445628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-297322d2-910e-43f9-853b-79a259a4aa26 req-b894107c-b6a0-4330-aff8-f6111285b96e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056610 Sep 25 01:30:24.446404 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2532/5058] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:24.457661 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2527/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:24 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:25.144214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:25.144990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:25.153716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:25.154531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:25.155276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:25.157200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:25.157915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:25.158344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:25.259971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:25.273240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f4f9b77-5497-4a90-8ba9-13f22efd2654 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.134603 Sep 25 01:30:25.273783 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2533/5060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:25 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:25.468441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:25.469813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:25.479669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:25.480370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:25.480807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:25.481570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:25.482094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:25.482518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.048805 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:26.057373 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ba72df7-b9ce-470a-85cd-63b78356b30d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.592890 Sep 25 01:30:26.058250 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2528/5061] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:25 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:26.226621 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:26.294218 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:26.300954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:26.301627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:26.317114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:26.317631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:26.318069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.318776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:26.319226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:26.319647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.524428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:26.525585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:26.534321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:26.535127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:26.535797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.537370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:26.537906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:26.538789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.607582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:30:26.799901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca82636a-2036-4133-a5ba-2b7ae20f2870 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 204 len: 0 microversion: 2.32 time: 0.603687 Sep 25 01:30:26.800966 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2534/5062] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:30:26 2022] DELETE /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:30:26.810047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:26.810832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:26.820044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:26.820892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:26.821759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.822747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:26.823365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:26.823939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:26.862393 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:27.035321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:27.037892 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=68 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:27.048544 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7970342f-20c9-4277-b29c-173ede1bf075 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.752209 Sep 25 01:30:27.049563 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2529/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:26 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:27.080874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:27.081629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:27.116159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:27.116669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:27.117103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:27.117909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:27.118361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:27.118787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:27.183662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:27.197710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:27.200176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:27.201748 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-112046b6-cdc3-4ce6-8716-579915a00d48 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2957 microversion: 2.32 time: 0.396349 Sep 25 01:30:27.207420 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2535/5064] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:26 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2957 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:30:27.338187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:27.349258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7174bb55-5b68-4972-b3b0-49c34b0d8454 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.272735 Sep 25 01:30:27.349959 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2530/5065] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:27 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:28.073790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:28.074421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:28.083566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.084242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.084689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.085450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.086085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.086573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.231388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:28.237091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:28.237804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:28.243829 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe5ea28c-c413-4b34-97cb-8351ca31e497 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.174227 Sep 25 01:30:28.245455 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2536/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:28 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:28.254222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.258790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.259548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.260504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.261313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.264072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.375258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:28.376439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:28.387267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.387959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.388732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.389654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.392409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.393258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.641176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:28.657812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:28.661899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:28.666072 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09d96962-6588-40d5-993c-f60c6dc45807 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2957 microversion: 2.32 time: 0.436801 Sep 25 01:30:28.666647 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2531/5067] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:28 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2957 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:28.682556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-33526272-2838-4445-91f9-7937870f1e7c req-702687cd-41a2-468a-9b72-8cfcaa4d35ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "name": "network-vif-plugged", "status": "completed", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:28.696431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-33526272-2838-4445-91f9-7937870f1e7c req-702687cd-41a2-468a-9b72-8cfcaa4d35ed service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:28.698215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-33526272-2838-4445-91f9-7937870f1e7c req-702687cd-41a2-468a-9b72-8cfcaa4d35ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:28.699200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-33526272-2838-4445-91f9-7937870f1e7c req-702687cd-41a2-468a-9b72-8cfcaa4d35ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:28.703113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:28.715127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5fdd2cbe-8d2a-4b03-ad39-1f697af64407 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.346414 Sep 25 01:30:28.716040 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2537/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:28 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:28.731614 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-33526272-2838-4445-91f9-7937870f1e7c req-702687cd-41a2-468a-9b72-8cfcaa4d35ed service nova] Creating event network-vif-plugged:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:30:28.741738 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-33526272-2838-4445-91f9-7937870f1e7c req-702687cd-41a2-468a-9b72-8cfcaa4d35ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071717 Sep 25 01:30:28.746208 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2532/5069] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:29.270294 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:29.274734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:29.290728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:29.291481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:29.297588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:29.298775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:29.299713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:29.300447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:29.440855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:29.463763 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c1a6910-dfce-4f40-88e2-07f214e28306 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.198994 Sep 25 01:30:29.464833 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2538/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:29 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:29.707289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:29.708721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:29.724643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:29.725147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:29.725622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:29.727071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:29.727537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:29.728421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:29.740134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:29.742104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:29.758104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:29.758640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:29.759148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:29.759897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:29.760397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:29.763257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:30.300215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:30.318562 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d304cb0c-7283-4bb9-a809-172952e756ef tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1322 microversion: 2.1 time: 0.582187 Sep 25 01:30:30.320860 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2539/5071] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:29 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:30.335630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:30.350465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:30.351963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:30.353283 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aab9d8da-501e-4b4a-a126-2a6585d04b3d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2957 microversion: 2.32 time: 0.657364 Sep 25 01:30:30.353904 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2533/5072] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:29 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2957 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:30.497262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:30.498365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:30.508236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:30.510223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:30.510223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:30.510223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:30.510829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:30.511329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:30.708847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:30.722728 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d42c7d6-a682-4594-82d3-8bdf03bf8c50 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.229096 Sep 25 01:30:30.724393 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2540/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:30 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:31.347521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:31.348079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:31.355706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:31.356473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:31.357173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:31.358128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:31.358787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:31.359690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:31.386218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:31.387512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:31.399730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:31.400726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:31.401322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:31.402341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:31.406650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:31.407772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.310503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:32.332016 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8afdecab-bc0c-4dd3-b19c-3a49152366f7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1516 microversion: 2.1 time: 0.988796 Sep 25 01:30:32.338809 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2534/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:31 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1516 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:32.358767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:32.360855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:32.361190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:32.373036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:32.373036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:32.373036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.373036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:32.373036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:32.373429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.374005 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:32.387391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:32.389592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:32.391756 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-526a83e9-d2e6-4fb3-b933-f83d7b504876 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2957 microversion: 2.32 time: 1.009637 Sep 25 01:30:32.395277 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2541/5075] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:31 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2957 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:30:32.400827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:32.403570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:32.421142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:32.425440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:32.428477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.432152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:32.433584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:32.434074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.469374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lazy-loading 'flavor' on Instance uuid ae2a4dc0-1850-4054-8224-cde43efb7ef4 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:30:32.504682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:32.521048 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4f3571a-2121-46e1-81d4-b0fb2a432a88 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.179139 Sep 25 01:30:32.523638 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2535/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:32 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:32.587271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff7fb196-34b3-4b22-86dc-0ac424db12c2 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action" status: 200 len: 32 microversion: 2.1 time: 0.190300 Sep 25 01:30:32.589847 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2542/5077] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:30:32 2022] POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:30:32.598937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:32.599553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:32.612606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:32.613497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:32.613936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.614649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:32.617500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:32.618110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:32.875011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:32.885703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02f82998-828c-44ff-833d-5cc91cb238d6 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.291599 Sep 25 01:30:32.895416 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2536/5078] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:32 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:33.046054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:33.047276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:33.067286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.069476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.070112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.071272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.071915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.072349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.186141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lazy-loading 'services' on Instance uuid e302d703-9875-41fe-a761-c059edf4ead9 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:30:33.324150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-276e0f0d-3237-4455-b52c-13332c8b7362 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments/c0c3bd98-6f30-401a-8362-d6dc615f458c" status: 202 len: 0 microversion: 2.1 time: 0.288311 Sep 25 01:30:33.325174 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2543/5079] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:30:33 2022] DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments/c0c3bd98-6f30-401a-8362-d6dc615f458c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:30:33.338141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:33.342166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:33.358542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.359757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.360275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.361035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.363740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.364190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.431511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:33.432686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:33.447056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.448887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.452068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.453876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.457117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.459091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.461478 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fdf18db1-86b1-442c-a8ee-1add159eeb23 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130909 Sep 25 01:30:33.462937 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2537/5080] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:33 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:33.548287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:33.549221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:33.557138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.558752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.559269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.560513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.561650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.562755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.731090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:33.751469 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f602d122-9d45-4953-b177-c5e39761feca tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.208520 Sep 25 01:30:33.757555 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2538/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:33 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:33.791117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:33.812145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:33.815426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:33.818711 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b9a280cb-1448-47a8-8b89-4635217cb408 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2936 microversion: 2.32 time: 0.393707 Sep 25 01:30:33.819717 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2544/5082] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:33 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2936 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:30:33.921147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:33.930123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:33.944270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.950752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.954097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:33.954901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:33.956511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:33.957635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.476215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:34.478448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:34.506952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.508313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.508783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.509554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.510020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.518931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.588029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:34.619461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3666643-bd73-42bd-8ac3-0a5df47b23f4 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.698684 Sep 25 01:30:34.633706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2626606b-7b6d-4a18-a7b8-d570d5c795cc tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155875 Sep 25 01:30:34.635304 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2539/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:33 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:34.646393 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2545/5084] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:34 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:30:34.651258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1e209d11-f519-441b-83f9-5c710946839e req-236944ff-770b-49c1-a630-4813b2d74ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-unplugged", "status": "completed", "tag": "5aa39579-ad32-4392-a851-b602c17f48a0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:34.676446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1e209d11-f519-441b-83f9-5c710946839e req-236944ff-770b-49c1-a630-4813b2d74ce7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.677355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1e209d11-f519-441b-83f9-5c710946839e req-236944ff-770b-49c1-a630-4813b2d74ce7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.677971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1e209d11-f519-441b-83f9-5c710946839e req-236944ff-770b-49c1-a630-4813b2d74ce7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.714540 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1e209d11-f519-441b-83f9-5c710946839e req-236944ff-770b-49c1-a630-4813b2d74ce7 service nova] Creating event network-vif-unplugged:5aa39579-ad32-4392-a851-b602c17f48a0 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:34.729301 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1e209d11-f519-441b-83f9-5c710946839e req-236944ff-770b-49c1-a630-4813b2d74ce7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089584 Sep 25 01:30:34.730613 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2540/5085] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:34.783873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:34.784320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:34.806254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.808632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.809281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.813278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.813993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.814601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.852490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:34.853261 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:34.868271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.868872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.869333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:34.871572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:34.872054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:34.872495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:35.383799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:35.407986 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5ff62b27-3384-4353-bdf6-a37ab12d3a76 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.630473 Sep 25 01:30:35.424048 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2546/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:34 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:35.641270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:35.644698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:35.664106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:35.667711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:35.669174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:35.672515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:35.676009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:35.680957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:35.769989 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74fc0370-5f72-4f9f-9b93-92953be7c2f3 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131715 Sep 25 01:30:35.771159 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2547/5087] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:35 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:35.787131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:35.790489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:35.814813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:35.819451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:35.823591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:35.825377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:35.828235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:35.828880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:36.706233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:36.722547 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6bd0282-1d71-4a03-830f-2280ef7814c0 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.948775 Sep 25 01:30:36.724144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2548/5088] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:35 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:36.738514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:36.739504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:36.746767 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:36.753294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:36.761248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:36.767165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:36.770006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:36.771409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:36.772423 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60d00ae8-b4fb-46e6-a001-93ac8185b425 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2936 microversion: 2.32 time: 1.925522 Sep 25 01:30:36.773175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:36.774229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:36.775184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:36.775841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:36.779854 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2541/5089] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:34 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2936 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:36.788559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:36.796297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:36.820793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:36.821714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:36.825857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:36.826616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:36.827088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:36.832002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:36.889826 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-78a0b0a0-7b41-4cc8-8b8a-11247d5fc0f0 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106850 Sep 25 01:30:36.891843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2542/5090] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:36 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:36.905775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-unplugged", "status": "completed", "tag": "b03ec708-b0f5-485e-9883-56cacce60459"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-unplugged", "status": "completed", "tag": "fde1c7f4-0458-4853-a17f-067df54210fd"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-unplugged", "status": "completed", "tag": "7aa07162-4d0d-4aed-bf40-436e8b476ed3"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-unplugged", "status": "completed", "tag": "7256f32a-8cf9-4e46-9caa-e40fd569b94c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:36.920461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:36.922867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:36.923613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:36.950769 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Creating event network-vif-unplugged:b03ec708-b0f5-485e-9883-56cacce60459 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:36.951444 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Creating event network-vif-unplugged:fde1c7f4-0458-4853-a17f-067df54210fd for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:36.952164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Creating event network-vif-unplugged:7aa07162-4d0d-4aed-bf40-436e8b476ed3 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:36.953681 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] Creating event network-vif-unplugged:7256f32a-8cf9-4e46-9caa-e40fd569b94c for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:36.964770 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-910d63ee-4db5-4c3c-bb80-ff6e4723ccc1 req-0af0993b-7f93-4e40-8ab1-61c5e73245ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.070275 Sep 25 01:30:36.966781 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2543/5091] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:37.013650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:37.038325 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-497fe7c3-5534-477b-ac9f-8287dab45e1c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.311183 Sep 25 01:30:37.039315 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2549/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:36 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:37.752351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:37.753098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:37.768750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:37.771027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:37.771479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:37.776968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:37.776968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:37.776968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:37.819057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:37.819689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:37.836846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:37.838976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:37.840540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:37.842445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:37.844517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:37.845782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:38.102931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:38.118674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:38.126645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:38.128130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1dafdb26-ef6d-4bd5-a642-775425af14dd tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2915 microversion: 2.32 time: 0.317764 Sep 25 01:30:38.142300 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2550/5093] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:37 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2915 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:38.154918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:38.158882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:38.165997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:38.166750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:38.167447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:38.168537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:38.169340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:38.170202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:38.271662 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1d894e7d-2cc4-4540-985b-e14fcf5d5ed4 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128628 Sep 25 01:30:38.273149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2551/5094] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:38 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:38.280263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:38.281932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:38.293941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:38.294680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:38.297885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:38.299004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:38.301784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:38.302433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:38.484642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:38.502654 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a6c2192d-28eb-44b7-8ca6-3ddd77862474 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.759037 Sep 25 01:30:38.503260 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2544/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:37 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:39.044510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-unplugged", "status": "completed", "tag": "b13e3d91-cda7-431a-9493-45c4469e5b7a"}, {"server_uuid": "8ed948d8-07f6-4cba-afb9-ff3b7231fa65", "name": "network-vif-plugged", "status": "completed", "tag": "86d4b538-a0f4-4c56-b4ff-29f5ce5a00b4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:39.086908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.088446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.090965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.092102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:39.107132 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-315de77d-6fba-4262-a7eb-0d9522a123e1 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.832550 Sep 25 01:30:39.108285 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2552/5096] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:38 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:39.145151 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] Creating event network-vif-unplugged:b13e3d91-cda7-431a-9493-45c4469e5b7a for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:39.150711 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] Creating event network-vif-plugged:86d4b538-a0f4-4c56-b4ff-29f5ce5a00b4 for instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 on n-h2-master-1 Sep 25 01:30:39.167885 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-683bab51-5bdf-4a59-b696-e17f827b4059 req-b8981371-202b-4eca-bf96-3c91e060a77e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.127172 Sep 25 01:30:39.177646 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2545/5097] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:39.178219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:39.179075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:39.194055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.194473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.194926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.195643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.196106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.196544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.288043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:39.293891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:39.326302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.326808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.327259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.328718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.329187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.342762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.396482 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f4d5ea51-e553-4fe6-a1a3-30a0cb1219ec tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114333 Sep 25 01:30:39.398037 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2546/5098] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:39 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:39.535780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:39.536865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:39.547290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.548084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.548810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.550377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:39.551069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:39.551850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:39.990801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:40.015543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:40.020980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:40.025656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c0348aa-8cef-4577-9cd3-7cea0fa67335 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2868 microversion: 2.32 time: 0.868238 Sep 25 01:30:40.027488 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2553/5099] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:39 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2868 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:40.042571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f9821273-d997-4193-b9f2-5f243173fccc req-aeb6b32e-7efb-4487-a1dc-2ad5b44aae50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-deleted", "tag": "b13e3d91-cda7-431a-9493-45c4469e5b7a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:40.073130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9821273-d997-4193-b9f2-5f243173fccc req-aeb6b32e-7efb-4487-a1dc-2ad5b44aae50 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:40.074434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9821273-d997-4193-b9f2-5f243173fccc req-aeb6b32e-7efb-4487-a1dc-2ad5b44aae50 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:40.075998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9821273-d997-4193-b9f2-5f243173fccc req-aeb6b32e-7efb-4487-a1dc-2ad5b44aae50 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:40.116085 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f9821273-d997-4193-b9f2-5f243173fccc req-aeb6b32e-7efb-4487-a1dc-2ad5b44aae50 service nova] Creating event network-vif-deleted:b13e3d91-cda7-431a-9493-45c4469e5b7a for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:40.132807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f9821273-d997-4193-b9f2-5f243173fccc req-aeb6b32e-7efb-4487-a1dc-2ad5b44aae50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101381 Sep 25 01:30:40.135119 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2554/5100] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:40.151741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:40.154115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:40.166870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:40.167369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:40.167810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:40.168522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:40.168980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:40.170371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:40.305898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:40.317385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd530598-a29b-47db-87fb-b1944f125b11 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.790327 Sep 25 01:30:40.318018 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2547/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:39 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:40.411839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:40.414826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:40.426133 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:40.430060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:40.432560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:40.434895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:40.435554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:40.436997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:40.437678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:40.438485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:40.445155 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24a8df5d-90df-4ada-b86c-c9bbb36fd419 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1300 microversion: 2.1 time: 0.307520 Sep 25 01:30:40.457777 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2555/5102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:40 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1300 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:40.498637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac0fe076-d4c7-4e96-b559-b29e34cb9a06 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091741 Sep 25 01:30:40.499927 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2548/5103] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:40 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:41.061672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:41.066254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:41.091420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:41.096837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:41.097663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:41.098780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:41.099431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:41.099868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:41.145437 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:41.341149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:41.341958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:41.363967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:41.364897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:41.364897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:41.368763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:41.370426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:41.378397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:41.392993 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:42.183434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:42.196934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:42.200030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:42.205526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:42.206385 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e7bcdc1-2fdb-4343-acef-9439689a18ca tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2534 microversion: 2.32 time: 1.153294 Sep 25 01:30:42.213371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ae79945-106e-4ce9-8b43-ca7df60cce69 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.876103 Sep 25 01:30:42.217203 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2549/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:41 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:42.217673 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2556/5105] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:41 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2534 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:42.231304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.235279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.236318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.239650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.246662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.247156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.247615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.248318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.248776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.251347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.251497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.252546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.254807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.257047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.258543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.259777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.304508 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc744f63-7b04-4659-97d5-138e0c0a146b tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083749 Sep 25 01:30:42.311130 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2550/5106] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:30:42 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:30:42.317487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-deleted", "tag": "7aa07162-4d0d-4aed-bf40-436e8b476ed3"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-deleted", "tag": "7256f32a-8cf9-4e46-9caa-e40fd569b94c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:42.330017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.330733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.331313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.351571 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] Creating event network-vif-deleted:7aa07162-4d0d-4aed-bf40-436e8b476ed3 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:42.352894 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] Creating event network-vif-deleted:7256f32a-8cf9-4e46-9caa-e40fd569b94c for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:42.361385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1c429b25-d636-4e1b-bcca-0aa34b9c401d req-80087b5a-9dfb-416f-82df-503e23645675 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048432 Sep 25 01:30:42.362296 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2551/5107] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:42.425142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:42.438757 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13d98df8-135b-40a7-960a-b5d59eea561a tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1472 microversion: 2.1 time: 0.218857 Sep 25 01:30:42.447893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2557/5108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:42 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:42.454146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:42.456819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.464722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.475857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.482573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.483041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.483494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.484296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.484775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.485179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.491152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.491914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.494447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.496765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.498957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.501713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.556114 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Cannot 'reboot' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action HTTP/1.1 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 28 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: {"reboot": {"type": "HARD"}} Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'reboot' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e07503bd-d487-460b-8d5f-368c97591164', 'body': {'reboot': {'type': 'HARD'}}} Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e07503bd-d487-460b-8d5f-368c97591164 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:30:42.560882 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.565933 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.570736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 409 to user: Cannot 'reboot' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:30:42.581157 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59507dd3-8da0-465f-bcf1-cd1b715e98b5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action" status: 409 len: 145 microversion: 2.1 time: 0.132367 Sep 25 01:30:42.581961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2552/5109] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:30:42 2022] POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action => generated 145 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:30:42.602209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:42.607882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.616960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.617513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.617950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.618662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.619114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.619542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.691496 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Cannot 'rebuild' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action HTTP/1.1 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 65 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: exception: Cannot 'rebuild' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e07503bd-d487-460b-8d5f-368c97591164', 'body': {'rebuild': {'imageRef': 'a3c714ab-6173-44d8-8a52-bcbf97934f05'}}} Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e07503bd-d487-460b-8d5f-368c97591164 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:30:42.694403 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 409 to user: Cannot 'rebuild' instance e07503bd-d487-460b-8d5f-368c97591164 while it is in vm_state rescued {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5298888c-0013-4df1-a18c-d5085ea56816 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action" status: 409 len: 146 microversion: 2.1 time: 0.108709 Sep 25 01:30:42.699220 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2553/5110] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:30:42 2022] POST /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164/action => generated 146 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:30:42.706348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:42.715358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.715867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.718462 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c128061d-986f-49ce-a258-cfd3220bb95d tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1472 microversion: 2.1 time: 0.257464 Sep 25 01:30:42.719476 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2558/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:42 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:42.736836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.737332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.740613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.741346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.741977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.742669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.748734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.749996 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.767456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.768242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.769677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.771355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.772678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.774210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.777067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:30:42.895065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f019a40c-41f9-4268-94e1-9c17a282212c tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 204 len: 0 microversion: 2.1 time: 0.185408 Sep 25 01:30:42.896162 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2554/5112] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:30:42 2022] DELETE /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:30:42.907952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.909351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.917303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.917859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.918292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.919179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.919842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.920427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.962978 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc11f1c8-1953-4304-814f-203cfa98f007 tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1623 microversion: 2.1 time: 0.221042 Sep 25 01:30:42.966205 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2559/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:42 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1623 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:42.986754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:42.987829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:42.995741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.996406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:42.997013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:42.997915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:42.998855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.000081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.285648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:43.297275 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-47df0a06-eeb9-4e04-98d3-161bdac2f155 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1690 microversion: 2.1 time: 0.393951 Sep 25 01:30:43.309494 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2555/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:42 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:43.309494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:43.309494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:43.317936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.318430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.320775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.321990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.322460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.322890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.342457 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a106338-45f5-4942-b696-0a8b63e8067b tempest-TestSecurityGroupsBasicOps-382388782 tempest-TestSecurityGroupsBasicOps-382388782-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1909 microversion: 2.1 time: 0.360779 Sep 25 01:30:43.343591 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2560/5115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:42 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1909 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:43.361022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:43.362470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:43.378135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.382623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.383331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.384252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.384879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.386720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.662554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:43.679549 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1c478f3-017e-47da-bb67-a9b67d8a0e39 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.379622 Sep 25 01:30:43.691421 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2556/5116] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:43 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:43.696679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:43.697262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:43.704378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.705163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.705931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.706712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.707361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.707979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.731959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:43.738040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:30:43.747071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:43.754064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:43.759479 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-366854fc-1729-476f-8966-b23f1740b002 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2212 microversion: 2.32 time: 0.409990 Sep 25 01:30:43.760236 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2561/5117] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:43 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2212 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:43.853270 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60da1870-7e0b-47e3-a99c-4543ff6e5c58 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 204 len: 0 microversion: 2.1 time: 0.164461 Sep 25 01:30:43.854638 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2557/5118] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:30:43 2022] DELETE /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:30:43.864730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:43.865254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:43.877216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.877822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.878296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.878989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:43.879605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:43.880053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:43.976499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:43.985663 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10430f90-1e55-440c-8252-89236d7d5bf0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1478 microversion: 2.1 time: 0.126714 Sep 25 01:30:43.986257 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2562/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:43 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1478 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:44.323570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:44.324317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:44.333032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.333627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.334259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.335322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.335971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.336558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.426508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-deleted", "tag": "5aa39579-ad32-4392-a851-b602c17f48a0"}, {"server_uuid": "0688d6b7-54a8-4145-9941-2ebba9ecdf6d", "name": "network-vif-deleted", "tag": "fde1c7f4-0458-4853-a17f-067df54210fd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:44.440358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.440854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.441293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.455014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] Creating event network-vif-deleted:5aa39579-ad32-4392-a851-b602c17f48a0 for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:44.455540 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] Creating event network-vif-deleted:fde1c7f4-0458-4853-a17f-067df54210fd for instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d on n-h2-master-1 Sep 25 01:30:44.461112 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-71414f31-b685-4cc6-9ee4-c62ebe79c43b req-74fd5192-3e39-4bee-9c64-0cea04943d42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041478 Sep 25 01:30:44.461919 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2563/5120] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:44.497355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:44.506055 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e65f79a8-a288-42ec-9f35-2285498b9f78 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1690 microversion: 2.1 time: 0.186865 Sep 25 01:30:44.506636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2558/5121] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:44 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:44.705069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:44.705837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:44.712109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.712594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.713035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.713783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.714240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.714667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.789646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:44.790432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:44.798409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.799227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.799883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.800864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:44.801593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:44.802229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:44.877866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:44.879653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:44.886616 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7007ffd4-3954-4e69-8004-0f5edc0f742b tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.185939 Sep 25 01:30:44.887207 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2564/5122] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:44 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:44.889726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:44.892349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:44.893626 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c196e500-fbfc-4e62-998d-a1dbe8d37581 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 2144 microversion: 2.32 time: 0.108495 Sep 25 01:30:44.894183 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2559/5123] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:44 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 2144 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:30:45.010056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:45.010976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:45.018099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.018597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.019039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.019747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.020251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.020810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.125899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:45.133869 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-446fc1fb-5d71-45b9-9043-500dc0a5ed72 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1478 microversion: 2.1 time: 0.128405 Sep 25 01:30:45.134539 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2565/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:45 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1478 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:45.533333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:45.534326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:45.563357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.565040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.568226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.569705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.574917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.575047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.848769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:45.860927 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc1051f9-1023-40da-bfe4-addc10b0e048 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1690 microversion: 2.1 time: 0.331749 Sep 25 01:30:45.863671 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2560/5125] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:45 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1690 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:45.913289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:45.914262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:45.923755 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:45.924475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:45.928153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.929998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.931324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.932124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.934723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.935642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.936063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.937272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.938033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:45.939248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:45.942386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:45.942917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:46.135628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:46.148447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:46.150427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:46.154034 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-843a5512-5718-4fbe-a4d1-4ee2d378f1ae tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.234846 Sep 25 01:30:46.166848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2561/5126] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:45 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:46.181228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:46.182141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:46.190689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:46.191456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:46.192056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:46.193037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:46.193678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:46.194286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:46.404763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:46.414210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-230f0f33-448a-407d-887c-c4cd81ea6217 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1478 microversion: 2.1 time: 0.246009 Sep 25 01:30:46.430300 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2562/5127] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:46 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1478 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:46.490442 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-cc5350c9-1418-422d-873c-65b949cdc3d1 req-6d8b8f3c-1a84-4e2b-bc17-8f53ab3e430f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed948d8-07f6-4cba-afb9-ff3b7231fa65", "name": "network-vif-deleted", "tag": "86d4b538-a0f4-4c56-b4ff-29f5ce5a00b4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:46.506867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:46.521105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cc5350c9-1418-422d-873c-65b949cdc3d1 req-6d8b8f3c-1a84-4e2b-bc17-8f53ab3e430f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:46.521642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cc5350c9-1418-422d-873c-65b949cdc3d1 req-6d8b8f3c-1a84-4e2b-bc17-8f53ab3e430f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:46.522114 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a052f42-bc9b-45c9-aa0e-95316ee08148 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.608358 Sep 25 01:30:46.541123 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2566/5128] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:45 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:46.542306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cc5350c9-1418-422d-873c-65b949cdc3d1 req-6d8b8f3c-1a84-4e2b-bc17-8f53ab3e430f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:46.559409 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-cc5350c9-1418-422d-873c-65b949cdc3d1 req-6d8b8f3c-1a84-4e2b-bc17-8f53ab3e430f service nova] Creating event network-vif-deleted:86d4b538-a0f4-4c56-b4ff-29f5ce5a00b4 for instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 on n-h2-master-1 Sep 25 01:30:46.565696 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-cc5350c9-1418-422d-873c-65b949cdc3d1 req-6d8b8f3c-1a84-4e2b-bc17-8f53ab3e430f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079999 Sep 25 01:30:46.566867 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2563/5129] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:30:46.893125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:46.893884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:46.901992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:46.908518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:46.909147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:46.910293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:46.912812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:46.913977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.184111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:47.184994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:47.193783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.194584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.195221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.196154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.196834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.197504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.217237 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:47.231885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:47.245664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43b9b9ba-4a1a-44ad-bcd6-f3db169b4878 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1690 microversion: 2.1 time: 0.357138 Sep 25 01:30:47.248346 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2567/5130] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:46 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1690 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:47.330515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:47.345572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:47.347426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:47.349150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de7933d1-2526-40b1-a6d7-cc0694836e51 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.169107 Sep 25 01:30:47.350001 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2564/5131] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:47 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:30:47.442121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:47.443184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:47.450017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.450839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.451284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.452045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.452539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.453291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.491377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.491858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.492498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.493278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lazy-loading 'fault' on Instance uuid 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:30:47.548418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:47.550645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:47.551809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:47.566275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.567088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.567707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:47.568169 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4384ad5a-dfbd-4bbf-ae6f-781135344b46 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 200 len: 1332 microversion: 2.1 time: 0.130288 Sep 25 01:30:47.568765 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2568/5132] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:47 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:47.578490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:47.579598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:47.581263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.157061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:48.169705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8aee2347-bd62-49b4-9faa-35d326939699 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.626110 Sep 25 01:30:48.171755 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2565/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:47 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:30:48.275685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:48.277190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:48.285545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.286382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.287061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.287988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.288663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.289356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.375716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:48.376314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:48.390750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.391308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.391765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.392516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.392978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.393446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.419451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:48.433761 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b8088bca-567d-4d48-81be-8db3b15332e9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 200 len: 1622 microversion: 2.1 time: 0.162664 Sep 25 01:30:48.436029 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2569/5134] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:48 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 1622 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:48.492506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:48.508425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:48.510376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:48.512236 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ecbc4a3-cf9b-4c24-b0aa-d230501e59f2 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.140448 Sep 25 01:30:48.513445 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2566/5135] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:48 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:48.581847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7e90ad0d-9ec8-4e46-8722-a33b94015e64 req-1ab71a4d-c6b9-4cee-9ba5-fcf69c32c6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e302d703-9875-41fe-a761-c059edf4ead9", "name": "network-vif-deleted", "tag": "d65b427c-d3cb-4557-bdec-1c826de4e774"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:48.593344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7e90ad0d-9ec8-4e46-8722-a33b94015e64 req-1ab71a4d-c6b9-4cee-9ba5-fcf69c32c6e2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.594274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7e90ad0d-9ec8-4e46-8722-a33b94015e64 req-1ab71a4d-c6b9-4cee-9ba5-fcf69c32c6e2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.595147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7e90ad0d-9ec8-4e46-8722-a33b94015e64 req-1ab71a4d-c6b9-4cee-9ba5-fcf69c32c6e2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.596125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:48.596876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 8ed948d8-07f6-4cba-afb9-ff3b7231fa65] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:48.610392 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7e90ad0d-9ec8-4e46-8722-a33b94015e64 req-1ab71a4d-c6b9-4cee-9ba5-fcf69c32c6e2 service nova] Creating event network-vif-deleted:d65b427c-d3cb-4557-bdec-1c826de4e774 for instance e302d703-9875-41fe-a761-c059edf4ead9 on n-h1-master-1 Sep 25 01:30:48.610760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.611408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.611858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.616522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7e90ad0d-9ec8-4e46-8722-a33b94015e64 req-1ab71a4d-c6b9-4cee-9ba5-fcf69c32c6e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038953 Sep 25 01:30:48.616952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:48.617484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:48.619781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:48.622734 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2570/5136] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:48.639506 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] HTTP exception thrown: Instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 could not be found. Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Request method failure captured: Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 HTTP/1.1 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL67VVseTQNvDmAbgni7GRR4YNl_-PjFaJxiebe0L3yoFJzvRz1kWjjLxekzeQm_-o545GWaD_EIWlBkrO-hqmbkdmdB8-IUsOLMbPOrWfqt0kQHBmvipm9wDXaioRJCRcs5dwPsNjH0nLCTo6ATbd4MEvt0snHYn4Q5uBxx-xYGUwuw Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: dc6eecfc22d54d30a11c63b0d7518e4a Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1815331837 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc6eecfc22d54d30a11c63b0d7518e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc6eecfc22d54d30a11c63b0d7518e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc6eecfc22d54d30a11c63b0d7518e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc6eecfc22d54d30a11c63b0d7518e4a"}]}] Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1815331837 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: dc6eecfc22d54d30a11c63b0d7518e4a Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1815331837 Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestSecurityGroupsBasicOps-1815331837-project Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: aa5f2510f105430fb01974c7a6e1579e Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1815331837-project Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 could not be found. Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8ed948d8-07f6-4cba-afb9-ff3b7231fa65'} Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 could not be found. Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 could not be found. Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:48.642058 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 could not be found. Sep 25 01:30:48.646055 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:48.648204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Returning 404 to user: Instance 8ed948d8-07f6-4cba-afb9-ff3b7231fa65 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:30:48.649267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bbde429e-8f38-4ed9-a404-e09ec2049059 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65" status: 404 len: 111 microversion: 2.1 time: 0.059507 Sep 25 01:30:48.649985 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2567/5137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:48 2022] GET /compute/v2.1/servers/8ed948d8-07f6-4cba-afb9-ff3b7231fa65 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:30:49.193482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:49.194200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:49.228280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:49.230810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:49.231471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:49.235039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:49.235620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:49.236374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:49.457279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:49.457954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e302d703-9875-41fe-a761-c059edf4ead9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:49.467356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:49.469059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:49.470205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:49.472721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:49.473368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:49.474003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:49.511563 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Instance e302d703-9875-41fe-a761-c059edf4ead9 could not be found. Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 HTTP/1.1 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e302d703-9875-41fe-a761-c059edf4ead9 could not be found. Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e302d703-9875-41fe-a761-c059edf4ead9'} Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e302d703-9875-41fe-a761-c059edf4ead9 could not be found. Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e302d703-9875-41fe-a761-c059edf4ead9 could not be found. Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:49.513583 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e302d703-9875-41fe-a761-c059edf4ead9 could not be found. Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 404 to user: Instance e302d703-9875-41fe-a761-c059edf4ead9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:30:49.518595 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac429b56-ab1a-42bc-aca6-d233559fe17a tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9" status: 404 len: 111 microversion: 2.1 time: 0.063175 Sep 25 01:30:49.522299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2568/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:49 2022] GET /compute/v2.1/servers/e302d703-9875-41fe-a761-c059edf4ead9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:30:49.527580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14cc976a-3921-44c1-9886-789778a587fa tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '.version_select at 0x7f7bea9d9ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:49.529788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:49.539801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-649e7ce6-975a-465e-b4c4-bc84d5d79158 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.350402 Sep 25 01:30:49.562990 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14cc976a-3921-44c1-9886-789778a587fa tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773730416" status: 202 len: 0 microversion: 2.1 time: 0.039127 Sep 25 01:30:49.564320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2569/5139] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:30:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773730416 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:30:49.574927 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2571/5140] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:49 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:49.595715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:49.596753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:49.613055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:49.613592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:49.614225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:49.615934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:49.617613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:49.620178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:49.807022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:49.836803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:49.839404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:49.840678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eecdf85d-8aef-43fb-a840-c2fbe8f8417e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.275333 Sep 25 01:30:49.845479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2570/5141] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:49 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:50.576187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:50.576814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:50.590420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:50.590925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:50.591379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:50.592095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:50.592560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:50.599528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:50.880280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:50.881052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:50.896064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:50.896463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:50.897109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:50.899087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:50.903947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:50.904723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:50.915811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:50.951757 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-438e76a9-0337-4dab-acdb-1ae9822745ab tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.379414 Sep 25 01:30:50.981626 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2572/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:50 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:51.125084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:51.138118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:51.139687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:51.141795 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6c66eed-8be9-45b9-811e-37d5ed77a4e3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.277426 Sep 25 01:30:51.149897 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2571/5143] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:50 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:51.975877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:51.976568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:51.991732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:51.993205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:51.995031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:51.995807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:51.996283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:51.996717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:52.169675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:52.170673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:52.184558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:52.191434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:52.194287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:52.199042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:52.203548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:52.210178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:52.338879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:52.354048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:52.357126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:52.361144 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-417e96b0-ec4f-4950-86d5-687b43cd2c96 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.192960 Sep 25 01:30:52.364083 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2572/5144] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:52 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:30:52.460691 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:52.478696 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a46eb244-cbe9-4b10-9254-1fca7f79eedb tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.507343 Sep 25 01:30:52.479303 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2573/5145] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:51 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:53.393215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:53.395314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:53.408757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:53.414011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:53.414666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:53.415549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:53.416143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:53.416707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:53.507769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:53.509264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:53.540446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:53.541210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:53.541867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:53.542756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:53.545846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:53.546938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:53.554256 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:30:53.576323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:53.587866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:53.597300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:53.601601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f4cacded-2149-44ad-8bef-89f26e2f4685 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.213031 Sep 25 01:30:53.605354 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2573/5146] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:53 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:53.790000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:53.802056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92d67ebf-1127-438f-aff0-c7f4e4a5bcb7 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.297647 Sep 25 01:30:53.814222 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2574/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:53 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:54.638121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:54.639293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:54.653348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:54.658305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:54.659009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:54.660408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:54.660997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:54.661546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:54.797125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:54.812969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:54.820708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:54.825489 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b7fa75e2-43c9-4dc7-9cd1-392ee75947ed tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.191066 Sep 25 01:30:54.831163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:54.832676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:54.844206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:54.847949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:54.849577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:54.850514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:54.853343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:54.854207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:54.858140 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2574/5148] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:54 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:55.256047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:55.273021 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e617f615-db16-49fd-9524-e0b0726988de tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1522 microversion: 2.1 time: 0.447304 Sep 25 01:30:55.278246 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2575/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:54 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:55.867444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:55.868830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:55.880909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:55.882912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:55.885716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:55.886833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:55.887892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:55.888549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.076195 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:56.110282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:56.115679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:56.118525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0859a62-2bb2-4c85-a748-a622b2c90fc0 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.258268 Sep 25 01:30:56.123652 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2575/5150] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:55 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:56.308469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:56.309151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:56.318387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.320349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.321131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.325030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.327783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.333769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.378776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:56.378776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:56.427219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.429861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.430898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.433182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.434092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.435550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.509768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:30:56.542526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:56.556283 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-848413e9-1a8d-48b9-b7c3-409f022f0b6d tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1502 microversion: 2.1 time: 0.251722 Sep 25 01:30:56.559019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2576/5151] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:56 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:56.572122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-31246172-cbdd-48bb-90ca-68c7ad27b4a7 req-e7e533b8-e847-4c67-95dd-fad047ce349c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694eaee5-7311-479d-816b-b14df6828b7c", "tag": "26f0e7ae-f692-4e66-a64d-38ce3ac14280"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:56.607069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-31246172-cbdd-48bb-90ca-68c7ad27b4a7 req-e7e533b8-e847-4c67-95dd-fad047ce349c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.614545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-31246172-cbdd-48bb-90ca-68c7ad27b4a7 req-e7e533b8-e847-4c67-95dd-fad047ce349c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.615383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-31246172-cbdd-48bb-90ca-68c7ad27b4a7 req-e7e533b8-e847-4c67-95dd-fad047ce349c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.650529 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-31246172-cbdd-48bb-90ca-68c7ad27b4a7 req-e7e533b8-e847-4c67-95dd-fad047ce349c service nova] Creating event network-changed:26f0e7ae-f692-4e66-a64d-38ce3ac14280 for instance 694eaee5-7311-479d-816b-b14df6828b7c on n-h1-master-1 Sep 25 01:30:56.679531 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-31246172-cbdd-48bb-90ca-68c7ad27b4a7 req-e7e533b8-e847-4c67-95dd-fad047ce349c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114216 Sep 25 01:30:56.696136 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2577/5152] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:56.717244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bffb7bce-828e-4cc7-a1f6-4fe0ece781b0 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "DELETE /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 204 len: 0 microversion: 2.1 time: 0.346514 Sep 25 01:30:56.719122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6f3dd1d-3278-46f3-8b2c-02254c26fc01 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'create', calling method: .version_select at 0x7f7beab64430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1238607941", "description": "tempest-description-469929544"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:56.780736 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2576/5153] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:30:56 2022] DELETE /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:30:56.829660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:56.832272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:56.846764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.848441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.849040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:56.851482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:56.851964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:56.852399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:57.293204 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e6f3dd1d-3278-46f3-8b2c-02254c26fc01 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.594807 Sep 25 01:30:57.301976 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2578/5154] 10.222.0.16 () {60 vars in 1180 bytes} [Sun Sep 25 01:30:56 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:30:57.301976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:57.301976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:57.326093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:57.326723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:57.327107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:57.327857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:57.328320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:57.328758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:57.530673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:57.545486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:57.547920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:57.552462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:57.565191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-611caec6-96c2-42f0-a094-3b0b656f5bb8 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.268137 Sep 25 01:30:57.565876 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ac2141e-94f1-41bf-b7d0-b19de3aa25f5 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1764 microversion: 2.1 time: 0.776891 Sep 25 01:30:57.583542 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2579/5155] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:57 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:57.601450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1238607941"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:57.601904 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2577/5156] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:56 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1764 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:30:57.611026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:57.618194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:57.618944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:57.619619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:57.620799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:57.621540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:57.622193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:57.977943 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Adding security group c7524af4-3ef8-4912-8184-d069df687b87 to port 1ca04bae-d211-42b3-a939-342556a605fd Sep 25 01:30:58.627401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:58.629868 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:58.663381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:58.673100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:58.676374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:58.676374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:58.676374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:58.676374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:59.241795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:59.259304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:59.272087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:30:59.273360 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02cc6f97-5b38-4ca8-aa60-f66a14abdafc tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.663192 Sep 25 01:30:59.273961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2578/5157] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:30:58 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:30:59.303191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:30:59.309213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:59.323205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:59.323946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:59.324568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:59.325507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:59.326117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:59.326700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:59.873243 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6e2e3c5-1796-4213-ac2e-ae45bc575364 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action" status: 202 len: 0 microversion: 2.1 time: 2.287976 Sep 25 01:30:59.881908 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2580/5158] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:30:57 2022] POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action => generated 0 bytes in 2297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:30:59.895624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1238607941"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:30:59.902555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:30:59.954279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:59.958103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:59.959305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:30:59.961077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:30:59.963432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:30:59.969542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:00.996054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5f2510f105430fb01974c7a6e1579e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6eecfc22d54d30a11c63b0d7518e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:01.010426 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0730780f-11b3-4953-bf4a-09ef20950b40 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 200 len: 1764 microversion: 2.1 time: 1.724519 Sep 25 01:31:01.011027 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2579/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:30:59 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 1764 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:01.037491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f3070b9d-48fe-49d2-910e-7a4c99099841 req-abb6ac72-74f6-4796-9015-b2be2a998976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:01.060680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3070b9d-48fe-49d2-910e-7a4c99099841 req-abb6ac72-74f6-4796-9015-b2be2a998976 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:01.060956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3070b9d-48fe-49d2-910e-7a4c99099841 req-abb6ac72-74f6-4796-9015-b2be2a998976 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:01.061719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3070b9d-48fe-49d2-910e-7a4c99099841 req-abb6ac72-74f6-4796-9015-b2be2a998976 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:01.084525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f3070b9d-48fe-49d2-910e-7a4c99099841 req-abb6ac72-74f6-4796-9015-b2be2a998976 service nova] Creating event network-changed:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:31:01.100465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f3070b9d-48fe-49d2-910e-7a4c99099841 req-abb6ac72-74f6-4796-9015-b2be2a998976 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073300 Sep 25 01:31:01.107329 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2580/5160] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:01.115900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5a40668c-2a6a-4508-86e0-b281ce68ff17 req-20bee55e-a4ef-45d1-ab97-ebd4062c8a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694eaee5-7311-479d-816b-b14df6828b7c", "name": "network-vif-deleted", "tag": "26f0e7ae-f692-4e66-a64d-38ce3ac14280"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:01.174335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5a40668c-2a6a-4508-86e0-b281ce68ff17 req-20bee55e-a4ef-45d1-ab97-ebd4062c8a73 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:01.177796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5a40668c-2a6a-4508-86e0-b281ce68ff17 req-20bee55e-a4ef-45d1-ab97-ebd4062c8a73 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:01.178513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5a40668c-2a6a-4508-86e0-b281ce68ff17 req-20bee55e-a4ef-45d1-ab97-ebd4062c8a73 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:01.204303 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5a40668c-2a6a-4508-86e0-b281ce68ff17 req-20bee55e-a4ef-45d1-ab97-ebd4062c8a73 service nova] Creating event network-vif-deleted:26f0e7ae-f692-4e66-a64d-38ce3ac14280 for instance 694eaee5-7311-479d-816b-b14df6828b7c on n-h1-master-1 Sep 25 01:31:01.218192 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5a40668c-2a6a-4508-86e0-b281ce68ff17 req-20bee55e-a4ef-45d1-ab97-ebd4062c8a73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105670 Sep 25 01:31:01.227180 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2581/5161] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:01.242576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:01.243737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:01.256236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:01.257128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:01.257898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:01.258849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:01.263167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:01.263960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:01.615892 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Removing security group c7524af4-3ef8-4912-8184-d069df687b87 from port 1ca04bae-d211-42b3-a939-342556a605fd Sep 25 01:31:01.631974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:01.648447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:01.650555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:01.663138 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0983e82-55d3-499b-b725-efe2481c14ba tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.434336 Sep 25 01:31:01.688542 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2582/5162] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:01 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:01.690321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:01.691070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:01.698103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:01.698901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:01.699547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:01.700499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:01.701151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:01.706782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:01.710431 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:01.749667 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:31:02.015142 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9be8c742-fa0c-4cbe-816c-95f791f57445 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 204 len: 0 microversion: 2.1 time: 0.334635 Sep 25 01:31:02.021419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2583/5163] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:31:01 2022] DELETE /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:31:02.065346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:02.066405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:02.086663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:02.093982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:02.095781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:02.097029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:02.098995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:02.100879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:02.766011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:02.782636 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ed09885-a01c-4d31-bc50-a2ae1042fb67 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1507 microversion: 2.1 time: 0.751510 Sep 25 01:31:02.786848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2584/5164] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:02 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1507 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:02.792015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:02.792900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] [instance: 694eaee5-7311-479d-816b-b14df6828b7c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:02.799853 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:02.802304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:02.803051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:02.803870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:02.804757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:02.805372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:02.805971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:02.824598 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] HTTP exception thrown: Instance 694eaee5-7311-479d-816b-b14df6828b7c could not be found. Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Request method failure captured: Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c HTTP/1.1 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL67VVseTQNvDmAbgni7GRR4YNl_-PjFaJxiebe0L3yoFJzvRz1kWjjLxekzeQm_-o545GWaD_EIWlBkrO-hqmbkdmdB8-IUsOLMbPOrWfqt0kQHBmvipm9wDXaioRJCRcs5dwPsNjH0nLCTo6ATbd4MEvt0snHYn4Q5uBxx-xYGUwuw Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: dc6eecfc22d54d30a11c63b0d7518e4a Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1815331837 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc6eecfc22d54d30a11c63b0d7518e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc6eecfc22d54d30a11c63b0d7518e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc6eecfc22d54d30a11c63b0d7518e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc6eecfc22d54d30a11c63b0d7518e4a"}]}] Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1815331837 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: dc6eecfc22d54d30a11c63b0d7518e4a Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1815331837 Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestSecurityGroupsBasicOps-1815331837-project Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: aa5f2510f105430fb01974c7a6e1579e Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1815331837-project Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 694eaee5-7311-479d-816b-b14df6828b7c could not be found. Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '694eaee5-7311-479d-816b-b14df6828b7c'} Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694eaee5-7311-479d-816b-b14df6828b7c could not be found. Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694eaee5-7311-479d-816b-b14df6828b7c could not be found. Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:02.826915 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694eaee5-7311-479d-816b-b14df6828b7c could not be found. Sep 25 01:31:02.831516 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:02.832988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Returning 404 to user: Instance 694eaee5-7311-479d-816b-b14df6828b7c could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:02.833908 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1bb27ba6-efa0-4441-b0a5-04bb004de86c tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c" status: 404 len: 111 microversion: 2.1 time: 0.045829 Sep 25 01:31:02.834614 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2585/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:02 2022] GET /compute/v2.1/servers/694eaee5-7311-479d-816b-b14df6828b7c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:31:02.850241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:02.851113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:02.860233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:02.861142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:02.862008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:02.863049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:02.863828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:02.864694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:03.105381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f8c4d6e4-46f9-4758-bc4f-74bc31228030 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action" status: 202 len: 0 microversion: 2.1 time: 3.218787 Sep 25 01:31:03.112234 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2581/5166] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:30:59 2022] POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action => generated 0 bytes in 3226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:31:03.117435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dafd5997-8753-4a0f-ba15-656b2f7b87d3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'create', calling method: .version_select at 0x7f7beaeef5e0>, body: {"pool": null} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:03.131141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:03.164963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:03.166574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:03.167837 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f08a5481-e84a-4733-90f3-33651f5df667 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.331919 Sep 25 01:31:03.172770 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2586/5167] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:02 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:03.420831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-53566c9e-7672-4f13-a710-6d04a68e5ddc req-c5386a57-1406-4953-a44c-c954e56a60b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:03.445420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-53566c9e-7672-4f13-a710-6d04a68e5ddc req-c5386a57-1406-4953-a44c-c954e56a60b7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:03.446140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-53566c9e-7672-4f13-a710-6d04a68e5ddc req-c5386a57-1406-4953-a44c-c954e56a60b7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:03.449614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-53566c9e-7672-4f13-a710-6d04a68e5ddc req-c5386a57-1406-4953-a44c-c954e56a60b7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:03.484531 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-53566c9e-7672-4f13-a710-6d04a68e5ddc req-c5386a57-1406-4953-a44c-c954e56a60b7 service nova] Creating event network-changed:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:31:03.503971 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-53566c9e-7672-4f13-a710-6d04a68e5ddc req-c5386a57-1406-4953-a44c-c954e56a60b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086808 Sep 25 01:31:03.510476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2587/5168] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:31:03.841043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:03.841823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:03.853969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:03.854475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:03.854923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:03.855651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:03.862608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:03.863202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:04.360075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:04.372063 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-db902cd3-1aa6-4920-8095-bcf4fb3afe10 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1507 microversion: 2.1 time: 0.536215 Sep 25 01:31:04.382158 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2588/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:03 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:31:04.395091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:04.398325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:04.420182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:04.421314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:04.426087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:04.427762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:04.428972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:04.429643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:04.766728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:04.797982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:04.804140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:04.805480 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e6fe000-8ca3-47b9-96a3-cb7a3dfbcaa3 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.421854 Sep 25 01:31:04.810629 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2589/5170] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:04 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:05.409673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:05.410372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:05.427890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:05.428392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:05.428828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:05.435325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:05.435836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:05.437962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:06.322255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:06.344063 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d352d73-71db-4278-b79f-579ebeb9a316 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1507 microversion: 2.1 time: 0.939979 Sep 25 01:31:06.345186 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2590/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:05 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1507 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:06.358797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:06.363501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:06.392907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:06.394156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:06.394761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:06.395672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:06.396291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:06.396878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:06.560920 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:06.574745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:06.577950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:06.579442 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9e858f3-7096-42ad-b6fc-bd8c91cb3a0e tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.233113 Sep 25 01:31:06.582414 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2591/5172] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:06 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:06.752275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6cbc5f2b-eacc-4ea1-95bf-a4ecdbe15430 req-ab627ae0-ceec-4473-bed1-8f5e41c7042a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07503bd-d487-460b-8d5f-368c97591164", "name": "network-vif-deleted", "tag": "54de02a8-a9bc-4b97-a598-85b12ac5f73f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:06.779615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6cbc5f2b-eacc-4ea1-95bf-a4ecdbe15430 req-ab627ae0-ceec-4473-bed1-8f5e41c7042a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:06.793518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6cbc5f2b-eacc-4ea1-95bf-a4ecdbe15430 req-ab627ae0-ceec-4473-bed1-8f5e41c7042a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:06.794208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6cbc5f2b-eacc-4ea1-95bf-a4ecdbe15430 req-ab627ae0-ceec-4473-bed1-8f5e41c7042a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:06.837933 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6cbc5f2b-eacc-4ea1-95bf-a4ecdbe15430 req-ab627ae0-ceec-4473-bed1-8f5e41c7042a service nova] Creating event network-vif-deleted:54de02a8-a9bc-4b97-a598-85b12ac5f73f for instance e07503bd-d487-460b-8d5f-368c97591164 on n-h1-master-1 Sep 25 01:31:06.859323 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6cbc5f2b-eacc-4ea1-95bf-a4ecdbe15430 req-ab627ae0-ceec-4473-bed1-8f5e41c7042a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113976 Sep 25 01:31:06.859959 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2592/5173] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:31:07.370429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:07.371176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:07.388794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:07.390166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:07.391041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:07.395628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:07.398038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:07.398541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:07.516111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:07.517003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:07.517927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:07.521229 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lazy-loading 'fault' on Instance uuid e07503bd-d487-460b-8d5f-368c97591164 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:31:07.692781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:07.708369 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e9248de-db3b-4d77-923f-10c0c5a2cfd6 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 200 len: 1311 microversion: 2.1 time: 0.343786 Sep 25 01:31:07.712614 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2593/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:07 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:31:07.729766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:07.732119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:07.753342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:07.757756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:07.758438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:07.759344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:07.761344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:07.761979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:07.967919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:07.990567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:07.992104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:08.000330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29d72f4a-2a10-4604-99cd-1eafeae69a08 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.279794 Sep 25 01:31:08.000987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2594/5175] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:07 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:08.059273 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dafd5997-8753-4a0f-ba15-656b2f7b87d3 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.945688 Sep 25 01:31:08.060820 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2582/5176] 10.222.0.16 () {60 vars in 1170 bytes} [Sun Sep 25 01:31:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:08.074455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.132"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:08.078573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:08.086074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:08.086663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:08.087177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:08.088089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:08.088625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:08.089098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:08.123050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "refresh_cache-ae2a4dc0-1850-4054-8224-cde43efb7ef4" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:31:08.124306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquired lock "refresh_cache-ae2a4dc0-1850-4054-8224-cde43efb7ef4" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:31:08.741068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:08.743431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: e07503bd-d487-460b-8d5f-368c97591164] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:08.745744 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=66 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:08.770739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:08.776097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:08.776721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:08.778257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:08.779475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:08.780681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:08.829824 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Instance e07503bd-d487-460b-8d5f-368c97591164 could not be found. Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 HTTP/1.1 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e07503bd-d487-460b-8d5f-368c97591164 could not be found. Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e07503bd-d487-460b-8d5f-368c97591164'} Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07503bd-d487-460b-8d5f-368c97591164 could not be found. Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07503bd-d487-460b-8d5f-368c97591164 could not be found. Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:08.831680 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07503bd-d487-460b-8d5f-368c97591164 could not be found. Sep 25 01:31:08.836447 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:08.837488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 404 to user: Instance e07503bd-d487-460b-8d5f-368c97591164 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:08.844442 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc77dc4a-e7b7-4270-989b-a9f7f505fcc9 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164" status: 404 len: 111 microversion: 2.1 time: 0.108093 Sep 25 01:31:08.846667 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2583/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:08 2022] GET /compute/v2.1/servers/e07503bd-d487-460b-8d5f-368c97591164 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:31:08.863278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:08.869494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:08.891659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:08.897227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:08.897891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:08.898766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:08.900199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:08.907018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:09.005674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:31:09.209064 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-833b0522-62b1-4429-a975-b5686e32f8a7 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 204 len: 0 microversion: 2.1 time: 0.347229 Sep 25 01:31:09.212071 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2584/5178] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:31:08 2022] DELETE /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:31:09.247027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:09.250865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:09.267004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:09.268274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:09.270166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:09.273659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:09.274151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:09.274594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:09.598063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:09.635159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:09.637039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:09.638606 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f037ab10-d133-4057-82d2-88e15298c488 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.411976 Sep 25 01:31:09.639717 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2585/5179] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:09 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:09.657844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:09.658726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:09.678800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:09.679312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:09.679763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:09.680483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:09.680952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:09.681457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:09.998313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:10.015432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c7c95c87-1f5f-4956-b5f5-dbf80ceda0f5 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.371662 Sep 25 01:31:10.018234 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2586/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:09 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:10.669904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:10.671422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:10.679450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:10.680057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:10.680572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:10.681393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:10.682281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:10.682797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:10.772620 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:10.810899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:10.812737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:10.814105 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ac496674-808e-4a41-a46d-486b750cc854 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.149289 Sep 25 01:31:10.834819 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2587/5181] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:10 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:31:10.973843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Building network info cache for instance {{(pid=122384) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:31:10.986392 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-88318f67-1093-4c89-bf18-3f74969d0393 req-0426802d-9834-406f-9b53-415f0615443d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:11.006629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-88318f67-1093-4c89-bf18-3f74969d0393 req-0426802d-9834-406f-9b53-415f0615443d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:11.007132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-88318f67-1093-4c89-bf18-3f74969d0393 req-0426802d-9834-406f-9b53-415f0615443d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:11.007574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-88318f67-1093-4c89-bf18-3f74969d0393 req-0426802d-9834-406f-9b53-415f0615443d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:11.040930 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-88318f67-1093-4c89-bf18-3f74969d0393 req-0426802d-9834-406f-9b53-415f0615443d service nova] Creating event network-changed:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:31:11.047650 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-88318f67-1093-4c89-bf18-3f74969d0393 req-0426802d-9834-406f-9b53-415f0615443d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065560 Sep 25 01:31:11.048662 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2588/5182] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:31:11.054106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:11.055201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:11.062506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:11.063194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:11.063804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:11.064705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:11.065554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:11.066148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:11.308502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:11.320574 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57ae8bd3-5c98-461b-b049-ce7c05554185 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.270396 Sep 25 01:31:11.321668 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2589/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:11 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:11.337638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3dcd16bf-4c65-4bf8-9061-c60e07c1fd32 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] Calling method '.version_select at 0x7f7bf000edc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:11.419260 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3dcd16bf-4c65-4bf8-9061-c60e07c1fd32 tempest-TestSecurityGroupsBasicOps-1815331837 tempest-TestSecurityGroupsBasicOps-1815331837-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1298653349" status: 202 len: 0 microversion: 2.1 time: 0.092170 Sep 25 01:31:11.420034 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2590/5184] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 01:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1298653349 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:31:11.842575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:11.843359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:11.860609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:11.863300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:11.865114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:11.867409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:11.868073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:11.869653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:11.934613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Updating instance_info_cache with network_info: [{"id": "1ca04bae-d211-42b3-a939-342556a605fd", "address": "fa:16:3e:fd:fc:59", "network": {"id": "71e4e1be-67ed-48d4-ace9-d9390c58c6ba", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-618430776-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba17f9b214fc4a1b8b543d1bf96cb68a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1ca04bae-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:31:11.991152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Releasing lock "refresh_cache-ae2a4dc0-1850-4054-8224-cde43efb7ef4" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:31:12.001085 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a32ea7c5-9457-4340-9d10-97c896da45cf tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action" status: 202 len: 0 microversion: 2.1 time: 3.922792 Sep 25 01:31:12.001986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2595/5185] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:31:08 2022] POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action => generated 0 bytes in 3932 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 25 01:31:12.010780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.132"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:12.014881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:12.043399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:12.045034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:12.046698 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-306fbf2b-f664-4af7-95ba-ac86e8a3aa6f tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1873 microversion: 2.32 time: 0.210389 Sep 25 01:31:12.047708 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2591/5186] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:11 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1873 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:31:12.345295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:12.346273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:12.361812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:12.362888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:12.363550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:12.366648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:12.369563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:12.370345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:12.377133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:12.383785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:12.384545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:12.385182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:12.386460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:12.391315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:12.392248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:12.912816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:12.923326 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a266415-2019-40bc-a6c7-47f95fa043cb tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.581538 Sep 25 01:31:12.940695 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2592/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:12 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:13.075943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:13.077038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:13.088263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "refresh_cache-ae2a4dc0-1850-4054-8224-cde43efb7ef4" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:31:13.088755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquired lock "refresh_cache-ae2a4dc0-1850-4054-8224-cde43efb7ef4" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:31:13.089115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:13.089942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:13.090615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:13.091544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:13.092943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:13.093644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:13.185832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:13.192548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:13.193201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:13.193792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lazy-loading 'fault' on Instance uuid 0688d6b7-54a8-4145-9941-2ebba9ecdf6d {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:31:13.883905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:13.902198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:13.904011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ae26af1d0d4104850875f565485d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af93ee90d9d415b850745b7374348b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:13.905645 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8df1b63e-188a-458a-85cb-e6e40c7fda66 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 200 len: 1640 microversion: 2.32 time: 0.834805 Sep 25 01:31:13.921322 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2593/5188] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:13 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 1640 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:31:13.950213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:13.950902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:13.958497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:13.958992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:13.959490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:13.960446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:13.961063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:13.961531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:13.986246 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:14.399292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a281617be64d1b85a6b7d8a708876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b293fd2bf248f0a714067e48ea0792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:14.408908 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-654c9fc2-fcc3-4b45-bbfa-a660ccd308fd tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 200 len: 1522 microversion: 2.1 time: 0.464346 Sep 25 01:31:14.413527 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2594/5189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:13 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:31:14.941681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:14.943436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:14.961894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:14.963894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:14.966655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:14.970771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:14.972183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:14.973242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:15.015412 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] HTTP exception thrown: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Request method failure captured: Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d HTTP/1.1 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL63JtJR9Vj_C_J9WtW4qgZr-3IRnB5rW5cRA033QoAzDHxTAgv61n-q0KrP98P5xFhK0xV2AU0lQeD4JV39AeBw53vNy6IcHFoU6vA6s_CUzVyBXeB_YUu3cEyaIVP9u6TgmEBSvXKe6545P3yIUB41x-YASGJvTcdjJi8avqE7cLpU Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.32 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1af93ee90d9d415b850745b7374348b8 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1af93ee90d9d415b850745b7374348b8"}]}] Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1af93ee90d9d415b850745b7374348b8 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TaggedBootDevicesTest-2121288461-project Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 45ae26af1d0d4104850875f565485d49 Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TaggedBootDevicesTest-2121288461-project Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0688d6b7-54a8-4145-9941-2ebba9ecdf6d'} Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:15.017607 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:15.021505 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:15.026767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Returning 404 to user: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:15.027345 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53ed3eb6-dfc7-4bca-99e5-03380d134912 tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 404 len: 111 microversion: 2.32 time: 0.093216 Sep 25 01:31:15.032702 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2595/5190] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:14 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:31:15.037892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c05e781-9af8-4eff-b4e1-7a0116ea933b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '.version_select at 0x7f7beab64dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:15.073684 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c05e781-9af8-4eff-b4e1-7a0116ea933b tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278627785" status: 204 len: 0 microversion: 2.32 time: 0.036919 Sep 25 01:31:15.073684 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2596/5191] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:31:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278627785 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:31:15.664439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Building network info cache for instance {{(pid=122384) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 25 01:31:15.810045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-35b78a35-be58-45b6-a8d6-fabf400ab5cf req-f60dd6ea-e0af-4eb7-91b2-725d72ba1442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4556d3-2b56-4e23-b0a9-0dd123052772", "name": "network-vif-deleted", "tag": "bb20be38-c4d7-484d-85ed-1c5abb628e57"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:15.832758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-35b78a35-be58-45b6-a8d6-fabf400ab5cf req-f60dd6ea-e0af-4eb7-91b2-725d72ba1442 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:15.833250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-35b78a35-be58-45b6-a8d6-fabf400ab5cf req-f60dd6ea-e0af-4eb7-91b2-725d72ba1442 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:15.833720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-35b78a35-be58-45b6-a8d6-fabf400ab5cf req-f60dd6ea-e0af-4eb7-91b2-725d72ba1442 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:15.856736 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-35b78a35-be58-45b6-a8d6-fabf400ab5cf req-f60dd6ea-e0af-4eb7-91b2-725d72ba1442 service nova] Creating event network-vif-deleted:bb20be38-c4d7-484d-85ed-1c5abb628e57 for instance fe4556d3-2b56-4e23-b0a9-0dd123052772 on n-h2-master-1 Sep 25 01:31:15.872251 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-35b78a35-be58-45b6-a8d6-fabf400ab5cf req-f60dd6ea-e0af-4eb7-91b2-725d72ba1442 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.548431 Sep 25 01:31:15.875918 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2597/5192] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:16.132496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:16.133218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] [instance: fe4556d3-2b56-4e23-b0a9-0dd123052772] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:16.156910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:16.157694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:16.158163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:16.158923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:16.159382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:16.159817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:16.211738 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] HTTP exception thrown: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 could not be found. Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Request method failure captured: Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 HTTP/1.1 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6425Po4zlHaDBIbVh2NYo2SP2MKLkQ4mFL5s0vHqWUiGwPDe-7tO_MfV_Z83isABERTCkeDXAZDTfM84VyCMN80lhC7IM-ezlj5U5lY5tixoo8j9cw9sHAEleRh6YdvOGqbyUNKU0PcdkIePRQySw5EXPDEbmIlEV4T5Kd066NzHbU Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24b293fd2bf248f0a714067e48ea0792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24b293fd2bf248f0a714067e48ea0792"}]}] Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 24b293fd2bf248f0a714067e48ea0792 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-330409474 Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 88a281617be64d1b85a6b7d8a708876a Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerRescueNegativeTestJSON-330409474-project Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: exception: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 could not be found. Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'fe4556d3-2b56-4e23-b0a9-0dd123052772'} Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 could not be found. Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 could not be found. Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:16.217837 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 could not be found. Sep 25 01:31:16.221695 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:16.223196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] Returning 404 to user: Instance fe4556d3-2b56-4e23-b0a9-0dd123052772 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:16.224842 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2a60c66-fcd3-4047-89e7-8f0c9ebc3368 tempest-ServerRescueNegativeTestJSON-330409474 tempest-ServerRescueNegativeTestJSON-330409474-project] 10.222.0.16 "GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772" status: 404 len: 111 microversion: 2.1 time: 0.347101 Sep 25 01:31:16.225641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2598/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:15 2022] GET /compute/v2.1/servers/fe4556d3-2b56-4e23-b0a9-0dd123052772 => generated 111 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:31:16.991520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Updating instance_info_cache with network_info: [{"id": "1ca04bae-d211-42b3-a939-342556a605fd", "address": "fa:16:3e:fd:fc:59", "network": {"id": "71e4e1be-67ed-48d4-ace9-d9390c58c6ba", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-618430776-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ba17f9b214fc4a1b8b543d1bf96cb68a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1ca04bae-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122384) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 25 01:31:17.012751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Releasing lock "refresh_cache-ae2a4dc0-1850-4054-8224-cde43efb7ef4" {{(pid=122384) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:31:17.013955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ee162a5-3a02-49bf-9d31-1d75e1d6eaae tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action" status: 202 len: 0 microversion: 2.1 time: 5.007910 Sep 25 01:31:17.021013 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2596/5194] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:31:12 2022] POST /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4/action => generated 0 bytes in 5015 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 25 01:31:17.044808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bcf69958-d1ca-4805-94b1-5047e3be803c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '.version_select at 0x7f7beab6e160>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:18.100178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-eee54588-6716-4c5a-a8c0-6d3b5a60df9d req-920b6ac9-6435-4bf9-8065-20efe8c31eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:18.144587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eee54588-6716-4c5a-a8c0-6d3b5a60df9d req-920b6ac9-6435-4bf9-8065-20efe8c31eaf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:18.144962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eee54588-6716-4c5a-a8c0-6d3b5a60df9d req-920b6ac9-6435-4bf9-8065-20efe8c31eaf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:18.145433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eee54588-6716-4c5a-a8c0-6d3b5a60df9d req-920b6ac9-6435-4bf9-8065-20efe8c31eaf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:18.193441 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-eee54588-6716-4c5a-a8c0-6d3b5a60df9d req-920b6ac9-6435-4bf9-8065-20efe8c31eaf service nova] Creating event network-changed:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:31:18.205273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-eee54588-6716-4c5a-a8c0-6d3b5a60df9d req-920b6ac9-6435-4bf9-8065-20efe8c31eaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108632 Sep 25 01:31:18.206253 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2597/5195] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:20.765813 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bcf69958-d1ca-4805-94b1-5047e3be803c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cce91269-c5cc-4eba-9b4f-2b4abb82a918" status: 202 len: 0 microversion: 2.1 time: 3.743787 Sep 25 01:31:20.766944 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2599/5196] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:31:17 2022] DELETE /compute/v2.1/os-floating-ips/cce91269-c5cc-4eba-9b4f-2b4abb82a918 => generated 0 bytes in 3746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:31:20.779042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15f94229-2f79-4c33-b9fa-33c686bcf360 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '.version_select at 0x7f7bea9ef4c0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:21.376653 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15f94229-2f79-4c33-b9fa-33c686bcf360 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c7524af4-3ef8-4912-8184-d069df687b87" status: 202 len: 0 microversion: 2.1 time: 0.603639 Sep 25 01:31:21.381260 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2598/5197] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 01:31:20 2022] DELETE /compute/v2.1/os-security-groups/c7524af4-3ef8-4912-8184-d069df687b87 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:31:21.387680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:21.388478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:21.402642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:21.403149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:21.403602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:21.404993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:21.405447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:21.413449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:21.482471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:31:21.626997 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a614eaaf-9629-4713-9be3-31aecf48e9e8 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 204 len: 0 microversion: 2.1 time: 0.243895 Sep 25 01:31:21.627951 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2600/5198] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:31:21 2022] DELETE /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:31:21.645292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:21.646414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:21.655712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:21.656627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:21.657487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:21.658376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:21.659071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:21.659708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:21.943342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:21.949821 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:21.966210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4fd75ea0-6aa9-4c62-93b0-68654668dc0e tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1508 microversion: 2.1 time: 0.327461 Sep 25 01:31:21.983228 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2599/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:21 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:22.764002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:22.765878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:22.774084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:22.774887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:22.776053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:22.777265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:22.777973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:22.778626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:22.797158 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] HTTP exception thrown: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Request method failure captured: Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d HTTP/1.1 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL63JtJR9Vj_C_J9WtW4qgZr-3IRnB5rW5cRA033QoAzDHxTAgv61n-q0KrP98P5xFhK0xV2AU0lQeD4JV39AeBw53vNy6IcHFoU6vA6s_CUzVyBXeB_YUu3cEyaIVP9u6TgmEBSvXKe6545P3yIUB41x-YASGJvTcdjJi8avqE7cLpU Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.32 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1af93ee90d9d415b850745b7374348b8 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1af93ee90d9d415b850745b7374348b8"}]}] Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1af93ee90d9d415b850745b7374348b8 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TaggedBootDevicesTest-2121288461-project Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 45ae26af1d0d4104850875f565485d49 Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TaggedBootDevicesTest-2121288461-project Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0688d6b7-54a8-4145-9941-2ebba9ecdf6d'} Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:22.799348 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.803148 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.806785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Returning 404 to user: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:22.808071 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b18eb77-9591-4ddc-bfc0-39502600605d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 404 len: 111 microversion: 2.32 time: 0.048818 Sep 25 01:31:22.815811 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2601/5200] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:31:22 2022] DELETE /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:31:22.826455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:22.827676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] [instance: 0688d6b7-54a8-4145-9941-2ebba9ecdf6d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:22.838707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:22.839500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:22.840162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:22.841124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:22.841877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:22.842539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:22.860220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] HTTP exception thrown: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Request method failure captured: Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d HTTP/1.1 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL63JtJR9Vj_C_J9WtW4qgZr-3IRnB5rW5cRA033QoAzDHxTAgv61n-q0KrP98P5xFhK0xV2AU0lQeD4JV39AeBw53vNy6IcHFoU6vA6s_CUzVyBXeB_YUu3cEyaIVP9u6TgmEBSvXKe6545P3yIUB41x-YASGJvTcdjJi8avqE7cLpU Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.32 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 1af93ee90d9d415b850745b7374348b8 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1af93ee90d9d415b850745b7374348b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1af93ee90d9d415b850745b7374348b8"}]}] Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 1af93ee90d9d415b850745b7374348b8 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2121288461 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TaggedBootDevicesTest-2121288461-project Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 45ae26af1d0d4104850875f565485d49 Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TaggedBootDevicesTest-2121288461-project Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '0688d6b7-54a8-4145-9941-2ebba9ecdf6d'} Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.862319 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. Sep 25 01:31:22.866824 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:22.867507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] Returning 404 to user: Instance 0688d6b7-54a8-4145-9941-2ebba9ecdf6d could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:22.868858 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3a18b88-2993-4fb1-bca3-12a6c07dd68d tempest-TaggedBootDevicesTest-2121288461 tempest-TaggedBootDevicesTest-2121288461-project] 10.222.0.16 "GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d" status: 404 len: 111 microversion: 2.32 time: 0.054930 Sep 25 01:31:22.876558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2600/5201] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:22 2022] GET /compute/v2.1/servers/0688d6b7-54a8-4145-9941-2ebba9ecdf6d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:31:23.000428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:23.001173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:23.009081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:23.010712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:23.011365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:23.012355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:23.013048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:23.022880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:23.243357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:23.256806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d00a006d-cd49-42c0-98e5-fd2525098883 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1508 microversion: 2.1 time: 0.264153 Sep 25 01:31:23.276231 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2602/5202] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:22 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:24.286656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:24.287919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:24.308844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:24.311512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:24.312856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:24.314493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:24.316892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:24.317529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:24.804129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830045557dd94ea5947df0c661c2a069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba17f9b214fc4a1b8b543d1bf96cb68a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:24.813199 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02eac094-0367-4810-b74b-5455bf702f4c tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 200 len: 1508 microversion: 2.1 time: 0.534340 Sep 25 01:31:24.834726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2601/5203] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:24 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 1508 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:24.870039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c650c720-c3ca-4cae-b8aa-f8f4c2027fde req-91c3b76f-0ee0-45e4-941c-a15f2956de19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2a4dc0-1850-4054-8224-cde43efb7ef4", "name": "network-vif-deleted", "tag": "1ca04bae-d211-42b3-a939-342556a605fd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:24.885624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c650c720-c3ca-4cae-b8aa-f8f4c2027fde req-91c3b76f-0ee0-45e4-941c-a15f2956de19 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:24.886825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c650c720-c3ca-4cae-b8aa-f8f4c2027fde req-91c3b76f-0ee0-45e4-941c-a15f2956de19 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:24.887825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c650c720-c3ca-4cae-b8aa-f8f4c2027fde req-91c3b76f-0ee0-45e4-941c-a15f2956de19 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:24.906769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c650c720-c3ca-4cae-b8aa-f8f4c2027fde req-91c3b76f-0ee0-45e4-941c-a15f2956de19 service nova] Creating event network-vif-deleted:1ca04bae-d211-42b3-a939-342556a605fd for instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 on n-h2-master-1 Sep 25 01:31:24.917960 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c650c720-c3ca-4cae-b8aa-f8f4c2027fde req-91c3b76f-0ee0-45e4-941c-a15f2956de19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053446 Sep 25 01:31:24.922017 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2603/5204] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:25.837389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:25.838340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] [instance: ae2a4dc0-1850-4054-8224-cde43efb7ef4] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:25.848283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:25.849056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:25.849237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:25.849942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:25.850394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:25.850858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:25.882619 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] HTTP exception thrown: Instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 could not be found. Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Request method failure captured: Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 HTTP/1.1 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL68htQS9fRkfyJPxmmd9yFCKGx5RqU-oE7GjAFuEfoutfC2RAIPp0k9kqMqhU7s2u4H44pHqZpHEjyBheX63UidOcDCZJxpXi7zTEIH5tzhyJCW0gk_hYNLFDveQKifmUcBeRHJbJKKqSCZ8aPU2oxr2NzyFG-io22BGgDfJFJ214c0 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: ba17f9b214fc4a1b8b543d1bf96cb68a Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1805865397 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba17f9b214fc4a1b8b543d1bf96cb68a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba17f9b214fc4a1b8b543d1bf96cb68a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba17f9b214fc4a1b8b543d1bf96cb68a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba17f9b214fc4a1b8b543d1bf96cb68a"}]}] Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1805865397 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: ba17f9b214fc4a1b8b543d1bf96cb68a Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1805865397 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueTestJSONUnderV235-1805865397-project Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 830045557dd94ea5947df0c661c2a069 Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1805865397-project Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 could not be found. Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ae2a4dc0-1850-4054-8224-cde43efb7ef4'} Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 could not be found. Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 could not be found. Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:25.886967 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 could not be found. Sep 25 01:31:25.892262 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:31:25.893674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] Returning 404 to user: Instance ae2a4dc0-1850-4054-8224-cde43efb7ef4 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:31:25.896182 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae0f1c6f-2476-48d1-b3e8-4b763a089327 tempest-ServerRescueTestJSONUnderV235-1805865397 tempest-ServerRescueTestJSONUnderV235-1805865397-project] 10.222.0.16 "GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4" status: 404 len: 111 microversion: 2.1 time: 0.062857 Sep 25 01:31:25.901618 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2602/5205] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:25 2022] GET /compute/v2.1/servers/ae2a4dc0-1850-4054-8224-cde43efb7ef4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:31:35.928403 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:35.931029 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:36.592488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2136697127", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:36.739148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:31:38.128727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:31:38.131018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:31:38.133655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:31:38.134919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:31:38.135524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:31:38.162393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:38.163472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:38.165681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:38.168655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:38.170987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:38.173613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:38.219406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:31:38.226617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:31:38.251370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:31:38.256863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:31:38.349704 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27e51895-d879-41e2-b474-10355211ab59 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.427671 Sep 25 01:31:38.351600 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2604/5206] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:31:38.362191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-00bbf0d6-435e-4a83-b350-9e9ea5c9434f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:38.362996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-00bbf0d6-435e-4a83-b350-9e9ea5c9434f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:38.368502 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=35 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:38.368502 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=11 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:38.531838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-00bbf0d6-435e-4a83-b350-9e9ea5c9434f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:38.549497 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-00bbf0d6-435e-4a83-b350-9e9ea5c9434f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1193 microversion: 2.1 time: 0.191126 Sep 25 01:31:38.562987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2603/5207] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:38 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1193 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:39.585268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da028686-2825-4c0e-9bf6-35fb77bdef91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:39.587786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da028686-2825-4c0e-9bf6-35fb77bdef91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:39.982350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da028686-2825-4c0e-9bf6-35fb77bdef91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:39.996592 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da028686-2825-4c0e-9bf6-35fb77bdef91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1193 microversion: 2.1 time: 0.423373 Sep 25 01:31:39.999326 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2605/5208] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:39 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1193 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:41.026655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:41.027276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:41.041723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:41.045270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:41.046171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:41.047313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:41.047954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:41.048736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:41.270560 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:41.296499 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e08d0ee5-fae2-4bea-9430-ae34e47eed95 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1253 microversion: 2.1 time: 0.268471 Sep 25 01:31:41.297559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2604/5209] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:41 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1253 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:42.323248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:42.324519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:42.343039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:42.343847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:42.344468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:42.345367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:42.346043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:42.346847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:42.571289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:42.590999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92ce0f9a-4563-44c6-b4d2-9772beb4a206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1251 microversion: 2.1 time: 0.271756 Sep 25 01:31:42.599697 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2606/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:42 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1251 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:43.626318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:43.627553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:43.657168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:43.659551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:43.660210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:43.661042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:43.666591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:43.666591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:43.871602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:43.893368 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5aa4bae3-b3ad-40f9-aec6-e566b3dd2202 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1251 microversion: 2.1 time: 0.267103 Sep 25 01:31:43.894110 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2605/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:43 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1251 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:44.919776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:44.920596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:44.934114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:44.936232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:44.937710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:44.939812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:44.940473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:44.942944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:45.603025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:45.614406 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8b62d452-4749-4a26-81d6-b7d648a51339 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 0.699688 Sep 25 01:31:45.620018 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2607/5212] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:44 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:46.646116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:46.646743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:46.658699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:46.665626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:46.666287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:46.667765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:46.668560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:46.669149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:47.446420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:47.470198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56a7c695-4d3c-4ad8-a761-e117d3a7854b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 0.827790 Sep 25 01:31:47.474598 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2606/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:46 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:47.706746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-01fd868a-fa1c-4fbb-bb20-dce38c8fa7c8 req-e25073ee-23b5-4d07-899c-bada81cdf00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42", "tag": "c740b914-498b-4637-b4b6-2cb3c831f824"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:47.760191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01fd868a-fa1c-4fbb-bb20-dce38c8fa7c8 req-e25073ee-23b5-4d07-899c-bada81cdf00b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:47.763035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01fd868a-fa1c-4fbb-bb20-dce38c8fa7c8 req-e25073ee-23b5-4d07-899c-bada81cdf00b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:47.763833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01fd868a-fa1c-4fbb-bb20-dce38c8fa7c8 req-e25073ee-23b5-4d07-899c-bada81cdf00b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:47.811923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-01fd868a-fa1c-4fbb-bb20-dce38c8fa7c8 req-e25073ee-23b5-4d07-899c-bada81cdf00b service nova] Creating event network-changed:c740b914-498b-4637-b4b6-2cb3c831f824 for instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 on n-h1-master-1 Sep 25 01:31:47.825527 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-01fd868a-fa1c-4fbb-bb20-dce38c8fa7c8 req-e25073ee-23b5-4d07-899c-bada81cdf00b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130751 Sep 25 01:31:47.830883 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2608/5214] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:48.496900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:48.498956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:48.514121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:48.517572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:48.519070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:48.533873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:48.534726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:48.535386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:48.572834 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:49.600349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:49.630896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2b12aadf-feeb-4f6c-bca7-dc4abb8e503d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 1.136107 Sep 25 01:31:49.633281 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2607/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:48 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:50.128013 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:50.130231 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:31:50.674830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:50.676103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:50.695978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:50.696716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:50.697532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:50.698513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:50.699137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:50.702167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:50.860989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1290378565", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "36be5b4f-512c-453c-8ca2-9b369006e2cb"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:50.963680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] validate_networks() for [('36be5b4f-512c-453c-8ca2-9b369006e2cb', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:31:51.900313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:51.918045 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac3b5c53-3d05-4959-b317-741160e0028d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 1.247831 Sep 25 01:31:51.920405 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2608/5216] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:50 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:52.626999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:31:52.628031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:31:52.628567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:31:52.629538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:31:52.629974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:31:52.639721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:52.640215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:52.640657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:52.641993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:52.642642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:52.643083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:52.663192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Getting quotas for project b729bd9361c5457b84040650f7fda117. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:31:52.668807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Getting quotas for user 1770fcec69584a7ba57800ff5cad8bf0 and project b729bd9361c5457b84040650f7fda117. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:31:52.683552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:31:52.687607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:31:52.745739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb76d473-3ffb-43cf-805c-ba1eae0528f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.618543 Sep 25 01:31:52.746426 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2609/5217] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:31:52.765122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e4dec06-ea54-4d59-9836-8b719a525b99 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:52.766242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e4dec06-ea54-4d59-9836-8b719a525b99 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:52.894170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e4dec06-ea54-4d59-9836-8b719a525b99 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:52.913607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e4dec06-ea54-4d59-9836-8b719a525b99 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:52.918683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e4dec06-ea54-4d59-9836-8b719a525b99 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:52.923362 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e4dec06-ea54-4d59-9836-8b719a525b99 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1262 microversion: 2.26 time: 0.169284 Sep 25 01:31:52.925574 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2609/5218] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:52 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1262 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:52.947602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:52.948239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:52.955149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:52.955645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:52.956206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:52.956921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:52.957389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:52.957874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:53.292204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:53.302127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9d3315bd-68c9-4825-825a-4f4ca7a1f254 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 0.361644 Sep 25 01:31:53.307035 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2610/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:52 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:53.955183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:53.958114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:53.969126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:53.970280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:53.970944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:53.972030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:53.972894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:53.973586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:54.139743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:54.163735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:54.165250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:54.167285 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-273a5f6f-1cc8-4ed4-8691-16d5ca884f21 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1314 microversion: 2.26 time: 0.218332 Sep 25 01:31:54.169765 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2610/5220] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:53 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:54.330571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:54.331198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:54.344140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:54.344411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:54.344864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:54.345618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:54.346084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:54.352451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:55.179397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:55.202475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:55.204645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:55.209241 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce3c0771-041e-4b5e-9315-a81f0558e27b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 0.882546 Sep 25 01:31:55.214536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2611/5221] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:54 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:55.219049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:55.220042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:55.220647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:55.221586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:55.225015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:55.225714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:55.494079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:55.505118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:55.514570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:55.517700 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-099a6e4b-135d-45a1-93b4-edf772bb0803 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1320 microversion: 2.26 time: 0.322560 Sep 25 01:31:55.534942 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2611/5222] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:55 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:56.236555 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:56.237178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:56.253676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:56.254170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:56.254607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:56.255313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:56.255769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:56.256193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:56.526567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fbe4a712-923f-4ae2-8284-fb30f3d1d926 req-db4635da-b852-45a6-b580-09eb1f5284bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42", "name": "network-vif-plugged", "status": "completed", "tag": "c740b914-498b-4637-b4b6-2cb3c831f824"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:56.555090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbe4a712-923f-4ae2-8284-fb30f3d1d926 req-db4635da-b852-45a6-b580-09eb1f5284bd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:56.555825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbe4a712-923f-4ae2-8284-fb30f3d1d926 req-db4635da-b852-45a6-b580-09eb1f5284bd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:56.556447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbe4a712-923f-4ae2-8284-fb30f3d1d926 req-db4635da-b852-45a6-b580-09eb1f5284bd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:56.570287 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fbe4a712-923f-4ae2-8284-fb30f3d1d926 req-db4635da-b852-45a6-b580-09eb1f5284bd service nova] Creating event network-vif-plugged:c740b914-498b-4637-b4b6-2cb3c831f824 for instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 on n-h1-master-1 Sep 25 01:31:56.576079 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fbe4a712-923f-4ae2-8284-fb30f3d1d926 req-db4635da-b852-45a6-b580-09eb1f5284bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.532102 Sep 25 01:31:56.577059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2612/5223] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:31:56.583663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:56.589035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:56.597050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:56.598022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:56.598542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:56.599332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:56.599867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:56.600364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:57.459841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:57.479057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-58d61552-0cff-4805-b262-0d24a707cc2b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1293 microversion: 2.1 time: 1.246405 Sep 25 01:31:57.480257 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2612/5224] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:56 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1293 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:57.511992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:57.521224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:57.522712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:57.523863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd95ea0d-a549-410e-921c-f97f51da4145 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.945431 Sep 25 01:31:57.524429 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2613/5225] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:56 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:58.504014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:58.506194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:58.517260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:58.518028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:58.518687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:58.519766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:58.520420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:58.521042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:58.557469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:31:58.558849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:31:58.574553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:58.580335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:58.583623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:58.586285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:58.586705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:58.587157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:59.117737 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:59.131193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:59.135346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:59.139477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6172526-9111-4deb-a4db-a155f7ca11d9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.585644 Sep 25 01:31:59.142794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2614/5226] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:31:58 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:31:59.338214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-684eddd6-fd59-4606-839e-0b3b162489ab req-16837550-62fb-409f-9561-61f1e1f6bbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04d2fc1-070a-452c-8e31-ef6e9e923fb5", "tag": "0616d778-943c-4f4d-b8af-4a3ced0ea962"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:59.347581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:31:59.364194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-684eddd6-fd59-4606-839e-0b3b162489ab req-16837550-62fb-409f-9561-61f1e1f6bbe8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:31:59.364777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-684eddd6-fd59-4606-839e-0b3b162489ab req-16837550-62fb-409f-9561-61f1e1f6bbe8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:31:59.365141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-684eddd6-fd59-4606-839e-0b3b162489ab req-16837550-62fb-409f-9561-61f1e1f6bbe8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:31:59.365773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9cd4556-ae61-4cc7-9f04-ba842949f750 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1474 microversion: 2.1 time: 0.860417 Sep 25 01:31:59.368677 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2613/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:31:58 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1474 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:31:59.404171 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-684eddd6-fd59-4606-839e-0b3b162489ab req-16837550-62fb-409f-9561-61f1e1f6bbe8 service nova] Creating event network-changed:0616d778-943c-4f4d-b8af-4a3ced0ea962 for instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 on n-h2-master-1 Sep 25 01:31:59.409530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-684eddd6-fd59-4606-839e-0b3b162489ab req-16837550-62fb-409f-9561-61f1e1f6bbe8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075527 Sep 25 01:31:59.410188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2615/5228] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:31:59.595209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1763652169", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:31:59.677643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:00.176812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:00.178384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:00.196072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:00.203506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:00.213545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:00.215302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:00.242328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:00.245993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:00.577238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:00.591917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:00.593477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:00.595001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eff646df-0a3e-4eae-8603-6a65bdc5d3e2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.427187 Sep 25 01:32:00.595899 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2616/5229] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:00 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:32:00.885447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:00.885988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:00.886696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:00.889338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:00.890094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:00.903455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:00.904341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:00.905096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:00.907038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:00.907819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:00.908494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:00.935907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:00.945000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:00.962179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:00.964535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: b53ef24f-52ab-474a-a42d-4891d7e418b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:01.020573 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4462b8d2-7e99-4f7a-b187-70266bde9b08 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431843 Sep 25 01:32:01.027997 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2614/5230] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:32:01.033276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6f12bec-5eb5-479b-b00f-e11c4a6a3745 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:01.033976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e6f12bec-5eb5-479b-b00f-e11c4a6a3745 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: b53ef24f-52ab-474a-a42d-4891d7e418b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:01.065906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e6f12bec-5eb5-479b-b00f-e11c4a6a3745 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: b53ef24f-52ab-474a-a42d-4891d7e418b6] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:32:01.384389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e6f12bec-5eb5-479b-b00f-e11c4a6a3745 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6" status: 204 len: 0 microversion: 2.1 time: 0.352891 Sep 25 01:32:01.391445 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2617/5231] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:32:01 2022] DELETE /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:32:01.418134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-831926de-7615-4d59-a3d9-c29d94601128 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:01.420941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-831926de-7615-4d59-a3d9-c29d94601128 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: b53ef24f-52ab-474a-a42d-4891d7e418b6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:01.442304 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-831926de-7615-4d59-a3d9-c29d94601128 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-831926de-7615-4d59-a3d9-c29d94601128 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 HTTP/1.1 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: exception: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b53ef24f-52ab-474a-a42d-4891d7e418b6'} Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance b53ef24f-52ab-474a-a42d-4891d7e418b6 Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:01.458129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-831926de-7615-4d59-a3d9-c29d94601128 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:32:01.462274 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-831926de-7615-4d59-a3d9-c29d94601128 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6" status: 404 len: 111 microversion: 2.1 time: 0.065206 Sep 25 01:32:01.464793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2615/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:01 2022] GET /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:32:01.604181 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1826163834", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:01.622986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:01.624145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:01.637202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:01.640469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:01.641130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:01.642079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:01.644781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:01.645519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:01.718094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:02.008424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:02.026045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:02.027780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:02.030151 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f1102ce-6384-4322-83f7-634ecbc7a965 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.411661 Sep 25 01:32:02.043142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2616/5233] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:01 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:02.654288 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:02.904497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:02.904912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:02.905443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:02.905850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:02.906272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:02.925344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:02.925903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:02.926349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:02.927098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:02.927557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:02.930990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:02.979554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:02.991560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:03.023537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:03.026594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:03.057936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:03.058629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:03.069117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:03.071860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:03.072530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:03.075359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:03.076780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:03.082574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:03.158972 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e65b5d2-e29f-4bde-afb5-22d1a8ecc336 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.558645 Sep 25 01:32:03.162612 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2618/5234] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:32:03.173524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51bb3e6b-4bdb-43c9-8f7e-90549cabdc7f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:03.174427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-51bb3e6b-4bdb-43c9-8f7e-90549cabdc7f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:03.481639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-51bb3e6b-4bdb-43c9-8f7e-90549cabdc7f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:03.491719 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51bb3e6b-4bdb-43c9-8f7e-90549cabdc7f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1221 microversion: 2.1 time: 0.325035 Sep 25 01:32:03.495232 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2619/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:03 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1221 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:03.612514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:03.623215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:03.624781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:03.626010 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1fa6586e-6b15-4608-ae02-2094621fc8e9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.572238 Sep 25 01:32:03.626590 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2617/5236] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:03 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:04.516707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:04.517450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:04.538785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:04.539286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:04.539736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:04.540454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:04.540913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:04.546251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:04.646128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:04.655966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:04.656604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:04.662066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8efd5045-9a1e-4b51-8cfc-bedc289b2bd7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1273 microversion: 2.1 time: 0.149695 Sep 25 01:32:04.662674 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2620/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:04 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:04.673981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:04.674738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:04.675198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:04.675940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:04.676404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:04.679070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:04.955015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:04.959306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3a8f4379-b007-479a-9b86-1cd24ed15ccf req-0b768c92-2a80-41c3-9d56-999d550770d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04d2fc1-070a-452c-8e31-ef6e9e923fb5", "name": "network-vif-plugged", "status": "completed", "tag": "0616d778-943c-4f4d-b8af-4a3ced0ea962"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:04.992641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:04.994705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:05.000820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6562a235-ae9d-4bb1-a136-86be33f4826e tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.348915 Sep 25 01:32:05.008963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2618/5238] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:04 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:05.009672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3a8f4379-b007-479a-9b86-1cd24ed15ccf req-0b768c92-2a80-41c3-9d56-999d550770d7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:05.013767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3a8f4379-b007-479a-9b86-1cd24ed15ccf req-0b768c92-2a80-41c3-9d56-999d550770d7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:05.014625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3a8f4379-b007-479a-9b86-1cd24ed15ccf req-0b768c92-2a80-41c3-9d56-999d550770d7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:05.056164 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3a8f4379-b007-479a-9b86-1cd24ed15ccf req-0b768c92-2a80-41c3-9d56-999d550770d7 service nova] Creating event network-vif-plugged:0616d778-943c-4f4d-b8af-4a3ced0ea962 for instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 on n-h2-master-1 Sep 25 01:32:05.062081 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3a8f4379-b007-479a-9b86-1cd24ed15ccf req-0b768c92-2a80-41c3-9d56-999d550770d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114403 Sep 25 01:32:05.063544 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2621/5239] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:32:05.691141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:05.691774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:05.711362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:05.715662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:05.718709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:05.719701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:05.721992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:05.723382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:05.857372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:05.882244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61916d4a-3183-4f27-91e2-6f51af06666a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1279 microversion: 2.1 time: 0.194611 Sep 25 01:32:05.883826 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2619/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:05 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:06.038083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:06.040009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:06.053128 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:06.055098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:06.056830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:06.057492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:06.059523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:06.060177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:06.064626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:06.068436 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=63 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:06.347366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:06.362528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:06.364541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:06.369939 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6bfe71c6-a11d-4602-9ba6-a89bd515250c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1362 microversion: 2.26 time: 0.335364 Sep 25 01:32:06.403742 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2622/5241] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:06 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:06.910275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:06.911107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:06.942360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:06.961458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:06.969172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:06.970174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:06.975160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:06.975938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.401639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:07.402810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:07.421066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.421730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.422197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.422951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.423418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.423990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.760720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:07.787333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a4f6cf6-8dd6-4ddb-82a2-03b9c7b54025 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1321 microversion: 2.1 time: 0.881483 Sep 25 01:32:07.787950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2620/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:06 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1321 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:07.838080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:07.851396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:07.853023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:07.854284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f7f0696-7a84-421e-be43-1ed84cf9e49d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1545 microversion: 2.26 time: 0.458786 Sep 25 01:32:07.869432 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2623/5243] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:07 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1545 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:07.881783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea986670>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:07.892960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.893929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.894598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.895319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:07.902176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.903069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.904088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.905015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.905583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.906236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.938489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.939155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.939412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.955979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:07.956821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:07.957766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:07.985665 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:07.996086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cc881124-a113-4331-a366-bc4df3d0406e req-f53b7986-f3ec-4712-a856-2749909ec4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d480ad63-604b-422c-93f9-395a34355ebb", "tag": "b7d165c4-573a-4cd2-b8a8-ec6ab4c11186"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:08.000488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:08.026953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08e67059-8880-4aa5-a94f-22cbe45e85f9 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-871737284" status: 201 len: 0 microversion: 2.26 time: 0.148685 Sep 25 01:32:08.033564 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2621/5244] 10.222.0.16 () {62 vars in 1377 bytes} [Sun Sep 25 01:32:07 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-871737284 => generated 0 bytes in 157 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 25 01:32:08.038435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cc881124-a113-4331-a366-bc4df3d0406e req-f53b7986-f3ec-4712-a856-2749909ec4b3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.039052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cc881124-a113-4331-a366-bc4df3d0406e req-f53b7986-f3ec-4712-a856-2749909ec4b3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.041636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab08f4f8-3731-44d8-a807-a9802537a32f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea772280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.042978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cc881124-a113-4331-a366-bc4df3d0406e req-f53b7986-f3ec-4712-a856-2749909ec4b3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.052187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab08f4f8-3731-44d8-a807-a9802537a32f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.053687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab08f4f8-3731-44d8-a807-a9802537a32f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.054426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab08f4f8-3731-44d8-a807-a9802537a32f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.073009 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cc881124-a113-4331-a366-bc4df3d0406e req-f53b7986-f3ec-4712-a856-2749909ec4b3 service nova] Creating event network-changed:b7d165c4-573a-4cd2-b8a8-ec6ab4c11186 for instance d480ad63-604b-422c-93f9-395a34355ebb on n-h1-master-1 Sep 25 01:32:08.084030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cc881124-a113-4331-a366-bc4df3d0406e req-f53b7986-f3ec-4712-a856-2749909ec4b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095631 Sep 25 01:32:08.086231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab08f4f8-3731-44d8-a807-a9802537a32f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-871737284" status: 204 len: 0 microversion: 2.26 time: 0.049178 Sep 25 01:32:08.087131 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2622/5246] 10.222.0.16 () {60 vars in 1358 bytes} [Sun Sep 25 01:32:08 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-871737284 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:32:08.091566 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2624/5246] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:08.111047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beacd9430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.128149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.128654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.129096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.129706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:08.135734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.136230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.136674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.138052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.138513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.139304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.179450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1929302954", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:08.183322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.183825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.185190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.223317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:08.250477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b2cf9d2-846a-4bff-9bea-2ac74b935255 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 204 len: 0 microversion: 2.26 time: 0.158612 Sep 25 01:32:08.255592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2625/5247] 10.222.0.16 () {60 vars in 1295 bytes} [Sun Sep 25 01:32:08 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:32:08.255959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] validate_networks() for None {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:08.261216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5042d37d-f485-41a6-a135-9a2745a9259d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beab6e040>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.270295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5042d37d-f485-41a6-a135-9a2745a9259d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.270787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5042d37d-f485-41a6-a135-9a2745a9259d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.271459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5042d37d-f485-41a6-a135-9a2745a9259d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.284316 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5042d37d-f485-41a6-a135-9a2745a9259d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 200 len: 12 microversion: 2.26 time: 0.027393 Sep 25 01:32:08.285594 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2626/5248] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 01:32:08 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:08.296470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beac62700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.306721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.307213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.307658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.308173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:08.315398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.316131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.316736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.317703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.318415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.319046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.353049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.353672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.354197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.365633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.366091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.366820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.407626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:08.425914 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ed61a73-849e-4409-9e22-8a0712c0cc5b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-1008608054" status: 201 len: 0 microversion: 2.26 time: 0.133925 Sep 25 01:32:08.427291 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2627/5249] 10.222.0.16 () {62 vars in 1380 bytes} [Sun Sep 25 01:32:08 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-1008608054 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 25 01:32:08.450451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-280b2a2d-c775-4c86-ab16-c7baf855b7cf tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beacd9e50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.461069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-280b2a2d-c775-4c86-ab16-c7baf855b7cf tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.461703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-280b2a2d-c775-4c86-ab16-c7baf855b7cf tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.464674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-280b2a2d-c775-4c86-ab16-c7baf855b7cf tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.480550 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-280b2a2d-c775-4c86-ab16-c7baf855b7cf tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 200 len: 36 microversion: 2.26 time: 0.045846 Sep 25 01:32:08.486923 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2628/5250] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 01:32:08 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 36 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:08.495487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beacdc550>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.507417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.507417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.508263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.508742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:08.525184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.526331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.526940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.528959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.529768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.530587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.568099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.569173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.569921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.605503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:08.626229 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0dc84f71-5c58-400a-b590-6159b1379d5f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-1008608054" status: 204 len: 0 microversion: 2.26 time: 0.137965 Sep 25 01:32:08.628110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2629/5251] 10.222.0.16 () {60 vars in 1364 bytes} [Sun Sep 25 01:32:08 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-1008608054 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:32:08.642101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90125558-2186-429b-a3de-f9ede7a0c23c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beacdcc10>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.650151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90125558-2186-429b-a3de-f9ede7a0c23c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.651064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90125558-2186-429b-a3de-f9ede7a0c23c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.651516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90125558-2186-429b-a3de-f9ede7a0c23c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.672045 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90125558-2186-429b-a3de-f9ede7a0c23c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 200 len: 12 microversion: 2.26 time: 0.039620 Sep 25 01:32:08.673283 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2630/5252] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 01:32:08 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:08.683418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beab16700>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.698515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.699018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.699549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.700156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:08.707656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.708322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.708762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.709544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.710327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.710609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.753330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.754001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.754540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.771633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:08.797750 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-787dc033-408f-4667-8208-04df473f9c0f tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 204 len: 0 microversion: 2.26 time: 0.117561 Sep 25 01:32:08.798521 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2631/5253] 10.222.0.16 () {60 vars in 1295 bytes} [Sun Sep 25 01:32:08 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:32:08.819775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:08.821701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:08.828708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:08.829465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:08.830231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:08.830855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:08.831472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:08.833736 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:08.851074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.851665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.852815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.853388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.854341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.854995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.856018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.856994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.858260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:08.858928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.861691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:08.862320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:08.913102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Getting quotas for project b788028d56a246d49f6586d6255e5f39. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:08.928542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Getting quotas for user 4ec1161d97a84fb2ab8d27491008c744 and project b788028d56a246d49f6586d6255e5f39. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:08.952288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:08.956019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:09.030369 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cca3ff7d-411a-4a21-a14e-ede984e0bc72 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855046 Sep 25 01:32:09.034246 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2623/5254] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:32:09.045747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea772280>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.059407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.060124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.060741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.061480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:09.087758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.088584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.089182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.090131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.092286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.095104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.107072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:09.120197 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c604c5ba-9eab-43c8-841c-0e426e2959f6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1321 microversion: 2.1 time: 0.305145 Sep 25 01:32:09.133494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2632/5255] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:08 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:09.133494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16339a79-6323-4ae8-875f-da6f6c343676 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.133494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16339a79-6323-4ae8-875f-da6f6c343676 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:09.196365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.197212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.198790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.222609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.223185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.225086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.253494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16339a79-6323-4ae8-875f-da6f6c343676 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:09.264136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16339a79-6323-4ae8-875f-da6f6c343676 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1214 microversion: 2.1 time: 0.140978 Sep 25 01:32:09.266326 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2633/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:09 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1214 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:09.274844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:09.332403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06566190-58cf-40ec-a16f-fbffc59b40d2 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-95487869" status: 201 len: 0 microversion: 2.26 time: 0.296905 Sep 25 01:32:09.335312 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2624/5257] 10.222.0.16 () {62 vars in 1374 bytes} [Sun Sep 25 01:32:09 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-95487869 => generated 0 bytes in 300 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Sep 25 01:32:09.346892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beab6d820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.367568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.373770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.401640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.402161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:09.432156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.432808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.433076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.446538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.447051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.447507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.500849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.501352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.501817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.521626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.522116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.522558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.582373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:09.617760 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-086faafd-3fa5-4084-a546-cf73cc6f1946 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-824136725" status: 201 len: 0 microversion: 2.26 time: 0.275326 Sep 25 01:32:09.618736 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2634/5258] 10.222.0.16 () {62 vars in 1377 bytes} [Sun Sep 25 01:32:09 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-824136725 => generated 0 bytes in 278 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 25 01:32:09.629108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea753160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.642626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.643753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.644251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.644807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:09.662718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.663221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.663659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.664596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.665002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.665695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.694752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.695381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.695748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.721687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:09.742655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20bd8e89-04b7-4c5d-813b-8a91b98ae421 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 204 len: 0 microversion: 2.26 time: 0.117751 Sep 25 01:32:09.743894 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2625/5259] 10.222.0.16 () {60 vars in 1295 bytes} [Sun Sep 25 01:32:09 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:32:09.753943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97aecf32-d234-4503-9303-b68de19791a5 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7beb47d820>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.765933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97aecf32-d234-4503-9303-b68de19791a5 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.766718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97aecf32-d234-4503-9303-b68de19791a5 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.769060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97aecf32-d234-4503-9303-b68de19791a5 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.794904 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97aecf32-d234-4503-9303-b68de19791a5 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 200 len: 12 microversion: 2.26 time: 0.042844 Sep 25 01:32:09.796667 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2635/5260] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 01:32:09 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:09.813048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea76aa60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.824219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.824722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.825976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.826508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:09.836138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.836638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.837261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.838145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.838608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.839040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.873012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.873703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.874243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.890372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:09.908687 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab8760fb-e3f3-4b5e-913f-aa4cd5fc7b9c tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 204 len: 0 microversion: 2.26 time: 0.106909 Sep 25 01:32:09.913933 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2626/5261] 10.222.0.16 () {60 vars in 1295 bytes} [Sun Sep 25 01:32:09 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:32:09.925293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea753700>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:09.937759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.939345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.939797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.942079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:09.947943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.948492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.948882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.949610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.950296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.950888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.980358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.982451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.983110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:09.993627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:09.994360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:09.995142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.051695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:10.086541 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e74a22a-8d4e-4321-bbd1-c6f0c40b5b3b tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-901658147" status: 201 len: 0 microversion: 2.26 time: 0.171348 Sep 25 01:32:10.093283 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2627/5262] 10.222.0.16 () {62 vars in 1377 bytes} [Sun Sep 25 01:32:09 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-901658147 => generated 0 bytes in 179 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 25 01:32:10.103662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea70fd30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:10.115521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.116339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.117004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.117725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:10.124791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.125292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.125776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.126484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.126939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.127369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.130059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-852317875", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:10.164707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.165205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.165715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.197086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.197838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.198455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.231688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] validate_networks() for [('b6d5a5d8-51d7-477d-890d-dc2adc630020', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:10.249884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:10.267265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7e8f3bb-ae60-40b9-9742-bba2f07dca7d tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-1031061663" status: 201 len: 0 microversion: 2.26 time: 0.171348 Sep 25 01:32:10.268560 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2628/5263] 10.222.0.16 () {62 vars in 1380 bytes} [Sun Sep 25 01:32:10 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags/tempest-tag-1031061663 => generated 0 bytes in 175 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 25 01:32:10.274214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:10.276726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:10.303606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.307848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.308571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.310094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.311793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.314960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.712448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:10.721255 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b882e42-330c-4173-bca4-eb91f1a63264 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1321 microversion: 2.1 time: 0.451235 Sep 25 01:32:10.721882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2629/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:10 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:10.751083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Action: 'update_all', calling method: .version_select at 0x7f7beb1fdd30>, body: {"tags": ["tempest-tag-1840321206", "tempest-tag-1132766880"]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:10.767417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.767939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.768317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.768797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:10.786615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.787111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.787548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.788260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.788716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.789143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.847099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.849759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.851017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.876215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:10.911118 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1bdfc97c-c897-4883-934d-b49266805e16 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 200 len: 62 microversion: 2.26 time: 0.188147 Sep 25 01:32:10.917040 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2630/5265] 10.222.0.16 () {62 vars in 1312 bytes} [Sun Sep 25 01:32:10 2022] PUT /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 62 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:10.925748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:10.926724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:10.935058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.935815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.936512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:10.937543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:10.938237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:10.939231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.122285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:11.126499 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:11.134278 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c43a1f2e-9cb8-42ba-b51e-cf135867e59e tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1274 microversion: 2.1 time: 0.221450 Sep 25 01:32:11.135379 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2631/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:10 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:11.173528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1bba1f69-9acf-478f-a572-632a6d572cae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea986a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:11.195707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bba1f69-9acf-478f-a572-632a6d572cae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.199618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bba1f69-9acf-478f-a572-632a6d572cae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.201802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bba1f69-9acf-478f-a572-632a6d572cae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.215611 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1bba1f69-9acf-478f-a572-632a6d572cae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 200 len: 62 microversion: 2.26 time: 0.053660 Sep 25 01:32:11.216986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2632/5267] 10.222.0.16 () {60 vars in 1292 bytes} [Sun Sep 25 01:32:11 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 62 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:11.227590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '.version_select at 0x7f7bea9f4b80>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:11.243779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.266292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.266825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.267324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:11.285080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.285605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.286037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.290043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.290526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.293187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.333747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.334227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.334795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.354925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'flavor' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:11.398082 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-848e7d77-c6ec-4f82-8715-7cacb6c96466 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags" status: 204 len: 0 microversion: 2.26 time: 0.174146 Sep 25 01:32:11.399550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2633/5268] 10.222.0.16 () {60 vars in 1295 bytes} [Sun Sep 25 01:32:11 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:32:11.419287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:11.419938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:11.440384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.441481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.442010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.442841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.443412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.443897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.508941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:11.509530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:11.510164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:11.510656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:11.511150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:11.511620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:32:11.532515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.533114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.533715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.535652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.536199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.538471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.598701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Getting quotas for project 0604216998c24ee59f60c44615850d30. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:11.605863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Getting quotas for user 8447ea42224541a69b6af35641350164 and project 0604216998c24ee59f60c44615850d30. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:11.627732 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:11.630459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:11.641700 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-908bb906-bf1a-45fb-ba4d-a360da6a9042 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 204 len: 0 microversion: 2.26 time: 0.235221 Sep 25 01:32:11.642682 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2634/5269] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:32:11 2022] DELETE /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:32:11.656825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:11.657433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:11.663650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.664139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.664654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.665366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.665841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.666270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.711514 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f96d86ef-8157-4886-bb6e-1535cc33f319 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.799469 Sep 25 01:32:11.712178 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2636/5270] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:32:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:32:11.723759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3a786b60-3908-48bd-8b8b-1d95d2fa7389 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:11.724475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3a786b60-3908-48bd-8b8b-1d95d2fa7389 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:11.823174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3a786b60-3908-48bd-8b8b-1d95d2fa7389 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:11.833420 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3a786b60-3908-48bd-8b8b-1d95d2fa7389 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1213 microversion: 2.1 time: 0.113436 Sep 25 01:32:11.851021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2637/5271] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:11 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:11.863805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:11.864639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:11.871539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.877214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.877957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.884060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:11.884752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:11.885369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:11.940557 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:11.960561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:11.978283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:11.983880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:11.987380 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1073154-7a32-4b9a-aab4-b603d507c5ff tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1551 microversion: 2.26 time: 0.339233 Sep 25 01:32:11.990684 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2635/5272] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:11 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1551 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:12.163184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:12.164558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:12.172925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:12.173586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:12.174170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:12.175122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:12.175864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:12.176690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:12.291344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:12.304337 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d954043-c26a-45de-bd31-a9d823ac507e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1321 microversion: 2.1 time: 0.451651 Sep 25 01:32:12.306007 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2638/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:11 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:12.325292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:12.334122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08f5bd11-2f90-4120-a538-206188111d0c tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1272 microversion: 2.1 time: 0.176710 Sep 25 01:32:12.334714 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2636/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:12 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:12.859497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:12.860194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:12.876303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:12.879358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:12.880192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:12.881357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:12.884016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:12.884782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:13.022166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:13.024959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:13.035114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:13.037351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:13.040270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:13.041029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:13.041525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:13.041964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:13.086553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:13.102440 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30223dae-f3bf-4726-8792-686ba42ee70f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1265 microversion: 2.1 time: 0.249520 Sep 25 01:32:13.105564 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2639/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:12 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:13.330458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:13.331083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:13.367083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:13.368353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:13.368961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:13.374405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:13.375250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:13.375866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:13.560253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:13.590615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:13.592471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:13.594149 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51d4477b-8ce3-401e-b45b-527387a9a1e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1551 microversion: 2.26 time: 0.575811 Sep 25 01:32:13.597088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2637/5276] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:13 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1551 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:13.616405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:13.617122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:13.635177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:13.635690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:13.636136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:13.636869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:13.642072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:13.642698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:14.438264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:14.447025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8eedbdbc-fe4d-4406-9974-cbb3e91eb635 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1321 microversion: 2.1 time: 1.121952 Sep 25 01:32:14.448188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2640/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:13 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1321 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:14.461500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7bf49fd4-e768-48e8-8e66-f0bf8e4a07bf req-edb5ee40-4286-42d2-ba5a-e2e172c8b709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d480ad63-604b-422c-93f9-395a34355ebb", "name": "network-vif-plugged", "status": "completed", "tag": "b7d165c4-573a-4cd2-b8a8-ec6ab4c11186"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:14.475694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7bf49fd4-e768-48e8-8e66-f0bf8e4a07bf req-edb5ee40-4286-42d2-ba5a-e2e172c8b709 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:14.477074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7bf49fd4-e768-48e8-8e66-f0bf8e4a07bf req-edb5ee40-4286-42d2-ba5a-e2e172c8b709 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:14.477782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7bf49fd4-e768-48e8-8e66-f0bf8e4a07bf req-edb5ee40-4286-42d2-ba5a-e2e172c8b709 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:14.491452 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7bf49fd4-e768-48e8-8e66-f0bf8e4a07bf req-edb5ee40-4286-42d2-ba5a-e2e172c8b709 service nova] Creating event network-vif-plugged:b7d165c4-573a-4cd2-b8a8-ec6ab4c11186 for instance d480ad63-604b-422c-93f9-395a34355ebb on n-h1-master-1 Sep 25 01:32:14.497601 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7bf49fd4-e768-48e8-8e66-f0bf8e4a07bf req-edb5ee40-4286-42d2-ba5a-e2e172c8b709 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047889 Sep 25 01:32:14.498313 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2641/5278] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:14.504790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:14.505726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:14.513222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:14.513922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:14.514526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:14.515225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:14.515680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:14.516102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:14.568898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:14.578640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75cbbfaf-e83a-4959-a6b1-aae1e153495f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.980387 Sep 25 01:32:14.579472 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2638/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:13 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:14.625029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:14.626363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:14.635596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:14.636431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:14.637143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:14.638540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:14.639216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:14.639849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:14.670009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:14.679541 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4fe3eb8-74d9-4dcf-b8e0-292f5a74c277 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1271 microversion: 2.1 time: 0.179723 Sep 25 01:32:14.684962 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2642/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:14 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:15.098419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:15.113606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:15.116047 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:15.118289 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6d8e3b2-7ead-4a46-a91e-f185fdab97ea tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1551 microversion: 2.26 time: 0.499053 Sep 25 01:32:15.118997 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2639/5281] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:14 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1551 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:15.394433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8f1cf209-bd49-4775-9c7c-f65b2a89a52b req-3b03106e-9345-48d1-b1dd-538202d27f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04d2fc1-070a-452c-8e31-ef6e9e923fb5", "name": "network-vif-deleted", "tag": "0616d778-943c-4f4d-b8af-4a3ced0ea962"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:15.421671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f1cf209-bd49-4775-9c7c-f65b2a89a52b req-3b03106e-9345-48d1-b1dd-538202d27f33 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:15.424126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f1cf209-bd49-4775-9c7c-f65b2a89a52b req-3b03106e-9345-48d1-b1dd-538202d27f33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:15.425988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8f1cf209-bd49-4775-9c7c-f65b2a89a52b req-3b03106e-9345-48d1-b1dd-538202d27f33 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:15.456887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8f1cf209-bd49-4775-9c7c-f65b2a89a52b req-3b03106e-9345-48d1-b1dd-538202d27f33 service nova] Creating event network-vif-deleted:0616d778-943c-4f4d-b8af-4a3ced0ea962 for instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 on n-h2-master-1 Sep 25 01:32:15.469385 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8f1cf209-bd49-4775-9c7c-f65b2a89a52b req-3b03106e-9345-48d1-b1dd-538202d27f33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078344 Sep 25 01:32:15.470643 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2643/5282] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:15.472003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:15.477004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:15.506853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:15.507745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:15.509159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:15.510764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:15.515463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:15.515933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:15.616023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:15.618281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:15.629940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:15.630438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:15.630881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:15.638859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:15.639375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:15.639822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:16.199911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:16.204895 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:16.210059 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55ce44c0-c4e9-4b29-912a-4af7da9db1df tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1321 microversion: 2.1 time: 0.742076 Sep 25 01:32:16.210651 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2640/5283] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:15 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1321 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:16.220473 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-766af5ae-6af9-4636-bba4-7348e0db7c18 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.611058 Sep 25 01:32:16.225912 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2644/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:15 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:16.234503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:16.235134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:16.235446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:16.236226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:16.243144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:16.243640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:16.244210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:16.244876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:16.245345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:16.245904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:16.254936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:16.255487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:16.255930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:16.256651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:16.257114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:16.257585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:16.332118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:16.332630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:16.333394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:16.334117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lazy-loading 'fault' on Instance uuid f04d2fc1-070a-452c-8e31-ef6e9e923fb5 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:16.474158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:16.486237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:16.487930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1770fcec69584a7ba57800ff5cad8bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b729bd9361c5457b84040650f7fda117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:16.489314 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5baf045d-7993-4f29-868d-ea99084f7eae tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 200 len: 1352 microversion: 2.26 time: 0.259903 Sep 25 01:32:16.506053 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2641/5285] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:16 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 1352 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:16.677268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:16.696949 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-09405fb9-a8a8-4941-9b65-7384ef941545 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.469615 Sep 25 01:32:16.713724 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2645/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:16 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:17.233661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:17.234408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:17.242147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:17.242844 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:17.250860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.251617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.252970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.253973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.254447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.255588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.265714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.266210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.266649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.267454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.267909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.268339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.554292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:17.563012 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-813043ff-11c0-4aec-b01e-7a498194b9db tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.328888 Sep 25 01:32:17.563826 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2646/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:17 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:17.569038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-11c9cfaf-c958-432c-b8a6-7aa510d7eba6 req-2bb0342e-9c53-4ed1-a259-48344b5c4504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bae8e2e-e11b-49e4-b620-da6c4ebc967d", "tag": "dcf604b7-62a9-4954-967b-740ddc278fc0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:17.570170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:17.580523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb6f88d1-01cf-47de-ada4-018ddb4a1d98 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1502 microversion: 2.1 time: 0.350857 Sep 25 01:32:17.592402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11c9cfaf-c958-432c-b8a6-7aa510d7eba6 req-2bb0342e-9c53-4ed1-a259-48344b5c4504 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.592713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2642/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:17 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:17.592806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11c9cfaf-c958-432c-b8a6-7aa510d7eba6 req-2bb0342e-9c53-4ed1-a259-48344b5c4504 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.592806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11c9cfaf-c958-432c-b8a6-7aa510d7eba6 req-2bb0342e-9c53-4ed1-a259-48344b5c4504 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.610568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:17.611119 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-11c9cfaf-c958-432c-b8a6-7aa510d7eba6 req-2bb0342e-9c53-4ed1-a259-48344b5c4504 service nova] Creating event network-changed:dcf604b7-62a9-4954-967b-740ddc278fc0 for instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d on n-h2-master-1 Sep 25 01:32:17.615340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] [instance: f04d2fc1-070a-452c-8e31-ef6e9e923fb5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:17.619331 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-11c9cfaf-c958-432c-b8a6-7aa510d7eba6 req-2bb0342e-9c53-4ed1-a259-48344b5c4504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052415 Sep 25 01:32:17.620711 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2647/5289] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:17.623002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.623561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.624246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.625175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.625847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.626456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.629063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:17.630435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:17.637067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.637597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.638231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.638942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.639428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.639860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.646242 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] HTTP exception thrown: Instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 could not be found. Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Request method failure captured: Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 HTTP/1.1 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6-F0hZTdJN-bdDX70sahgjI6EamFF69ELWql6MUAesxjuv02PlO4L0ZE8S1HIPL7Bjk9LRaalmSfHQgotAB3M3G5iHaAM-ye77Z43RuwsLk5OezcftHhSrxV6rTNCPqWpW0W1Oaq9E_913kpjbFhmPwwxJL0Q4wYu0Ihe-R_IQtVD8 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.26 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b729bd9361c5457b84040650f7fda117 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerTagsTestJSON-505816619 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b729bd9361c5457b84040650f7fda117"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b729bd9361c5457b84040650f7fda117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b729bd9361c5457b84040650f7fda117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b729bd9361c5457b84040650f7fda117"}]}] Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerTagsTestJSON-505816619 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b729bd9361c5457b84040650f7fda117 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerTagsTestJSON-505816619 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerTagsTestJSON-505816619-project Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1770fcec69584a7ba57800ff5cad8bf0 Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerTagsTestJSON-505816619-project Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: exception: Instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 could not be found. Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'f04d2fc1-070a-452c-8e31-ef6e9e923fb5'} Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 could not be found. Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 could not be found. Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:17.648461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 could not be found. Sep 25 01:32:17.653114 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:17.655066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] Returning 404 to user: Instance f04d2fc1-070a-452c-8e31-ef6e9e923fb5 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:32:17.656255 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4712334e-995b-4c92-8d19-519f1b1aa8e3 tempest-ServerTagsTestJSON-505816619 tempest-ServerTagsTestJSON-505816619-project] 10.222.0.16 "GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5" status: 404 len: 111 microversion: 2.26 time: 0.069266 Sep 25 01:32:17.656796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2643/5290] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:17 2022] GET /compute/v2.1/servers/f04d2fc1-070a-452c-8e31-ef6e9e923fb5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:32:17.720238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:17.720855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:17.732044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.732807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.733448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:17.734958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:17.735420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:17.735854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.020368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:18.037842 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7bb40bdf-0372-483e-b2cc-1cc96dbcc4af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1502 microversion: 2.1 time: 0.414263 Sep 25 01:32:18.045758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:18.054665 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2648/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:17 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1502 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:18.058475 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e700ae8e-33c1-4f6e-8296-3702b0e4556f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.337834 Sep 25 01:32:18.059434 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2644/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:17 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:18.065277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:18.065809 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:18.072028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:18.072715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:18.073466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.075454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:18.076036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:18.076462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.102824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:32:18.195976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ac43be5-b4a7-45d3-bced-89663ca20edd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 204 len: 0 microversion: 2.1 time: 0.135388 Sep 25 01:32:18.197301 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2649/5293] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:32:18 2022] DELETE /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:32:18.207769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:18.209247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:18.227536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:18.228294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:18.228898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.229632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:18.232373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:18.235594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.384256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:18.392807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-826c8ac7-66c6-41c6-8b28-f6965f971f38 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1508 microversion: 2.1 time: 0.191085 Sep 25 01:32:18.394009 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2645/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:18 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:18.586574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:18.587373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:18.595244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:18.595932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:18.596448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.597238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:18.597803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:18.598305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:18.757910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:18.779945 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eaed4faf-7b48-4dfc-b154-9bdf5a87601d tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.197692 Sep 25 01:32:18.793893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2650/5295] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:18 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:19.091305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:19.091858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:19.098262 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:19.099188 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:19.101233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.102273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.103106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.104042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.104703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.105327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.339863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:19.352537 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c28644b4-fa96-40c5-b8d9-65e638b018dc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.272915 Sep 25 01:32:19.360412 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2646/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:19 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:19.416395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:19.417659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:19.424566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.425052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.425709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.426609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.427230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.427821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.653730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4bdba50b-45b0-4091-934b-e0ab4f7d3fd2 req-171f2e5c-e6cf-4f69-8231-16d0ce065774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a78a7e5-1e7d-43f5-81cd-9960a38d76a5", "tag": "11141640-2781-46cf-a807-bd6129060bb2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:19.677203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4bdba50b-45b0-4091-934b-e0ab4f7d3fd2 req-171f2e5c-e6cf-4f69-8231-16d0ce065774 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.680535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4bdba50b-45b0-4091-934b-e0ab4f7d3fd2 req-171f2e5c-e6cf-4f69-8231-16d0ce065774 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.685041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4bdba50b-45b0-4091-934b-e0ab4f7d3fd2 req-171f2e5c-e6cf-4f69-8231-16d0ce065774 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.690281 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:19.690588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:19.702207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff77ce56-c631-4839-8359-f67176ba998c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1508 microversion: 2.1 time: 0.289703 Sep 25 01:32:19.703170 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2651/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:19 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:19.735624 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4bdba50b-45b0-4091-934b-e0ab4f7d3fd2 req-171f2e5c-e6cf-4f69-8231-16d0ce065774 service nova] Creating event network-changed:11141640-2781-46cf-a807-bd6129060bb2 for instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 on n-h1-master-1 Sep 25 01:32:19.754005 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4bdba50b-45b0-4091-934b-e0ab4f7d3fd2 req-171f2e5c-e6cf-4f69-8231-16d0ce065774 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098445 Sep 25 01:32:19.755056 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2647/5298] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:19.804670 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:19.805634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:19.812542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.813647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.814382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.815509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:19.816236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:19.816862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:19.999105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:20.010242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6dc66c03-6b6e-4861-b5a6-a1244bbb5a79 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.209101 Sep 25 01:32:20.025435 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2652/5299] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:19 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:20.379158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:20.379878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:20.388051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:20.388749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:20.389387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:20.390308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:20.390928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:20.391556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:20.556311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:20.570595 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a463250-739d-4a8f-a2ac-bf0a2fd6a775 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.197433 Sep 25 01:32:20.571364 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2648/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:20 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:20.726486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:20.727706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:20.748072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:20.749681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:20.750373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:20.751340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:20.752867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:20.753542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:21.035108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:21.036006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:21.045094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:21.048583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:21.049020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:21.049849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:21.050231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:21.050654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:21.575581 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:21.594703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:21.607246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7aa018f0-c35f-44ad-9d87-efe5d3185201 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.576016 Sep 25 01:32:21.622088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2649/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:21 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:21.631835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:21.636656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:21.651547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:21.652186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:21.653283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:21.658555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:21.659152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:21.659703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:21.799163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:21.813545 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cfa4b3ae-d8ea-452a-a96d-46a84c51815b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1508 microversion: 2.1 time: 1.091694 Sep 25 01:32:21.814144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2653/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:20 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1508 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:21.908007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:21.922906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6322b935-307e-4870-9a9a-a0e68254d4fb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.291939 Sep 25 01:32:21.930849 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2650/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:21 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:22.328143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5ecca851-7087-428a-9b92-70362d3c22a4 req-e87580ae-121b-445e-bfd6-480709ce7760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d480ad63-604b-422c-93f9-395a34355ebb", "name": "network-vif-deleted", "tag": "b7d165c4-573a-4cd2-b8a8-ec6ab4c11186"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:22.341136 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=26 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:22.348642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ecca851-7087-428a-9b92-70362d3c22a4 req-e87580ae-121b-445e-bfd6-480709ce7760 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.349124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ecca851-7087-428a-9b92-70362d3c22a4 req-e87580ae-121b-445e-bfd6-480709ce7760 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.349586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ecca851-7087-428a-9b92-70362d3c22a4 req-e87580ae-121b-445e-bfd6-480709ce7760 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.390370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5ecca851-7087-428a-9b92-70362d3c22a4 req-e87580ae-121b-445e-bfd6-480709ce7760 service nova] Creating event network-vif-deleted:b7d165c4-573a-4cd2-b8a8-ec6ab4c11186 for instance d480ad63-604b-422c-93f9-395a34355ebb on n-h1-master-1 Sep 25 01:32:22.403813 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5ecca851-7087-428a-9b92-70362d3c22a4 req-e87580ae-121b-445e-bfd6-480709ce7760 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079863 Sep 25 01:32:22.408157 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2654/5304] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:22.635416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:22.636042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:22.646680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.647178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.647610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.648469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.648925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.649595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.840941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:22.842688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:22.849934 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:22.852959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.853685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.854073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:22.854528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.855387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.856636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.857461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.884267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-69b52f3f-6f0e-451e-a93c-eeaf264cae64 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.253412 Sep 25 01:32:22.903404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.903404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.903404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.903404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lazy-loading 'fault' on Instance uuid d480ad63-604b-422c-93f9-395a34355ebb {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:22.911687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2651/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:22 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:22.968704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6e44aaae-923f-4922-9f8e-b9c504613bbf req-dcb3acdf-e713-4409-b23f-13548cb9e318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bae8e2e-e11b-49e4-b620-da6c4ebc967d", "name": "network-vif-plugged", "status": "completed", "tag": "dcf604b7-62a9-4954-967b-740ddc278fc0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:22.972908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:22.981358 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:22.981751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6e44aaae-923f-4922-9f8e-b9c504613bbf req-dcb3acdf-e713-4409-b23f-13548cb9e318 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:22.982416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6e44aaae-923f-4922-9f8e-b9c504613bbf req-dcb3acdf-e713-4409-b23f-13548cb9e318 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:22.982851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6e44aaae-923f-4922-9f8e-b9c504613bbf req-dcb3acdf-e713-4409-b23f-13548cb9e318 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:22.995121 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6e44aaae-923f-4922-9f8e-b9c504613bbf req-dcb3acdf-e713-4409-b23f-13548cb9e318 service nova] Creating event network-vif-plugged:dcf604b7-62a9-4954-967b-740ddc278fc0 for instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d on n-h2-master-1 Sep 25 01:32:23.004638 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6e44aaae-923f-4922-9f8e-b9c504613bbf req-dcb3acdf-e713-4409-b23f-13548cb9e318 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045946 Sep 25 01:32:23.005920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2652/5306] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:23.006144 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c396aa1-83f8-4e83-952d-4cbd1f6173c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 200 len: 1311 microversion: 2.1 time: 0.169419 Sep 25 01:32:23.007262 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2655/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:22 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:23.031316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:23.045933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:23.056110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:23.058623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:23.060800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:23.062194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:23.063740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:23.071851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:23.466396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:23.477316 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-32e0338a-5d07-46b7-8ddb-5e600db076b1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.470019 Sep 25 01:32:23.478148 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2653/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:23 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:23.910891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:23.911590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:23.921000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:23.921568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:23.922011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:23.922715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:23.923238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:23.923681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:24.033472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:24.034202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:24.041199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:24.042072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:24.042614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:24.044313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:24.044883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:24.045434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:24.061298 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb HTTP/1.1 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: exception: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'd480ad63-604b-422c-93f9-395a34355ebb'} Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:24.063110 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:32:24.068808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea0f5fb7-25bb-40a7-ba9f-e4df06df7526 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 404 len: 111 microversion: 2.1 time: 0.036781 Sep 25 01:32:24.074055 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2654/5309] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:24 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:32:24.079427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3adce13-7ac5-472a-8b1d-9651e32523c4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: .version_select at 0x7f7bea986d30>, body: {"keypair": {"name": "tempest-key-1839148626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG778pGX/fNIeN7Im0Jup3q7oOab97me2ZsL8WGKtgvN+sHDstoq/LCo4M+AbfMPQPOUNKRNIlKBhYOQ4nhI9x0TQYn6z8yOf3bO0WjdncgFuDZU9Kj0R1FbiB1cdMvRQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:24.089473 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:24.098322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d3adce13-7ac5-472a-8b1d-9651e32523c4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:24.106690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d3adce13-7ac5-472a-8b1d-9651e32523c4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:24.126553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:24.137769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd041479-47eb-46ff-abdd-e76cc5fe68e1 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1314 microversion: 2.1 time: 0.230889 Sep 25 01:32:24.138483 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2656/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:23 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:24.157383 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3adce13-7ac5-472a-8b1d-9651e32523c4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.081876 Sep 25 01:32:24.158293 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2655/5311] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:32:24 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:24.169612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-daf3ecbc-cfd0-4022-b249-db8c098aa87c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '.version_select at 0x7f7beacdce50>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:24.173908 n-d-master-1 devstack@n-api.service[122385]: WARNING oslo_db.sqlalchemy.utils [None req-daf3ecbc-cfd0-4022-b249-db8c098aa87c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 25 01:32:24.180386 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-daf3ecbc-cfd0-4022-b249-db8c098aa87c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.014876 Sep 25 01:32:24.180895 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2657/5312] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:32:24 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:24.317027 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1601314614", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-key-1839148626", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:24.383349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:24.501615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:24.502115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:24.516294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:24.516865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:24.517383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:24.518249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:24.518717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:24.519292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:24.803993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:24.825148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0319a0fe-24ef-4fd3-a91b-7cc020079bf2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.327974 Sep 25 01:32:24.827072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2658/5313] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:24 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:25.038032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:25.038992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:25.039635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:25.040231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:25.040809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:25.053279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.053946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.054398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.055305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.055987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.056842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.079614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:25.086238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:25.099808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:25.104520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:25.163006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:25.164625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:25.175736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.179830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.180620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.181709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.183660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.185433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.208647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0ee0572-a0ee-4851-b24f-4231967c3b78 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899220 Sep 25 01:32:25.209955 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2656/5314] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:32:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:32:25.223064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d4ec229-b01b-4334-ac12-8be092329091 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:25.223944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d4ec229-b01b-4334-ac12-8be092329091 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:25.374399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d4ec229-b01b-4334-ac12-8be092329091 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:25.385875 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d4ec229-b01b-4334-ac12-8be092329091 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1229 microversion: 2.1 time: 0.168574 Sep 25 01:32:25.388814 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2657/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:25 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:25.529850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:25.553106 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30ba7c6f-0ca1-41a2-9078-5e1ac03a9310 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1463 microversion: 2.1 time: 0.382674 Sep 25 01:32:25.563376 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2659/5316] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:25 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:25.586596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e77aa12-6c26-42ef-b098-e32d0349074b", "device": "/dev/sdb"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:25.588738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:25.597096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.597816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.598419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.599319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.600198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.600797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.740489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-edf6c51a-ffaf-460b-b458-1709cf32ccbd req-c9332c6d-962d-46f6-8d6e-10978b5a6a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a78a7e5-1e7d-43f5-81cd-9960a38d76a5", "name": "network-vif-plugged", "status": "completed", "tag": "11141640-2781-46cf-a807-bd6129060bb2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:25.757278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-edf6c51a-ffaf-460b-b458-1709cf32ccbd req-c9332c6d-962d-46f6-8d6e-10978b5a6a8d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.758164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-edf6c51a-ffaf-460b-b458-1709cf32ccbd req-c9332c6d-962d-46f6-8d6e-10978b5a6a8d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.758775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-edf6c51a-ffaf-460b-b458-1709cf32ccbd req-c9332c6d-962d-46f6-8d6e-10978b5a6a8d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.791970 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-edf6c51a-ffaf-460b-b458-1709cf32ccbd req-c9332c6d-962d-46f6-8d6e-10978b5a6a8d service nova] Creating event network-vif-plugged:11141640-2781-46cf-a807-bd6129060bb2 for instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 on n-h1-master-1 Sep 25 01:32:25.799324 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-edf6c51a-ffaf-460b-b458-1709cf32ccbd req-c9332c6d-962d-46f6-8d6e-10978b5a6a8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062491 Sep 25 01:32:25.800928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2660/5317] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:25.853063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:25.854084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:25.870844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.873035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.875529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:25.878654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:25.879384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:25.880803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:26.101241 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1fc9e2d8-7720-496f-a6c0-02c70c9f52fd tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "POST /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526867 Sep 25 01:32:26.103649 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2658/5318] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:32:25 2022] POST /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:26.374641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:26.390548 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2192d3a5-a48e-4f10-a005-65aed075e1a4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.541463 Sep 25 01:32:26.406135 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2661/5319] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:25 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:26.412028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:26.412738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:26.430747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:26.431251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:26.431695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:26.432674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:26.433138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:26.433599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:26.579779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:26.599395 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8733fad-8f22-4d75-871f-ce7185fa81c5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1225 microversion: 2.1 time: 0.193960 Sep 25 01:32:26.599986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2659/5320] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:26 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:27.423479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:27.434707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:27.443170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:27.444050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:27.450210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:27.451275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:27.451912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:27.452702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:27.627975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:27.628585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:27.654397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:27.655107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:27.655563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:27.656305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:27.664366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:27.664889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:27.819810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:27.831695 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-154cd497-fa55-4551-8509-cc30027217c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1313 microversion: 2.1 time: 0.412069 Sep 25 01:32:27.834409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2662/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:27 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:27.867675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:27.879026 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3fd0650-71ce-4905-a532-5e3873f6c9a9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1287 microversion: 2.1 time: 0.254891 Sep 25 01:32:27.879623 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2660/5322] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:27 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1287 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:28.857310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:28.858573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:28.866540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:28.867306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:28.867934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:28.868921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:28.869823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:28.870584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:28.908679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:28.910417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:28.928025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:28.934700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:28.937321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:28.938188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:28.939793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:28.942489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:29.764878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:29.780599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c38f1893-f221-426f-8012-302dd604d4a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1498 microversion: 2.1 time: 0.926312 Sep 25 01:32:29.781224 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2663/5323] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:28 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1498 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:29.797282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:29.812992 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2011d3e-ce29-4156-bd4e-2647b9247dca tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.908896 Sep 25 01:32:29.813720 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2661/5324] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:28 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:29.817014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:29.819497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:29.836755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:29.838852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:29.842462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:29.843345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:29.843893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:29.844407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:29.903699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lazy-loading 'flavor' on Instance uuid 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:32:30.029778 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-062fdd69-e7eb-4e96-a25c-78988a5a2307 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "POST /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5/action" status: 200 len: 32 microversion: 2.1 time: 0.217339 Sep 25 01:32:30.031446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2664/5325] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:32:29 2022] POST /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:32:30.042367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:30.044724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:30.065837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:30.068771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:30.069964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:30.072443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:30.082089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:30.098268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:30.636624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:30.648887 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3053da33-1d21-4091-a995-630450ce5c5b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.612061 Sep 25 01:32:30.650052 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2662/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:30 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:30.843258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:30.844098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:30.860210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:30.861093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:30.862711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:30.866928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:30.867551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:30.868098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:30.929824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-512ac7c4-4681-4569-b65d-76acbffbef23 req-25cd8956-9dc0-431d-9cc5-2306ac74c15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3986a12a-906d-4b76-820e-420e3cc12217", "tag": "e7e8fda5-bb5f-42a4-8ae8-d76651525790"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:30.951344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-512ac7c4-4681-4569-b65d-76acbffbef23 req-25cd8956-9dc0-431d-9cc5-2306ac74c15a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:30.952217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-512ac7c4-4681-4569-b65d-76acbffbef23 req-25cd8956-9dc0-431d-9cc5-2306ac74c15a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:30.953548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-512ac7c4-4681-4569-b65d-76acbffbef23 req-25cd8956-9dc0-431d-9cc5-2306ac74c15a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:30.981371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-512ac7c4-4681-4569-b65d-76acbffbef23 req-25cd8956-9dc0-431d-9cc5-2306ac74c15a service nova] Creating event network-changed:e7e8fda5-bb5f-42a4-8ae8-d76651525790 for instance 3986a12a-906d-4b76-820e-420e3cc12217 on n-h2-master-1 Sep 25 01:32:30.995177 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-512ac7c4-4681-4569-b65d-76acbffbef23 req-25cd8956-9dc0-431d-9cc5-2306ac74c15a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073799 Sep 25 01:32:30.996676 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2663/5327] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:31.581508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:31.589630 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef65a764-9a46-472f-b014-d976ab37d2ff tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.752232 Sep 25 01:32:31.609449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2665/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:30 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:31.678979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:31.679809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:31.687512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:31.698655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:31.700549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:31.703411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:31.704062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:31.705793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:31.960025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-773fb4e1-38e3-46e4-802a-16db170ec6db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'create', calling method: .version_select at 0x7f7bebd52af0>, body: {"keypair": {"name": "tempest-keypair-1431337651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfv1sd6ozo79mHcSsdxapG9vAgAUepsGLoe8SJEbpgb3ZPFD+rR6+qjkuqtx7CESRYGkoPGHzJmxkUAIoIhzBfZ73ZaDludmkKdP7zaYgT7jd2NLZFwtEyc+PGn64FEdw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:31.983183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-773fb4e1-38e3-46e4-802a-16db170ec6db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:31.996884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-773fb4e1-38e3-46e4-802a-16db170ec6db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for user 0f8c7f57af21464684837dcce49d4d0b and project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:32.059508 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-773fb4e1-38e3-46e4-802a-16db170ec6db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.293981 Sep 25 01:32:32.060139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2666/5329] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:32:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 296 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:32:32.320320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:32.338221 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-087ad3fa-52ca-4459-8bef-9307df509be1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.665227 Sep 25 01:32:32.339254 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2664/5330] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:31 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:32.625439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:32.626224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:32.635164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:32.635666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:32.636143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:32.642224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:32.642951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:32.643420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:32.824952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:32.836056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-77b508d4-9aaa-4d1b-96eb-075720c804bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.215342 Sep 25 01:32:32.837029 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2667/5331] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:32 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:33.364730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:33.366206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:33.381766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:33.382554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:33.383207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:33.384114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:33.384767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:33.385426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:33.568559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:33.578919 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ada14a0-8927-4ab9-8462-394ecea1cfba tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.219482 Sep 25 01:32:33.582776 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2665/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:33 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:33.850567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1971723987", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30b62076-0bb4-4ded-8d1a-fd267e5b0585"}], "security_groups": [{"name": "tempest-securitygroup--777222950"}], "key_name": "tempest-keypair-1431337651", "user_data": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:33.864878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:33.866999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:33.882869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:33.883621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:33.884215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:33.885124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:33.889130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:33.889843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:34.107011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:34.118448 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf7ccb41-2eae-4e82-ac9f-64d767768a39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.262842 Sep 25 01:32:34.119600 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2666/5333] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:33 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:34.128266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] validate_networks() for [('30b62076-0bb4-4ded-8d1a-fd267e5b0585', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:34.604605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:34.605231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:34.615965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:34.616469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:34.616905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:34.617651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:34.618109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:34.618530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:34.961597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:34.967988 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:34.996780 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2846e8c5-28ef-484a-a780-aa08d79b450f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.395648 Sep 25 01:32:34.998808 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2667/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:34 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:35.143275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:35.144102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:35.147678 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:35.162941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:35.196843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:35.200985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:35.203269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:35.204691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:35.206031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:35.380779 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=12 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:35.569694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:35.582634 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6d182da-b3cf-444b-9d7e-0a0d6b3c82eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.445113 Sep 25 01:32:35.607336 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2668/5335] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:35 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:35.607887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:35.608263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:35.608538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:35.608949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:35.609364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:35.628563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:35.629046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:35.629687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:35.630583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:35.631065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:35.631494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:35.703706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:35.718616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for user 0f8c7f57af21464684837dcce49d4d0b and project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:35.736032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:35.743503 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:35.813665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2a98d15-b65d-4a24-b7fa-fcc5fa31e5b8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.967132 Sep 25 01:32:35.814916 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2668/5336] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:32:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:32:35.827243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d498382-4b19-4bfa-9bcf-3fd2ec52eac5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:35.828497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d498382-4b19-4bfa-9bcf-3fd2ec52eac5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:35.908615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d498382-4b19-4bfa-9bcf-3fd2ec52eac5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:35.920034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d498382-4b19-4bfa-9bcf-3fd2ec52eac5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:35.921800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d498382-4b19-4bfa-9bcf-3fd2ec52eac5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:35.923348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d498382-4b19-4bfa-9bcf-3fd2ec52eac5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1282 microversion: 2.20 time: 0.100830 Sep 25 01:32:35.923909 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2669/5337] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:35 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:36.036476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:36.036476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:36.052519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:36.053215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:36.056040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:36.057656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:36.058500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:36.059317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:36.249642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:36.259880 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-195c8aab-ea96-4941-822a-f9fc713219a9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.240348 Sep 25 01:32:36.260822 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2669/5338] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:36 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:36.617214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:36.617878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:36.627104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:36.628721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:36.629298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:36.630665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:36.631374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:36.631973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:36.809887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:36.818983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d3d8a45-7fb2-48a0-ad2b-d77f3175d7e6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.214641 Sep 25 01:32:36.819648 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2670/5339] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:36 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:36.951544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:36.952205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:36.958388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:36.959066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:36.959677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:36.962236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:36.962877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:36.963553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:37.053478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:37.063120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:37.064581 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:37.065741 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dee89051-c366-4792-8fe8-76789a89b514 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1334 microversion: 2.20 time: 0.119141 Sep 25 01:32:37.066304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2670/5340] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:36 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1334 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:37.287228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:37.288200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:37.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:37.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:37.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:37.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:37.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:37.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:37.367639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1e4a9213-e019-4f31-be79-8ffa9bf7b633 req-6b4526a0-3fe2-4227-a971-93df6517ccf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3986a12a-906d-4b76-820e-420e3cc12217", "name": "network-vif-plugged", "status": "completed", "tag": "e7e8fda5-bb5f-42a4-8ae8-d76651525790"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:37.385260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1e4a9213-e019-4f31-be79-8ffa9bf7b633 req-6b4526a0-3fe2-4227-a971-93df6517ccf5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:37.392191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1e4a9213-e019-4f31-be79-8ffa9bf7b633 req-6b4526a0-3fe2-4227-a971-93df6517ccf5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:37.392684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1e4a9213-e019-4f31-be79-8ffa9bf7b633 req-6b4526a0-3fe2-4227-a971-93df6517ccf5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:37.431503 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1e4a9213-e019-4f31-be79-8ffa9bf7b633 req-6b4526a0-3fe2-4227-a971-93df6517ccf5 service nova] Creating event network-vif-plugged:e7e8fda5-bb5f-42a4-8ae8-d76651525790 for instance 3986a12a-906d-4b76-820e-420e3cc12217 on n-h2-master-1 Sep 25 01:32:37.436895 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1e4a9213-e019-4f31-be79-8ffa9bf7b633 req-6b4526a0-3fe2-4227-a971-93df6517ccf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073409 Sep 25 01:32:37.438532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2671/5341] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:32:37.559651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:37.583793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b343323a-934a-4257-a8a0-cb76dd754b38 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.300402 Sep 25 01:32:37.603469 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2671/5342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:37 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:37.843669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:37.844677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:37.851419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:37.851873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:37.852508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:37.853251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:37.853850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:37.854299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:38.075517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:38.086452 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d378061b-1cf1-4d6f-a192-da2ae857eff8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.247396 Sep 25 01:32:38.094581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:38.096072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:38.102427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2672/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:37 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:38.104877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:38.107044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:38.107044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:38.108032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:38.108494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:38.108981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:38.189650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:38.198746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:38.200774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:38.202459 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9efa2b7a-11a7-4406-a5e1-007203cd3441 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1340 microversion: 2.20 time: 0.115552 Sep 25 01:32:38.203547 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2672/5344] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:38 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:38.613911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:38.614843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:38.622248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:38.623075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:38.623680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:38.624556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:38.625067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:38.625554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:38.900047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:38.909326 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0abfed76-ff47-42b5-bc22-866c8b55f7d8 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.299580 Sep 25 01:32:38.910209 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2673/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:38 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:39.110624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:39.111240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:39.118329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.118822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.119259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:39.120125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.120582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.121076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:39.232850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:39.234131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:39.243365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.244036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.244761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:39.246021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.247848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.248435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:39.274479 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:39.353628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:39.363410 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ff2f3f7-5e19-411f-b134-f81d94a81d3e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1329 microversion: 2.1 time: 0.256794 Sep 25 01:32:39.364213 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2673/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:39 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1329 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:39.493936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:39.503642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:39.505109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:39.506315 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2476cbd9-b1d7-47a4-aa0a-d1b128817b4e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.278992 Sep 25 01:32:39.506890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2674/5347] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:39 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:32:39.551875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c782e8b3-81ab-4cd2-a459-8f3eb441070e req-892881d6-3ebe-49b1-9269-7cd8a323225d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:39.572809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c782e8b3-81ab-4cd2-a459-8f3eb441070e req-892881d6-3ebe-49b1-9269-7cd8a323225d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.573323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c782e8b3-81ab-4cd2-a459-8f3eb441070e req-892881d6-3ebe-49b1-9269-7cd8a323225d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.573795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c782e8b3-81ab-4cd2-a459-8f3eb441070e req-892881d6-3ebe-49b1-9269-7cd8a323225d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:39.586674 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c782e8b3-81ab-4cd2-a459-8f3eb441070e req-892881d6-3ebe-49b1-9269-7cd8a323225d service nova] Creating event network-changed:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h1-master-1 Sep 25 01:32:39.592117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c782e8b3-81ab-4cd2-a459-8f3eb441070e req-892881d6-3ebe-49b1-9269-7cd8a323225d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043989 Sep 25 01:32:39.592935 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2674/5348] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:39.932823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:39.934160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:39.941820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.942522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.943118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:39.944150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:39.944772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:39.945592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.109961 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:40.117963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-44c3f668-7311-4a20-ac7b-dae763e0992b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.189371 Sep 25 01:32:40.118683 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2675/5349] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:39 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:40.391476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:40.392895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:40.400730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.401599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.402233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.403458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.404120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.407689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.531525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:40.532805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:40.539217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.539708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.540148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.540842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.541506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.542104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.550560 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:40.559426 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4424adc-da78-4956-8a45-e162de7de6c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1509 microversion: 2.1 time: 0.173843 Sep 25 01:32:40.560305 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2675/5350] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:40 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:40.583218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:40.584258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:40.590822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.591557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.592173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.593044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.593702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.594315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.729909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:40.739066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:40.740516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:40.741861 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8d578fc7-6c6c-4d92-8b61-423fe280b0e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.214318 Sep 25 01:32:40.742430 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2676/5351] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:40 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:40.767316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:40.775299 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5de2a523-b76e-44e0-9d24-ad850cffe871 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1509 microversion: 2.1 time: 0.196149 Sep 25 01:32:40.775872 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2676/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:40 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:40.798280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:40.798790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:40.805424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.805978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.806676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.807859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.808862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.809636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.845909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:32:40.935925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-516462a2-fef5-4b8b-bee2-7580030e5b86 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 204 len: 0 microversion: 2.1 time: 0.141028 Sep 25 01:32:40.936861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2677/5353] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:32:40 2022] DELETE /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:32:40.944992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:40.945754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:40.952462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.953151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.953703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:40.958217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:40.958777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:40.959292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:41.106834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:41.115263 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81e052c5-b67a-409f-80a2-167fe542ffac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1515 microversion: 2.1 time: 0.174196 Sep 25 01:32:41.116557 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2677/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:40 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:41.142072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:41.142788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:41.150089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:41.150584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:41.151292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:41.152020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:41.152484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:41.153176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:41.377621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:41.385981 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5be8816-1c14-4737-8290-56d807ce4a3b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.248210 Sep 25 01:32:41.387284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2678/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:41 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:41.767810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:41.768419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:41.775197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:41.775675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:41.776359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:41.777619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:41.778368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:41.778800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:41.919410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:41.927764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:41.929213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:41.930358 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-03386c76-71fd-4a53-a218-94b35cc2d88c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.166525 Sep 25 01:32:41.930920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2678/5356] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:41 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:42.140584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:42.141212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:42.148938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:42.149449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:42.149902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:42.150613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:42.151337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:42.151771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:42.293694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:42.302410 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ce8f196-3f31-417f-9c30-865a86071297 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1515 microversion: 2.1 time: 0.166704 Sep 25 01:32:42.302988 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2679/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:42 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:42.409854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:42.410796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:42.418532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:42.419350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:42.420158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:42.421089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:42.421811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:42.422313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:42.580163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:42.597773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e23aada9-5bf8-4e07-8b2f-283b523ae89a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.192173 Sep 25 01:32:42.598356 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2679/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:42 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:42.956638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:42.957490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:42.965912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:42.971687 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:42.972211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:42.972974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:42.973474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:42.973912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:43.337758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:43.340144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:43.347778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:43.351171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:43.351948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:43.352604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:43.366281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:43.366784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:43.367233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:43.375381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:43.383030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:43.385247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-05bb91ba-52a9-41e9-acf2-743267f25563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.432500 Sep 25 01:32:43.389512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2680/5359] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:42 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:43.405078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d3e5bc05-f927-49e2-be9d-8c9b21fc6f65 req-f27dbbcd-11df-4bda-8ef7-ccea9e23f9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3986a12a-906d-4b76-820e-420e3cc12217", "name": "network-vif-deleted", "tag": "e7e8fda5-bb5f-42a4-8ae8-d76651525790"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:43.428733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d3e5bc05-f927-49e2-be9d-8c9b21fc6f65 req-f27dbbcd-11df-4bda-8ef7-ccea9e23f9d3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:43.429187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d3e5bc05-f927-49e2-be9d-8c9b21fc6f65 req-f27dbbcd-11df-4bda-8ef7-ccea9e23f9d3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:43.429666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d3e5bc05-f927-49e2-be9d-8c9b21fc6f65 req-f27dbbcd-11df-4bda-8ef7-ccea9e23f9d3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:43.450359 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d3e5bc05-f927-49e2-be9d-8c9b21fc6f65 req-f27dbbcd-11df-4bda-8ef7-ccea9e23f9d3 service nova] Creating event network-vif-deleted:e7e8fda5-bb5f-42a4-8ae8-d76651525790 for instance 3986a12a-906d-4b76-820e-420e3cc12217 on n-h2-master-1 Sep 25 01:32:43.456734 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d3e5bc05-f927-49e2-be9d-8c9b21fc6f65 req-f27dbbcd-11df-4bda-8ef7-ccea9e23f9d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065680 Sep 25 01:32:43.459471 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2681/5360] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:43.516369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:43.527542 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89cdeba9-a82e-4868-bd0a-c4e1e7d2f69c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 200 len: 1314 microversion: 2.1 time: 0.203897 Sep 25 01:32:43.534351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2680/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:43 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:43.627232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:43.628702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:43.656723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:43.657356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:43.657895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:43.658826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:43.659489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:43.660100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:43.903571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:43.922832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60ab732d-ba85-4ce6-963f-68720cf8770e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.303964 Sep 25 01:32:43.923705 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2682/5362] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:43 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:44.414251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:44.420516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:44.422245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:44.422741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:44.423182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:44.423892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:44.424342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:44.424779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:44.551534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:44.552982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:44.561100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:44.561892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:44.562496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:44.564062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:44.564754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:44.565344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:44.586160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:44.588167 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 HTTP/1.1 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3986a12a-906d-4b76-820e-420e3cc12217'} Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:32:44.590426 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:32:44.599719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:32:44.599719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:32:44.599719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:32:44.599719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:32:44.599719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:32:44.599719 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:32:44.600174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:44.601030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:32:44.601957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c5cb6f6-7f71-4f62-a54a-4be2b250caba tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 404 len: 111 microversion: 2.1 time: 0.054431 Sep 25 01:32:44.602449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:44.604196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-926da6b8-cdfb-4a0a-bb05-5eb2772439f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.193993 Sep 25 01:32:44.605307 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2681/5363] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:44 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:44.605876 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2683/5364] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:44 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:32:44.618313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5aa6a92d-72a9-4f2b-9b7a-90fb8a84d875 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '.version_select at 0x7f7beaad9f70>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:44.642803 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5aa6a92d-72a9-4f2b-9b7a-90fb8a84d875 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1839148626" status: 202 len: 0 microversion: 2.1 time: 0.035717 Sep 25 01:32:44.648747 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2684/5365] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 25 01:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1839148626 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:32:44.710700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1358051028", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:44.785981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:32:44.950967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:44.952415 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:44.962641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:44.963889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:44.964350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:44.965364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:44.968316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:44.968763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:45.291608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:45.304621 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9d5a247-d0cd-4998-ba26-84dd571a16f2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.359091 Sep 25 01:32:45.307421 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2685/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:44 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:45.353211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:32:45.353664 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:32:45.356729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:32:45.357142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:32:45.357674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:32:45.379304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2ec24137-ccb7-42c0-8876-29e2e8cdde8a req-6e09efa0-e9af-4c4b-99f0-f68288a03b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "name": "network-vif-plugged", "status": "completed", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:45.398833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2ec24137-ccb7-42c0-8876-29e2e8cdde8a req-6e09efa0-e9af-4c4b-99f0-f68288a03b90 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:45.400390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2ec24137-ccb7-42c0-8876-29e2e8cdde8a req-6e09efa0-e9af-4c4b-99f0-f68288a03b90 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:45.401439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2ec24137-ccb7-42c0-8876-29e2e8cdde8a req-6e09efa0-e9af-4c4b-99f0-f68288a03b90 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:45.404619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:45.405185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:45.406717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:45.408548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:45.411316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:45.418470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:45.421139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2ec24137-ccb7-42c0-8876-29e2e8cdde8a req-6e09efa0-e9af-4c4b-99f0-f68288a03b90 service nova] Creating event network-vif-plugged:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h1-master-1 Sep 25 01:32:45.431506 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2ec24137-ccb7-42c0-8876-29e2e8cdde8a req-6e09efa0-e9af-4c4b-99f0-f68288a03b90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057258 Sep 25 01:32:45.436955 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2686/5367] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:32:45.457669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:32:45.466043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:32:45.484770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:32:45.488052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:32:45.555036 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5647836f-6b05-49b5-b6f8-5da43e58980d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846840 Sep 25 01:32:45.556167 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2682/5368] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:32:45.568924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-040cd2c8-fbbb-46cd-b1a0-d1460b3fa409 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:45.569752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-040cd2c8-fbbb-46cd-b1a0-d1460b3fa409 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:45.578427 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:45.632344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:45.633086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:45.648924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:45.649526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:45.650030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:45.651747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:45.655448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:45.656008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:45.671198 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:45.682330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-040cd2c8-fbbb-46cd-b1a0-d1460b3fa409 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:45.695160 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-040cd2c8-fbbb-46cd-b1a0-d1460b3fa409 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1209 microversion: 2.1 time: 0.131257 Sep 25 01:32:45.696773 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2687/5369] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:45 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:45.869842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:45.881845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:45.883294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:45.884762 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2b5bf914-4619-4d5c-9ae4-f49031c52674 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.258095 Sep 25 01:32:45.885945 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2683/5370] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:45 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:32:46.333071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:46.334146 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:46.345013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:46.345686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:46.346226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:46.347179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:46.347999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:46.348674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:46.593166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:46.602074 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93f72362-7b68-4c0d-9558-47fceef34352 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.274504 Sep 25 01:32:46.608818 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2688/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:46 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:46.720033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:46.721440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:46.724347 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:46.730896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:46.731399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:46.731846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:46.732559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:46.733015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:46.733499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:46.807480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:46.816487 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8703b4e-6d0e-401d-b6ad-3df234a25e64 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1261 microversion: 2.1 time: 0.100569 Sep 25 01:32:46.817155 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2684/5372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:46 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:46.911471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:46.912227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:46.923286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:46.923782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:46.924218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:46.924921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:46.925373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:46.925843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:47.190078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:47.199912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:47.204290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:47.205571 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-36714ab1-7497-4d85-a5b7-a84ccde9cae6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1407 microversion: 2.20 time: 0.298142 Sep 25 01:32:47.206149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2689/5373] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:46 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:47.634381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:47.635266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:47.643540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:47.644856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:47.645536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:47.646535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:47.646997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:47.647596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:47.840663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:47.842405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:47.855749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:47.856409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:47.860578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:47.861610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:47.862400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:47.863146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:47.904408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:47.918104 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2061dde-857e-46c8-b940-a146063c942a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.288739 Sep 25 01:32:47.921013 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2685/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:47 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:48.274829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:48.277882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:48.296387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:48.297540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:48.299033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:48.301166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:48.302345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:48.303133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:48.361817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:48.372175 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9b360752-706f-4748-8f3c-eaef43fb7e3c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1267 microversion: 2.1 time: 0.535660 Sep 25 01:32:48.373521 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2690/5375] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:47 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1267 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:48.502251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:48.504535 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:48.514300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:48.516018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:48.517389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4bd8b147-bf9e-4ec4-9a6e-f44f78873504 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1599 microversion: 2.20 time: 0.276134 Sep 25 01:32:48.533873 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2686/5376] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:32:48 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1599 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:32:48.544675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:48.545188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:48.551454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:48.552171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:48.552769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:48.553677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:48.554291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:48.554883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:48.795690 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f01ab54-4d77-4294-96b8-6cfdbbbdf1f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.240696 Sep 25 01:32:48.796945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2691/5377] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:32:48 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:32:48.944271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:48.945633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:48.958982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:48.961121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:48.961689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:48.970119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:48.970706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:48.971529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:49.400240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:49.401696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:49.416653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:49.416653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:49.420666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:49.421918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:49.422636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:49.423298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:49.567590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:49.635662 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08ecf60e-a0e8-4cfe-b09c-0be0ebcb6401 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.692796 Sep 25 01:32:49.638473 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2687/5378] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:48 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:49.733543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:49.752627 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85eb6e1a-db4a-485f-93c0-e2f46abf080a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.353653 Sep 25 01:32:49.753425 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2692/5379] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:49 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:50.671748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:50.672695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:50.699311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:50.700606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:50.703852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:50.705848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:50.708391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:50.708639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:50.797051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:50.797906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:50.806862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:50.807613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:50.808265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:50.809177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:50.809712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:50.810326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:51.229392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:51.240669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:51.242940 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:51.252610 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c9763a8-82e0-4e96-a98e-85e42754e033 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.595181 Sep 25 01:32:51.259685 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5efb9244-91c7-4058-b01c-22a592f2890a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.483636 Sep 25 01:32:51.280571 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2693/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:50 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:51.285179 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2688/5381] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:50 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:51.303269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f07637b4-5012-4694-af19-828f473f13e4 req-2eb8e493-0902-4332-bd0e-b9bb59d4789a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50cad2e-625b-4636-94df-b6a878b28891", "tag": "3f519b8e-f13a-4df6-a3c4-9f22bc1fb7dd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:51.303269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f07637b4-5012-4694-af19-828f473f13e4 req-2eb8e493-0902-4332-bd0e-b9bb59d4789a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:51.303269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f07637b4-5012-4694-af19-828f473f13e4 req-2eb8e493-0902-4332-bd0e-b9bb59d4789a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:51.303269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f07637b4-5012-4694-af19-828f473f13e4 req-2eb8e493-0902-4332-bd0e-b9bb59d4789a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:51.327167 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f07637b4-5012-4694-af19-828f473f13e4 req-2eb8e493-0902-4332-bd0e-b9bb59d4789a service nova] Creating event network-changed:3f519b8e-f13a-4df6-a3c4-9f22bc1fb7dd for instance a50cad2e-625b-4636-94df-b6a878b28891 on n-h2-master-1 Sep 25 01:32:51.348643 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f07637b4-5012-4694-af19-828f473f13e4 req-2eb8e493-0902-4332-bd0e-b9bb59d4789a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083320 Sep 25 01:32:51.354404 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2694/5382] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:52.282185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:52.282820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:52.296201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:52.296854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:52.297349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:52.298340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:52.299100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:52.299689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:52.330272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:52.331625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:52.342339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:52.354281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:52.358237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:52.359761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:52.360485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:52.361118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:52.562048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:52.570855 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d7d6071-6264-4311-a2ec-0f28aec9aa1d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.294515 Sep 25 01:32:52.571411 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2689/5383] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:52 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:52.603601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:52.611673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccedd6d2-ec87-46a0-88bc-703c9ea88e00 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.286470 Sep 25 01:32:52.612256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2695/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:52 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:53.373180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b6f09ecc-a1c0-4c53-bdb7-69f2e7d83a08 req-8fecdb2d-ec5e-4e62-a1a5-04a56d0d1790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:53.384711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b6f09ecc-a1c0-4c53-bdb7-69f2e7d83a08 req-8fecdb2d-ec5e-4e62-a1a5-04a56d0d1790 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:53.385190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b6f09ecc-a1c0-4c53-bdb7-69f2e7d83a08 req-8fecdb2d-ec5e-4e62-a1a5-04a56d0d1790 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:53.385643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b6f09ecc-a1c0-4c53-bdb7-69f2e7d83a08 req-8fecdb2d-ec5e-4e62-a1a5-04a56d0d1790 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:53.399698 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b6f09ecc-a1c0-4c53-bdb7-69f2e7d83a08 req-8fecdb2d-ec5e-4e62-a1a5-04a56d0d1790 service nova] Creating event network-changed:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h1-master-1 Sep 25 01:32:53.405308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b6f09ecc-a1c0-4c53-bdb7-69f2e7d83a08 req-8fecdb2d-ec5e-4e62-a1a5-04a56d0d1790 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036326 Sep 25 01:32:53.406058 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2690/5385] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:53.595808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:53.596538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:53.604485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:53.605896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:53.606688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:53.607457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:53.608115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:53.608748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:53.636646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:53.637357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:53.645442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:53.645970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:53.647040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:53.647833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:53.648580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:53.649328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:53.992901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:54.001611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e576546a-0e5d-43a4-9b04-c526911862e7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.409841 Sep 25 01:32:54.002206 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2696/5386] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:53 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:54.045053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:54.053828 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ccd9511-6b4a-48fc-b6e9-a978d2dbe577 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.422218 Sep 25 01:32:54.054799 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2691/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:53 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:55.025034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:55.025793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:55.033235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:55.033964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:55.034590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:55.035294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:55.035911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:55.036340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:55.077785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:55.079582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:55.088567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:55.089318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:55.090084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:55.091031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:55.091648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:55.092233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:55.231109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:55.240785 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb859929-0e3f-44f9-805f-4ff4f1b6ba6d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.220371 Sep 25 01:32:55.241364 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2697/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:55 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:55.291687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:55.301868 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-076764ff-0409-48c3-9b01-6963582ddc11 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.228196 Sep 25 01:32:55.303207 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2692/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:55 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:56.265105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:56.265771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:56.268067 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:56.275016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:56.275614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:56.276441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:56.277251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:56.277871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:56.278380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:56.326662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:56.328033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:56.334917 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:56.335817 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:32:56.338455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:56.339412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:56.340278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:56.341161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:56.341892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:56.342573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:56.470117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:56.480454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a22fea2f-29bd-4c34-a8a4-af46ad6d5685 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.219527 Sep 25 01:32:56.481683 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2698/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:56 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:56.539786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:56.549189 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a16acd10-31bb-4a02-bf12-7811194d3c71 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.227435 Sep 25 01:32:56.549799 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2693/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:56 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:57.374028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e50c35d4-6ec2-4b29-b53b-5637f2915980 req-2f3044e7-c433-4006-8d65-db0fe16c060f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50cad2e-625b-4636-94df-b6a878b28891", "name": "network-vif-plugged", "status": "completed", "tag": "3f519b8e-f13a-4df6-a3c4-9f22bc1fb7dd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:32:57.387690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e50c35d4-6ec2-4b29-b53b-5637f2915980 req-2f3044e7-c433-4006-8d65-db0fe16c060f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:57.388465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e50c35d4-6ec2-4b29-b53b-5637f2915980 req-2f3044e7-c433-4006-8d65-db0fe16c060f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:57.389174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e50c35d4-6ec2-4b29-b53b-5637f2915980 req-2f3044e7-c433-4006-8d65-db0fe16c060f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:57.404442 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e50c35d4-6ec2-4b29-b53b-5637f2915980 req-2f3044e7-c433-4006-8d65-db0fe16c060f service nova] Creating event network-vif-plugged:3f519b8e-f13a-4df6-a3c4-9f22bc1fb7dd for instance a50cad2e-625b-4636-94df-b6a878b28891 on n-h2-master-1 Sep 25 01:32:57.409775 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e50c35d4-6ec2-4b29-b53b-5637f2915980 req-2f3044e7-c433-4006-8d65-db0fe16c060f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039655 Sep 25 01:32:57.411221 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2699/5392] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:32:57.503831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:57.504433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:57.511929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:57.512417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:57.512856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:57.513776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:57.514856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:57.515480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:57.574223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:57.575459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:57.582805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:57.583643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:57.584543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:57.586335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:57.587131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:57.587737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:57.744974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:57.755507 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c785329-c72b-4260-9a8e-e71006052a60 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.186073 Sep 25 01:32:57.756008 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2700/5393] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:57 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:32:57.936323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:57.944251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46716d9d-aa43-4f9e-8549-391c18eeee73 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.444502 Sep 25 01:32:57.945043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2694/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:57 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:58.779598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:58.780314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:58.787449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:58.787939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:58.788378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:58.789084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:58.789568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:58.789996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:58.933748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:58.942080 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-41579e8d-9afc-43d2-a145-8e2f2ee5a4cd tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1309 microversion: 2.1 time: 0.167201 Sep 25 01:32:58.942801 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2701/5395] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:58 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:58.966997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:58.967521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:58.975566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:58.976101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:58.977261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:58.978321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:58.978812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:58.979275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:59.117158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:32:59.125386 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4f788ce-aceb-4a18-89a4-abc883dc75b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1504 microversion: 2.1 time: 0.162313 Sep 25 01:32:59.125929 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2695/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:58 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:32:59.966127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:32:59.966746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:32:59.974322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:59.974811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:59.975255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:32:59.976126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:32:59.976597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:32:59.977094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:00.125191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:00.140364 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec411042-85a9-4290-811e-1b2335cc81eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1489 microversion: 2.1 time: 0.178203 Sep 25 01:33:00.140957 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2702/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:32:59 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1489 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:00.155718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:00.156582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:00.163831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:00.164667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:00.165167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:00.166404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:00.166686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:00.167845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:00.209211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1358051028", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:00.285151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:33:00.400379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:00.408953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-612f40be-04ad-42da-8fb0-88f8fe80aacd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1484 microversion: 2.1 time: 0.258041 Sep 25 01:33:00.422025 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2696/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:00 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1484 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:00.541217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-928292952", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:00.598679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] validate_networks() for [('b6d5a5d8-51d7-477d-890d-dc2adc630020', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:33:00.829718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:33:00.830345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:33:00.830827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:33:00.831244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:33:00.831662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:33:00.842162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:00.842828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:00.843377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:00.844254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:00.844851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:00.845380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:00.863734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:33:00.869541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:33:00.890057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:33:00.895450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:33:00.952510 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8242a975-5483-426b-9a1a-cc630c2f616f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747715 Sep 25 01:33:00.957453 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2703/5399] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:33:00.966319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6cd5200-0785-479b-8600-5671b0702e87 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:00.966964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6cd5200-0785-479b-8600-5671b0702e87 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:01.044796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a6cd5200-0785-479b-8600-5671b0702e87 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:01.058015 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6cd5200-0785-479b-8600-5671b0702e87 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1209 microversion: 2.1 time: 0.096413 Sep 25 01:33:01.061679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2704/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:00 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:01.159830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:33:01.160303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:33:01.160797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:33:01.161281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:33:01.161800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:33:01.172845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:01.173630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:01.174375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:01.175528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:01.176062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:01.176498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:01.197367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Getting quotas for project 0604216998c24ee59f60c44615850d30. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:33:01.205342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Getting quotas for user 8447ea42224541a69b6af35641350164 and project 0604216998c24ee59f60c44615850d30. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:33:01.221077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:33:01.223528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:33:01.288486 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b78634c6-2809-4350-9f84-ece35fbd9421 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.751329 Sep 25 01:33:01.295924 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2697/5401] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:33:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:33:01.301155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14d73d24-9980-4837-842c-a6bb789ac7bb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:01.301816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14d73d24-9980-4837-842c-a6bb789ac7bb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:01.379063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14d73d24-9980-4837-842c-a6bb789ac7bb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:01.392678 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14d73d24-9980-4837-842c-a6bb789ac7bb tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1213 microversion: 2.1 time: 0.094206 Sep 25 01:33:01.393938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2705/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:01 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:02.080739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:02.081502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:02.087684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:02.088202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:02.088644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:02.089896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:02.090360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:02.090793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:02.162892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:02.173581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ecf35229-9b7a-4fef-81c4-cc98852d2c61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1261 microversion: 2.1 time: 0.096868 Sep 25 01:33:02.174399 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2698/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:02 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:02.421672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:02.422415 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:02.429851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:02.433023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:02.437674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:02.438656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:02.439359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:02.441838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:02.520735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:02.529764 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-06bd25e0-db3c-4408-aba1-57bf03f902b2 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1265 microversion: 2.1 time: 0.118291 Sep 25 01:33:02.530361 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2706/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:02 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:03.197549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:03.199237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:03.211714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:03.212405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:03.213322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:03.215048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:03.216326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:03.218198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:03.315108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:03.327518 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5850953a-5051-4bd7-ba84-89ed242cb511 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1267 microversion: 2.1 time: 0.134728 Sep 25 01:33:03.329034 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2699/5405] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:03 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:03.553771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:03.554316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:03.564966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:03.566952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:03.567473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:03.568460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:03.569146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:03.570360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:03.724151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:03.743828 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a8b35496-7fa0-4948-93f5-9de281be30bc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1271 microversion: 2.1 time: 0.194185 Sep 25 01:33:03.772029 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2707/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:03 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:04.358257 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:04.359549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:04.370027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:04.371833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:04.372626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:04.373727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:04.374588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:04.375616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:04.724963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:04.732982 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2eaf4d7-6507-47c3-8827-cada67ac929f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.384787 Sep 25 01:33:04.734059 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2700/5407] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:04 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:04.775121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:04.775833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:04.796013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:04.797126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:04.798124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:04.799107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:04.799831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:04.800504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:05.142283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:05.158431 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15c636e4-277c-43ca-8e8d-f217baaa2b79 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1313 microversion: 2.1 time: 0.388248 Sep 25 01:33:05.178321 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2708/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:04 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:05.240816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-079c33b4-7826-4686-b9bf-e687e6c76112 req-785ec828-bca9-4161-aa46-fc18aae44c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce86b42c-8d2f-4235-8aee-016350489468", "tag": "20e1ae2e-2195-44a4-9bc4-0bf6691fbcc6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:05.259774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-079c33b4-7826-4686-b9bf-e687e6c76112 req-785ec828-bca9-4161-aa46-fc18aae44c44 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:05.270499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-079c33b4-7826-4686-b9bf-e687e6c76112 req-785ec828-bca9-4161-aa46-fc18aae44c44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:05.271158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-079c33b4-7826-4686-b9bf-e687e6c76112 req-785ec828-bca9-4161-aa46-fc18aae44c44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:05.299589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-079c33b4-7826-4686-b9bf-e687e6c76112 req-785ec828-bca9-4161-aa46-fc18aae44c44 service nova] Creating event network-changed:20e1ae2e-2195-44a4-9bc4-0bf6691fbcc6 for instance ce86b42c-8d2f-4235-8aee-016350489468 on n-h2-master-1 Sep 25 01:33:05.312599 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-079c33b4-7826-4686-b9bf-e687e6c76112 req-785ec828-bca9-4161-aa46-fc18aae44c44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080846 Sep 25 01:33:05.314667 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2701/5409] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:05.756299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:05.757135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:05.765046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:05.765633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:05.766315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:05.767247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:05.767912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:05.768798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:06.184032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:06.194114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:06.204215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:06.205076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:06.205664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:06.206627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:06.207166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:06.207677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:06.625638 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:06.639574 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4915f4ec-6d51-4125-98a2-facc7db2f653 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.887443 Sep 25 01:33:06.642431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2709/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:05 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:06.645377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:06.661019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ccc96386-4814-46e4-b33e-1b75623f2087 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1313 microversion: 2.1 time: 0.481880 Sep 25 01:33:06.668405 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2702/5411] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:06 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:07.331756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-61adbcf1-e240-4f70-b879-f94e1b781380 req-69b857e0-7cc1-4c96-acdd-36aa395479ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023ec25c-db25-4466-ba3a-724755fe399a", "tag": "287a2b3c-60f5-47be-9d60-aadf3e615c61"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:07.343089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61adbcf1-e240-4f70-b879-f94e1b781380 req-69b857e0-7cc1-4c96-acdd-36aa395479ba service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:07.343595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61adbcf1-e240-4f70-b879-f94e1b781380 req-69b857e0-7cc1-4c96-acdd-36aa395479ba service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:07.344983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-61adbcf1-e240-4f70-b879-f94e1b781380 req-69b857e0-7cc1-4c96-acdd-36aa395479ba service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:07.369715 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-61adbcf1-e240-4f70-b879-f94e1b781380 req-69b857e0-7cc1-4c96-acdd-36aa395479ba service nova] Creating event network-changed:287a2b3c-60f5-47be-9d60-aadf3e615c61 for instance 023ec25c-db25-4466-ba3a-724755fe399a on n-h1-master-1 Sep 25 01:33:07.376393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-61adbcf1-e240-4f70-b879-f94e1b781380 req-69b857e0-7cc1-4c96-acdd-36aa395479ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048282 Sep 25 01:33:07.377003 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2710/5412] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:07.664241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:07.664861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:07.673380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:07.673899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:07.674335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:07.675036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:07.675822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:07.676245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:07.697050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:07.697780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:07.707753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:07.708259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:07.708710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:07.709432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:07.709918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:07.710350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:07.904006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:07.916400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:07.918643 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac310710-ff9f-4caf-b60e-1a3035e5e159 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.252949 Sep 25 01:33:07.919679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2703/5413] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:07 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:07.925100 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d63efcc7-1f47-4b7d-9418-b32757bfc9b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1313 microversion: 2.1 time: 0.234352 Sep 25 01:33:07.940110 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2711/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:07 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:08.944149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:08.944947 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:08.949187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:08.949842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:08.953921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:08.954420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:08.954858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:08.955574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:08.956026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:08.956179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:08.956452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:08.956681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:08.957126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:08.957883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:08.958349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:08.958783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:09.274180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:09.279388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:09.291039 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba90a0a4-8070-4aea-bbdc-62ebe0f243a1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1313 microversion: 2.1 time: 0.346776 Sep 25 01:33:09.291646 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2712/5415] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:08 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:09.294736 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64eb10e3-515d-4155-9d5f-4b4bace3dfeb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.353142 Sep 25 01:33:09.305488 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2704/5416] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:08 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:10.316292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:10.318279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:10.325693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:10.326507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:10.327204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:10.328136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:10.328854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:10.329532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:10.335457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:10.335988 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:10.352366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:10.352904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:10.353344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:10.354251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:10.355357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:10.356083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:10.383248 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:10.596381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:10.606148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d74603b0-2bfb-4459-9263-869fb4a0b84e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1313 microversion: 2.1 time: 0.293576 Sep 25 01:33:10.607283 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2713/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:10 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:10.613683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:10.627415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1cb7bab0-6e89-48e8-8f45-212e2c5ab6eb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.296002 Sep 25 01:33:10.628168 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2705/5418] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:10 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:11.574286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4885b890-bc87-4046-8a7e-704a160cadc7 req-d644d3e8-1e09-46e9-a3d7-bc283a581402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023ec25c-db25-4466-ba3a-724755fe399a", "name": "network-vif-plugged", "status": "completed", "tag": "287a2b3c-60f5-47be-9d60-aadf3e615c61"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:11.616381 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:11.621011 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:11.626218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4885b890-bc87-4046-8a7e-704a160cadc7 req-d644d3e8-1e09-46e9-a3d7-bc283a581402 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:11.626709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4885b890-bc87-4046-8a7e-704a160cadc7 req-d644d3e8-1e09-46e9-a3d7-bc283a581402 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:11.627154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4885b890-bc87-4046-8a7e-704a160cadc7 req-d644d3e8-1e09-46e9-a3d7-bc283a581402 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:11.629741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:11.630367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:11.637931 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:11.639111 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:11.641452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:11.641989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:11.642439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:11.643173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:11.643629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:11.644058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:11.657555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4885b890-bc87-4046-8a7e-704a160cadc7 req-d644d3e8-1e09-46e9-a3d7-bc283a581402 service nova] Creating event network-vif-plugged:287a2b3c-60f5-47be-9d60-aadf3e615c61 for instance 023ec25c-db25-4466-ba3a-724755fe399a on n-h1-master-1 Sep 25 01:33:11.672932 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4885b890-bc87-4046-8a7e-704a160cadc7 req-d644d3e8-1e09-46e9-a3d7-bc283a581402 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103431 Sep 25 01:33:11.674266 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2714/5419] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:11.689588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:11.690610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:11.716722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:11.718672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:11.719830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:11.720829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:11.721555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:11.722847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:12.047500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:12.059876 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d93a8e62-4216-46c0-81b3-5978d26eb223 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1313 microversion: 2.1 time: 0.433943 Sep 25 01:33:12.061149 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2706/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:11 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:12.078872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:12.081816 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:12.094821 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b723a98a-146b-4830-bf41-4cb6bccb427a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.419179 Sep 25 01:33:12.095427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2715/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:11 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:13.084078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:13.084665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:13.092333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.093132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.093785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.094685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.095297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.095879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.123703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:13.124535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:13.131373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.131877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.132325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.133034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.133719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.134320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.381753 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:13.391902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:13.402405 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c599b41-1eb9-4f07-84ab-5a091deae8c0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1499 microversion: 2.1 time: 0.322670 Sep 25 01:33:13.403112 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2707/5422] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:13 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1499 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:13.408330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e37eaca1-6ba9-40ab-9175-5a9ba56de611 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.291507 Sep 25 01:33:13.409452 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2716/5423] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:13 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:13.433606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:13.435886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:13.442301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.442679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.443129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.443847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.444312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.444744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.473428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lazy-loading 'flavor' on Instance uuid 023ec25c-db25-4466-ba3a-724755fe399a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:33:13.572331 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a652b482-3252-45bb-ae01-5b2bd3b2e6b0 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "POST /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a/action" status: 200 len: 32 microversion: 2.1 time: 0.142722 Sep 25 01:33:13.572995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2708/5424] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:33:13 2022] POST /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:33:13.594557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:13.595202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:13.605570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.606083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.606533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.607259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.607721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.623004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.710200 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bcc1fe0c-4c19-43d5-b70e-0ae0839f1882 req-025a5edc-afd8-4344-b608-29a2e169b5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86b42c-8d2f-4235-8aee-016350489468", "name": "network-vif-plugged", "status": "completed", "tag": "20e1ae2e-2195-44a4-9bc4-0bf6691fbcc6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:13.721552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bcc1fe0c-4c19-43d5-b70e-0ae0839f1882 req-025a5edc-afd8-4344-b608-29a2e169b5ec service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:13.722332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bcc1fe0c-4c19-43d5-b70e-0ae0839f1882 req-025a5edc-afd8-4344-b608-29a2e169b5ec service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:13.722935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bcc1fe0c-4c19-43d5-b70e-0ae0839f1882 req-025a5edc-afd8-4344-b608-29a2e169b5ec service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:13.743684 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bcc1fe0c-4c19-43d5-b70e-0ae0839f1882 req-025a5edc-afd8-4344-b608-29a2e169b5ec service nova] Creating event network-vif-plugged:20e1ae2e-2195-44a4-9bc4-0bf6691fbcc6 for instance ce86b42c-8d2f-4235-8aee-016350489468 on n-h2-master-1 Sep 25 01:33:13.749294 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bcc1fe0c-4c19-43d5-b70e-0ae0839f1882 req-025a5edc-afd8-4344-b608-29a2e169b5ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042970 Sep 25 01:33:13.750267 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2709/5425] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:33:13.888802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:13.902524 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec756de2-5611-4284-b900-408e0fceba47 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.323612 Sep 25 01:33:13.903210 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2717/5426] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:13 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:14.433124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:14.434970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:14.447285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:14.448509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:14.450615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:14.451154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:14.451727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:14.452691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:14.633634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:14.642970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d7663976-b602-4013-8874-9d71ada94782 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1309 microversion: 2.1 time: 0.214332 Sep 25 01:33:14.643915 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2710/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:14 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1309 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:14.925488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:14.926774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:14.933495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:14.933993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:14.934441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:14.935149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:14.935611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:14.936046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:15.081548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:15.091170 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b6186c72-3f4a-4b3f-8ef8-da8eab85c03b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.169509 Sep 25 01:33:15.105427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2718/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:14 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:15.670318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:15.671631 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:15.699656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:15.700400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:15.700995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:15.701927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:15.702531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:15.703169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:15.880464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:15.891483 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60f836eb-47c8-4a04-a27c-c2a218d4b1ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1490 microversion: 2.1 time: 0.225405 Sep 25 01:33:15.892895 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2711/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:15 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1490 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:15.914936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:15.915567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:15.918308 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:15.923946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:15.924635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:15.925083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:15.925812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:15.926390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:15.926685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.079928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:16.088957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d10a4287-e332-4e6b-9f5c-f5259102f4c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1489 microversion: 2.1 time: 0.177769 Sep 25 01:33:16.090492 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2719/5430] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:15 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1489 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:16.113707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:16.114311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:16.122663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.123462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.123895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.124779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.125248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.125677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.126697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:16.127402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:16.133642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.134165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.134851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.135561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.136254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.136824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.353266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:16.361939 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38566052-1158-4cd0-8148-5dd9f0cba17f tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.243787 Sep 25 01:33:16.362532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2720/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:16 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:16.428418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:16.437939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-044a2051-d7ad-40d3-ba0f-96cf5629e30d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1490 microversion: 2.1 time: 0.328283 Sep 25 01:33:16.439191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2712/5432] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:16 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1490 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:16.460547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:16.461048 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:16.468853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.469258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.469900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.470930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.471405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.471831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.499261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:33:16.603819 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e161d26-7a3d-4ba3-8ef8-f2b4e3f1e2bf tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 204 len: 0 microversion: 2.1 time: 0.146928 Sep 25 01:33:16.605488 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2721/5433] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:33:16 2022] DELETE /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:33:16.615665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:16.616761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:16.625892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.626910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.627353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.628194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:16.628737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:16.629170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:16.799432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:16.807643 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0cb8ef89-0162-4b17-935d-828e5e6c36d3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1496 microversion: 2.1 time: 0.197452 Sep 25 01:33:16.808686 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2713/5434] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:16 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1496 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:17.386526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:17.388102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:17.399007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:17.399256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:17.399702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:17.400443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:17.401222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:17.401703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:17.545367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:17.553299 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f17a0aff-caa2-42b2-9e11-88e529e1b16b tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.172453 Sep 25 01:33:17.553932 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2722/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:17 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:17.836489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:17.837103 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:17.845511 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:17.847211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:17.848104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:17.848892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:17.850055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:17.850745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:17.851367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:17.999738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:18.008710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-294f81fb-1841-4941-984d-12ce35deec20 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1496 microversion: 2.1 time: 0.176121 Sep 25 01:33:18.009571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2714/5436] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:17 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1496 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:18.576513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:18.577143 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:18.583882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:18.584361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:18.584803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:18.585531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:18.585989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:18.586410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:19.034674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:19.039026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:19.051813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:19.053234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:19.054337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:19.055497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:19.056425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:19.057256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:19.222154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:19.234692 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d870270d-63bc-4951-8219-1bd84cf689fb tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 200 len: 1454 microversion: 2.1 time: 0.205716 Sep 25 01:33:19.239840 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2715/5437] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:19 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 1454 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:19.297854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:19.316210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-86ca8f75-7bb7-4727-8455-4415c4f0134d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.743780 Sep 25 01:33:19.317334 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2723/5438] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:18 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:19.383259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f3c81f5d-f2a5-4008-9fd0-157ff71eea16 req-e92b6d07-5e2e-4c3a-8d04-feb2aabcfd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce86b42c-8d2f-4235-8aee-016350489468", "name": "network-vif-deleted", "tag": "20e1ae2e-2195-44a4-9bc4-0bf6691fbcc6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:19.401709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3c81f5d-f2a5-4008-9fd0-157ff71eea16 req-e92b6d07-5e2e-4c3a-8d04-feb2aabcfd63 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:19.402405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3c81f5d-f2a5-4008-9fd0-157ff71eea16 req-e92b6d07-5e2e-4c3a-8d04-feb2aabcfd63 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:19.403008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3c81f5d-f2a5-4008-9fd0-157ff71eea16 req-e92b6d07-5e2e-4c3a-8d04-feb2aabcfd63 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:19.428267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f3c81f5d-f2a5-4008-9fd0-157ff71eea16 req-e92b6d07-5e2e-4c3a-8d04-feb2aabcfd63 service nova] Creating event network-vif-deleted:20e1ae2e-2195-44a4-9bc4-0bf6691fbcc6 for instance ce86b42c-8d2f-4235-8aee-016350489468 on n-h2-master-1 Sep 25 01:33:19.434471 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f3c81f5d-f2a5-4008-9fd0-157ff71eea16 req-e92b6d07-5e2e-4c3a-8d04-feb2aabcfd63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054793 Sep 25 01:33:19.440875 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2716/5439] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:20.259918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:20.260588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:20.267690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.268185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.268631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.269333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.269829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.270256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.284737 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 HTTP/1.1 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ce86b42c-8d2f-4235-8aee-016350489468'} Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:20.286585 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5765d5e5-a90c-4105-9bfc-461961bd1097 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 404 len: 111 microversion: 2.1 time: 0.032019 Sep 25 01:33:20.291614 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2724/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:20 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:33:20.300040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:20.300634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:20.307810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.308533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.309036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.309833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.310356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.310866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.337924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:33:20.346791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:20.347906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:20.355512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.356278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.356910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.358525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.358998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.359436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.459472 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-184f5a5a-68e7-4ac2-932e-65178d177f79 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 204 len: 0 microversion: 2.1 time: 0.163763 Sep 25 01:33:20.464521 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2717/5441] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:33:20 2022] DELETE /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:33:20.477356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:20.478187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:20.503685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.504190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.504762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.506408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:20.507137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:20.507872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:20.540181 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:20.550040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0602e1a3-6ded-4417-a7f7-840a56bfbe51 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.207947 Sep 25 01:33:20.583112 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2725/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:20 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:20.670822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:20.679209 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-20062708-209a-49b9-a1d3-49ccd2df2ee0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1495 microversion: 2.1 time: 0.212278 Sep 25 01:33:20.679790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2718/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:20 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1495 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:21.581522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:21.582158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:21.588855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:21.589886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:21.590492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:21.591568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:21.592383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:21.592961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:21.704520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:21.705765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:21.716223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:21.717052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:21.717720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:21.719180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:21.720242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:21.720846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:21.728848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:21.737849 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8a9b2988-ee5b-48a0-be8e-7e764dfe399c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.160060 Sep 25 01:33:21.739286 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2726/5444] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:21 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:21.894383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:21.896736 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:21.904632 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-abd5419a-088e-4a82-80f1-5cec11c5860e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1495 microversion: 2.1 time: 0.205467 Sep 25 01:33:21.906691 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2719/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:21 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1495 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:22.762248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:22.762871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:22.770362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:22.771337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:22.771946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:22.772852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:22.773507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:22.774175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:22.930295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:22.930959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:22.940630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:22.941936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:22.942590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:22.943532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:22.944345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:22.944999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:22.987223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:23.012956 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8fc5f0a1-ce4d-4f20-83b7-d384efa4bcf1 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.251263 Sep 25 01:33:23.013943 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2727/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:22 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:23.134007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:23.145370 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5770c17d-289f-40de-92f1-f03bd0d72d45 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 200 len: 1453 microversion: 2.1 time: 0.218892 Sep 25 01:33:23.147431 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2720/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:22 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:23.210704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f9b9143c-8f52-40b7-930c-a99aae435326 req-c4702619-f216-47ca-a67c-049fd1469f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50cad2e-625b-4636-94df-b6a878b28891", "name": "network-vif-deleted", "tag": "3f519b8e-f13a-4df6-a3c4-9f22bc1fb7dd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:23.255510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9b9143c-8f52-40b7-930c-a99aae435326 req-c4702619-f216-47ca-a67c-049fd1469f97 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:23.256018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9b9143c-8f52-40b7-930c-a99aae435326 req-c4702619-f216-47ca-a67c-049fd1469f97 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:23.256459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9b9143c-8f52-40b7-930c-a99aae435326 req-c4702619-f216-47ca-a67c-049fd1469f97 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:23.294231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f9b9143c-8f52-40b7-930c-a99aae435326 req-c4702619-f216-47ca-a67c-049fd1469f97 service nova] Creating event network-vif-deleted:3f519b8e-f13a-4df6-a3c4-9f22bc1fb7dd for instance a50cad2e-625b-4636-94df-b6a878b28891 on n-h2-master-1 Sep 25 01:33:23.303250 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f9b9143c-8f52-40b7-930c-a99aae435326 req-c4702619-f216-47ca-a67c-049fd1469f97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096678 Sep 25 01:33:23.308878 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2728/5448] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:24.045220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:24.046620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:24.054424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:24.055177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:24.055694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:24.056482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:24.056947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:24.057936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:24.173793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:24.174463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:24.182025 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:24.183259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:24.183991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:24.184968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:24.186736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:24.187716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:24.204511 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 HTTP/1.1 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: exception: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'a50cad2e-625b-4636-94df-b6a878b28891'} Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:24.206590 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:24.214190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:24.214190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:24.214190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:33:24.214190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:33:24.214190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:33:24.214190 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:33:24.226662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:33:24.227539 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de93f6bf-d383-4ec4-a22c-82faf6eb8112 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 404 len: 111 microversion: 2.1 time: 0.058383 Sep 25 01:33:24.228121 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2729/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:24 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:33:24.243495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:24.249643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:24.259591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:24.262267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:24.265718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:24.266235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:24.267079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:24.268540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:24.269320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:24.270372 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-edfc34f3-7a3b-4d49-9349-f1f08ae929ce tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.228987 Sep 25 01:33:24.284889 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2721/5450] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:24 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:24.314396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e136a7e-e8c8-41e6-9153-be5b08ab19c5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.077064 Sep 25 01:33:24.318178 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2730/5451] 10.222.0.16 () {60 vars in 1289 bytes} [Sun Sep 25 01:33:24 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/ips => generated 151 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:33:24.324135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1900765481", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:24.410019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:33:24.991576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:33:24.992508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:33:24.993246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:33:24.993678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:33:24.994164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:33:25.005259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:25.005970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:25.006418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:25.007152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:25.007782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:25.008406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:25.035675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:33:25.043073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:33:25.077944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:33:25.080939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:33:25.143846 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-31129443-1e11-4331-aa2a-bb62d274f8ae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825754 Sep 25 01:33:25.145657 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2722/5452] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:33:25.157113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-925c7ea0-0f53-497b-9efe-f9140dcfd7ce tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:25.158045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-925c7ea0-0f53-497b-9efe-f9140dcfd7ce tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:25.231259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-925c7ea0-0f53-497b-9efe-f9140dcfd7ce tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:25.241889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-925c7ea0-0f53-497b-9efe-f9140dcfd7ce tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1209 microversion: 2.1 time: 0.088555 Sep 25 01:33:25.258723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2731/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:25 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:25.298269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:25.299076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:25.313359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:25.313982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:25.314512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:25.317055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:25.317717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:25.318282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:25.717524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:25.756750 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a24eff20-93d2-4f7e-9802-20fe4901b958 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.452491 Sep 25 01:33:25.757611 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2723/5454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:25 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:26.266960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:26.268509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:26.293701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:26.294492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:26.296259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:26.297659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:26.298217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:26.298903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:26.379361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:26.390551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2022355d-905e-44f0-bd61-489a69146da1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1261 microversion: 2.1 time: 0.129207 Sep 25 01:33:26.392159 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2732/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:26 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:26.784173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:26.785144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:26.801671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:26.805670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:26.805670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:26.805670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:26.805670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:26.805670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:27.078327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:27.094454 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aabe860b-192f-4350-822a-dfd98d0e44c9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.315792 Sep 25 01:33:27.095994 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2724/5456] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:26 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:27.419643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:27.421832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:27.442348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:27.443119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:27.443667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:27.444619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:27.445185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:27.445750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:27.533742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:27.534307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:27.547268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:27.559313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:27.559789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:27.561276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd4a97ff-d5c9-4b3c-8305-60bb8554d562 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1267 microversion: 2.1 time: 0.148808 Sep 25 01:33:27.562389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2733/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:27 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:27.563030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:27.564360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:27.564985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:27.565636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:27.609742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lazy-loading 'flavor' on Instance uuid e17b9865-cbb3-447a-9976-a7d72f6066e2 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:33:28.006640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d26d7f8-b724-47ad-89fe-d048c7368126 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/action" status: 202 len: 0 microversion: 2.20 time: 0.467470 Sep 25 01:33:28.007501 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2725/5458] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:33:27 2022] POST /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:33:28.017741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:28.018450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:28.032465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:28.035655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:28.036390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:28.040091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:28.046022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:28.046610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:28.087419 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:28.137993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:28.139294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:28.180532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:28.184723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:28.188202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:28.189137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:28.192218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:28.192868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:28.616815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:28.639056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:28.643066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:28.644510 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8e9a380b-643a-4932-9bc8-a14f89b93a18 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.631742 Sep 25 01:33:28.650280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2734/5459] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:28 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:28.656688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:28.657667 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:28.669112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:28.670152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:28.671949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:28.673232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:28.674408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:28.676835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:28.692854 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:28.711997 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-009941ad-8fe6-4c20-8dbc-52ae76880a0a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.579337 Sep 25 01:33:28.714805 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2726/5460] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:28 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:29.047168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:29.058794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ffa6350-f89c-4bd9-bd68-8eb721704c1c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.405718 Sep 25 01:33:29.074584 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2735/5461] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:28 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:29.572136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f47d11c1-864e-4b55-bde9-6bb8cd5bf2fa req-46431597-eac4-4c54-b4e2-7adf606124d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d01b4f9-113d-4c69-895e-849b972f1720", "tag": "5e0884fb-978f-4567-aac4-65e87b5250d4"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:29.603465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f47d11c1-864e-4b55-bde9-6bb8cd5bf2fa req-46431597-eac4-4c54-b4e2-7adf606124d3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:29.604787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f47d11c1-864e-4b55-bde9-6bb8cd5bf2fa req-46431597-eac4-4c54-b4e2-7adf606124d3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:29.605042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f47d11c1-864e-4b55-bde9-6bb8cd5bf2fa req-46431597-eac4-4c54-b4e2-7adf606124d3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:29.644228 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f47d11c1-864e-4b55-bde9-6bb8cd5bf2fa req-46431597-eac4-4c54-b4e2-7adf606124d3 service nova] Creating event network-changed:5e0884fb-978f-4567-aac4-65e87b5250d4 for instance 4d01b4f9-113d-4c69-895e-849b972f1720 on n-h2-master-1 Sep 25 01:33:29.655325 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f47d11c1-864e-4b55-bde9-6bb8cd5bf2fa req-46431597-eac4-4c54-b4e2-7adf606124d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089665 Sep 25 01:33:29.655941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2727/5462] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:29.679806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:29.680431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:29.695529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:29.695529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:29.704988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:29.705865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:29.706354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:29.706794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:29.743893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:29.749004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:29.759496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:29.764140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:29.764711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:29.765591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:29.767699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:29.768249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:30.119215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:30.136774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:30.142454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:30.144561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:30.145919 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a787440-3c34-4cce-8ed9-9a9e62bba9de tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.406390 Sep 25 01:33:30.146637 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2728/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:29 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:30.146807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed403464-4a03-4781-917c-17cebc7561f4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.470794 Sep 25 01:33:30.162824 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2736/5464] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:29 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:30.166453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:30.167636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:30.174278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:30.174888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:30.175435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:30.176279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:30.177077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:30.177642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:30.409648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:30.422959 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab27641b-d16c-4227-bf91-214dc1a2037e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.275271 Sep 25 01:33:30.423568 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2729/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:30 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:31.171027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:31.171027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:31.174783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:31.175409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:31.177658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:31.178150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:31.178640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:31.179344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:31.179799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:31.180386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:31.182530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:31.183209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:31.184010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:31.187071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:31.187722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:31.188326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:31.393444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:31.400391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:31.409281 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-692d0dfb-050f-4b13-9ca9-b23a72fcc3ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.243714 Sep 25 01:33:31.409651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:31.413019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2737/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:31 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:31.422613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:31.424309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14d04e07-2452-4052-a855-f57ac15a635c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.253625 Sep 25 01:33:31.426332 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2730/5467] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:31 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:31.446228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:31.447008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:31.454232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:31.454836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:31.455354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:31.456132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:31.456663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:31.457164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:31.600309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:31.608792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f14d2ad-a069-43ff-8136-4a7a03a33bef tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.166450 Sep 25 01:33:31.609368 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2738/5468] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:31 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:32.436128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:32.436750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:32.444203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:32.445016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:32.445679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:32.446661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:32.447326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:32.448022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:32.454827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:32.458530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:32.468975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:32.469501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:32.469955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:32.471052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:32.471660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:32.472106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:32.763762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:32.771079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:32.782036 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b21259b-2e31-4d4d-8145-d210e1863844 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.350363 Sep 25 01:33:32.782540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:32.783505 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2731/5469] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:32 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:32.785877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:32.788999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae6075c2-9754-40d9-9990-b2aa3827dd92 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.341714 Sep 25 01:33:32.789767 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2739/5470] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:32 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:32.793957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:32.794835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:32.807826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:32.808869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:32.809590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:32.810528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:32.811365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:32.812018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:33.021034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:33.036244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6749864-cefc-420c-8299-41e082f82d0d tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.245410 Sep 25 01:33:33.038807 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2732/5471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:32 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:33.806331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:33.809382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:33.816001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:33.816515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:33.816974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:33.817274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:33.818019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:33.818396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:33.819055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:33.819583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:33.827660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:33.828567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:33.829271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:33.830260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:33.830978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:33.831678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:34.066202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:34.072763 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b42adecd-ec15-4f36-b65f-82a13f968006 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.270306 Sep 25 01:33:34.096756 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2740/5472] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:33 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:34.102701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:34.103539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:34.118804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:34.120381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:34.121229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:34.122151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:34.122789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:34.123373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:34.142443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:34.152858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:34.154644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:34.156029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-034c66da-481f-4b48-8fec-83e39fd4d941 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.345142 Sep 25 01:33:34.157479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2733/5473] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:33 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:34.277147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:34.287390 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2fcb618-fc85-4b44-b8f5-e54d4e629fee tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.189191 Sep 25 01:33:34.288059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2741/5474] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:34 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:35.104470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:35.105105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:35.108136 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:35.110137 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:35.114992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.115497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.115937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.116662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.117107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.117640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.183245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:35.186075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:35.198301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.198810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.199479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.200555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.201185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.201849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.236950 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:35.306614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:35.319833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c61c3b40-7939-4023-ad7c-5057a3ee1109 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.219584 Sep 25 01:33:35.321948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2734/5475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:35 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:35.327417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:35.329501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:35.358413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.361185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.362133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.363069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.363554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.363995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.389265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:35.398344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:35.399909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:35.406733 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91c2e0be-e276-4de7-85b2-e3c291db340a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.222420 Sep 25 01:33:35.409869 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2742/5476] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:35 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:35.581510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f01f5fc0-071a-441b-a563-1999c762ead8 req-75706d3a-eacf-499c-89dd-d308ad9323fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d01b4f9-113d-4c69-895e-849b972f1720", "name": "network-vif-plugged", "status": "completed", "tag": "5e0884fb-978f-4567-aac4-65e87b5250d4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:35.600510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f01f5fc0-071a-441b-a563-1999c762ead8 req-75706d3a-eacf-499c-89dd-d308ad9323fa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:35.601002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f01f5fc0-071a-441b-a563-1999c762ead8 req-75706d3a-eacf-499c-89dd-d308ad9323fa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:35.601514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f01f5fc0-071a-441b-a563-1999c762ead8 req-75706d3a-eacf-499c-89dd-d308ad9323fa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:35.611752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:35.619747 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:35.624072 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa8877a6-6786-49ac-8883-ea7c5d2df490 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.300640 Sep 25 01:33:35.625525 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2735/5477] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:35 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:35.625853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f01f5fc0-071a-441b-a563-1999c762ead8 req-75706d3a-eacf-499c-89dd-d308ad9323fa service nova] Creating event network-vif-plugged:5e0884fb-978f-4567-aac4-65e87b5250d4 for instance 4d01b4f9-113d-4c69-895e-849b972f1720 on n-h2-master-1 Sep 25 01:33:35.638061 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f01f5fc0-071a-441b-a563-1999c762ead8 req-75706d3a-eacf-499c-89dd-d308ad9323fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060558 Sep 25 01:33:35.638962 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2743/5478] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:36.348148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:36.349718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:36.362719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:36.363473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:36.364100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:36.365148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:36.365823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:36.366400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:36.437097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:36.438372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:36.446367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:36.446996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:36.449371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:36.450615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:36.451322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:36.452005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:36.570046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:36.583071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7443082e-8910-480f-ba23-c385bf71de59 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.241232 Sep 25 01:33:36.584067 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2736/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:36 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:36.636811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:36.646648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:36.649824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:36.651025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:36.654743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:36.658163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:36.658964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:36.659403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:36.659978 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43b91276-0202-46fa-96e2-92e128cbeeac tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.228667 Sep 25 01:33:36.660118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:36.660858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:36.661302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:36.672277 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2744/5480] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:36 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:36.815994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:36.824625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d58749df-ca96-424e-bbac-979affcf8aed tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1309 microversion: 2.1 time: 0.179233 Sep 25 01:33:36.825207 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2737/5481] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:36 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1309 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:37.608365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:37.609692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:37.616838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:37.617341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:37.617841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:37.618557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:37.619022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:37.619507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:37.688896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:37.690150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:37.704423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:37.704921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:37.705358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:37.706116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:37.706563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:37.707170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:37.821018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:37.832422 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1090157f-5dcf-4ae8-8cdf-a8ff4bc5f4ff tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.228967 Sep 25 01:33:37.833144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2745/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:37 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:37.864123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:37.864753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:37.871250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:37.871976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:37.872428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:37.873134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:37.873620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:37.874218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:37.905832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:37.914377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:37.916092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:37.917300 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-228f31a5-c94b-41a9-9d80-7844821e7db4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.234330 Sep 25 01:33:37.918371 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2738/5483] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:37 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:38.017396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:38.025388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-050f1a6d-60c9-4185-a27b-929f2e465b61 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1490 microversion: 2.1 time: 0.165145 Sep 25 01:33:38.026098 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2746/5484] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:37 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1490 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:38.048410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:38.051121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.059156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.059676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.060105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.060825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.061282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.061745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.133442 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-efeaac41-fd70-4d3c-8c84-8e09f83ecc91 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "PUT /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1085 microversion: 2.1 time: 0.088862 Sep 25 01:33:38.134096 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2739/5485] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:33:38 2022] PUT /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1085 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:38.153451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:38.154197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.160256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.160841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.161358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.162147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.162676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.163174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.304496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:38.313439 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ea940e1-8336-4b86-972e-e1c161ed9ec5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1511 microversion: 2.1 time: 0.164275 Sep 25 01:33:38.314042 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2747/5486] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:38 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:38.335652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:38.336276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.342442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.342933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.343384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.344083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.344860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.345141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.482194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:38.499138 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c8174775-1eb0-435b-a1e7-dc3f21a743c0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1511 microversion: 2.1 time: 0.167326 Sep 25 01:33:38.499708 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2740/5487] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:38 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:38.520676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:38.521182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.527865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.528450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.528897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.529637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.530095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.530523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.556219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:33:38.637652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd19e828-92d6-49eb-95de-4b8063d68418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 204 len: 0 microversion: 2.1 time: 0.120497 Sep 25 01:33:38.638653 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2748/5488] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:33:38 2022] DELETE /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:33:38.646789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:38.647663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.654481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.654960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.655392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.656082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.656529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.656948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.799704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:38.808053 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6092a567-4b27-4151-a28b-1bea726f74af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1517 microversion: 2.1 time: 0.165113 Sep 25 01:33:38.811758 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2741/5489] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:38 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:38.865335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:38.866089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.872723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.873506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.873949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.874655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.875158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.875710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.944300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:38.945069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:38.952014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.952690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.953128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:38.953930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:38.954555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:38.955113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:39.058695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:39.061090 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:39.070006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-882b6336-b481-4e6e-8d90-70e35e6316a7 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.209093 Sep 25 01:33:39.071219 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2749/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:38 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:39.126687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:39.135722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:39.137542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:39.138860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43ab94f8-1131-4d37-856b-64919e7bd711 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.198652 Sep 25 01:33:39.139651 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2742/5491] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:38 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:39.831310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:39.832304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:39.842895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:39.843566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:39.844093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:39.845023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:39.846853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:39.847402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:39.989494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:39.997896 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e12bc0d-91c9-4738-9946-3631e2266b7a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1517 microversion: 2.1 time: 0.170583 Sep 25 01:33:39.998687 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2750/5492] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:39 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:40.094296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:40.094929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:40.102646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:40.103241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:40.103751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:40.104467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:40.104933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:40.105529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:40.166060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:40.167153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:40.173829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:40.174576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:40.175201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:40.176088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:40.176550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:40.176979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:40.415512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:40.427897 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64e888ec-3213-4a0b-9ed4-c156bdf9f899 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.337514 Sep 25 01:33:40.428594 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2743/5493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:40 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:40.496925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:40.507103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:40.508900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:40.511808 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c7fd364e-fb21-4d58-8ea2-4b1b5e31d81a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.350456 Sep 25 01:33:40.543068 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2751/5494] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:40 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:41.022826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:41.024332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:41.032740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.033944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.034760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.035760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.036457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.037277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.219778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:41.237949 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0b73e2f-72b6-438e-9be2-b58adfc8d8a5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 200 len: 1475 microversion: 2.1 time: 0.218484 Sep 25 01:33:41.250838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2744/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:41 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 1475 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:41.286730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4ff4415c-1f25-41c4-84e6-f86cd888873a req-b558a727-fe1c-4982-adc5-f10f758592e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d01b4f9-113d-4c69-895e-849b972f1720", "name": "network-vif-deleted", "tag": "5e0884fb-978f-4567-aac4-65e87b5250d4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:41.302689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4ff4415c-1f25-41c4-84e6-f86cd888873a req-b558a727-fe1c-4982-adc5-f10f758592e5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.303197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4ff4415c-1f25-41c4-84e6-f86cd888873a req-b558a727-fe1c-4982-adc5-f10f758592e5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.303625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4ff4415c-1f25-41c4-84e6-f86cd888873a req-b558a727-fe1c-4982-adc5-f10f758592e5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.369421 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4ff4415c-1f25-41c4-84e6-f86cd888873a req-b558a727-fe1c-4982-adc5-f10f758592e5 service nova] Creating event network-vif-deleted:5e0884fb-978f-4567-aac4-65e87b5250d4 for instance 4d01b4f9-113d-4c69-895e-849b972f1720 on n-h2-master-1 Sep 25 01:33:41.381263 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4ff4415c-1f25-41c4-84e6-f86cd888873a req-b558a727-fe1c-4982-adc5-f10f758592e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098313 Sep 25 01:33:41.395743 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2752/5496] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:41.454111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:41.455193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:41.461941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.462796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.464438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.465534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.466208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.467007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.550675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:41.551906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:41.571418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.573817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.574307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.576581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:41.578931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:41.579390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:41.686344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:41.696503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac43b322-fd71-4fb1-bae6-cd4bc5341d6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.247579 Sep 25 01:33:41.698550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2745/5497] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:41 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:41.766664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:41.775839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:41.777789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:41.779269 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-955ccb14-2982-4536-a841-959fcf71d254 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.239860 Sep 25 01:33:41.780191 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2753/5498] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:41 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:42.261709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:42.262340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:42.269002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.269572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.270009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.270708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.271162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.271587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.286180 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 HTTP/1.1 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4d01b4f9-113d-4c69-895e-849b972f1720'} Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:42.287873 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4bf9610-bdea-4b2f-b7ad-65ef71259d39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 404 len: 111 microversion: 2.1 time: 0.031851 Sep 25 01:33:42.293751 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2746/5499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:42 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:33:42.346127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1508694903", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "cb378072-ca68-49e8-8dfa-8d89a6aa2c4b"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:42.422075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] validate_networks() for [('cb378072-ca68-49e8-8dfa-8d89a6aa2c4b', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:33:42.722981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:42.723609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:42.731684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.732442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.733071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.734033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.739130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.739890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.907193 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:33:42.908063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:33:42.908948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:33:42.910198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:33:42.910198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:33:42.920506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.921157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.921802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.922573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.923128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.923661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.940725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:42.942886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:33:42.949261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Getting quotas for user c10efff521ac401cb6b0cf0f7a0f8826 and project 0ab8cb461554463fa9ed654c88096888. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:33:42.949473 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18e3637c-1563-4b95-af37-3f5c63e63557 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.230753 Sep 25 01:33:42.950511 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2747/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:42 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:42.956274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:42.957566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:42.964241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:33:42.964420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.964959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.965433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.966267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:42.966724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:42.967153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:42.968307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:33:43.027964 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1396410a-2c15-46df-97db-c333b8838834 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685692 Sep 25 01:33:43.029030 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2754/5501] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:33:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:33:43.042987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-015661e6-8de3-4473-8310-2aaaf25729c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:43.044738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-015661e6-8de3-4473-8310-2aaaf25729c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:43.054221 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:43.150995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-015661e6-8de3-4473-8310-2aaaf25729c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:43.162713 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-015661e6-8de3-4473-8310-2aaaf25729c8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1209 microversion: 2.1 time: 0.124910 Sep 25 01:33:43.163327 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2755/5502] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:43 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:43.179287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:43.197765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:43.199510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:43.201105 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c455d29d-942c-4d28-848f-f3d51a337c2c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.249196 Sep 25 01:33:43.201888 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2748/5503] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:42 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:43.978150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:43.979259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:43.986895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:43.987462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:43.987975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:43.988746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:43.989447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:43.989929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:44.148912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:44.159023 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1299f421-e026-43b6-a7fe-c4d9b56dc95d tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.184766 Sep 25 01:33:44.159785 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2756/5504] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:43 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:44.187974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:44.189541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:44.196936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:44.197738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:44.198533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:44.199914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:44.200993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:44.201901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:44.227577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:44.229461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:44.244828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:44.245660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:44.246276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:44.247282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:44.247896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:44.248518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:44.473750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:44.476002 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08e36f11-8e97-4f72-b624-e8d8761f2709 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1261 microversion: 2.1 time: 0.291651 Sep 25 01:33:44.492884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2749/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:44 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:44.609991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:44.619109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:44.629766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:44.631077 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e272322-f156-4f82-a854-07877e427db8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1744 microversion: 2.20 time: 0.408078 Sep 25 01:33:44.631676 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2757/5506] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:44 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1744 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:45.185941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:45.186569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:45.199571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:45.200215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:45.200789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:45.210634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:45.211925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:45.212953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:45.501206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:45.502901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:45.517708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:45.518223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:45.519222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:45.519825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:45.520574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:45.521085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:45.831255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:45.861458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6759345-51fe-4eb1-b4ff-a8d215053b2c tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.665820 Sep 25 01:33:45.864011 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2750/5507] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:45 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:45.872429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:45.873964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:45.882319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:45.883057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:45.883930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:45.886008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:45.886980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:45.887809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:45.937493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:45.946113 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b50b86f6-eedc-4741-a641-89daacc4d000 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.448758 Sep 25 01:33:45.953378 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2758/5508] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:45 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:46.339389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:46.353123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:46.356238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:46.357594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cb28be1-5266-45c8-822f-d52851c98d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1744 microversion: 2.20 time: 0.492139 Sep 25 01:33:46.370226 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2751/5509] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:45 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1744 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:46.892987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:46.894496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:46.906379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:46.908186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:46.910061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:46.911295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:46.911974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:46.912614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:46.972458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:46.973081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:46.990665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:46.991436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:46.991944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:46.992636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:46.993097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:46.993558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:47.015182 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:47.329220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:47.343347 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84f7f300-df96-43cd-8da2-d51e891d6a23 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.456879 Sep 25 01:33:47.360016 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2759/5510] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:46 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:47.374061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-554bd282-c4f7-4288-ad28-c6f3374e88cb req-412f9346-3edd-4768-b043-3315654e0a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8873ab8-5ea6-4a7c-881c-be8fab6a107b", "tag": "ddd05242-1095-4520-a782-24a8880b624e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:47.409065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-554bd282-c4f7-4288-ad28-c6f3374e88cb req-412f9346-3edd-4768-b043-3315654e0a22 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:47.413302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-554bd282-c4f7-4288-ad28-c6f3374e88cb req-412f9346-3edd-4768-b043-3315654e0a22 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:47.413939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-554bd282-c4f7-4288-ad28-c6f3374e88cb req-412f9346-3edd-4768-b043-3315654e0a22 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:47.436395 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-554bd282-c4f7-4288-ad28-c6f3374e88cb req-412f9346-3edd-4768-b043-3315654e0a22 service nova] Creating event network-changed:ddd05242-1095-4520-a782-24a8880b624e for instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b on n-h2-master-1 Sep 25 01:33:47.442575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-554bd282-c4f7-4288-ad28-c6f3374e88cb req-412f9346-3edd-4768-b043-3315654e0a22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080701 Sep 25 01:33:47.443385 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2760/5511] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:47.451144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:47.452068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:47.460446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:47.461435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:47.462164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:47.463828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:47.464691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:47.465284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:47.490550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:47.508471 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6d852a7-c11a-4999-8217-a2792d5dd7d9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.531781 Sep 25 01:33:47.521027 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2752/5512] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:46 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:47.875962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4a842c98-bd53-4590-9f56-7bc7cdf8f1bb req-4c0b3929-efe6-4b21-a601-04ea31176508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "name": "network-vif-plugged", "status": "completed", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:47.894699 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:47.902593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4a842c98-bd53-4590-9f56-7bc7cdf8f1bb req-4c0b3929-efe6-4b21-a601-04ea31176508 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:47.903658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4a842c98-bd53-4590-9f56-7bc7cdf8f1bb req-4c0b3929-efe6-4b21-a601-04ea31176508 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:47.904974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4a842c98-bd53-4590-9f56-7bc7cdf8f1bb req-4c0b3929-efe6-4b21-a601-04ea31176508 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:47.921537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:47.937136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:47.937986 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4a842c98-bd53-4590-9f56-7bc7cdf8f1bb req-4c0b3929-efe6-4b21-a601-04ea31176508 service nova] Creating event network-vif-plugged:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h1-master-1 Sep 25 01:33:47.939616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:47.945960 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9c013b6-f383-4f24-a45e-eee41b4f3154 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.500824 Sep 25 01:33:47.948909 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2761/5513] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:47 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:47.967753 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4a842c98-bd53-4590-9f56-7bc7cdf8f1bb req-4c0b3929-efe6-4b21-a601-04ea31176508 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096881 Sep 25 01:33:47.968491 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2753/5514] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:33:48.371289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:48.371937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:48.386337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.386857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.387311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.388049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.388509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.388940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.537742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:48.538460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:48.556043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:48.574897 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a68557d9-2802-433b-957c-c0bae2b953b9 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1485 microversion: 2.1 time: 0.209969 Sep 25 01:33:48.575494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2762/5515] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:48 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1485 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:48.591440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.592235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.592941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.593705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.594361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.594960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.598528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:48.601513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:48.620484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.620996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.621469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.622199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.622655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.623589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.779244 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-efb8cd1c-427a-4683-8b5c-37c90c88f327 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "POST /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a/action" status: 202 len: 0 microversion: 2.1 time: 0.184147 Sep 25 01:33:48.784367 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2763/5516] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:33:48 2022] POST /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:33:48.808857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:48.809608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:48.822793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:48.841683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.842374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.842869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.843296 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2caaa55-78ea-4a55-b0e1-3774e5e2092a tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.311667 Sep 25 01:33:48.843584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.844141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.844470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:48.860091 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2754/5517] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:48 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:48.972935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:48.973601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:48.998721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:48.999248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:48.999673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:49.000388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:49.000846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:49.001273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:49.231968 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:49.248116 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-713dcc8f-0bde-4bb6-9f3a-913648374174 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1493 microversion: 2.1 time: 0.446753 Sep 25 01:33:49.248553 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2764/5518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:48 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1493 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:49.431069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:49.447639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:49.449460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:49.454891 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-57ae626b-328d-4e66-aed3-661d4248545a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.486072 Sep 25 01:33:49.455857 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2755/5519] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:48 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:49.871772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:49.873032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:49.882960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:49.886004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:49.886637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:49.887558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:49.888407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:49.889006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:50.094573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:50.103032 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd1ef14a-57cd-432f-ab1f-faa254fe1faa tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.238190 Sep 25 01:33:50.104133 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2765/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:49 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:50.272392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:50.273689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:50.283631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:50.284430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:50.285032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:50.286045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:50.286665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:50.287366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:50.480974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:50.482221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:50.490957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:50.491459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:50.491910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:50.492632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:50.493098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:50.493571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:50.579852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:50.594457 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb389ea1-33e3-4f67-b7f7-ea8c20713326 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1493 microversion: 2.1 time: 0.326003 Sep 25 01:33:50.595330 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2756/5521] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:50 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1493 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:50.751488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:50.762859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:50.764556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:50.766080 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-089373a4-c3d9-41e8-88ce-c2ee843a6e52 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.289848 Sep 25 01:33:50.767260 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2766/5522] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:50 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:50.919272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:50.919776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:50.928462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:50.928960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:50.929622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:50.930489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:50.931215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:50.932337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.034230 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lazy-loading 'services' on Instance uuid 5bae8e2e-e11b-49e4-b620-da6c4ebc967d {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:33:51.122246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09952b04-23cb-4d58-8e30-3783d4aa0638 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d/os-volume_attachments/4e77aa12-6c26-42ef-b098-e32d0349074b" status: 202 len: 0 microversion: 2.1 time: 0.206966 Sep 25 01:33:51.122950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2757/5523] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:33:50 2022] DELETE /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d/os-volume_attachments/4e77aa12-6c26-42ef-b098-e32d0349074b => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:33:51.126700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:51.127328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:51.135616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:51.136488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:51.137297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.138289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:51.138942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:51.139943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.355610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:51.367519 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49a05f34-9b73-49bd-aab3-162ccf4daa0f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.245204 Sep 25 01:33:51.368714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2767/5524] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:51 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:51.628513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:51.630506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:51.640283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:51.641644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:51.642499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.643530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:51.644269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:51.645536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.794221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:51.794929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:51.802175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:51.802770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:51.803232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.805894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:51.807179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:51.808008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:51.836423 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:51.989392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:52.010980 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ff5592e-3c06-4a58-887d-3f062ad37ae6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1493 microversion: 2.1 time: 0.392407 Sep 25 01:33:52.012254 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2758/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:51 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1493 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:52.080207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:52.112915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:52.114584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:52.116040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc9f0d0d-c331-4956-8a81-57aee1b95f37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.325914 Sep 25 01:33:52.117541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2768/5526] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:51 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:52.390912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:52.391537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:52.399248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:52.401025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:52.402401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:52.404028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:52.404541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:52.404979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:52.618466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:52.628536 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4eb8ee3c-26ed-47f6-bdf6-c9cc66b5b4dc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.241480 Sep 25 01:33:52.642513 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2759/5527] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:52 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:53.037116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:53.041253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:53.048506 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:53.050496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.051289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.051946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.052929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.053594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.054322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.148321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:53.148946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:53.160259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.161075 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:53.164049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.164631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.165423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.166214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.166685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.409642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:53.429130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:53.430707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:53.431128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:53.432029 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ade4a1a-71ee-48dc-b74a-4b4e7956f11e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.287848 Sep 25 01:33:53.445428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2760/5528] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:53 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:33:53.461251 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8ed1875-a511-434b-a85d-078063689228 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1499 microversion: 2.1 time: 0.430516 Sep 25 01:33:53.484120 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2769/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:53 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1499 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:53.505884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:53.506594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:53.515154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.518015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.520174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.520917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.521380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.527571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.620144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:33:53.655047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:53.656450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:53.670901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.673333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.675111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.677547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.680603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.682638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.793906 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08baa2c7-bb3b-414c-80f1-5dc31c5c82fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 204 len: 0 microversion: 2.1 time: 0.292639 Sep 25 01:33:53.794710 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2761/5530] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:33:53 2022] DELETE /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:33:53.802365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5b0ab229-c091-4833-b267-5102f61df761 req-54a928d9-b8e9-4383-97ea-fe6361fdad6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8873ab8-5ea6-4a7c-881c-be8fab6a107b", "name": "network-vif-plugged", "status": "completed", "tag": "ddd05242-1095-4520-a782-24a8880b624e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:53.815951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5b0ab229-c091-4833-b267-5102f61df761 req-54a928d9-b8e9-4383-97ea-fe6361fdad6b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.816728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5b0ab229-c091-4833-b267-5102f61df761 req-54a928d9-b8e9-4383-97ea-fe6361fdad6b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.817290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5b0ab229-c091-4833-b267-5102f61df761 req-54a928d9-b8e9-4383-97ea-fe6361fdad6b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.835827 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5b0ab229-c091-4833-b267-5102f61df761 req-54a928d9-b8e9-4383-97ea-fe6361fdad6b service nova] Creating event network-vif-plugged:ddd05242-1095-4520-a782-24a8880b624e for instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b on n-h2-master-1 Sep 25 01:33:53.854456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5b0ab229-c091-4833-b267-5102f61df761 req-54a928d9-b8e9-4383-97ea-fe6361fdad6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057326 Sep 25 01:33:53.856313 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2762/5531] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:33:53.869940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:53.871022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:53.917776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.921172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.921705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.924673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:53.925245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:53.925854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:53.963400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:53.980229 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82bdb290-0558-4dd9-b592-f900ce947d27 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.330604 Sep 25 01:33:53.994504 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2770/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:53 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:54.299803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:54.310614 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51ee47c8-a327-466a-b87d-75f6674a0266 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.450738 Sep 25 01:33:54.311723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2763/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:53 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:54.464371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:54.465677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:54.481817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:54.482674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:54.484751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:54.485877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:54.487169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:54.488887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:54.693164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:54.708649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:54.708649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:54.709321 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d894aa2d-6708-457f-ac0c-009941695d79 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.251278 Sep 25 01:33:54.710875 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2771/5534] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:54 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:55.006749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:55.007387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:55.019044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:55.020977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:55.021653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:55.022550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:55.023979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:55.024643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:55.195526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:55.209190 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea292934-6678-4d6f-a908-00c6133c0418 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1309 microversion: 2.1 time: 0.208889 Sep 25 01:33:55.211851 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2764/5535] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:54 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:55.351266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:55.352086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:55.363788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:55.364293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:55.364743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:55.366445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:55.369909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:55.370752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:55.620110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:55.633910 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4bfe60ab-071a-458f-abee-df74c06c2ccd tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.286436 Sep 25 01:33:55.645172 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2772/5536] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:55 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:55.735978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:55.736725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:55.745432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:55.753532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:55.755342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:55.756218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:55.756808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:55.757540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.004116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:56.016000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:56.018172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:56.019557 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a0493e1f-b00b-4fb7-987d-fb3581e53737 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.288598 Sep 25 01:33:56.020735 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2765/5537] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:55 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:56.236061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:56.237202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:56.245611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.246435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.247090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.248632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.249314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.250019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.403455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:56.415221 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60eefdb3-9810-4d47-82a4-2409cd076421 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1489 microversion: 2.1 time: 0.183433 Sep 25 01:33:56.429925 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2773/5538] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:56 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1489 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:56.440969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1519874610"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:56.443612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:56.451316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.451819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.452271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.452987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.453475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.454084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.573190 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4cc93b44-7cb0-4bac-aee4-2a019a959695 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "PUT /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1074 microversion: 2.1 time: 0.136561 Sep 25 01:33:56.586131 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2766/5539] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:33:56 2022] PUT /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1074 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:56.593973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:56.594865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:56.602599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.603893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.604517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.605463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.606527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.607147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.669581 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:56.670475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:56.687841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.689613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.690647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.693471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.695601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.698905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.757655 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:33:56.782121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:56.818009 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a5ddb2e-3f03-4d66-9891-05972f12677f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1500 microversion: 2.1 time: 0.226019 Sep 25 01:33:56.829509 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2774/5540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:56 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1500 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:56.841693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:56.842420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:56.854870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.856307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.857131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:56.858292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:56.859117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:56.859934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:57.047722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:57.057515 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3de6e716-dadf-4e05-a5d8-63feabda53ea tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.393498 Sep 25 01:33:57.076677 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2767/5541] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:56 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:33:57.090722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:57.092178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:57.102200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:57.102790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:57.104598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:57.105487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:57.110418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:57.114374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:57.115118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:57.118696 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df2cf662-03b7-4213-b00b-51c3f02cf378 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1500 microversion: 2.1 time: 0.281483 Sep 25 01:33:57.129486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2775/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:56 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1500 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:57.150914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a6c2a44-cdc5-4bf8-8a89-3160b5f70eae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:57.170251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a6c2a44-cdc5-4bf8-8a89-3160b5f70eae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:57.170865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a6c2a44-cdc5-4bf8-8a89-3160b5f70eae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:57.171787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a6c2a44-cdc5-4bf8-8a89-3160b5f70eae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:57.233653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a6c2a44-cdc5-4bf8-8a89-3160b5f70eae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:33:57.327992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a6c2a44-cdc5-4bf8-8a89-3160b5f70eae tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "POST /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b/action" status: 202 len: 0 microversion: 2.1 time: 0.172692 Sep 25 01:33:57.328818 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2776/5543] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:33:57 2022] POST /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:33:57.356257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:57.358305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:57.370735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:57.371235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:57.374487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:57.385434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:57.386938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:57.387439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:57.973716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:57.986521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:57.986521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:57.987672 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8c095c3-ac3e-4fd4-9c29-6a9d68f14b37 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.905957 Sep 25 01:33:57.988908 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2768/5544] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:57 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:58.005311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:58.008839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:58.017226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.017751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.018499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.019163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.019618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.020104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.073371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:33:58.105147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:58.115806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2205ee3-4ab8-4127-b7e3-a332c00ef282 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.782423 Sep 25 01:33:58.134367 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2777/5545] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:57 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:58.134861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:58.137854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:58.155636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.158045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.158045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.160163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.160661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.161156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.245775 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79bca494-4f4e-4d6a-9efe-84424134751f tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 204 len: 0 microversion: 2.1 time: 0.255700 Sep 25 01:33:58.246659 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2769/5546] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:33:57 2022] DELETE /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:33:58.260719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:58.261638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:58.272569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.274475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.275591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.282708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.283260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.283708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.604661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:58.614094 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c811a553-fc7b-4a7a-84b6-4e9f31ac80fc tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 200 len: 1505 microversion: 2.1 time: 0.483065 Sep 25 01:33:58.614685 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2778/5547] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:58 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:58.671992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c675f6f5-fb9e-4ab5-9286-4ab05be6b108 req-c3cd994f-353b-4266-9f79-12089070e84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023ec25c-db25-4466-ba3a-724755fe399a", "name": "network-vif-deleted", "tag": "287a2b3c-60f5-47be-9d60-aadf3e615c61"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:33:58.690786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c675f6f5-fb9e-4ab5-9286-4ab05be6b108 req-c3cd994f-353b-4266-9f79-12089070e84f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:58.691491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c675f6f5-fb9e-4ab5-9286-4ab05be6b108 req-c3cd994f-353b-4266-9f79-12089070e84f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:58.692131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c675f6f5-fb9e-4ab5-9286-4ab05be6b108 req-c3cd994f-353b-4266-9f79-12089070e84f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:58.692372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:58.706834 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-272c7132-ef2d-47ad-a65c-c2d57e583d85 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1469 microversion: 2.1 time: 0.455159 Sep 25 01:33:58.707467 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2770/5548] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:58 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:58.736419 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c675f6f5-fb9e-4ab5-9286-4ab05be6b108 req-c3cd994f-353b-4266-9f79-12089070e84f service nova] Creating event network-vif-deleted:287a2b3c-60f5-47be-9d60-aadf3e615c61 for instance 023ec25c-db25-4466-ba3a-724755fe399a on n-h1-master-1 Sep 25 01:33:58.741462 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c675f6f5-fb9e-4ab5-9286-4ab05be6b108 req-c3cd994f-353b-4266-9f79-12089070e84f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073069 Sep 25 01:33:58.742389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2779/5549] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:33:59.016485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:59.017109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:59.028751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.029516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.030088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.031150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.031773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.032209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.146102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:59.146911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:59.161559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.161816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.162136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.162858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.163317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.163745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.265933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:59.277647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:59.279537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:59.281126 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77b260c7-2288-45a9-b6c8-152bb4d57631 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.268682 Sep 25 01:33:59.282104 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2771/5550] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:33:59 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:33:59.420770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:33:59.433019 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53e43b75-3d79-4852-b777-44103516b3a0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.287134 Sep 25 01:33:59.437820 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2780/5551] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:59 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:33:59.639198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:59.639839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 023ec25c-db25-4466-ba3a-724755fe399a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:59.655510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.656304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.658696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.660079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.660557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.660996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.706523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] HTTP exception thrown: Instance 023ec25c-db25-4466-ba3a-724755fe399a could not be found. Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Request method failure captured: Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a HTTP/1.1 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6-ZkEi40pSJe2mmCoTE9JvQWpkEG8k5dD84Gveuuhgxv77RCyBW0rxMXeYIB8D0ypiBQuEFXeauxKf3yEPFeWZiXjnCSrlXbszQsZnEkT3eNqdznkSIMFh5doAjr4Jn4HTrekosiE7i4d7eIxejCsSaTO33_s6nKPTah0MxI4igKHQ Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0604216998c24ee59f60c44615850d30 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueTestJSON-1649507113 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0604216998c24ee59f60c44615850d30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0604216998c24ee59f60c44615850d30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0604216998c24ee59f60c44615850d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0604216998c24ee59f60c44615850d30"}]}] Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueTestJSON-1649507113 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0604216998c24ee59f60c44615850d30 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueTestJSON-1649507113 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueTestJSON-1649507113-project Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8447ea42224541a69b6af35641350164 Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueTestJSON-1649507113-project Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 023ec25c-db25-4466-ba3a-724755fe399a could not be found. Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '023ec25c-db25-4466-ba3a-724755fe399a'} Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023ec25c-db25-4466-ba3a-724755fe399a could not be found. Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023ec25c-db25-4466-ba3a-724755fe399a could not be found. Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:33:59.708533 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023ec25c-db25-4466-ba3a-724755fe399a could not be found. Sep 25 01:33:59.714343 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:33:59.716559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Returning 404 to user: Instance 023ec25c-db25-4466-ba3a-724755fe399a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:33:59.717693 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ca5b5243-69fb-4d6c-b281-ae6611a03a6a tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a" status: 404 len: 111 microversion: 2.1 time: 0.083939 Sep 25 01:33:59.721587 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2772/5552] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:59 2022] GET /compute/v2.1/servers/023ec25c-db25-4466-ba3a-724755fe399a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:33:59.726634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:59.727150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:59.734996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.735506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.736209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.737116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.737819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.738438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.748755 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:59.749419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:59.765600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.766101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.766926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.767720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.768259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.768698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.779220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:33:59.910557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a463fdf6-94b8-4f6c-a459-2baf12f8cdc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 204 len: 0 microversion: 2.1 time: 0.186884 Sep 25 01:33:59.914580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2781/5553] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:33:59 2022] DELETE /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:33:59.927518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:33:59.928579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:33:59.936092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.936708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.937492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:33:59.941145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:33:59.942113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:33:59.942770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:00.080535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:00.090721 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-07c46b67-7c0e-4efb-a957-73cbfb8be644 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1469 microversion: 2.1 time: 0.356054 Sep 25 01:34:00.112880 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2773/5554] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:59 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:00.210481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:00.222467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d1b2df61-7a6e-4966-8383-ec84a044a87e tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1490 microversion: 2.1 time: 0.302403 Sep 25 01:34:00.250199 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2782/5555] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:33:59 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1490 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:00.309900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:00.311149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:00.321107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:00.322253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:00.323713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:00.324548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:00.325085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:00.325774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:00.453021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:00.453677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:00.463350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:00.468098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:00.468707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:00.469774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:00.470473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:00.471544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:00.474913 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:00.754006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:00.756213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:00.789591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:00.789591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:00.789591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7255984c-be36-4e9d-abf6-4e854d7b44d8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.464730 Sep 25 01:34:00.789591 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2774/5556] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:00 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:00.804683 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e17bd19-59e4-4488-af01-d9807bd054af tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.355708 Sep 25 01:34:00.805621 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2783/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:00 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:34:01.001343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-dd61eb3b-aa4d-45ad-b8dd-b433527d93c9 req-d4632e60-fe52-428a-b135-993a25bf2b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bae8e2e-e11b-49e4-b620-da6c4ebc967d", "name": "network-vif-deleted", "tag": "dcf604b7-62a9-4954-967b-740ddc278fc0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:01.013748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dd61eb3b-aa4d-45ad-b8dd-b433527d93c9 req-d4632e60-fe52-428a-b135-993a25bf2b4c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.014281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dd61eb3b-aa4d-45ad-b8dd-b433527d93c9 req-d4632e60-fe52-428a-b135-993a25bf2b4c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.014647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dd61eb3b-aa4d-45ad-b8dd-b433527d93c9 req-d4632e60-fe52-428a-b135-993a25bf2b4c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.041590 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dd61eb3b-aa4d-45ad-b8dd-b433527d93c9 req-d4632e60-fe52-428a-b135-993a25bf2b4c service nova] Creating event network-vif-deleted:dcf604b7-62a9-4954-967b-740ddc278fc0 for instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d on n-h2-master-1 Sep 25 01:34:01.065605 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-dd61eb3b-aa4d-45ad-b8dd-b433527d93c9 req-d4632e60-fe52-428a-b135-993a25bf2b4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073555 Sep 25 01:34:01.065846 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2775/5558] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:01.121296 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:01.121984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:01.128260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.128895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.129353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.130153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.130619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.131178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.203266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec1161d97a84fb2ab8d27491008c744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b788028d56a246d49f6586d6255e5f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:01.215800 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d00da2e-ad52-4955-9cf5-21de2cbe09fe tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 200 len: 1299 microversion: 2.1 time: 0.099468 Sep 25 01:34:01.216699 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2784/5559] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:01 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:01.252471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:01.253469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:01.266885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.267540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.268207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.269008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.269574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.270381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.555883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:01.570126 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d17fd3a-1e66-40f0-96ff-734c24f946b4 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1490 microversion: 2.1 time: 0.322974 Sep 25 01:34:01.571352 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2776/5560] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:01 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1490 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:01.799446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:01.800111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:01.815986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.816860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.817579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.818575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.820161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.820879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.832370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:01.833856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:01.850799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.851692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.858770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:01.859948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:01.860498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:01.861009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:02.123381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:02.129320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:02.139144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:02.140089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd6fbb7e-eb7f-48ae-be78-4ed958a00a2e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.314092 Sep 25 01:34:02.158982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:02.158982 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b702fa4-f9d8-4e9c-b516-7bdf60963ae3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1739 microversion: 2.20 time: 0.363121 Sep 25 01:34:02.158982 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2785/5561] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:01 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:02.161019 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2777/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:01 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:02.240308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:02.241163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] [instance: 5bae8e2e-e11b-49e4-b620-da6c4ebc967d] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:02.249135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:02.249825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:02.250272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:02.251004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:02.251526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:02.252096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:02.267472 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] HTTP exception thrown: Instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d could not be found. Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Request method failure captured: Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d HTTP/1.1 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6-VsLXJ74DBkTkCB_eh7mi91pX2ZI4FWAp6Pmm0iylfkz3U4-V56lW_o5mmkOV-sR3c0VV2sQ_0Kq2HsMpVAeIXuoD2F8KffZoUuW_QjU9wKdfwgYtd_pHIoqvC6fbYtubj8O3dezqi3LxcTZOQjT8NIzQqlH0DEZO_9l1Ux_IJPIU Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: b788028d56a246d49f6586d6255e5f39 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesBackupsTest-1963598578 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b788028d56a246d49f6586d6255e5f39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b788028d56a246d49f6586d6255e5f39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b788028d56a246d49f6586d6255e5f39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b788028d56a246d49f6586d6255e5f39"}]}] Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesBackupsTest-1963598578 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: b788028d56a246d49f6586d6255e5f39 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesBackupsTest-1963598578 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesBackupsTest-1963598578-project Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4ec1161d97a84fb2ab8d27491008c744 Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesBackupsTest-1963598578-project Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d could not be found. Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5bae8e2e-e11b-49e4-b620-da6c4ebc967d'} Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d could not be found. Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d could not be found. Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:02.269194 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d could not be found. Sep 25 01:34:02.273989 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:02.275373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] Returning 404 to user: Instance 5bae8e2e-e11b-49e4-b620-da6c4ebc967d could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:02.277312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd8ea84c-d1a1-4d70-9a6b-077bc5d3b682 tempest-VolumesBackupsTest-1963598578 tempest-VolumesBackupsTest-1963598578-project] 10.222.0.16 "GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d" status: 404 len: 111 microversion: 2.1 time: 0.041256 Sep 25 01:34:02.281478 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2786/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:02 2022] GET /compute/v2.1/servers/5bae8e2e-e11b-49e4-b620-da6c4ebc967d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:34:02.602657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:02.604441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:02.612532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:02.613394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:02.614023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:02.614928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:02.615612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:02.616204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:02.855930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:02.865079 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e2f956f-6894-45e2-8297-e9d0af584101 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1490 microversion: 2.1 time: 0.267012 Sep 25 01:34:02.879398 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2778/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:02 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1490 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:03.167145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:03.167870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:03.175774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.176776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.178267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.179453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.180329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.181721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.184573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:03.185455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:03.192461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.193153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.193866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.194787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.195568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.196279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.566056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:03.570295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:03.575258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c47bf2f-5b29-453d-8eb9-7963bb02a8bc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.413353 Sep 25 01:34:03.589627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:03.589627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:03.589627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e368d299-71ca-4cb9-9ed8-4c0aca721dc0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1721 microversion: 2.20 time: 0.403116 Sep 25 01:34:03.589627 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2779/5565] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:03 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1721 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:03.589627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3c361762-a935-45fe-a287-8645927bb181 req-c6eb9475-70a3-4e16-9fed-a67ec56424fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a78a7e5-1e7d-43f5-81cd-9960a38d76a5", "name": "network-vif-deleted", "tag": "11141640-2781-46cf-a807-bd6129060bb2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:03.591011 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2787/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:03 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:03.600089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3c361762-a935-45fe-a287-8645927bb181 req-c6eb9475-70a3-4e16-9fed-a67ec56424fb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.600585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3c361762-a935-45fe-a287-8645927bb181 req-c6eb9475-70a3-4e16-9fed-a67ec56424fb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.601145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3c361762-a935-45fe-a287-8645927bb181 req-c6eb9475-70a3-4e16-9fed-a67ec56424fb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.614077 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3c361762-a935-45fe-a287-8645927bb181 req-c6eb9475-70a3-4e16-9fed-a67ec56424fb service nova] Creating event network-vif-deleted:11141640-2781-46cf-a807-bd6129060bb2 for instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 on n-h1-master-1 Sep 25 01:34:03.619678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3c361762-a935-45fe-a287-8645927bb181 req-c6eb9475-70a3-4e16-9fed-a67ec56424fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034241 Sep 25 01:34:03.623356 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2780/5567] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:03.891606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:03.892592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:03.899362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.900777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.901520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.902723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.903416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.904073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.948103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:03.948869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:03.949511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:03.950263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lazy-loading 'fault' on Instance uuid 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:34:04.015836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8447ea42224541a69b6af35641350164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0604216998c24ee59f60c44615850d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:04.033979 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30c9ded4-d943-4328-8e31-ee58bb5e7561 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 200 len: 1303 microversion: 2.1 time: 0.146316 Sep 25 01:34:04.037333 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2788/5568] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:03 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:04.603585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:04.616052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:04.616947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:04.617263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:04.630326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:04.630828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:04.631271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:04.631981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:04.632436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:04.632862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:04.632983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:04.633996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:04.635221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:04.636154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:04.636828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:04.637498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:04.849693 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:04.857942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:04.859731 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b810feb7-030b-4be8-8170-0b74871de3b3 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.261404 Sep 25 01:34:04.860342 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2781/5569] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:04 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:04.869846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:04.871859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:04.873294 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd4e3176-0e5f-484f-b71d-25c199c2f041 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1721 microversion: 2.20 time: 0.261711 Sep 25 01:34:04.874361 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2789/5570] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:04 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:05.059668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:05.060393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] [instance: 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:05.066703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.067261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.067770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:05.068545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.069108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.069721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:05.083732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] HTTP exception thrown: Instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 could not be found. Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Request method failure captured: Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 HTTP/1.1 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6-ZkEi40pSJe2mmCoTE9JvQWpkEG8k5dD84Gveuuhgxv77RCyBW0rxMXeYIB8D0ypiBQuEFXeauxKf3yEPFeWZiXjnCSrlXbszQsZnEkT3eNqdznkSIMFh5doAjr4Jn4HTrekosiE7i4d7eIxejCsSaTO33_s6nKPTah0MxI4igKHQ Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0604216998c24ee59f60c44615850d30 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerRescueTestJSON-1649507113 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0604216998c24ee59f60c44615850d30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0604216998c24ee59f60c44615850d30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0604216998c24ee59f60c44615850d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0604216998c24ee59f60c44615850d30"}]}] Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerRescueTestJSON-1649507113 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0604216998c24ee59f60c44615850d30 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerRescueTestJSON-1649507113 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerRescueTestJSON-1649507113-project Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8447ea42224541a69b6af35641350164 Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerRescueTestJSON-1649507113-project Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 could not be found. Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8a78a7e5-1e7d-43f5-81cd-9960a38d76a5'} Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 could not be found. Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 could not be found. Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:05.085556 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 could not be found. Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] Returning 404 to user: Instance 8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:05.091815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-39ffd11a-31e3-4825-8ba4-0a7f79c4fbc6 tempest-ServerRescueTestJSON-1649507113 tempest-ServerRescueTestJSON-1649507113-project] 10.222.0.16 "GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5" status: 404 len: 111 microversion: 2.1 time: 0.031482 Sep 25 01:34:05.095286 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2782/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:05 2022] GET /compute/v2.1/servers/8a78a7e5-1e7d-43f5-81cd-9960a38d76a5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:05.642634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9a05b2a9-e186-4a82-9d49-febd4d35fb79 req-527fafe2-d760-4e6d-8795-626688b12f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "name": "network-vif-unplugged", "status": "completed", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:05.664874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a05b2a9-e186-4a82-9d49-febd4d35fb79 req-527fafe2-d760-4e6d-8795-626688b12f8d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.666772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a05b2a9-e186-4a82-9d49-febd4d35fb79 req-527fafe2-d760-4e6d-8795-626688b12f8d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.667621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a05b2a9-e186-4a82-9d49-febd4d35fb79 req-527fafe2-d760-4e6d-8795-626688b12f8d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:05.690205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9a05b2a9-e186-4a82-9d49-febd4d35fb79 req-527fafe2-d760-4e6d-8795-626688b12f8d service nova] Creating event network-vif-unplugged:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h1-master-1 Sep 25 01:34:05.696976 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9a05b2a9-e186-4a82-9d49-febd4d35fb79 req-527fafe2-d760-4e6d-8795-626688b12f8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057674 Sep 25 01:34:05.698549 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2790/5572] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:05.892626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:05.894085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:05.902130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:05.902958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:05.904243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.904741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.905643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:05.906540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.907547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.908155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:05.919065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.919674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.920228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:05.921050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:05.922319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:05.922986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:06.160289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:06.170627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-926f6051-2f7b-4a5f-9821-b9b8f8ca2d2c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.282279 Sep 25 01:34:06.183097 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2783/5573] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:05 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:06.207870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:06.218356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:06.221107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:06.222561 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2d887fd-debb-4730-ba98-d9702897d8d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1721 microversion: 2.20 time: 0.326359 Sep 25 01:34:06.223619 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2791/5574] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:05 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:07.197376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:07.199949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:07.211835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:07.212911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:07.213630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:07.214640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:07.215187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:07.215775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:07.250219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:07.251398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:07.269118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:07.270252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:07.271697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:07.275198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:07.277227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:07.277710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:07.737460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:07.749665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:07.757042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:07.757201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:07.760036 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f250d252-4c0b-48b5-afc6-23841c9a3bd8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1664 microversion: 2.20 time: 0.515169 Sep 25 01:34:07.769546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eef6d82f-567a-474b-ba65-8674248f132b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.577261 Sep 25 01:34:07.769976 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2792/5575] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:07 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1664 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:07.786722 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2784/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:07 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:07.798047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f048cad-2f06-4571-b9c6-dfb11ace2229"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:07.800492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:07.815382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:07.823752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:07.830164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:07.830981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:07.831460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:07.835694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:08.399387 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97fe5460-7946-4344-9f04-b61f4532255b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.606297 Sep 25 01:34:08.402479 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2793/5577] 10.222.0.16 () {62 vars in 1364 bytes} [Sun Sep 25 01:34:07 2022] POST /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 188 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:34:08.609244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:08.610544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:08.618286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:08.619560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:08.620250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:08.621342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:08.621951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:08.622640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:08.628126 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:08.685760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122384) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:34:08.773321 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-523ac31d-23b2-43be-9f0d-5958f22da287 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/action" status: 202 len: 0 microversion: 2.20 time: 0.167747 Sep 25 01:34:08.774655 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2785/5578] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:34:08 2022] POST /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:34:08.784168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:08.785028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:08.796097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:08.797275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:08.802414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:08.802918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:08.803358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:08.804566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:08.805031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:08.805486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:08.809669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:08.812551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:08.815993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:08.817045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:08.817780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:08.818460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:09.163722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:09.174709 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a53d885-e1d1-4ec5-bd84-f7aeec2bf206 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.383481 Sep 25 01:34:09.181461 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2786/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:08 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:09.252132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:09.267851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:09.269746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:09.271151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4fc3ed4-a477-4586-a17d-e4713b7f4468 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1750 microversion: 2.20 time: 0.491618 Sep 25 01:34:09.287021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2794/5580] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:08 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1750 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:10.208346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:10.208946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:10.226414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:10.227309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:10.228195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:10.229356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:10.230195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:10.230919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:10.300714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:10.301397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:10.326134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:10.326680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:10.327140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:10.327873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:10.328558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:10.329195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:10.586688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:10.611226 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-29b6758a-ac79-423d-8ccf-c92e34d12915 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.405895 Sep 25 01:34:10.612869 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2787/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:10 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:10.639452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:10.651549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:10.653813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:10.655274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-35bce08f-2a0c-42e9-83e1-b59f45be1563 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1750 microversion: 2.20 time: 0.359218 Sep 25 01:34:10.669831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2795/5582] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:10 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1750 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:11.645136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:11.646126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:11.656966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:11.657575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:11.658096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:11.659020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:11.659559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:11.660080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:11.808413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1729913669", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": "none"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:11.819780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:11.833853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7d07c0ce-1a36-4fb5-ad8b-2d3953ad924b tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.193453 Sep 25 01:34:11.834752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2796/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:11 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:34:11.849556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:11.850187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:11.871052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:11.871556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:11.872011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:11.872737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:11.873203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:11.873672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:11.919122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:34:11.920907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:34:11.921437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:34:11.921873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:34:11.922296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:34:11.943236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:11.943727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:11.945103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:11.946135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:11.947660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:11.948314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:11.970997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Getting quotas for project 143d98d4d3984729b03022104174e152. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:34:11.978722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Getting quotas for user a5ee3a1275ac406bb0f8fbda96d3ad4b and project 143d98d4d3984729b03022104174e152. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:34:12.009981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:34:12.013185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:34:12.067733 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:12.111315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:12.121695 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6151f521-8d1f-43b7-9270-e0e377ece8a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.507463 Sep 25 01:34:12.123061 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2788/5584] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:34:12.123911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:12.125487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:12.126925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23b68d77-7500-4587-b8b0-a6621f17e301 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1752 microversion: 2.20 time: 0.290879 Sep 25 01:34:12.142308 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2797/5585] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:11 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1752 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:12.154403 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4bbf92c2-896e-4793-be2e-a4888033f030 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:12.155946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4bbf92c2-896e-4793-be2e-a4888033f030 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:12.222477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bbf92c2-896e-4793-be2e-a4888033f030 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:12.234750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bbf92c2-896e-4793-be2e-a4888033f030 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:12.237244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bbf92c2-896e-4793-be2e-a4888033f030 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:12.238815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4bbf92c2-896e-4793-be2e-a4888033f030 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1278 microversion: 2.57 time: 0.095842 Sep 25 01:34:12.239909 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2789/5586] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:12 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:12.860382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:12.861200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:12.869396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:12.870164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:12.870902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:12.872281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:12.873203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:12.874495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:12.880592 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:13.138912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.148343 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3e10d5f-1b00-488b-b16d-614cf077bbe5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.291954 Sep 25 01:34:13.155108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:13.155879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:13.160214 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2798/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:12 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:13.170511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:13.171306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:13.171916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:13.172815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:13.173473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:13.174064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:13.267628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:13.268640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:13.271249 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:13.283709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:13.284217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:13.286414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:13.287167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:13.287643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:13.288077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:13.428341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.437439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.439384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.440993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9ee70648-66b9-4c0d-b951-199a3e694ca0 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1330 microversion: 2.57 time: 0.177620 Sep 25 01:34:13.442071 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2799/5588] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:13 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1330 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:13.467216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.477569 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.480126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:13.482840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f3b387a-b5d6-469b-ace0-579f316aa60e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1752 microversion: 2.20 time: 0.331460 Sep 25 01:34:13.484530 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2790/5589] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:13 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1752 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:14.172548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:14.174079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:14.224591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:14.226588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:14.227348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:14.228383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:14.229040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:14.229502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:14.389335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.410851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8564e61a-d1ca-4ab7-9d30-b19483904cd1 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.242433 Sep 25 01:34:14.411449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2800/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:14 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:14.473432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:14.475235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:14.484430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:14.485177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:14.485919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:14.486905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:14.487526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:14.488126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:14.509926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:14.510793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:14.527620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:14.528180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:14.528638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:14.529371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:14.529859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:14.530293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:14.588709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.598379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.600477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.601912 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-66cfae74-5c48-4150-aa94-1575acbb05e2 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1336 microversion: 2.57 time: 0.139192 Sep 25 01:34:14.620920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2791/5591] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:14 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1336 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:14.732386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.750695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.752178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:14.753429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd68d1d9-4a39-4574-a9fc-bcacad8b1040 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1752 microversion: 2.20 time: 0.248218 Sep 25 01:34:14.754587 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2801/5592] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:14 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:15.436185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:15.436815 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:15.444364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:15.444866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:15.445313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:15.446053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:15.447072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:15.447507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:15.632496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:15.633120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.633834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:15.642340 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aa53a812-d369-440c-9ca2-ea0d029d0131 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.210671 Sep 25 01:34:15.653539 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2792/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:15 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:34:15.653740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:15.653740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:15.653740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:15.653740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:15.653740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:15.653740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:15.756982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.766716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.768476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.769781 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4dcd9b1a-a21f-4255-ae95-00774bd7349e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1336 microversion: 2.57 time: 0.141845 Sep 25 01:34:15.770466 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2802/5594] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:15 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:15.787218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:15.788352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:15.796332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:15.797096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:15.797743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:15.798809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:15.799429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:15.800129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:15.950293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.960654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.963055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:15.964308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9fd14510-a417-4ad3-a013-cd799efb2204 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1752 microversion: 2.20 time: 0.187494 Sep 25 01:34:15.964881 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2793/5595] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:15 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:16.668790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:16.669831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:16.679175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:16.679717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:16.680332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:16.681818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:16.682476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:16.683097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:16.801236 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:16.803074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:16.812173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:16.813007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:16.813860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:16.815116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:16.815828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:16.816543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:16.843589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:16.853195 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cbf0215d-1d20-4491-89c9-ad010265517f tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.188647 Sep 25 01:34:16.865931 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2803/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:16 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:16.905244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:16.919772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:16.921576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:16.922755 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21b1b08e-e06b-456f-b956-1de0cfde0128 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1336 microversion: 2.57 time: 0.130270 Sep 25 01:34:16.923362 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2794/5597] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:16 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1336 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:16.996658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:16.997304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:17.004019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:17.004518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:17.005059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:17.006999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:17.007460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:17.007905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:17.154841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:17.163731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:17.165851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:17.167182 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f8ef9e91-c6eb-4d44-af40-cf96887b791f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1752 microversion: 2.20 time: 0.177501 Sep 25 01:34:17.167754 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2804/5598] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:16 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:17.879524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:17.880614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:17.888823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:17.889503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:17.890068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:17.890880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:17.891442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:17.891971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:17.952599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:17.954491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:17.966288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:17.967275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:17.967895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:17.968823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:17.969505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:17.970135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.067272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.081094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.083177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.084444 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9fb3b39-3e95-479b-9bf9-c7be7447bf9a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1357 microversion: 2.57 time: 0.139816 Sep 25 01:34:18.084828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.097427 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2805/5599] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:17 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1357 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:18.097653 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b92ae23f-ba0f-4efc-bf78-427c450d5331 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.219801 Sep 25 01:34:18.097653 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2795/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:17 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:18.112034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:18.115521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:18.124049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.126888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.127598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.128365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.128830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.129282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.193504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:18.194219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:18.202265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.202761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.203203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.203913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.204357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.204785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.246881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:34:18.247377 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:34:18.247875 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:34:18.248657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:34:18.249093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:34:18.376772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:18.403414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.404192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.404653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.407802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.408340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.408792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.451442 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e688f62f-6f64-43aa-a3b5-a4f9eb7e722b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "POST /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183/action" status: 202 len: 1138 microversion: 2.57 time: 0.343384 Sep 25 01:34:18.452509 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2806/5601] 10.222.0.16 () {62 vars in 1320 bytes} [Sun Sep 25 01:34:18 2022] POST /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183/action => generated 1138 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 25 01:34:18.474835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:18.476656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:18.485023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.486509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.487216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.488036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:18.488542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:18.488987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:18.612594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.628238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.630550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.632106 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da841dab-8c71-4e49-af3c-1852054e2c8a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.162783 Sep 25 01:34:18.633396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.643849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.648015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:18.651258 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2807/5602] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:18 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:18.652223 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43731b11-4b88-43b6-b5fe-1b89925118ed tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.462610 Sep 25 01:34:18.670024 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2796/5603] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:18 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:19.120565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:19.121541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:19.132489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:19.133289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:19.134273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:19.135894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:19.136864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:19.138175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:19.519235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:19.530741 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2e4045c9-8712-472e-8105-48093988ffe4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.416352 Sep 25 01:34:19.531807 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2808/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:19 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:19.660410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:19.661889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:19.673026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:19.679352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:19.680509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:19.687586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:19.688390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:19.690855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:19.691566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:19.692214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:19.692869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:19.695663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:19.697123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:19.699298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:19.701017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:19.701726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:19.853561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:19.864904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:19.866712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:19.868692 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e483935d-d259-4d53-9780-8ff09ddba69e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.212168 Sep 25 01:34:19.881701 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2797/5605] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:19 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:19.987305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:19.997665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:19.999359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:20.000859 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ed4fa26-81f1-452a-befa-8b0abdcfec57 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.326193 Sep 25 01:34:20.001771 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2809/5606] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:19 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:20.172377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f614d500-5cae-41b1-a3b5-08d2ec191921 req-c8a29faa-ee92-4471-8a43-6694d0d457c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:20.189683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f614d500-5cae-41b1-a3b5-08d2ec191921 req-c8a29faa-ee92-4471-8a43-6694d0d457c4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:20.190453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f614d500-5cae-41b1-a3b5-08d2ec191921 req-c8a29faa-ee92-4471-8a43-6694d0d457c4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:20.191051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f614d500-5cae-41b1-a3b5-08d2ec191921 req-c8a29faa-ee92-4471-8a43-6694d0d457c4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:20.206885 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f614d500-5cae-41b1-a3b5-08d2ec191921 req-c8a29faa-ee92-4471-8a43-6694d0d457c4 service nova] Creating event network-changed:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h2-master-1 Sep 25 01:34:20.214584 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f614d500-5cae-41b1-a3b5-08d2ec191921 req-c8a29faa-ee92-4471-8a43-6694d0d457c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046679 Sep 25 01:34:20.215674 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2798/5607] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:20.555311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:20.557228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:20.565999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:20.566744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:20.567199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:20.567912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:20.568664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:20.569319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:20.795260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:20.806017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-754313b8-6709-4bdd-9e39-cae3cbc8b84c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.252767 Sep 25 01:34:20.818358 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2810/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:20 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:20.904897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:20.906659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:20.915582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:20.916498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:20.917172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:20.918023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:20.918554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:20.919190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:20.994764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:21.004066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:21.006259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:21.007834 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6456e2d-7819-40b4-bb33-72535a630d5e tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.116250 Sep 25 01:34:21.009601 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2799/5609] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:20 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:21.027616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:21.028268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:21.040760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:21.044502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:21.046996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:21.047767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:21.048250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:21.048699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:21.324156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:21.338408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:21.341765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:21.343066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-450992f2-86d2-457a-a09c-d0f6c6fdb1b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.320620 Sep 25 01:34:21.343637 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2811/5610] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:21 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:21.830172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:21.831114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:21.846726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:21.847711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:21.848341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:21.851254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:21.853482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:21.854284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:21.961542 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:22.034207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:22.035674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:22.053556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:22.054675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:22.056475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:22.057515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:22.059536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:22.061431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:22.136224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.149135 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37b275a0-e85e-4e0f-8a90-96e9686bb445 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.324784 Sep 25 01:34:22.150860 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2800/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:21 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:22.208407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.211394 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:22.221590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.223424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.224887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2ab67cd-6684-44e6-9d9d-971790a8430f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.194925 Sep 25 01:34:22.237580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2812/5612] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:22 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:22.370060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:22.371190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:22.374661 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:22.388262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:22.389068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:22.389713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:22.390589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:22.391208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:22.391779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:22.582537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.601926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.601926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:22.601926 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-60a2da10-6132-4480-b92d-708abe93b6b7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.235844 Sep 25 01:34:22.601926 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2801/5613] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:22 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:23.175113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:23.176757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:23.193592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:23.198850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:23.199635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:23.201626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:23.204785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:23.205519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:23.256459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:23.258191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:23.273610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:23.276067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:23.278235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:23.280011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:23.281945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:23.282627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:23.417234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.429778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.438905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.440626 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17f7f9fc-2977-4347-b6e7-56b43f5e4c4d tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.188416 Sep 25 01:34:23.454990 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2802/5614] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:23 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:23.567754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.577749 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-067689a0-816e-48f8-bc4b-df68525381cc tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.407341 Sep 25 01:34:23.578833 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2813/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:23 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:34:23.632452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:23.634284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:23.646735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:23.647597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:23.650737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:23.651802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:23.654309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:23.655001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:23.660925 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:23.859418 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.886259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.891045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:23.898177 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e40de30a-531e-4337-b45b-61fc744e4d33 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.269128 Sep 25 01:34:23.899021 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2803/5616] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:23 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:24.472647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:24.474139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:24.484054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:24.484795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:24.485723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:24.486644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:24.487260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:24.487857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:24.572935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:24.590641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:24.592176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:24.596349 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe302f53-8472-44c6-bd9b-6bbec7f3a93c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.125117 Sep 25 01:34:24.604847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:24.606327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:24.615628 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2814/5617] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:24 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:24.622746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:24.623484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:24.624640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:24.625743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:24.626365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:24.626979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:24.864482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:24.883145 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18e70c7e-b5bc-42a1-823e-49de5b2359c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.282836 Sep 25 01:34:24.905683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2804/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:24 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:34:24.928835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:24.947132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:24.975560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:24.976772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:24.978177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:24.979257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:24.980363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:24.981143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:25.164107 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:25.193128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:25.198477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:25.199764 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ecd30c09-0b1e-41c5-b4ff-ee3588a3cfdd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.275407 Sep 25 01:34:25.205811 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2815/5619] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:24 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:25.640192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:25.641819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:25.651008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:25.651517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:25.652219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:25.653008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:25.653496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:25.654111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:25.735186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:25.745598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:25.747601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:25.749183 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45ba8ef0-9baf-419c-b89a-a479f4e931d5 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.124652 Sep 25 01:34:25.749952 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2805/5620] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:25 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:25.910693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:25.911325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:25.925142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:25.925727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:25.926130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:25.926848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:25.927338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:25.927742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:26.173575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.193792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50192fd7-9937-4da7-8d84-a3339d6f4bf5 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.286965 Sep 25 01:34:26.205934 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2816/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:25 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:26.229503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:26.230059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:26.239011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:26.240076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:26.240731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:26.241718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:26.242396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:26.243645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:26.506958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.518958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.521610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.523486 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9d27fd0-8630-4242-9f43-798dfebab090 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.298819 Sep 25 01:34:26.524880 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2806/5622] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:26 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:26.779283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:26.779910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:26.799384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:26.799891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:26.800367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:26.801089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:26.801580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:26.802010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:26.923678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.934636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.941678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:26.945561 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f69e316-ed4b-494e-ae95-eec676b9f2d8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.170506 Sep 25 01:34:26.947258 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2817/5623] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:26 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:27.220363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:27.221772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:27.231234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:27.232252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:27.232942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:27.234202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:27.235109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:27.235766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:27.464323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:27.475044 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b0b23d1-051d-484b-9ef1-10265cb80391 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.258465 Sep 25 01:34:27.475974 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2807/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:27 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:27.552863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:27.554191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:27.562308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:27.563375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:27.563997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:27.564984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:27.565811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:27.566413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:27.844894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:27.862390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:27.863851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:27.865053 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6a95586-7495-4533-bd2b-2a9b3bead831 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.316637 Sep 25 01:34:27.865654 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2818/5625] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:27 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:27.972550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:27.973172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:27.983027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:27.984449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:27.985722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:27.987002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:27.987557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:27.988028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:28.086194 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:28.100124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:28.101676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:28.103362 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-839159bc-ef46-46a6-a17d-6f9c484f2785 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.134590 Sep 25 01:34:28.103965 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2808/5626] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:27 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:28.504632 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:28.505272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:28.519503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:28.521865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:28.522349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:28.525167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:28.525975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:28.526436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:28.765854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:28.779388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24fbdcfa-b8b2-48f4-93ac-3df12d1dff39 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.279736 Sep 25 01:34:28.799867 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2819/5627] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:28 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:28.897986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:28.899832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:28.927034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:28.927795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:28.928441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:28.929865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:28.931087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:28.931743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:29.100894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.114110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.115870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.118213 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d235f5b1-3ef3-48ba-80fb-615f6d0e43a1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.225635 Sep 25 01:34:29.118636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2809/5628] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:28 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:29.131122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:29.132119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:29.144234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:29.144744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:29.145677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:29.146586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:29.147060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:29.147500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:29.242301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.252496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.254228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.255558 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-145ff101-9c2a-4a8b-b949-cbf51cfa6862 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.128570 Sep 25 01:34:29.271019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2820/5629] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:29 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:29.808235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:29.808979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:29.815928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:29.816403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:29.816917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:29.817648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:29.818110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:29.818680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:29.973336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:29.982121 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-181c6a95-5c57-4e50-83ee-4895b8359979 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1510 microversion: 2.1 time: 0.177892 Sep 25 01:34:29.982712 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2810/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:29 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:30.147565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:30.148187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:30.156304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:30.156800 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:30.157255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:30.157998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:30.158538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:30.159129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:30.291076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:30.292812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:30.300998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:30.302031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:30.303632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:30.305016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:30.305894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:30.306628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:30.312422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:30.326388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:30.328260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:30.329754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49a87ca2-7333-4b60-91f2-376326dab404 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.186230 Sep 25 01:34:30.331173 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2821/5631] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:30 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:30.414078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:30.425911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:30.427835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:30.429130 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bd23e7c-f6e9-4379-a4aa-5d92c54a79bb tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.150265 Sep 25 01:34:30.447950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2811/5632] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:30 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:31.005927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:31.006551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.012980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.013513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.013964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.014660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.015130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.015563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.150463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.159567 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c68a85ef-e105-46c3-b143-53e82cd0beb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1487 microversion: 2.1 time: 0.157629 Sep 25 01:34:31.160146 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2822/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:31 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1487 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:31.184545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1548486150"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:31.187162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.194057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.194540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.194978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.195683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.196182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.196614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.260962 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-be258d67-22cd-4bf5-917e-516b9dd4849c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "PUT /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1060 microversion: 2.1 time: 0.080854 Sep 25 01:34:31.261730 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2812/5634] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:34:31 2022] PUT /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1060 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:31.282610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:31.283310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.291580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.292145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.292674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.293463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.293991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.294485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.359592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:31.360768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.367044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.367792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.368280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.369159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.369636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.370308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.567696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.588143 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31e943fd-3f87-4729-9229-e869dc2be0ac tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1487 microversion: 2.1 time: 0.309681 Sep 25 01:34:31.589045 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2823/5635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:31 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1487 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:31.594363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:31.595612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.606373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.607091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.607727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.608181 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.608616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.609077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.609547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.618034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.619933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.621334 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb389eb7-7a8d-489f-9252-10d06ad1ddb3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.265745 Sep 25 01:34:31.638667 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2813/5636] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:31 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:31.643685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:31.644367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.653631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.654302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.654778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.655616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.656084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.656556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.727404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.739024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.740855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.742317 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-18a9e13e-2a31-4060-9bb9-85ba0e42f184 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.151962 Sep 25 01:34:31.743321 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2824/5637] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:31 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:31.847844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:31.858539 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bb6278c-2d9b-46f9-9b3a-9c6859673eb8 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1487 microversion: 2.1 time: 0.218534 Sep 25 01:34:31.859752 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2814/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:31 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1487 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:31.891295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:31.891814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:31.898439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.899645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.900402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.901148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:31.901636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:31.902489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:31.932721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:34:32.019315 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bf925ed-f885-49fd-a5b2-4c38c5c1c134 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 204 len: 0 microversion: 2.1 time: 0.133710 Sep 25 01:34:32.020228 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2825/5639] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:31 2022] DELETE /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:34:32.033221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:32.033877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:32.042441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:32.043021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:32.043672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:32.044488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:32.045141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:32.045662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:32.190171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.200193 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a282874-602f-4002-905e-95f1b1c2d4a4 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1493 microversion: 2.1 time: 0.175046 Sep 25 01:34:32.200882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2815/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:32 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1493 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:32.656798 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:32.657790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:32.665352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:32.666057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:32.666610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:32.667439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:32.668158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:32.668693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:32.773277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:32.774201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:32.789945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:32.791207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:32.791897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:32.792822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:32.793482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:32.794236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:32.834100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.847526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.850358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.852459 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-250b6184-9b01-40c4-b912-dce3dc5d89b6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.200412 Sep 25 01:34:32.853658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2826/5641] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:32 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:32.877321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.887739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.889585 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:32.890804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d5515c2-3080-4704-b25d-d6a2d573b312 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.121575 Sep 25 01:34:32.891380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2816/5642] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:32 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:33.223958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:33.224865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:33.232019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:33.232504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:33.232942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:33.233656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:33.234113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:33.234539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:33.372486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:33.374909 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:33.381971 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ecd02b7-3b03-4381-93c7-26e276a91664 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1493 microversion: 2.1 time: 0.162006 Sep 25 01:34:33.382759 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2827/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:33 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1493 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:33.880065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:33.880944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:33.889506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:33.889996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:33.890431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:33.891160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:33.891642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:33.892074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:33.916757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:33.918004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:33.925045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:33.925799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:33.926433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:33.927321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:33.927946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:33.928542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:34.031456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.041537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.043208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.044718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-588cfb00-66ca-4faf-8699-98ceb44cea50 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.132370 Sep 25 01:34:34.046475 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2828/5644] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:33 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:34.303486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.315549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.316635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.317930 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3e0e0860-05a5-49e6-a66d-aa3b96af28db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.442637 Sep 25 01:34:34.318856 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2817/5645] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:33 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:34.406817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:34.407442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:34.413913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:34.414740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:34.415382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:34.416289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:34.416917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:34.417776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:34.655504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:34.664022 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c655698b-8e68-42db-9edd-91df0640551c tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1493 microversion: 2.1 time: 0.261057 Sep 25 01:34:34.669334 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2829/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:34 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1493 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:35.016656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4f94b90c-1bd7-48ec-a47e-77c30c03a221 req-0768f92e-e4fb-459d-9b1d-b46720cf3a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8873ab8-5ea6-4a7c-881c-be8fab6a107b", "name": "network-vif-deleted", "tag": "ddd05242-1095-4520-a782-24a8880b624e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:35.029431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4f94b90c-1bd7-48ec-a47e-77c30c03a221 req-0768f92e-e4fb-459d-9b1d-b46720cf3a6b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.030320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4f94b90c-1bd7-48ec-a47e-77c30c03a221 req-0768f92e-e4fb-459d-9b1d-b46720cf3a6b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.030981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4f94b90c-1bd7-48ec-a47e-77c30c03a221 req-0768f92e-e4fb-459d-9b1d-b46720cf3a6b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.047702 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4f94b90c-1bd7-48ec-a47e-77c30c03a221 req-0768f92e-e4fb-459d-9b1d-b46720cf3a6b service nova] Creating event network-vif-deleted:ddd05242-1095-4520-a782-24a8880b624e for instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b on n-h2-master-1 Sep 25 01:34:35.054231 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4f94b90c-1bd7-48ec-a47e-77c30c03a221 req-0768f92e-e4fb-459d-9b1d-b46720cf3a6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041040 Sep 25 01:34:35.061219 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2818/5647] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:35.072951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:35.074823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:35.082690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.083730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.084647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.085640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.086374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.087702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.174642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.189721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.195491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.200269 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3995d42d-89d8-4c9c-ab04-12f7fdbdb27c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.132541 Sep 25 01:34:35.205647 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2830/5648] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:35 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:35.345613 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:35.346680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:35.354053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.354847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.355466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.356356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.357051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.357709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.520285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.523028 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:35.534792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.536549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.537886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce3ce4fd-8da2-4b56-898f-8068012b840f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.197297 Sep 25 01:34:35.538772 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2819/5649] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:35 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:35.696243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:35.697251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:35.703744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.704324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.704843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.705657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.706364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.707009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.747683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:35.748189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:35.748638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:35.749106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lazy-loading 'fault' on Instance uuid c8873ab8-5ea6-4a7c-881c-be8fab6a107b {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:34:35.793284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:35.801849 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00841a30-8fb3-4b3a-bcda-aee8140fc252 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 200 len: 1310 microversion: 2.1 time: 0.109640 Sep 25 01:34:35.802440 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2831/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:35 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:36.236765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:36.238149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:36.246020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.246625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.247129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.248062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.249346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.250056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.317731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:36.327309 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:36.328903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:36.330216 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-937bea96-2103-4447-89e9-81651a49c90a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.097795 Sep 25 01:34:36.330858 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2820/5651] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:36 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:36.564509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:36.565314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:36.572910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.573460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.573943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.574676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.575263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.575700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.715840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:36.724636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:36.726138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:36.727370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba73b168-9f65-455c-a31a-723b2717c97b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.166994 Sep 25 01:34:36.728074 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2832/5652] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:36 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:36.824893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:36.825438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:36.831869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.832363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.832802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.833530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.833989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.834414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.849079 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b HTTP/1.1 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: exception: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'c8873ab8-5ea6-4a7c-881c-be8fab6a107b'} Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.850930 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d9d837c-1b0e-4024-840e-c6e6384daf06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 404 len: 111 microversion: 2.1 time: 0.032264 Sep 25 01:34:36.858414 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2821/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:36 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:36.869092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:36.869795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:36.876329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.876815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.877255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.877984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.878445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.883183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.905695 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b HTTP/1.1 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: exception: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'c8873ab8-5ea6-4a7c-881c-be8fab6a107b'} Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:36.907414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.912393 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.914154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:36.915783 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57f50787-c405-4733-89a5-79683043eb06 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 404 len: 111 microversion: 2.1 time: 0.051918 Sep 25 01:34:36.916837 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2833/5654] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:36 2022] DELETE /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:36.924776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:36.926356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: c8873ab8-5ea6-4a7c-881c-be8fab6a107b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:36.934184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.935212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.936467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.937458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.938121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.938745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.957543 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b HTTP/1.1 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: exception: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'c8873ab8-5ea6-4a7c-881c-be8fab6a107b'} Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.959557 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:36.964171 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:36.964171 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:36.964171 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:36.964171 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:36.964171 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. Sep 25 01:34:36.964171 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:36.967098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance c8873ab8-5ea6-4a7c-881c-be8fab6a107b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:36.968061 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-665f4aa2-4a05-4ce5-95f9-195a0b55f43e tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b" status: 404 len: 111 microversion: 2.1 time: 0.047486 Sep 25 01:34:36.968717 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2822/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:36 2022] GET /compute/v2.1/servers/c8873ab8-5ea6-4a7c-881c-be8fab6a107b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:36.977486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:36.977974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:36.984655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.985154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.985640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:36.986351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:36.986998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:36.987597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.003392 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 HTTP/1.1 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4d01b4f9-113d-4c69-895e-849b972f1720'} Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.005233 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2ec31145-48a1-483b-b3ed-4386d53463b7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 404 len: 111 microversion: 2.1 time: 0.033809 Sep 25 01:34:37.010723 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2834/5656] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:36 2022] DELETE /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:34:37.016097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.016626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 4d01b4f9-113d-4c69-895e-849b972f1720] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.023099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.023590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.024087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.024895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.025352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.025804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.041313 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 HTTP/1.1 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4d01b4f9-113d-4c69-895e-849b972f1720'} Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.043804 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 4d01b4f9-113d-4c69-895e-849b972f1720 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.048416 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79ea6987-0966-414d-a15a-59fd7187b8c9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720" status: 404 len: 111 microversion: 2.1 time: 0.033299 Sep 25 01:34:37.048963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2823/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/4d01b4f9-113d-4c69-895e-849b972f1720 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.063838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.064501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.076320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.076897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.077466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.078298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.078872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.079406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.094739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 HTTP/1.1 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ce86b42c-8d2f-4235-8aee-016350489468'} Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.096599 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.101755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.102979 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ebfd63bc-2381-4d28-8d76-a4db3b06ddd6 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 404 len: 111 microversion: 2.1 time: 0.051514 Sep 25 01:34:37.103906 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2835/5658] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:37 2022] DELETE /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.111723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.112345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: ce86b42c-8d2f-4235-8aee-016350489468] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.119380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.119867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.120306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.120999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.121473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.121901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.136296 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 HTTP/1.1 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: exception: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ce86b42c-8d2f-4235-8aee-016350489468'} Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.138070 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance ce86b42c-8d2f-4235-8aee-016350489468 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d2cb057-5a15-4a88-982f-287bd26f82e7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468" status: 404 len: 111 microversion: 2.1 time: 0.031725 Sep 25 01:34:37.143415 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2824/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/ce86b42c-8d2f-4235-8aee-016350489468 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.150697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.151201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.157904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.158393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.158828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.159517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.161216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.161844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.180434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 HTTP/1.1 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: exception: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'a50cad2e-625b-4636-94df-b6a878b28891'} Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.182463 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.188145 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.189084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.190242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7252b03c-a629-43aa-badb-1d6ee3cb3b68 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 404 len: 111 microversion: 2.1 time: 0.044571 Sep 25 01:34:37.190967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2836/5660] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:37 2022] DELETE /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.200139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.200850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: a50cad2e-625b-4636-94df-b6a878b28891] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.207186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.207750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.208265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.209040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.209611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.210129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.225158 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 HTTP/1.1 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: exception: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'a50cad2e-625b-4636-94df-b6a878b28891'} Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.226846 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance a50cad2e-625b-4636-94df-b6a878b28891 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.232338 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5dcc4af0-f6db-46ca-8187-22d68e87d7c7 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891" status: 404 len: 111 microversion: 2.1 time: 0.033255 Sep 25 01:34:37.233095 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2825/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/a50cad2e-625b-4636-94df-b6a878b28891 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.239088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.239654 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.247781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.248262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.248700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.249430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.249943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.250369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.266073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 HTTP/1.1 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3986a12a-906d-4b76-820e-420e3cc12217'} Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.267644 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.271882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ecea3c44-9b60-42f4-a729-0e1430a3b7e9 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 404 len: 111 microversion: 2.1 time: 0.033921 Sep 25 01:34:37.275280 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2837/5662] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:37 2022] DELETE /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.281349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.282059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 3986a12a-906d-4b76-820e-420e3cc12217] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.289273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.289823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.290268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.291011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.291471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.291905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.308700 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 HTTP/1.1 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3986a12a-906d-4b76-820e-420e3cc12217'} Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.310239 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 3986a12a-906d-4b76-820e-420e3cc12217 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6fb11741-dd1a-439c-977b-74b4848c4065 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217" status: 404 len: 111 microversion: 2.1 time: 0.034641 Sep 25 01:34:37.316440 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2826/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/3986a12a-906d-4b76-820e-420e3cc12217 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.320274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.321629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.328009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.328434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.328865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.329596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.330698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.331134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.346108 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb HTTP/1.1 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: exception: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'd480ad63-604b-422c-93f9-395a34355ebb'} Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.347938 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.354250 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.354901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.355256 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7b68e4ab-f813-4fe7-8844-a2eff4e28c56 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 404 len: 111 microversion: 2.1 time: 0.038843 Sep 25 01:34:37.355832 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2838/5664] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:37 2022] DELETE /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.356671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.357297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.363672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.364100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.364236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.364600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.364705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: d480ad63-604b-422c-93f9-395a34355ebb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.365714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.366375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.366826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.371588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.372087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.372744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.373476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.373947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.374383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.389298 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb HTTP/1.1 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: exception: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'd480ad63-604b-422c-93f9-395a34355ebb'} Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.391247 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance d480ad63-604b-422c-93f9-395a34355ebb could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.396203 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd28e78e-0950-4e8a-abc0-5d4ab1f9d846 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb" status: 404 len: 111 microversion: 2.1 time: 0.032706 Sep 25 01:34:37.401585 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2839/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/d480ad63-604b-422c-93f9-395a34355ebb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.407000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e191b70-ffc8-45ce-8f86-1c3ba6319d22 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.407664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6e191b70-ffc8-45ce-8f86-1c3ba6319d22 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: b53ef24f-52ab-474a-a42d-4891d7e418b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.415876 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6e191b70-ffc8-45ce-8f86-1c3ba6319d22 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e191b70-ffc8-45ce-8f86-1c3ba6319d22 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 HTTP/1.1 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b53ef24f-52ab-474a-a42d-4891d7e418b6'} Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.417533 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6e191b70-ffc8-45ce-8f86-1c3ba6319d22 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6e191b70-ffc8-45ce-8f86-1c3ba6319d22 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6" status: 404 len: 111 microversion: 2.1 time: 0.015924 Sep 25 01:34:37.421955 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2840/5666] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:37 2022] DELETE /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.431259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-441d2219-c962-4bc1-a913-b018fa362039 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.431897 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-441d2219-c962-4bc1-a913-b018fa362039 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: b53ef24f-52ab-474a-a42d-4891d7e418b6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.438798 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-441d2219-c962-4bc1-a913-b018fa362039 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-441d2219-c962-4bc1-a913-b018fa362039 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 HTTP/1.1 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b53ef24f-52ab-474a-a42d-4891d7e418b6'} Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:37.440383 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-441d2219-c962-4bc1-a913-b018fa362039 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance b53ef24f-52ab-474a-a42d-4891d7e418b6 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-441d2219-c962-4bc1-a913-b018fa362039 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6" status: 404 len: 111 microversion: 2.1 time: 0.015286 Sep 25 01:34:37.445603 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2841/5667] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/b53ef24f-52ab-474a-a42d-4891d7e418b6 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:37.451556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.452428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.456225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.459816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.460508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.461147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.462098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.462562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.462999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.466780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.470072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.471545 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5df240a4-5577-4dc6-a750-cefc8b2162f6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.118875 Sep 25 01:34:37.472619 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2827/5668] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:37.504949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:34:37.572734 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:37.593535 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f53b33ac-67ee-466b-8cff-dd8fad185a77 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 204 len: 0 microversion: 2.1 time: 0.145369 Sep 25 01:34:37.594516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2842/5669] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:34:37 2022] DELETE /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:34:37.602566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.603446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.609609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.610104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.610544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.611242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.611696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.612129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.750025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.754858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:37.755728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:37.760707 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a9d5c83-e66b-4232-ab74-32e4d4290f04 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1480 microversion: 2.1 time: 0.162049 Sep 25 01:34:37.762115 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2828/5670] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1480 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:37.764224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.764769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.765462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.767586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:37.768294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:37.768910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:37.921386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.931859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.933543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:37.934943 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ef41f58-67e5-488c-ae42-61f5d0c27885 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.185399 Sep 25 01:34:37.935899 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2843/5671] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:37 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:38.499523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:38.500140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:38.506754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:38.507229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:38.507661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:38.509062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:38.509780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:38.510210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:38.575809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:38.584280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:38.585843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:38.587836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d37f21d5-b4af-4e15-ba3f-c73ebdc58931 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.092476 Sep 25 01:34:38.588409 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2829/5672] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:38 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:38.785285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:38.786161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:38.793331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:38.793892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:38.794338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:38.795040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:38.795498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:38.795930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:38.939077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:38.947811 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e3a6212-6f30-4ee9-93e6-30364d70f941 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1480 microversion: 2.1 time: 0.166423 Sep 25 01:34:38.948384 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2844/5673] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:38 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1480 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:38.966742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:38.967445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:38.974506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:38.975091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:38.975600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:38.976393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:38.976963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:38.977505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:39.123400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:39.146274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:39.147677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:39.148977 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e5987ada-484b-4ead-abe0-4fb81317ce13 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.186180 Sep 25 01:34:39.150027 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2830/5674] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:38 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:39.614831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:39.615758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:39.628656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:39.629171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:39.629693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:39.635091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:39.636226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:39.637227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:39.720780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:39.731594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:39.733918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:39.735290 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b3ac56f-694d-4a13-924e-78b6284d626a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.125673 Sep 25 01:34:39.736122 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2845/5675] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:39 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:39.979575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:39.980703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:40.004501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.005636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.007536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.009763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.010747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.011374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.049536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.050144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.050711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.051395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lazy-loading 'fault' on Instance uuid 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:34:40.114468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10efff521ac401cb6b0cf0f7a0f8826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab8cb461554463fa9ed654c88096888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.136924 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af9ea441-18db-4ca5-af4e-5b5809ae6514 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 200 len: 1283 microversion: 2.1 time: 0.169328 Sep 25 01:34:40.137123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e799d098-a8bc-4c3f-a7c9-cfba43fa74fd req-07e8b6ea-2558-4861-b47c-501388c92e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42", "name": "network-vif-deleted", "tag": "c740b914-498b-4637-b4b6-2cb3c831f824"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:40.153852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e799d098-a8bc-4c3f-a7c9-cfba43fa74fd req-07e8b6ea-2558-4861-b47c-501388c92e60 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.154353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e799d098-a8bc-4c3f-a7c9-cfba43fa74fd req-07e8b6ea-2558-4861-b47c-501388c92e60 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.154774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e799d098-a8bc-4c3f-a7c9-cfba43fa74fd req-07e8b6ea-2558-4861-b47c-501388c92e60 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.157444 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2846/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:39 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 1283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:34:40.172701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e799d098-a8bc-4c3f-a7c9-cfba43fa74fd req-07e8b6ea-2558-4861-b47c-501388c92e60 service nova] Creating event network-vif-deleted:c740b914-498b-4637-b4b6-2cb3c831f824 for instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 on n-h1-master-1 Sep 25 01:34:40.181348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e799d098-a8bc-4c3f-a7c9-cfba43fa74fd req-07e8b6ea-2558-4861-b47c-501388c92e60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289394 Sep 25 01:34:40.182408 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2831/5677] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:40.189662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:40.190521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:40.197967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.198698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.199440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.200357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.200987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.201643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.396788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.423748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.425148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.426465 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1b8f1d1-8dc6-4830-b498-a22d48d533c8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.249784 Sep 25 01:34:40.441742 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2847/5678] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:40 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:40.763663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:40.764636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:40.771899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.772461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.772973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.774382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:40.774913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:40.775713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:40.846861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.859833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.861344 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:40.862685 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ae2be5b-ac47-4395-9419-5dfa14781728 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.104318 Sep 25 01:34:40.863685 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2832/5679] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:40 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:41.164762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:41.165592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] [instance: 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:41.173931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:41.174424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:41.174873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:41.175576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:41.176037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:41.176471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:41.190645 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] HTTP exception thrown: Instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 could not be found. Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Request method failure captured: Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 HTTP/1.1 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL693els3QqLirImQih7UgLPN_c_8UI3RkWEOrdLh-QRQDI3JkrOurJZPeFhbRGeGhiAGEKhkk0eIlXcDUCfocIbX_WCX5XGcBHjymJjO1zWkAvsEXB3EVQQuKIJ8d0EXcyHH89PR27WyfyKz7i6GEPo3tO136yn0Z-Q4Z6NP1xSk23E Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ab8cb461554463fa9ed654c88096888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ab8cb461554463fa9ed654c88096888"}]}] Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersTestJSON-276495109 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 0ab8cb461554463fa9ed654c88096888 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersTestJSON-276495109 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersTestJSON-276495109-project Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: c10efff521ac401cb6b0cf0f7a0f8826 Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersTestJSON-276495109-project Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 could not be found. Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42'} Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 could not be found. Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 could not be found. Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:41.192379 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 could not be found. Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] Returning 404 to user: Instance 0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df026e6e-d304-463d-acd8-132b08f525e0 tempest-ServersTestJSON-276495109 tempest-ServersTestJSON-276495109-project] 10.222.0.16 "GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42" status: 404 len: 111 microversion: 2.1 time: 0.033753 Sep 25 01:34:41.200629 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2848/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:34:41 2022] GET /compute/v2.1/servers/0b0cbdaa-d7ce-4d9e-899a-eb5d0648cc42 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:41.456271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:41.457538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:41.465706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:41.466400 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:41.466836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:41.467928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:41.468565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:41.469304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:41.711134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:41.720266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:41.727957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:41.729234 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-daf81e35-c272-47ec-9bce-8dae4c736036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.276864 Sep 25 01:34:41.730159 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2833/5681] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:41 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:41.892267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:41.893106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:41.902750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:41.905352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:41.905930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:41.909864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:41.910422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:41.910949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:41.950383 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:42.057517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:42.073693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:42.076303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:42.079141 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11457867-e4f9-4a56-8d1b-7f810231de9c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.193313 Sep 25 01:34:42.082021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2849/5682] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:41 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:42.760150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:42.761483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:42.763695 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=93 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:42.788415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:42.789994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:42.790733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:42.794457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:42.794927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:42.795418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:43.010783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:43.026579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:43.029660 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:43.031586 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b278e05c-a5c8-49d6-a49c-0ee6accd69db tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.277987 Sep 25 01:34:43.032919 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2834/5683] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:42 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:43.106089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:43.107726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:43.115344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:43.116213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:43.118887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:43.120121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:43.120863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:43.121571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:43.430276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:43.441699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:43.443812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:43.446171 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c872a59b-6e4b-45e1-aeda-a18765319e7b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.343471 Sep 25 01:34:43.447644 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2850/5684] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:43 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:43.843452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1e5b330b-e55e-4c16-ba21-8bfda088eb2b req-70efeb66-6820-4772-87a6-0257746663ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "name": "network-vif-plugged", "status": "completed", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:43.863584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1e5b330b-e55e-4c16-ba21-8bfda088eb2b req-70efeb66-6820-4772-87a6-0257746663ff service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:43.865964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1e5b330b-e55e-4c16-ba21-8bfda088eb2b req-70efeb66-6820-4772-87a6-0257746663ff service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:43.867863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1e5b330b-e55e-4c16-ba21-8bfda088eb2b req-70efeb66-6820-4772-87a6-0257746663ff service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:43.894786 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1e5b330b-e55e-4c16-ba21-8bfda088eb2b req-70efeb66-6820-4772-87a6-0257746663ff service nova] Creating event network-vif-plugged:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h2-master-1 Sep 25 01:34:43.906499 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1e5b330b-e55e-4c16-ba21-8bfda088eb2b req-70efeb66-6820-4772-87a6-0257746663ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066781 Sep 25 01:34:43.910695 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2835/5685] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:34:44.060429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:44.068321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:44.092292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:44.092998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:44.093696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:44.094589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:44.095230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:44.095863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:44.417708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:44.432273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:44.435471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:44.437179 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-904d22a6-6fe8-4773-bec4-5433b3b46f67 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.383043 Sep 25 01:34:44.451972 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2851/5686] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:44 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:44.479341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:44.482592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:44.507203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:44.507692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:44.508356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:44.509582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:44.510378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:44.511507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:44.620852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:44.635567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:44.637462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:44.639329 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-212d5ac0-f1a9-4edc-bc93-a5b9da2fd77f tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.166546 Sep 25 01:34:44.640312 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2836/5687] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:44 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:45.466087 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:45.467301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:45.485298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:45.485845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:45.486303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:45.487028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:45.487498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:45.487932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:45.665717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:45.667035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:45.682912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:45.694062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:45.694669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:45.696434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:45.697136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:45.698020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:45.909268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:45.916872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:45.927021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:45.927233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:45.928713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:45.930751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:45.932896 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a8242a5f-e769-4656-8930-e1cf34a1faa0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.469367 Sep 25 01:34:45.933140 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c4b5284-c8cd-47b2-95f7-65eeb9f23739 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.271463 Sep 25 01:34:45.934236 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2837/5688] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:45 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:45.935641 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2852/5689] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:45 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:46.960168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:46.961716 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:46.962075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:46.963223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:46.970245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:46.971136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:46.971816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:46.973083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:46.974077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:46.974949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:46.975163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:46.975648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:46.976166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:46.977890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:46.978605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:46.982816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:47.108507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:47.121088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:47.123495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:47.126172 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bcd32252-5341-413f-9040-f6c792b90aa6 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1366 microversion: 2.57 time: 0.171468 Sep 25 01:34:47.137384 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2838/5690] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:46 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:47.225273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:47.236822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:47.241795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:47.245302 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d24eb84b-6624-4eeb-bf89-9c46f66b13ab tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1808 microversion: 2.20 time: 0.286830 Sep 25 01:34:47.246134 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2853/5691] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:46 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:47.952544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cc792dd-41a6-4f72-9234-c843527b97b0 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Action: 'create', calling method: .version_select at 0x7f7bf3fc3ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-186022808", "metadata": {"Type": "work"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cc792dd-41a6-4f72-9234-c843527b97b0 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Request method failure captured: Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 121 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7A3lDwOkG1H4UtDd0MoHZYbL2hxPcz4LeuFbuKVzb8OvVbqUxPNFBMnVdR8B0AhfELgdLvBz9jQ9eDopAnIoFidz-hz_a2KcE-DY3UXzArTEXUCiUSfDKyolyjDyezoeLavQnVvHz2sXZOm7vXOQna1xQ-7XM3Muu7McYfoWX3av6o Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68493330abad42a09d142b7edbad78f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68493330abad42a09d142b7edbad78f5"}]}] Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d9bd70e8cb7c471594ba2553edea1b75 Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-186022808", "metadata": {"Type": "work"}}} Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-186022808', 'metadata': {'Type': 'work'}}}} Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '#$%' Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:34:47.956617 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 01:34:47.962380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.964221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cc792dd-41a6-4f72-9234-c843527b97b0 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:47.965095 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cc792dd-41a6-4f72-9234-c843527b97b0 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.167590 Sep 25 01:34:47.969458 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2839/5692] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:34:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:34:47.974983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6f8fcf9-904c-4f2c-98d1-c613aa8c56ba tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Action: 'create', calling method: .version_select at 0x7f7bebf27af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1577266152", "metadata": {"Type": "work"}}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6f8fcf9-904c-4f2c-98d1-c613aa8c56ba tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Request method failure captured: Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 120 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7A3lDwOkG1H4UtDd0MoHZYbL2hxPcz4LeuFbuKVzb8OvVbqUxPNFBMnVdR8B0AhfELgdLvBz9jQ9eDopAnIoFidz-hz_a2KcE-DY3UXzArTEXUCiUSfDKyolyjDyezoeLavQnVvHz2sXZOm7vXOQna1xQ-7XM3Muu7McYfoWX3av6o Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68493330abad42a09d142b7edbad78f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68493330abad42a09d142b7edbad78f5"}]}] Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d9bd70e8cb7c471594ba2553edea1b75 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1577266152", "metadata": {"Type": "work"}}} Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1577266152', 'metadata': {'Type': 'work'}}}} Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi '0' Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:34:47.979826 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6f8fcf9-904c-4f2c-98d1-c613aa8c56ba tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6f8fcf9-904c-4f2c-98d1-c613aa8c56ba tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010351 Sep 25 01:34:47.987905 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2854/5693] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:34:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:34:47.993741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f086401-5c42-4d6e-bc86-c66c66fd424f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Action: 'create', calling method: .version_select at 0x7f7bebba0ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1320994378", "metadata": {"Type": "work"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f086401-5c42-4d6e-bc86-c66c66fd424f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Request method failure captured: Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 119 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7A3lDwOkG1H4UtDd0MoHZYbL2hxPcz4LeuFbuKVzb8OvVbqUxPNFBMnVdR8B0AhfELgdLvBz9jQ9eDopAnIoFidz-hz_a2KcE-DY3UXzArTEXUCiUSfDKyolyjDyezoeLavQnVvHz2sXZOm7vXOQna1xQ-7XM3Muu7McYfoWX3av6o Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68493330abad42a09d142b7edbad78f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68493330abad42a09d142b7edbad78f5"}]}] Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d9bd70e8cb7c471594ba2553edea1b75 Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1320994378", "metadata": {"Type": "work"}}} Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1320994378', 'metadata': {'Type': 'work'}}}} Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi '' Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:34:47.998246 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f086401-5c42-4d6e-bc86-c66c66fd424f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f086401-5c42-4d6e-bc86-c66c66fd424f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010810 Sep 25 01:34:48.003150 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2840/5694] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 25 01:34:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:34:48.011641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8ca1d8e-0bc2-4588-875c-60561d2fc53f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Calling method '.version_select at 0x7f7bebc089d0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:48.045923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c8ca1d8e-0bc2-4588-875c-60561d2fc53f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] HTTP exception thrown: Volume tempest-invalid-1681627847 could not be found. Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8ca1d8e-0bc2-4588-875c-60561d2fc53f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Request method failure captured: Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1681627847 HTTP/1.1 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7A3lDwOkG1H4UtDd0MoHZYbL2hxPcz4LeuFbuKVzb8OvVbqUxPNFBMnVdR8B0AhfELgdLvBz9jQ9eDopAnIoFidz-hz_a2KcE-DY3UXzArTEXUCiUSfDKyolyjDyezoeLavQnVvHz2sXZOm7vXOQna1xQ-7XM3Muu7McYfoWX3av6o Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68493330abad42a09d142b7edbad78f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68493330abad42a09d142b7edbad78f5"}]}] Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d9bd70e8cb7c471594ba2553edea1b75 Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: exception: Volume tempest-invalid-1681627847 could not be found. Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'tempest-invalid-1681627847'} Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1681627847 could not be found. (HTTP 404) (Request-ID: req-6e57a184-0267-421a-90b4-ac7484ba127a) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:34:48.055818 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1681627847 could not be found. Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1681627847 could not be found. Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1681627847 could not be found. Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8ca1d8e-0bc2-4588-875c-60561d2fc53f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Returning 404 to user: Volume tempest-invalid-1681627847 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8ca1d8e-0bc2-4588-875c-60561d2fc53f tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1681627847" status: 404 len: 99 microversion: 2.1 time: 0.050800 Sep 25 01:34:48.060366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2855/5695] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 01:34:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1681627847 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 25 01:34:48.069076 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eda1cc6c-0b0b-43a9-a5a3-242f4e7d7c90 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003841 Sep 25 01:34:48.069653 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2841/5696] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 25 01:34:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:34:48.078308 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c0e54bdb-2580-474a-abaf-325c5752a984 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003817 Sep 25 01:34:48.078844 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2856/5697] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 25 01:34:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:34:48.090618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79ab559b-abed-4a4b-85d1-f63ca68799b2 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Calling method '.version_select at 0x7f7bf3f36a60>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:48.126646 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-79ab559b-abed-4a4b-85d1-f63ca68799b2 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] HTTP exception thrown: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79ab559b-abed-4a4b-85d1-f63ca68799b2 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Request method failure captured: Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/os-volumes/14e917b7-b1ce-4828-b318-ddc3045b5d52 HTTP/1.1 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7A3lDwOkG1H4UtDd0MoHZYbL2hxPcz4LeuFbuKVzb8OvVbqUxPNFBMnVdR8B0AhfELgdLvBz9jQ9eDopAnIoFidz-hz_a2KcE-DY3UXzArTEXUCiUSfDKyolyjDyezoeLavQnVvHz2sXZOm7vXOQna1xQ-7XM3Muu7McYfoWX3av6o Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68493330abad42a09d142b7edbad78f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68493330abad42a09d142b7edbad78f5"}]}] Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: d9bd70e8cb7c471594ba2553edea1b75 Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: method: Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: exception: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '14e917b7-b1ce-4828-b318-ddc3045b5d52'} Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. (HTTP 404) (Request-ID: req-240a6334-f9b6-4b29-83ca-9439908c32d0) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:34:48.128624 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79ab559b-abed-4a4b-85d1-f63ca68799b2 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Returning 404 to user: Volume 14e917b7-b1ce-4828-b318-ddc3045b5d52 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79ab559b-abed-4a4b-85d1-f63ca68799b2 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/14e917b7-b1ce-4828-b318-ddc3045b5d52" status: 404 len: 109 microversion: 2.1 time: 0.046543 Sep 25 01:34:48.132632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2842/5698] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:34:48 2022] DELETE /compute/v2.1/os-volumes/14e917b7-b1ce-4828-b318-ddc3045b5d52 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:34:48.143707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d82e439-dfc3-4201-9239-361973255a00 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Calling method '.version_select at 0x7f7bf409ad30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:48.162924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:48.163784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:48.171240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:48.172021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:48.172634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:48.176262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-5d82e439-dfc3-4201-9239-361973255a00 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] HTTP exception thrown: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. Sep 25 01:34:48.177869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d82e439-dfc3-4201-9239-361973255a00 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Request method failure captured: Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/os-volumes/3d2d4f7f-89dc-467c-9e71-0531643f31ee HTTP/1.1 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7A3lDwOkG1H4UtDd0MoHZYbL2hxPcz4LeuFbuKVzb8OvVbqUxPNFBMnVdR8B0AhfELgdLvBz9jQ9eDopAnIoFidz-hz_a2KcE-DY3UXzArTEXUCiUSfDKyolyjDyezoeLavQnVvHz2sXZOm7vXOQna1xQ-7XM3Muu7McYfoWX3av6o Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68493330abad42a09d142b7edbad78f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68493330abad42a09d142b7edbad78f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68493330abad42a09d142b7edbad78f5"}]}] Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 68493330abad42a09d142b7edbad78f5 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesNegativeTest-313675677 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d9bd70e8cb7c471594ba2553edea1b75 Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesNegativeTest-313675677-project Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: method: Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: exception: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3d2d4f7f-89dc-467c-9e71-0531643f31ee'} Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. (HTTP 404) (Request-ID: req-d67c5b66-5877-471d-aa25-c1abe319f7db) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:34:48.178329 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d82e439-dfc3-4201-9239-361973255a00 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] Returning 404 to user: Volume 3d2d4f7f-89dc-467c-9e71-0531643f31ee could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:48.182544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d82e439-dfc3-4201-9239-361973255a00 tempest-VolumesNegativeTest-313675677 tempest-VolumesNegativeTest-313675677-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3d2d4f7f-89dc-467c-9e71-0531643f31ee" status: 404 len: 109 microversion: 2.1 time: 0.043123 Sep 25 01:34:48.189242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:48.189242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:48.191227 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2857/5699] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 25 01:34:48 2022] GET /compute/v2.1/os-volumes/3d2d4f7f-89dc-467c-9e71-0531643f31ee => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:34:48.280411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:48.281635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:48.299175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:48.299793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:48.300576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:48.301034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:48.302549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:48.303268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:48.303928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:48.309315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:48.313371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:48.316843 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc5398bc-ae65-4675-9f04-28a2fdbe8e2b tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1372 microversion: 2.57 time: 0.158858 Sep 25 01:34:48.334093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2843/5700] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:48 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:48.508838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:48.518508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:48.520086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:48.521705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3bbdf48f-7cca-42b2-85d1-e8d0feb8fd51 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1795 microversion: 2.20 time: 0.246537 Sep 25 01:34:48.523228 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2858/5701] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:48 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1795 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:49.355005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:49.357339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:49.367861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:49.369241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:49.370791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:49.372043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:49.373649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:49.374348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:49.468491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:49.499928 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:49.501544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:49.503006 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7bd68dda-a56e-4677-b72e-0d7e428e75d4 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1372 microversion: 2.57 time: 0.159898 Sep 25 01:34:49.503876 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2844/5702] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:49 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:50.528618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:50.529950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:50.541051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:50.542059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:50.542514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:50.543235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:50.543704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:50.544138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:50.630176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:50.640832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:50.643151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:50.645145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-932c4f57-3dbd-4ec7-97eb-7df9350bb28c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1372 microversion: 2.57 time: 0.120700 Sep 25 01:34:50.645997 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2859/5703] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:50 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:51.671859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:51.673314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:51.683039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:51.683874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:51.684621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:51.685604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:51.686312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:51.686874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:51.797117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:51.804332 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:34:51.819174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:51.822121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:51.823592 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06bf500e-1bb8-476f-ad7f-e7484a0b108c tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1357 microversion: 2.57 time: 0.156004 Sep 25 01:34:51.824335 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2845/5704] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:51 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:51.855495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:51.856321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:51.866260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:51.867940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:51.868989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:51.870428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:51.871066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:51.871685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:51.909568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:34:52.044968 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ba52b413-f356-4009-bbba-28aa3018c2cd tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 204 len: 0 microversion: 2.57 time: 0.192681 Sep 25 01:34:52.045804 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2860/5705] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:34:51 2022] DELETE /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:34:52.054384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:52.055774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:52.062871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:52.063509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:52.064037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:52.064819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:52.065393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:52.066062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:52.169532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:52.198224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:52.199359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:52.201741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21f61618-fc95-4812-8860-467fb79985a8 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1363 microversion: 2.57 time: 0.151343 Sep 25 01:34:52.203142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2846/5706] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:52 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:34:53.231297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:53.232020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:53.251826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:53.252341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:53.252797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:53.253822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:53.254754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:53.259413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:53.374934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:53.390730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:53.392349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:53.395999 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-085bb4f4-1d97-4621-9686-d089d8e94f2a tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1363 microversion: 2.57 time: 0.171060 Sep 25 01:34:53.397047 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2861/5707] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:53 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:54.424174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:54.424789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:54.432676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:54.433166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:54.433633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:54.434575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:54.435212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:54.435811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:54.492832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:54.493437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:54.493864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:54.494315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lazy-loading 'fault' on Instance uuid dd119901-71dd-430e-a0f2-c8b3ee686183 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:34:54.574288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:54.587504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:54.595153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5ee3a1275ac406bb0f8fbda96d3ad4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143d98d4d3984729b03022104174e152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:34:54.599155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 200 len: 1368 microversion: 2.57 time: 0.179227 Sep 25 01:34:54.601583 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2847/5708] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:54 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:34:55.628438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:34:55.630056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] [instance: dd119901-71dd-430e-a0f2-c8b3ee686183] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:34:55.641992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:55.642747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:55.644146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:55.645582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:34:55.646028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:34:55.646518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:34:55.663088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] HTTP exception thrown: Instance dd119901-71dd-430e-a0f2-c8b3ee686183 could not be found. Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Request method failure captured: Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 HTTP/1.1 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7AT_QNZkEsxpeepEnlxdtGa92iyIdlGh26AR56mE6ekO2x2RgdpcPf6_Kbp-CUzKFbSqHIlJolavrOnoUD-XLd8Nr7NKcssaUHJP6qlSmHYeh0zmg0xav5KDNu1nIANgysHnkLTGaR4eYdzk3XGM8zODfYqR3l0l4SKxSVFbyK0knM Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.57 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 143d98d4d3984729b03022104174e152 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerShowV257Test-316819689 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/143d98d4d3984729b03022104174e152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/143d98d4d3984729b03022104174e152"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/143d98d4d3984729b03022104174e152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_143d98d4d3984729b03022104174e152"}]}] Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerShowV257Test-316819689 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 143d98d4d3984729b03022104174e152 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerShowV257Test-316819689 Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerShowV257Test-316819689-project Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: a5ee3a1275ac406bb0f8fbda96d3ad4b Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerShowV257Test-316819689-project Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: exception: Instance dd119901-71dd-430e-a0f2-c8b3ee686183 could not be found. Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'dd119901-71dd-430e-a0f2-c8b3ee686183'} Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd119901-71dd-430e-a0f2-c8b3ee686183 could not be found. Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd119901-71dd-430e-a0f2-c8b3ee686183 could not be found. Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:34:55.665891 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd119901-71dd-430e-a0f2-c8b3ee686183 could not be found. Sep 25 01:34:55.671811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:34:55.673553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Returning 404 to user: Instance dd119901-71dd-430e-a0f2-c8b3ee686183 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:34:55.676036 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de6be89b-bb2e-4ab2-9114-c9a295ac46c9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183" status: 404 len: 111 microversion: 2.57 time: 0.051204 Sep 25 01:34:55.676830 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2862/5709] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:34:55 2022] GET /compute/v2.1/servers/dd119901-71dd-430e-a0f2-c8b3ee686183 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:35:06.623724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:06.624712 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd37c984-44a1-4b92-804d-5291233379e9 tempest-ServerShowV257Test-316819689 tempest-ServerShowV257Test-316819689-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001335 Sep 25 01:35:06.633084 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2848/5710] 10.222.0.16 () {56 vars in 886 bytes} [Sun Sep 25 01:35:06 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 25 01:35:14.555013 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:14.555760 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:15.038562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a9b80270-0687-4c81-94a4-054e807882db tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Calling method '.version_select at 0x7f7bebf4a8b0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:15.270338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a9b80270-0687-4c81-94a4-054e807882db tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800/defaults" status: 200 len: 371 microversion: 2.1 time: 0.721752 Sep 25 01:35:15.270901 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2863/5711] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:35:14 2022] GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800/defaults => generated 371 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:35:15.284607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ef48c1d-3ff5-49b6-8197-df72b155137b tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Calling method '.version_select at 0x7f7bf3f49c10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:15.318886 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=21 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:15.319797 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=15 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:15.439065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ef48c1d-3ff5-49b6-8197-df72b155137b tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800" status: 200 len: 371 microversion: 2.1 time: 0.153023 Sep 25 01:35:15.449390 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2849/5712] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:35:15 2022] GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800 => generated 371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:35:15.455763 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c59a991-2e19-469a-adb8-31932279de8c tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Calling method '.version_select at 0x7f7bebdaa310>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:15.569122 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c59a991-2e19-469a-adb8-31932279de8c tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800/defaults" status: 200 len: 371 microversion: 2.1 time: 0.118273 Sep 25 01:35:15.582744 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2864/5713] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:35:15 2022] GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800/defaults => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:35:15.589026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24ab7326-5359-47f8-b0b4-1889882a37ef tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Calling method '.version_select at 0x7f7beb9aa160>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:15.712826 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24ab7326-5359-47f8-b0b4-1889882a37ef tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800" status: 200 len: 371 microversion: 2.1 time: 0.127265 Sep 25 01:35:15.716202 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2850/5714] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:35:15 2022] GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800 => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:35:15.729782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69072654-8e8c-4c61-a390-d937a9c9e94b tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] Calling method '.version_select at 0x7f7bebabd940>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:15.860723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69072654-8e8c-4c61-a390-d937a9c9e94b tempest-QuotasTestJSON-949967733 tempest-QuotasTestJSON-949967733-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800?user_id=028c263d522245a88ee3137154ada628" status: 200 len: 371 microversion: 2.1 time: 0.134172 Sep 25 01:35:15.871601 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2865/5715] 10.222.0.16 () {58 vars in 1323 bytes} [Sun Sep 25 01:35:15 2022] GET /compute/v2.1/os-quota-sets/2020d598af4c4da6a7013733d7f4b800?user_id=028c263d522245a88ee3137154ada628 => generated 371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:35:44.679828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:44.681671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:44.696595 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:44.697524 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:44.699126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:44.700263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:44.703022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:44.703644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:44.704174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:44.704612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:44.774983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-83ee752c-4684-42bd-b67c-8b67dbdb2ebf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments/3f048cad-2f06-4571-b9c6-dfb11ace2229" status: 200 len: 194 microversion: 2.20 time: 0.106937 Sep 25 01:35:44.781870 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2851/5716] 10.222.0.16 () {60 vars in 1454 bytes} [Sun Sep 25 01:35:44 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments/3f048cad-2f06-4571-b9c6-dfb11ace2229 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:44.904971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:44.906080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:44.917909 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:44.919001 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:35:44.920916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:44.921452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:44.921933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:44.922723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:44.923190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:44.923626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:45.344889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lazy-loading 'services' on Instance uuid e17b9865-cbb3-447a-9976-a7d72f6066e2 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:35:45.456275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a3bace65-1daf-4187-bb6e-ad4bd8d7595b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments/3f048cad-2f06-4571-b9c6-dfb11ace2229" status: 202 len: 0 microversion: 2.20 time: 0.556157 Sep 25 01:35:45.462273 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2866/5717] 10.222.0.16 () {60 vars in 1457 bytes} [Sun Sep 25 01:35:44 2022] DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments/3f048cad-2f06-4571-b9c6-dfb11ace2229 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:35:45.466863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:45.470166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:45.478441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:45.479227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:45.479903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:45.480844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:45.481530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:45.482165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:45.516007 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee9c66a0-513f-4aaa-981d-df9d28e242e4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053407 Sep 25 01:35:45.516795 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2852/5718] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:45 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:46.530926 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:35:46.531794 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 01:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments (ip 10.222.0.16) !!! Sep 25 01:35:46.543442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:46.552919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:46.575233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:46.576069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:46.576721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:46.577690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:46.578467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:46.579105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:46.653543 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b8eaf98b-8aa5-49a0-b5d3-c9017ebea8dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123956 Sep 25 01:35:46.655263 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2867/5719] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:46 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:47.668013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:47.670443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:47.687576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:47.688087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:47.688536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:47.689276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:47.693825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:47.694629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:47.772411 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2ab0da3-ae58-42f7-ab34-972a4b6e1503 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108047 Sep 25 01:35:47.777397 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2853/5720] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:47 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:48.785267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:48.788023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:48.795619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:48.796368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:48.796912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:48.808381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:48.809159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:48.809853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:48.881889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f92a5676-4427-4179-bfe4-88748be2f9ef tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100108 Sep 25 01:35:48.882960 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2868/5721] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:48 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:49.895426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:49.903240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:49.917816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:49.918313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:49.918760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:49.927419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:49.928606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:49.929076 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:50.000061 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f7f2d02c-bf09-4080-a997-2f495c6916f6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109791 Sep 25 01:35:50.004903 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2854/5722] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:49 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:51.013695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:51.016749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:51.031314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:51.034107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:51.034777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:51.036435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:51.037968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:51.039754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:51.111316 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f3c66f9-27a8-446e-9b07-a15994f7c59b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102221 Sep 25 01:35:51.116082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2869/5723] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:51 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:52.126202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:52.128541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:52.150216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:52.150905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:52.151457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:52.156008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:52.156606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:52.157159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:52.231873 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8211a639-766d-45f4-938f-2297c8607439 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104829 Sep 25 01:35:52.237865 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2855/5724] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:52 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:35:53.245199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:53.248749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:53.265299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:53.265992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:53.266435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:53.267209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:53.267685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:53.268172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:53.302806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6b26ec3c-0ae6-4f08-829f-66206b8fbb3d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063129 Sep 25 01:35:53.303786 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2870/5725] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:35:53 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:35:53.403476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:53.403994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:53.410971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:53.411814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:53.412251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:53.412970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:53.413449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:53.414083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:53.443209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:35:53.565818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-705fe783-76d3-4156-bb8b-a7a64b97b7d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 204 len: 0 microversion: 2.20 time: 0.169515 Sep 25 01:35:53.566576 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2856/5726] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:35:53 2022] DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:35:53.578886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:53.579784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:53.594525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:53.595063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:53.595525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:53.596260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:53.596832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:53.597207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:53.799605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:53.809391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:53.811774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:53.812951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92cbe536-5c46-491a-850d-0c3fce35fa43 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.241319 Sep 25 01:35:53.816298 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2871/5727] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:35:53 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:35:54.850441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:54.851197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:54.860770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:54.861347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:54.861835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:54.866731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:54.867332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:54.868522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:55.658626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:55.681036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:55.683406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:55.686718 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4b9d524-9f8e-4066-adcd-c1a705a5a8c4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1723 microversion: 2.20 time: 0.847140 Sep 25 01:35:55.688632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2857/5728] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:35:54 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1723 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:35:56.718159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:56.720114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:56.743092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:56.744182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:56.744820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:56.745750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:56.746483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:56.747080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:56.965565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:56.986280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:56.988235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:35:56.989589 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-33563189-8f0d-471e-b667-449993b0e90c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 200 len: 1656 microversion: 2.20 time: 0.275625 Sep 25 01:35:56.990702 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2872/5729] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:35:56 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 1656 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:35:57.292919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c787dc03-e080-4df5-8722-d3ed714c5c93 req-db22f2c0-28d0-407e-b55e-c6e044f7c61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b9865-cbb3-447a-9976-a7d72f6066e2", "name": "network-vif-deleted", "tag": "8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:35:57.316751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c787dc03-e080-4df5-8722-d3ed714c5c93 req-db22f2c0-28d0-407e-b55e-c6e044f7c61d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:57.317279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c787dc03-e080-4df5-8722-d3ed714c5c93 req-db22f2c0-28d0-407e-b55e-c6e044f7c61d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:57.320032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c787dc03-e080-4df5-8722-d3ed714c5c93 req-db22f2c0-28d0-407e-b55e-c6e044f7c61d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:57.377936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c787dc03-e080-4df5-8722-d3ed714c5c93 req-db22f2c0-28d0-407e-b55e-c6e044f7c61d service nova] Creating event network-vif-deleted:8ce42629-2b9b-4e47-91c4-3b8dcdc3ee8a for instance e17b9865-cbb3-447a-9976-a7d72f6066e2 on n-h2-master-1 Sep 25 01:35:57.398193 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c787dc03-e080-4df5-8722-d3ed714c5c93 req-db22f2c0-28d0-407e-b55e-c6e044f7c61d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101586 Sep 25 01:35:57.398193 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2858/5730] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:35:58.037643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:58.038862 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:35:58.046374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:58.054188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:58.055220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:58.056165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:35:58.056828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:35:58.057484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:35:58.089009 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] HTTP exception thrown: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Request method failure captured: Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 HTTP/1.1 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6-vPMDhRANLgNSgFuOdHvUU7PBnsfrdvVugkiMj9YdsWAePivIbU_S0OTkcuSOoOorJon1D_zv9OJtfVdi5ktnD9sn7y9VAM55h-JaJgbQqz_vnQze7zd7yMg8T4GFm3lbhYdC27gGnzYVs4JJDS3u5Fy2md5lCZLZYlvaKeqPJbjM Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c215ba6bfd84b8fb7e6b170b813b517"}]}] Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 0f8c7f57af21464684837dcce49d4d0b Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e17b9865-cbb3-447a-9976-a7d72f6066e2'} Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:35:58.093964 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:35:58.100472 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:35:58.103333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Returning 404 to user: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:35:58.106857 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae15d369-c9a5-4d40-af21-baef66cac6e7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 404 len: 111 microversion: 2.20 time: 0.074296 Sep 25 01:35:58.108238 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2873/5731] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:35:58 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:35:58.120139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cda0546e-1151-4d21-8604-889236fa6241 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '.version_select at 0x7f7bebbb8ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:35:58.145248 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cda0546e-1151-4d21-8604-889236fa6241 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431337651" status: 204 len: 0 microversion: 2.20 time: 0.032134 Sep 25 01:35:58.146681 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2859/5732] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:35:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431337651 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:35:59.400913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccb7d6d8-3515-4f48-b261-5b2219c3328c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'create', calling method: .version_select at 0x7f7bf035dee0>, body: {"keypair": {"name": "tempest-keypair-1641039269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2qDsNlHSLmEhPd1ccmjAQ8vdIkOetT+qqDGZIq28THFUX8K4AcZfkWpPKn1VJlp781lvXHmofctPVjXHb6yZx+roTScDUJQXIEOigHMQAFEHWO7OOf4zc6OWm+e6Z6Zg=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:35:59.437179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ccb7d6d8-3515-4f48-b261-5b2219c3328c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:35:59.445903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ccb7d6d8-3515-4f48-b261-5b2219c3328c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for user 0f8c7f57af21464684837dcce49d4d0b and project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:35:59.523859 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccb7d6d8-3515-4f48-b261-5b2219c3328c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.116985 Sep 25 01:35:59.531188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2874/5733] 10.222.0.16 () {62 vars in 1200 bytes} [Sun Sep 25 01:35:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:36:02.892445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-696782593", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30b62076-0bb4-4ded-8d1a-fd267e5b0585"}], "security_groups": [{"name": "tempest-securitygroup--178068835"}], "key_name": "tempest-keypair-1641039269", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:36:03.101055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] validate_networks() for [('30b62076-0bb4-4ded-8d1a-fd267e5b0585', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:36:03.921358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:36:03.922055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:36:03.922378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:36:03.923006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:36:03.923600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:36:03.934880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:03.935536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:03.936142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:03.937626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:03.938376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:03.938882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:03.965024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:36:03.971157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Getting quotas for user 0f8c7f57af21464684837dcce49d4d0b and project 1c215ba6bfd84b8fb7e6b170b813b517. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:36:03.988273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:36:03.990926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:36:04.125829 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-068b59e3-aaea-4f2c-b4e2-16284c37863f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.251572 Sep 25 01:36:04.131284 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2860/5734] 10.222.0.16 () {62 vars in 1188 bytes} [Sun Sep 25 01:36:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 25 01:36:04.144889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-957a3e67-9f82-454f-b8fb-f769f81896a3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:04.146011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-957a3e67-9f82-454f-b8fb-f769f81896a3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:04.230514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-957a3e67-9f82-454f-b8fb-f769f81896a3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:04.249843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-957a3e67-9f82-454f-b8fb-f769f81896a3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:04.252348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-957a3e67-9f82-454f-b8fb-f769f81896a3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:04.255029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-957a3e67-9f82-454f-b8fb-f769f81896a3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1281 microversion: 2.20 time: 0.116159 Sep 25 01:36:04.256412 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2875/5735] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:04 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:36:05.285425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:05.286954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:05.296320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:05.297138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:05.297828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:05.299043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:05.299827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:05.300450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:05.421793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:05.432841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:05.435473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:05.436883 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99532b3d-8b23-40b9-a4be-4c4cc045b88a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1333 microversion: 2.20 time: 0.159696 Sep 25 01:36:05.453443 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2861/5736] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:05 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:06.465803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:06.466422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:06.482268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:06.485166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:06.485738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:06.486531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:06.489316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:06.490557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:06.603593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:06.620388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:06.622574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:06.625463 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fba15dde-2e3b-48be-9396-3a24bf91842c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1339 microversion: 2.20 time: 0.164543 Sep 25 01:36:06.629146 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2876/5737] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:06 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:07.659614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:07.660294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:07.673315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:07.676212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:07.678294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:07.680819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:07.682261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:07.684500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:08.062588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:08.098158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:08.099595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:08.100763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bae80602-e6bd-4d62-bd16-9740b7b595e3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.449913 Sep 25 01:36:08.101344 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2862/5738] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:07 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:08.680747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-2754edae-587a-47c9-87c4-f56afa18697d req-6b59c1ce-92b6-4584-aff2-dcc18451d94b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:36:08.702096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2754edae-587a-47c9-87c4-f56afa18697d req-6b59c1ce-92b6-4584-aff2-dcc18451d94b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:08.702637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2754edae-587a-47c9-87c4-f56afa18697d req-6b59c1ce-92b6-4584-aff2-dcc18451d94b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:08.703070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-2754edae-587a-47c9-87c4-f56afa18697d req-6b59c1ce-92b6-4584-aff2-dcc18451d94b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:08.730729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-2754edae-587a-47c9-87c4-f56afa18697d req-6b59c1ce-92b6-4584-aff2-dcc18451d94b service nova] Creating event network-changed:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h1-master-1 Sep 25 01:36:08.743171 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-2754edae-587a-47c9-87c4-f56afa18697d req-6b59c1ce-92b6-4584-aff2-dcc18451d94b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067187 Sep 25 01:36:08.744915 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2877/5739] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:36:09.128778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:09.129550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:09.141261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:09.141861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:09.145960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:09.146896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:09.147575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:09.148090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:09.735173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:09.745369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:09.752513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:09.755647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f7459f68-a987-4b2a-a7e1-8543b2eee949 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.630888 Sep 25 01:36:09.760079 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2863/5740] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:09 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:10.790429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:10.793020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:10.805860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:10.808220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:10.809042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:10.809968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:10.811904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:10.813206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:11.155999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:11.168662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:11.174411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:11.175602 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1e8b5719-9b0f-41c1-aa04-4811c401ce9d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.391141 Sep 25 01:36:11.176185 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2878/5741] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:10 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:12.213364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:12.215677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:12.241005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:12.241771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:12.243198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:12.245149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:12.245842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:12.247148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:12.624733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:12.639444 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:12.643747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:12.647805 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e924288-97a4-459d-ac58-67331781baca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.445002 Sep 25 01:36:12.649834 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2864/5742] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:12 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:13.683598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:13.684256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:13.711477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:13.712931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:13.715977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:13.717311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:13.718027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:13.718477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:13.950553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:13.966281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:13.968172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:13.971571 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1681467-65da-465a-a74a-c3b95ad2256c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.295962 Sep 25 01:36:13.973202 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2879/5743] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:13 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:15.004666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:15.006106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:15.011094 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:15.012262 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:15.013351 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:15.026212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:15.030355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:15.031139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:15.032194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:15.033980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:15.034870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:15.048255 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:15.278399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:15.291656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:15.294500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:15.310826 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ed86a2e8-d98c-4bb9-a974-c86913a1e3ea tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.309076 Sep 25 01:36:15.330483 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2865/5744] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:14 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:16.348596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:16.350007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:16.361613 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:16.371466 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:16.379463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:16.380243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:16.382184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:16.383417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:16.393155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:16.394042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:16.402306 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:16.642404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:16.651941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:16.653716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:16.664419 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce09e4a7-62df-457c-8519-19385138c416 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.313618 Sep 25 01:36:16.665529 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2880/5745] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:16 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:17.243313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ae53f005-077e-4ccb-85a6-a203abe5dad2 req-362eca0b-eac7-4bab-8520-2e12cd6e3adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "name": "network-vif-plugged", "status": "completed", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:36:17.279665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae53f005-077e-4ccb-85a6-a203abe5dad2 req-362eca0b-eac7-4bab-8520-2e12cd6e3adc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:17.280413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae53f005-077e-4ccb-85a6-a203abe5dad2 req-362eca0b-eac7-4bab-8520-2e12cd6e3adc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:17.280853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae53f005-077e-4ccb-85a6-a203abe5dad2 req-362eca0b-eac7-4bab-8520-2e12cd6e3adc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:17.301776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ae53f005-077e-4ccb-85a6-a203abe5dad2 req-362eca0b-eac7-4bab-8520-2e12cd6e3adc service nova] Creating event network-vif-plugged:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h1-master-1 Sep 25 01:36:17.312182 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ae53f005-077e-4ccb-85a6-a203abe5dad2 req-362eca0b-eac7-4bab-8520-2e12cd6e3adc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087302 Sep 25 01:36:17.314644 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2866/5746] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:36:17.702777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:17.703413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:17.720919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:17.722686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:17.723358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:17.724516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:17.725292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:17.726399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:18.196018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:18.205212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:18.206423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:18.207527 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-982401f8-ff78-43a3-8472-248f30eb408c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1406 microversion: 2.20 time: 0.511822 Sep 25 01:36:18.234161 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2881/5747] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:17 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:19.271421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:19.272149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:19.279707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:19.280486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:19.281287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:19.282595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:19.283451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:19.284194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:19.875422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:19.883765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:19.890096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:36:19.891439 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd3e70c2-6b90-4d68-b482-fa0e7c26a776 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1597 microversion: 2.20 time: 0.632853 Sep 25 01:36:19.893768 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2867/5748] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:36:19 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1597 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:36:19.924955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:19.927852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:19.939488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:19.940021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:19.940473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:19.941256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:19.941774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:19.942384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:20.123927 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1210b257-0323-44d2-a343-de6518d8f7dd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.206351 Sep 25 01:36:20.132528 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2882/5749] 10.222.0.16 () {60 vars in 1316 bytes} [Sun Sep 25 01:36:19 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:36:21.943277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-558ddeb3-4686-458b-b103-134549fa25c7 req-c0524ee9-aec3-4883-b768-d5ea97d293ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:36:21.978532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-558ddeb3-4686-458b-b103-134549fa25c7 req-c0524ee9-aec3-4883-b768-d5ea97d293ef service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:21.983565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-558ddeb3-4686-458b-b103-134549fa25c7 req-c0524ee9-aec3-4883-b768-d5ea97d293ef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:21.984899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-558ddeb3-4686-458b-b103-134549fa25c7 req-c0524ee9-aec3-4883-b768-d5ea97d293ef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:22.040669 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-558ddeb3-4686-458b-b103-134549fa25c7 req-c0524ee9-aec3-4883-b768-d5ea97d293ef service nova] Creating event network-changed:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h1-master-1 Sep 25 01:36:22.051863 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-558ddeb3-4686-458b-b103-134549fa25c7 req-c0524ee9-aec3-4883-b768-d5ea97d293ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413195 Sep 25 01:36:22.059969 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2868/5750] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:36:57.159242 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:57.160001 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=15 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:36:57.166442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:36:57.166952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:36:57.187501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:57.188057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:57.188503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:57.189244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:36:57.189739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:36:57.190179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:36:57.251855 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95612528-29c9-44ad-9855-383b2fc1b3dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/ips" status: 200 len: 150 microversion: 2.20 time: 0.094445 Sep 25 01:36:57.252816 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2883/5751] 10.222.0.16 () {60 vars in 1289 bytes} [Sun Sep 25 01:36:57 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:37:00.688805 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:00.690236 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=15 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:00.695319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:37:00.697354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:00.718460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:00.719393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:00.720019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:00.721187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:00.722127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:00.722825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:00.761633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lazy-loading 'flavor' on Instance uuid 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:37:01.104244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7dea535f-5624-4687-9d7e-ccbc7f809ea8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/action" status: 202 len: 0 microversion: 2.20 time: 0.421245 Sep 25 01:37:01.105572 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2869/5752] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:37:00 2022] POST /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:37:01.114479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:01.115814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:01.136038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:01.136570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:01.137006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:01.137757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:01.145353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:01.145930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:01.375527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:01.401280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:01.410944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:01.423029 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-39125ff2-e0bc-4332-93fc-f5baa0b060ca tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.313245 Sep 25 01:37:01.426486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2884/5753] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:01 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:02.457990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:02.458717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:02.484923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:02.487431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:02.490851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:02.494042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:02.495044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:02.496786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:02.854015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:02.866483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:02.873804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:02.876152 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2fc59156-cdac-4f40-b05a-f09d8042b4d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.423816 Sep 25 01:37:02.882419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2870/5754] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:02 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:03.904742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:03.905372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:03.923176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:03.923719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:03.924173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:03.924907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:03.925372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:03.925889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:04.357956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:04.371407 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:04.379689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:04.383254 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f082fe57-1ef7-43b6-bce7-9ae7e1e06191 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.482712 Sep 25 01:37:04.399563 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2885/5755] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:03 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:05.416872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:05.417624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:05.438370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:05.439142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:05.439744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:05.444023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:05.444838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:05.445458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:05.740302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:05.750504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:05.760529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:05.761911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e6405025-5702-44c3-8d4c-04162ffbd32f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.349072 Sep 25 01:37:05.777440 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2871/5756] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:05 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:06.792516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:06.793128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:06.825242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:06.826101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:06.826758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:06.828435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:06.829515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:06.830154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:07.193860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:07.208531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:07.210076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:07.211286 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9ccd65ec-381e-4597-9ce7-3d54917b18ae tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.422806 Sep 25 01:37:07.224400 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2886/5757] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:06 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:08.240080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:08.240788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:08.255107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:08.258188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:08.261239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:08.264628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:08.267043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:08.267915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:08.690887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:08.702750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:08.704610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:08.706613 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21f2789e-ef8d-4722-a3d7-68e587956225 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.472458 Sep 25 01:37:08.709143 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2872/5758] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:08 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:09.738786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:09.740197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:09.749987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:09.750760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:09.751374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:09.752284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:09.752927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:09.753551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:10.240359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:10.257050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:10.267874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:10.272753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c4d811b-eb86-4329-8af4-badde433d60d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.539788 Sep 25 01:37:10.275228 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2887/5759] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:09 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:11.304446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:11.305659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:11.314023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:11.315354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:11.316267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:11.317874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:11.319658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:11.321075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:11.610684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:11.621134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:11.622688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:11.623890 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cf20d4a-6134-49fa-a2be-9993268606dc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.329564 Sep 25 01:37:11.625469 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2873/5760] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:11 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:12.652329 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:12.653852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:12.665434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:12.666235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:12.667584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:12.668571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:12.669964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:12.670645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:13.017204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:13.033630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:13.033630 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:13.033630 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dae7ee05-d816-4034-bdd8-93b77564152f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1742 microversion: 2.20 time: 0.386048 Sep 25 01:37:13.053793 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2888/5761] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:12 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1742 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:14.064747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:14.065366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:14.077858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:14.083475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:14.084129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:14.095122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:14.095662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:14.096118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:14.891615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:14.904682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:14.922938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:14.924452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67810763-7190-4e58-8d88-62904be8bff8 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.864279 Sep 25 01:37:14.925654 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2874/5762] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:14 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:15.957929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:15.958645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:15.976793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:15.981668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:15.982155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:15.982914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:15.983385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:15.983833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:16.384459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:16.398505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:16.419347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:16.422814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e6aece23-3dae-478f-b6d4-d19d02dbfe45 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.470633 Sep 25 01:37:16.447615 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2889/5763] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:15 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:17.419022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-04e18a93-6930-43b8-acd4-9891b7899f50 req-9116786b-b1c6-4e3d-89a7-5fb257465f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "name": "network-vif-plugged", "status": "completed", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:37:17.450406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-04e18a93-6930-43b8-acd4-9891b7899f50 req-9116786b-b1c6-4e3d-89a7-5fb257465f0b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:17.450906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-04e18a93-6930-43b8-acd4-9891b7899f50 req-9116786b-b1c6-4e3d-89a7-5fb257465f0b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:17.451264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:17.451741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-04e18a93-6930-43b8-acd4-9891b7899f50 req-9116786b-b1c6-4e3d-89a7-5fb257465f0b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:17.451891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:17.466851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:17.467406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:17.468570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:17.471778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:17.472923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:17.474880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:17.510460 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-04e18a93-6930-43b8-acd4-9891b7899f50 req-9116786b-b1c6-4e3d-89a7-5fb257465f0b service nova] Creating event network-vif-plugged:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h1-master-1 Sep 25 01:37:17.541808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-04e18a93-6930-43b8-acd4-9891b7899f50 req-9116786b-b1c6-4e3d-89a7-5fb257465f0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.799711 Sep 25 01:37:17.543079 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2875/5764] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:37:18.087266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:18.104865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:18.106988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:18.122139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-08b4c602-3cf7-4187-b85a-4e430345011a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.674741 Sep 25 01:37:18.132524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2890/5765] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:17 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:37:19.157288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:19.158605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:19.173987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:19.174958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:19.177830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:19.178888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:19.180554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:19.183320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:19.601263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:19.616670 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:19.619400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:19.623669 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40251493-6c5d-45f3-acf4-845c36902d24 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.471005 Sep 25 01:37:19.626339 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2876/5766] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:19 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:20.671935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:20.673156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:20.686527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:20.694561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:20.695371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:20.696297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:20.697964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:20.698590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:21.150854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:21.164424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:21.169811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:21.175482 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-228ad9b8-8b43-4a98-95f9-0280382422d4 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.508125 Sep 25 01:37:21.205604 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2891/5767] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:20 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:22.219441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:22.220705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:22.241608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:22.245166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:22.245657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:22.246416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:22.246872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:22.247298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:22.779086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:22.792208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:22.794715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:22.796254 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ca0a0c2a-a44e-4116-b190-0dd65b8a149e tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.585162 Sep 25 01:37:22.821253 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2877/5768] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:22 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:23.841651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:23.842857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:23.850270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:23.864940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:23.872437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:23.873450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:23.874130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:23.874714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:24.452147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:24.470696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:24.473521 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:24.482338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-04bbded6-2e48-40e1-a013-7a5f1c5f3af3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.644827 Sep 25 01:37:24.490328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2892/5769] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:23 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:25.512867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:25.513599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:25.553973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:25.560165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:25.561013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:25.561743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:25.566874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:25.568767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:26.082222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:26.093453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:26.094959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:26.100466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d974de85-86c1-45f6-9cc1-a9cca39b6238 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.591662 Sep 25 01:37:26.102813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2878/5770] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:25 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:27.140165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:27.142771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:27.153317 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:37:27.155703 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 01:37:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 (ip 10.222.0.16) !!! Sep 25 01:37:27.171303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:27.172074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:27.172685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:27.173609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:27.174225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:27.174810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:27.496249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:27.499765 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=63 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:27.517506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:27.519600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:27.520853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec4b9488-2757-49dc-a2cd-c6dab2c36b2f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.394490 Sep 25 01:37:27.542080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2893/5771] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:27 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:28.548307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:28.548932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:28.561653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:28.576704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:28.577165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:28.587698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:28.591008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:28.593526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:29.020649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:29.031709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:29.036684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:29.041707 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f1bd9f62-50f1-4a18-b17e-dff64409cb64 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.497446 Sep 25 01:37:29.042838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2879/5772] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:28 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:37:30.069119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:30.069886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:30.087294 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=23 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:30.099022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:30.102094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:30.104169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:30.110663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:30.115527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:30.120674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:30.577750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:30.591695 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:30.593223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:30.597353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85474999-2f55-4170-9658-e66ce8e4c78f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.533129 Sep 25 01:37:30.598387 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2894/5773] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:30 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:31.625959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:31.626762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:31.641222 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=23 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:31.658128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:31.658364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:31.667913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:31.668795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:31.672289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:31.672794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:31.688312 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:31.999544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:32.010631 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:32.015317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:32.019278 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a1fc531-bbcb-4fe9-a798-5f5f6b7a3d7f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.398005 Sep 25 01:37:32.022117 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2880/5774] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:31 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:33.567277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:33.573168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:33.589096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:33.594191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:33.595455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:33.599355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:33.600120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:33.600725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:33.991059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:34.004840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:34.008163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:34.010369 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f20e72f-db26-424c-ac85-ef24558554d3 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.963319 Sep 25 01:37:34.014592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2895/5775] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:33 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:35.039427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:35.040043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:35.050786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:35.051290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:35.051730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:35.052439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:35.052896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:35.053324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:35.871814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:35.881240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:35.898618 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:35.906094 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4223b69f-82f7-41f9-b802-3e02d888c4d6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.870505 Sep 25 01:37:35.910608 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2881/5776] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:35 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:36.943662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:36.944298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:36.961479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:36.965295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:36.965836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:36.966617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:36.967105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:36.967549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:37.279060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:37.292659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:37.295116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:37.297556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91e4c16f-906f-4c26-baac-29753e0d6232 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.358148 Sep 25 01:37:37.298639 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2896/5777] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:36 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:38.328964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:38.329622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:38.348828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:38.349886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:38.350999 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:38.351768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:38.353675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:38.358250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:38.624122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:38.648071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:38.650969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:38.656073 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f89f5dda-d335-4c78-8718-2160245d5208 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.331002 Sep 25 01:37:38.658026 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2882/5778] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:38 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:39.704475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:39.705025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:39.721037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:39.722877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:39.726222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:39.727569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:39.728348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:39.728925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:40.537992 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:40.596414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:40.623800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:40.631567 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-569c1079-ce47-4ecd-bdaa-d2a0819edddf tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.934209 Sep 25 01:37:40.637047 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2897/5779] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:39 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:41.665275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:41.665827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:41.681255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:41.689603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:41.690519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:41.692929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:41.695348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:41.697067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:42.195965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:42.205093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:42.208104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:42.210018 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-97826968-69d7-428f-8ae6-6a0745148ecc tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.548728 Sep 25 01:37:42.224272 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2883/5780] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:41 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:43.241932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:43.254805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:43.276924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:43.277475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:43.277863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:43.278860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:43.279305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:43.280183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:43.524436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:43.533615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:43.535483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:43.536704 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a0190bc-7953-45cd-96b9-253a48c295bb tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1737 microversion: 2.20 time: 0.300394 Sep 25 01:37:43.539072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2898/5781] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:43 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:44.571825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:44.573054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:44.591185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:44.592195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:44.592798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:44.594068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:44.594693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:44.595275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:45.541837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:45.552808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:45.563113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:45.564657 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c119189b-e44e-4b0b-b51c-eaf37f47f449 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1719 microversion: 2.20 time: 0.997512 Sep 25 01:37:45.598675 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2884/5782] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:44 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1719 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:46.615400 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:46.616036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:46.638574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:46.639322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:46.639919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:46.640792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:46.641715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:46.642302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:47.026000 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:47.040582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:47.042384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:47.053862 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-78e7ffb3-468d-47c0-9487-60e179997f00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1719 microversion: 2.20 time: 0.435534 Sep 25 01:37:47.069608 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2899/5783] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:46 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1719 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:48.092871 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:48.093614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:48.122443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:48.126078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:48.128660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:48.130970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:48.144404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:48.147607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:48.482450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:48.511029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:48.515761 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:48.517644 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59d0ebae-16d3-4821-88d5-2ec4ea92cac6 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1662 microversion: 2.20 time: 0.430100 Sep 25 01:37:48.530214 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2885/5784] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:48 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1662 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:48.564819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ad8dd40-95b6-42b8-8400-927b3f0d0863"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:37:48.585077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:48.602982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:48.604139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:48.604746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:48.606872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:48.608378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:48.610004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:48.730495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-49d5c931-9d45-4cb5-9acc-b3dd12da544c req-095f1696-44e5-4812-a94b-da4a08d64578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "name": "network-vif-unplugged", "status": "completed", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:37:48.747380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-49d5c931-9d45-4cb5-9acc-b3dd12da544c req-095f1696-44e5-4812-a94b-da4a08d64578 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:48.750359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-49d5c931-9d45-4cb5-9acc-b3dd12da544c req-095f1696-44e5-4812-a94b-da4a08d64578 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:48.751493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-49d5c931-9d45-4cb5-9acc-b3dd12da544c req-095f1696-44e5-4812-a94b-da4a08d64578 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:48.788909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.compute.server_external_events [req-49d5c931-9d45-4cb5-9acc-b3dd12da544c req-095f1696-44e5-4812-a94b-da4a08d64578 service nova] Unable to find a host for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2. Dropping event network-vif-unplugged {{(pid=122384) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 01:37:48.791818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-49d5c931-9d45-4cb5-9acc-b3dd12da544c req-095f1696-44e5-4812-a94b-da4a08d64578 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063916 Sep 25 01:37:48.792553 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2886/5785] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 25 01:37:49.198750 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63c81513-cb6a-4262-9652-1538e59d50af tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.646133 Sep 25 01:37:49.200068 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2900/5786] 10.222.0.16 () {62 vars in 1364 bytes} [Sun Sep 25 01:37:48 2022] POST /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-volume_attachments => generated 188 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:37:49.459593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:49.460145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:49.472052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:49.472565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:49.473017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:49.473760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:49.480177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:49.487248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:49.940825 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84c654a4-bed9-4135-a171-9707541296b1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-volume_attachments/3ad8dd40-95b6-42b8-8400-927b3f0d0863" status: 202 len: 0 microversion: 2.20 time: 0.485803 Sep 25 01:37:49.941850 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2887/5787] 10.222.0.16 () {60 vars in 1457 bytes} [Sun Sep 25 01:37:49 2022] DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-volume_attachments/3ad8dd40-95b6-42b8-8400-927b3f0d0863 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:37:50.054096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:37:50.057283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:50.071686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:50.074516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:50.075263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:50.076229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:50.076961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:50.078071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:50.299675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122385) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:37:50.427994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f0503dd-0fdc-42db-b85e-1a154a12c73b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "POST /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/action" status: 202 len: 0 microversion: 2.20 time: 0.386140 Sep 25 01:37:50.431350 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2901/5788] 10.222.0.16 () {62 vars in 1319 bytes} [Sun Sep 25 01:37:50 2022] POST /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:37:50.438682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:50.439608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:50.447034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:50.448026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:50.449036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:50.450020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:50.450912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:50.451499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:50.768043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:50.779124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:50.790118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:50.794532 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d6ee484-5520-43bf-b55d-a7074703151b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1670 microversion: 2.20 time: 0.360598 Sep 25 01:37:50.795771 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2888/5789] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:50 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1670 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:51.825032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:51.827156 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:51.838057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:51.839830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:51.841351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:51.842575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:51.844901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:51.845641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:52.150927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:52.171662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:52.173923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:52.176732 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3ead118-28d1-499f-a6e0-e77d4280403c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1670 microversion: 2.20 time: 0.356548 Sep 25 01:37:52.179050 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2902/5790] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:51 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1670 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:53.204557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:53.207824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:53.226525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:53.228554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:53.231607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:53.235430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:53.236749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:53.238097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:53.644273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:53.657071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:53.659828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:53.661953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c473e2e-f607-4479-90ad-475043e6936f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.461496 Sep 25 01:37:53.662518 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2889/5791] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:53 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:54.343126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b18e5dfe-0b70-4f93-9e7f-602bed16442d req-54955e0f-12c0-40a3-90f2-06bd61d851a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:37:54.364401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b18e5dfe-0b70-4f93-9e7f-602bed16442d req-54955e0f-12c0-40a3-90f2-06bd61d851a1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:54.364896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b18e5dfe-0b70-4f93-9e7f-602bed16442d req-54955e0f-12c0-40a3-90f2-06bd61d851a1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:54.365396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b18e5dfe-0b70-4f93-9e7f-602bed16442d req-54955e0f-12c0-40a3-90f2-06bd61d851a1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:54.390963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b18e5dfe-0b70-4f93-9e7f-602bed16442d req-54955e0f-12c0-40a3-90f2-06bd61d851a1 service nova] Creating event network-changed:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h2-master-1 Sep 25 01:37:54.407135 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b18e5dfe-0b70-4f93-9e7f-602bed16442d req-54955e0f-12c0-40a3-90f2-06bd61d851a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066456 Sep 25 01:37:54.411172 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2903/5792] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:37:54.688150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:54.690174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:54.699771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:54.700474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:54.701086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:54.702222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:54.702838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:54.704008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:55.030381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:55.051274 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:55.062991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:55.064944 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24a26824-d495-4ff7-8371-1f7bf9bbe656 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.381222 Sep 25 01:37:55.077781 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2890/5793] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:54 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:56.092898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:56.095112 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:56.109271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:56.111811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:56.113568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:56.114735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:56.116479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:56.119200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:56.801494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:56.812461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:56.819351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:56.821202 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-456a5eb0-ac8b-43f1-bd40-2a62308ea010 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.733543 Sep 25 01:37:56.822847 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2904/5794] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:56 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:57.855898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:57.857760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:57.878339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:57.882233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:57.887995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:57.890263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:57.891600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:57.893957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:58.376276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:58.409846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:58.429460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:58.445870 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-66fe5839-b87c-46bf-a0b2-3c9adeb443aa tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.597737 Sep 25 01:37:58.451151 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2891/5795] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:57 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:37:59.475337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:37:59.476772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:37:59.488451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:59.493294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:59.494035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:59.495005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:37:59.495669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:37:59.496483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:37:59.499922 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:37:59.901325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:59.916435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:59.918402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:37:59.919719 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5968f0d-a3a5-4f37-b705-3562fed1b912 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.448524 Sep 25 01:37:59.935730 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2905/5796] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:37:59 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:00.950327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:00.951125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:00.964283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:00.968521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:00.969077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:00.969914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:00.970590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:00.972825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:01.341926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:01.370198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:01.375346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:01.379378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a9453fb-1d93-41b4-b2f1-a45133478be0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.433169 Sep 25 01:38:01.380566 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2892/5797] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:00 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:02.409298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:02.410030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:02.420786 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:02.442885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:02.460914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:02.463668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:02.466493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:02.467033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:02.468973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:02.778544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:02.795038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:02.800316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:02.810591 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3bd3ef17-8c56-45c3-a0dc-fc2a7c2b8568 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.406040 Sep 25 01:38:02.812049 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2906/5798] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:02 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:03.843440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:03.844544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:03.864458 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=26 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:03.869423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:03.870159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:03.871020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:03.873891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:03.879463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:03.880122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:03.883925 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:04.430887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:04.450467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:04.452169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:04.456351 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f59af4b6-5445-4a6c-b276-3b0edbf93576 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.617949 Sep 25 01:38:04.464729 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2893/5799] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:03 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:05.483565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:05.484213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:05.508167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:05.508662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:05.509110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:05.509856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:05.510446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:05.510820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:05.950035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:06.054854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:06.071027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:06.080545 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-921bcb87-56a2-4b02-a165-508d1e7d614b tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.595978 Sep 25 01:38:06.086040 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2907/5800] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:05 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:07.122063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:07.122785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:07.143655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:07.146832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:07.148216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:07.152887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:07.155078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:07.156398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:07.561582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:07.573481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:07.579509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:07.582806 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6892f1d5-b021-4b83-a9af-1101656231bd tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.466452 Sep 25 01:38:07.587590 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2894/5801] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:07 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:08.630610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:08.633813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:08.649534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:08.651254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:08.651254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:08.651254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:08.651557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:08.652261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:08.866055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:08.887722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:08.889195 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:08.890434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f86b6553-27f6-4e6d-8a2e-1b576cbe95e0 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.279047 Sep 25 01:38:08.891374 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2908/5802] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:08 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:09.920648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:09.922078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:09.934511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:09.939357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:09.940958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:09.942536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:09.943061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:09.943990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:10.147211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:10.156415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:10.158961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:10.160438 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a9a9456b-3c82-4592-98fd-c9aa1487eb29 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.246012 Sep 25 01:38:10.161579 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2895/5803] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:09 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:38:11.185781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:11.189950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:11.200301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:11.200672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:11.201113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:11.204201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:11.207544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:11.208171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:11.461007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:11.472788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:11.474883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:11.475738 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-312de3aa-c133-4d9d-9f74-21d16a199259 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.294176 Sep 25 01:38:11.476363 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2909/5804] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:11 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:12.504734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:12.506176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:12.514753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:12.515709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:12.516327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:12.517595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:12.518793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:12.519545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:12.721953 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:12.733109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:12.735303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:12.737267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b5ee8ba8-6e36-4d80-a211-89de2b47c7f5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.238987 Sep 25 01:38:12.738679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2896/5805] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:12 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:13.764586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:13.765113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:13.777793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:13.778281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:13.778716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:13.779685 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:13.780231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:13.780660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:13.973365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:13.983179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:13.984664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:13.985942 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-58563ab7-e59a-4094-9cd5-4907701edf00 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.225660 Sep 25 01:38:13.987523 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2910/5806] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:13 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:15.013329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:15.015170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:15.033965 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:15.036536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:15.039774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:15.041820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:15.045856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:15.046745 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:15.312677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:15.325742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:15.327571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:15.329281 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ccb38e0-00d4-4021-a0c6-fb61c7ab207f tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.320670 Sep 25 01:38:15.348163 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2897/5807] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:15 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:16.360028 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:16.361259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:16.369071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:16.369958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:16.370595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:16.371511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:16.372135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:16.372728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:16.579102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9e9e3021-6312-4bfe-ae84-de98dfe653ad req-07b75c56-7dfb-4477-9fd7-c71d399b1ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "name": "network-vif-plugged", "status": "completed", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:38:16.610136 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9e9e3021-6312-4bfe-ae84-de98dfe653ad req-07b75c56-7dfb-4477-9fd7-c71d399b1ddd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:16.610679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9e9e3021-6312-4bfe-ae84-de98dfe653ad req-07b75c56-7dfb-4477-9fd7-c71d399b1ddd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:16.615306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9e9e3021-6312-4bfe-ae84-de98dfe653ad req-07b75c56-7dfb-4477-9fd7-c71d399b1ddd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:16.636661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9e9e3021-6312-4bfe-ae84-de98dfe653ad req-07b75c56-7dfb-4477-9fd7-c71d399b1ddd service nova] Creating event network-vif-plugged:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h2-master-1 Sep 25 01:38:16.640957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:16.650508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:16.651980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:16.656430 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c13e34d-6985-49e2-80f7-8d2b5fc95036 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 0.298076 Sep 25 01:38:16.657470 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2911/5808] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:16 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:16.662091 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9e9e3021-6312-4bfe-ae84-de98dfe653ad req-07b75c56-7dfb-4477-9fd7-c71d399b1ddd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078029 Sep 25 01:38:16.668053 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2898/5809] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:38:17.684577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:17.685197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:17.696999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:17.698377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:17.706692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:17.707996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:17.708634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:17.709224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:18.836369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:18.855057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:18.856726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:18.860557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc35e1f0-308a-4050-a6ff-6c75f0d49c23 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1728 microversion: 2.20 time: 1.179935 Sep 25 01:38:18.861693 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2912/5810] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:17 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1728 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:19.905246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:19.906012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:19.926192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:19.926311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:19.926707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:19.927431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:19.927895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:19.928329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:20.215627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:20.225785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:20.230186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:20.232654 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96a8bd0c-0211-41c1-a778-32f483f03cd5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1715 microversion: 2.20 time: 0.332877 Sep 25 01:38:20.237202 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2899/5811] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:38:19 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1715 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:38:44.205708 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=13 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:44.206624 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=47 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:44.592703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2084336248", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "9fd093ce-626a-4df4-b6b9-16b60db00a19"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:38:44.732097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] validate_networks() for [('9fd093ce-626a-4df4-b6b9-16b60db00a19', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:38:45.609773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:38:45.610344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:38:45.611160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:38:45.612525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:38:45.613682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:38:45.634223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:45.635078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:45.640019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:45.640917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:45.641431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:45.651611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:45.709778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Getting quotas for project a01bd93d7ca24ae39ea8a94730ffa2cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:38:45.720969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Getting quotas for user 4e396b6c77264a30ab00cf9879a93fe4 and project a01bd93d7ca24ae39ea8a94730ffa2cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:38:45.751956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:38:45.754321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:38:45.859846 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1e51d45-c8b4-43ce-be03-0a874786da62 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659496 Sep 25 01:38:45.877774 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2913/5812] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:38:45.883415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-32af84ea-54ba-477d-b796-301b10a72dbd tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:45.885153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-32af84ea-54ba-477d-b796-301b10a72dbd tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:45.889380 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=13 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:45.892838 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=37 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:45.980927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32af84ea-54ba-477d-b796-301b10a72dbd tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:45.990845 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-32af84ea-54ba-477d-b796-301b10a72dbd tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1214 microversion: 2.1 time: 0.111200 Sep 25 01:38:45.992294 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2900/5813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:45 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:47.021203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-018db511-f4d7-4b14-b5eb-1dd41a34bd13 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:47.021863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-018db511-f4d7-4b14-b5eb-1dd41a34bd13 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:47.145093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-018db511-f4d7-4b14-b5eb-1dd41a34bd13 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:47.156370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-018db511-f4d7-4b14-b5eb-1dd41a34bd13 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1214 microversion: 2.1 time: 0.136561 Sep 25 01:38:47.158398 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2914/5814] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:47 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:48.181196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:48.182683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:48.190803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:48.192228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:48.192824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:48.193739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:48.194372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:48.194977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:48.304416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:48.320109 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21b1665d-42c4-4484-8d5b-501ac29eafdb tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1218 microversion: 2.1 time: 0.143424 Sep 25 01:38:48.321977 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2901/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:48 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:49.347052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:49.348747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:49.364869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:49.365363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:49.367495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:49.368259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:49.368729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:49.369162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:49.471447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:49.481151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c70630b2-84c0-44d1-9fef-3b5d72a3d55f tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1266 microversion: 2.1 time: 0.140944 Sep 25 01:38:49.513202 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2915/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:49 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:50.508507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:50.509132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:50.522306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:50.531762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:50.537191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:50.538720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:50.542026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:50.542785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:50.665127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:50.675291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-53f8ede3-9721-4c03-9517-d718fbc77861 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1272 microversion: 2.1 time: 0.169326 Sep 25 01:38:50.676416 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2902/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:50 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:51.708777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:51.710628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:51.721170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:51.721803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:51.722736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:51.723519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:51.724085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:51.724754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:51.911583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:51.926675 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6faccc8a-c66a-48d4-a2e2-c325c26917ff tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.224524 Sep 25 01:38:51.929646 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2916/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:51 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:52.673689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-88cc0e5a-778e-47c2-98f6-d07fb72348c3 req-d39efdd3-6463-49fd-a6fc-a839751e97c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9244310a-e287-4d22-8bfb-16b462bbbc11", "tag": "01a89a12-9d4b-4de1-801e-dc1c0ff8de20"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:38:52.739204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-88cc0e5a-778e-47c2-98f6-d07fb72348c3 req-d39efdd3-6463-49fd-a6fc-a839751e97c6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:52.739718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-88cc0e5a-778e-47c2-98f6-d07fb72348c3 req-d39efdd3-6463-49fd-a6fc-a839751e97c6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:52.740163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-88cc0e5a-778e-47c2-98f6-d07fb72348c3 req-d39efdd3-6463-49fd-a6fc-a839751e97c6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:52.792694 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-88cc0e5a-778e-47c2-98f6-d07fb72348c3 req-d39efdd3-6463-49fd-a6fc-a839751e97c6 service nova] Creating event network-changed:01a89a12-9d4b-4de1-801e-dc1c0ff8de20 for instance 9244310a-e287-4d22-8bfb-16b462bbbc11 on n-h1-master-1 Sep 25 01:38:52.813165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-88cc0e5a-778e-47c2-98f6-d07fb72348c3 req-d39efdd3-6463-49fd-a6fc-a839751e97c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151414 Sep 25 01:38:52.814986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2903/5819] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:38:52.952884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:52.953548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:52.975958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:52.976751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:52.977170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:52.977915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:52.978547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:52.985078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:53.352473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:53.365544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-702853fe-a02e-4994-b1ce-f464d9171d21 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.417409 Sep 25 01:38:53.370162 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2917/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:52 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:54.392886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:54.393603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:54.413000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:54.414460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:54.414900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:54.415614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:54.416079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:54.416510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:54.683128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:54.694744 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf541123-c0f1-495a-9479-4e4080e9081b tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.305917 Sep 25 01:38:54.712424 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2904/5821] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:54 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:55.719253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:55.721592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:55.729796 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:55.732614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:55.733128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:55.733599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:55.734334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:55.734792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:55.736508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:55.978514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:55.989989 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fbf19420-4f3e-4113-9dce-2b4aac4188f7 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.274852 Sep 25 01:38:56.006436 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2918/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:55 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:57.014668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:57.016508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:57.024730 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:57.026298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:57.027565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:57.028010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:57.029172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:57.030073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:57.030665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:57.206510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:57.215115 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e30f7d53-3d90-428f-b122-25f360d090e2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.205334 Sep 25 01:38:57.215709 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2905/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:57 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:58.239487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:58.240538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:58.256291 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:38:58.259039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:58.259795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:58.261723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:58.262669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:58.264677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:58.265990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:58.459707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:58.468365 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-de3f2aa5-dae8-4a7b-94d9-a6d60a6feb12 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.233673 Sep 25 01:38:58.468949 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2919/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:58 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:38:58.978453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a934a0d0-54f8-4d29-8f28-7484a0646c73 req-e223825c-2767-473d-8c4d-c2a506077599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9244310a-e287-4d22-8bfb-16b462bbbc11", "name": "network-vif-plugged", "status": "completed", "tag": "01a89a12-9d4b-4de1-801e-dc1c0ff8de20"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:38:58.993730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a934a0d0-54f8-4d29-8f28-7484a0646c73 req-e223825c-2767-473d-8c4d-c2a506077599 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:58.994520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a934a0d0-54f8-4d29-8f28-7484a0646c73 req-e223825c-2767-473d-8c4d-c2a506077599 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:58.995155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a934a0d0-54f8-4d29-8f28-7484a0646c73 req-e223825c-2767-473d-8c4d-c2a506077599 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:59.010780 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a934a0d0-54f8-4d29-8f28-7484a0646c73 req-e223825c-2767-473d-8c4d-c2a506077599 service nova] Creating event network-vif-plugged:01a89a12-9d4b-4de1-801e-dc1c0ff8de20 for instance 9244310a-e287-4d22-8bfb-16b462bbbc11 on n-h1-master-1 Sep 25 01:38:59.017083 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a934a0d0-54f8-4d29-8f28-7484a0646c73 req-e223825c-2767-473d-8c4d-c2a506077599 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043134 Sep 25 01:38:59.018344 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2906/5825] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:38:59.492367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:38:59.493715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:38:59.501131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:59.501684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:59.502130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:59.502844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:38:59.503304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:38:59.503732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:38:59.668658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:38:59.677461 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88e87360-0718-4298-80d5-7498ee7f4f7e tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1314 microversion: 2.1 time: 0.189467 Sep 25 01:38:59.679603 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2920/5826] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:38:59 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:39:00.703466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:00.704166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:00.711092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:00.711575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:00.712008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:00.712708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:00.713159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:00.713607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:00.912294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:00.921526 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-85fe7272-8daa-4bfc-952e-53f00dc8136d tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1498 microversion: 2.1 time: 0.223272 Sep 25 01:39:00.922129 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2907/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:39:00 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1498 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:39:04.879232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:04.880302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:04.887637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:04.888446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:04.889126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:04.890359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:04.891079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:04.891756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:04.923313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:39:05.063822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88a6eed2-ec90-46a3-b763-7b419a4557b9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 204 len: 0 microversion: 2.1 time: 0.187649 Sep 25 01:39:05.071053 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2921/5828] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:39:04 2022] DELETE /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:39:05.077621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:05.079513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:05.109029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:05.109660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:05.110608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:05.111397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:05.111846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:05.112481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:05.460701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:05.472935 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-35db741a-f8ac-45b6-9bc6-cbe44ebd1eb2 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1504 microversion: 2.1 time: 0.399932 Sep 25 01:39:05.486131 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2908/5829] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:39:05 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:39:06.502827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:06.504591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:06.516808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:06.518018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:06.518689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:06.519616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:06.520559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:06.521607 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:06.728217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:06.738176 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1abdbff-f9ea-4028-80e9-291f748afea9 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1504 microversion: 2.1 time: 0.244891 Sep 25 01:39:06.740366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2922/5830] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:39:06 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:39:07.539849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-13b29cda-5efd-49d3-9d4d-f8e390f955ff req-88b234fa-ebdb-4498-a695-511ff3a7d3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9244310a-e287-4d22-8bfb-16b462bbbc11", "name": "network-vif-deleted", "tag": "01a89a12-9d4b-4de1-801e-dc1c0ff8de20"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:39:07.551640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-13b29cda-5efd-49d3-9d4d-f8e390f955ff req-88b234fa-ebdb-4498-a695-511ff3a7d3ff service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:07.552301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-13b29cda-5efd-49d3-9d4d-f8e390f955ff req-88b234fa-ebdb-4498-a695-511ff3a7d3ff service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:07.552782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-13b29cda-5efd-49d3-9d4d-f8e390f955ff req-88b234fa-ebdb-4498-a695-511ff3a7d3ff service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:07.564795 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-13b29cda-5efd-49d3-9d4d-f8e390f955ff req-88b234fa-ebdb-4498-a695-511ff3a7d3ff service nova] Creating event network-vif-deleted:01a89a12-9d4b-4de1-801e-dc1c0ff8de20 for instance 9244310a-e287-4d22-8bfb-16b462bbbc11 on n-h1-master-1 Sep 25 01:39:07.570148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-13b29cda-5efd-49d3-9d4d-f8e390f955ff req-88b234fa-ebdb-4498-a695-511ff3a7d3ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Sep 25 01:39:07.571247 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2909/5831] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:39:07.763625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:07.766923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:07.769343 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:39:07.769785 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 01:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 (ip 10.222.0.16) !!! Sep 25 01:39:07.783308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:07.784371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:07.785574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:07.786542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:07.787569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:07.788225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:07.827143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:07.828406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:07.829484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:07.829921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lazy-loading 'fault' on Instance uuid 9244310a-e287-4d22-8bfb-16b462bbbc11 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:39:07.871834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e396b6c77264a30ab00cf9879a93fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a01bd93d7ca24ae39ea8a94730ffa2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:07.880449 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6cf75d8-ae6b-4638-89ba-581515c2cbca tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 200 len: 1304 microversion: 2.1 time: 0.121619 Sep 25 01:39:07.882833 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2923/5832] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:39:07 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:39:08.907341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:08.908926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] [instance: 9244310a-e287-4d22-8bfb-16b462bbbc11] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:08.912255 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:39:08.915747 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 01:39:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 (ip 10.222.0.16) !!! Sep 25 01:39:08.917963 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:39:08.918079 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 01:39:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 (ip 10.222.0.16) !!! Sep 25 01:39:08.937365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:08.938994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:08.939776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:08.940779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:08.941448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:08.942080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:08.975253 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] HTTP exception thrown: Instance 9244310a-e287-4d22-8bfb-16b462bbbc11 could not be found. Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Request method failure captured: Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 HTTP/1.1 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Eg9zrF3Eq3nJJh6kBZ9C24KqrXGSNNpaIsnt_ILBPQblIKRqYnCTTEldwZPwKwNOa89HYYqYFhED71DIAHQYghBEeORq7O8mXIvZvpVYeYLhGDj2ET8kkROXtS58WBVFedB7HAHycMw0I6lx6FAgoKLhSPJyEe-g19I2jffl2Euoo Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: a01bd93d7ca24ae39ea8a94730ffa2cc Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesActionsTest-2135636577 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a01bd93d7ca24ae39ea8a94730ffa2cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a01bd93d7ca24ae39ea8a94730ffa2cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a01bd93d7ca24ae39ea8a94730ffa2cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a01bd93d7ca24ae39ea8a94730ffa2cc"}]}] Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesActionsTest-2135636577 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: a01bd93d7ca24ae39ea8a94730ffa2cc Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesActionsTest-2135636577 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesActionsTest-2135636577-project Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4e396b6c77264a30ab00cf9879a93fe4 Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesActionsTest-2135636577-project Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 9244310a-e287-4d22-8bfb-16b462bbbc11 could not be found. Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '9244310a-e287-4d22-8bfb-16b462bbbc11'} Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9244310a-e287-4d22-8bfb-16b462bbbc11 could not be found. Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9244310a-e287-4d22-8bfb-16b462bbbc11 could not be found. Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:08.979416 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9244310a-e287-4d22-8bfb-16b462bbbc11 could not be found. Sep 25 01:39:08.984531 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:08.987524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] Returning 404 to user: Instance 9244310a-e287-4d22-8bfb-16b462bbbc11 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:39:08.988861 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-58067686-2684-4887-9985-f26066a352c4 tempest-VolumesActionsTest-2135636577 tempest-VolumesActionsTest-2135636577-project] 10.222.0.16 "GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11" status: 404 len: 111 microversion: 2.1 time: 0.086207 Sep 25 01:39:08.989991 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2910/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:39:08 2022] GET /compute/v2.1/servers/9244310a-e287-4d22-8bfb-16b462bbbc11 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:39:15.947074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:15.949582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:15.956717 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:15.958743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:15.959641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:15.960288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:15.961342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:15.961973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:15.962550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:16.007144 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:16.025289 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-568ca8a6-b30b-4d6c-aef3-24a8c5691ada tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082178 Sep 25 01:39:16.038542 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2924/5834] 10.222.0.16 () {60 vars in 1343 bytes} [Sun Sep 25 01:39:15 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:39:16.153029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:16.154253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:16.174884 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=25 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:16.177969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:16.179003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:16.182484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:16.183495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:16.184134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:16.185011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:16.197208 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=45 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:16.259209 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:39:16.494510 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3adc700f-ef28-4f67-82ac-f8bd0bd552e1 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 204 len: 0 microversion: 2.20 time: 0.344903 Sep 25 01:39:16.511109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:16.512026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:16.513748 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2911/5835] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:39:16 2022] DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:39:16.526481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:16.527175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:16.529036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:16.534015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:16.534700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:16.535298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:16.786644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:16.809235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:16.814571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:16.817181 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16853385-8368-47da-95f6-fe724fa46089 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.313605 Sep 25 01:39:16.826485 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2925/5836] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:16 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:39:17.864842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:17.866253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:17.876004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:17.876512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:17.876949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:17.881548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:17.882306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:17.882919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:18.096584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:18.105599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:18.106964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:18.108333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-613017f5-c390-4451-a4f2-4c569fdaa84a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.249540 Sep 25 01:39:18.110446 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2912/5837] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:17 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:39:19.137463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:19.138115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:19.165439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:19.165951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:19.166399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:19.167126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:19.177777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:19.178313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:19.459608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:19.474957 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:19.476759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:19.478242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b96b725b-d95f-4802-b8a6-cdb60cd62333 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1721 microversion: 2.20 time: 0.344880 Sep 25 01:39:19.479521 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2926/5838] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:19 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:39:20.073819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5cac46f1-4716-4ff9-8dd4-f95f95bf91fa req-558ccadc-4265-491f-9a64-37ff124da69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2", "name": "network-vif-deleted", "tag": "feb2c992-f75c-473d-93b8-8316499ed663"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:39:20.090983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5cac46f1-4716-4ff9-8dd4-f95f95bf91fa req-558ccadc-4265-491f-9a64-37ff124da69f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:20.091421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5cac46f1-4716-4ff9-8dd4-f95f95bf91fa req-558ccadc-4265-491f-9a64-37ff124da69f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:20.091863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5cac46f1-4716-4ff9-8dd4-f95f95bf91fa req-558ccadc-4265-491f-9a64-37ff124da69f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:20.153158 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5cac46f1-4716-4ff9-8dd4-f95f95bf91fa req-558ccadc-4265-491f-9a64-37ff124da69f service nova] Creating event network-vif-deleted:feb2c992-f75c-473d-93b8-8316499ed663 for instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 on n-h2-master-1 Sep 25 01:39:20.172754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5cac46f1-4716-4ff9-8dd4-f95f95bf91fa req-558ccadc-4265-491f-9a64-37ff124da69f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101691 Sep 25 01:39:20.173389 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2913/5839] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:39:20.507352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:20.508005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:20.522676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:20.523450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:20.524512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:20.525566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:20.526334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:20.526923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:20.597175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:20.598543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:20.604705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:20.605452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lazy-loading 'fault' on Instance uuid 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:39:20.732031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:20.749332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:20.755574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f8c7f57af21464684837dcce49d4d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c215ba6bfd84b8fb7e6b170b813b517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:39:20.767672 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2993bf56-31ac-4fd6-8a3d-8134fdba1b1d tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 200 len: 1371 microversion: 2.20 time: 0.264079 Sep 25 01:39:20.769036 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2927/5840] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:20 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:39:21.801566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:21.803308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:21.813898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:21.816169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:21.817075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:21.825546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:21.827956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:21.829118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:21.863582 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] HTTP exception thrown: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Request method failure captured: Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 HTTP/1.1 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6-vPMDhRANLgNSgFuOdHvUU7PBnsfrdvVugkiMj9YdsWAePivIbU_S0OTkcuSOoOorJon1D_zv9OJtfVdi5ktnD9sn7y9VAM55h-JaJgbQqz_vnQze7zd7yMg8T4GFm3lbhYdC27gGnzYVs4JJDS3u5Fy2md5lCZLZYlvaKeqPJbjM Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c215ba6bfd84b8fb7e6b170b813b517"}]}] Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0f8c7f57af21464684837dcce49d4d0b Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2'} Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:21.867162 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:21.872421 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:21.875013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Returning 404 to user: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:39:21.876941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01a8ac8c-86f2-4039-869c-ee9be2215fc7 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 404 len: 111 microversion: 2.20 time: 0.082281 Sep 25 01:39:21.878683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2914/5841] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:21 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:39:21.892463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e3b704a8-d5da-4973-b766-24c3a0656b9c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '.version_select at 0x7f7bebd72430>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:21.968383 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e3b704a8-d5da-4973-b766-24c3a0656b9c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641039269" status: 204 len: 0 microversion: 2.20 time: 0.085302 Sep 25 01:39:21.970056 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2928/5842] 10.222.0.16 () {60 vars in 1262 bytes} [Sun Sep 25 01:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641039269 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:39:26.596953 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:26.597757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:26.611901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:26.612432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:26.612890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:26.617437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:26.618037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:26.618491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:26.652844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] HTTP exception thrown: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Request method failure captured: Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 HTTP/1.1 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6-vPMDhRANLgNSgFuOdHvUU7PBnsfrdvVugkiMj9YdsWAePivIbU_S0OTkcuSOoOorJon1D_zv9OJtfVdi5ktnD9sn7y9VAM55h-JaJgbQqz_vnQze7zd7yMg8T4GFm3lbhYdC27gGnzYVs4JJDS3u5Fy2md5lCZLZYlvaKeqPJbjM Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c215ba6bfd84b8fb7e6b170b813b517"}]}] Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0f8c7f57af21464684837dcce49d4d0b Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2'} Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:39:26.654860 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Returning 404 to user: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:39:26.659291 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-58b50f55-b189-4d4d-8301-2bcab5a2753c tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 404 len: 111 microversion: 2.20 time: 0.063933 Sep 25 01:39:26.668821 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2915/5843] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:39:26 2022] DELETE /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:39:26.669556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:26.670339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:26.689812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:26.690310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:26.690754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:26.691471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:26.705056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:26.705682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:26.752632 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] HTTP exception thrown: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Request method failure captured: Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 HTTP/1.1 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6-vPMDhRANLgNSgFuOdHvUU7PBnsfrdvVugkiMj9YdsWAePivIbU_S0OTkcuSOoOorJon1D_zv9OJtfVdi5ktnD9sn7y9VAM55h-JaJgbQqz_vnQze7zd7yMg8T4GFm3lbhYdC27gGnzYVs4JJDS3u5Fy2md5lCZLZYlvaKeqPJbjM Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c215ba6bfd84b8fb7e6b170b813b517"}]}] Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 0f8c7f57af21464684837dcce49d4d0b Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2'} Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.754410 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Returning 404 to user: Instance 10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b5f6a212-9122-489a-9a43-29ecd82bdc5a tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2" status: 404 len: 111 microversion: 2.20 time: 0.094366 Sep 25 01:39:26.758052 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2929/5844] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:26 2022] GET /compute/v2.1/servers/10dea6ba-f9b1-4f4d-a2bf-1e18d80583d2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:39:32.564590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:32.565105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:32.576609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:32.577655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:32.579450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:32.587024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:32.588099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:32.589280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:32.638035 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] HTTP exception thrown: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Request method failure captured: Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 HTTP/1.1 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL6-vPMDhRANLgNSgFuOdHvUU7PBnsfrdvVugkiMj9YdsWAePivIbU_S0OTkcuSOoOorJon1D_zv9OJtfVdi5ktnD9sn7y9VAM55h-JaJgbQqz_vnQze7zd7yMg8T4GFm3lbhYdC27gGnzYVs4JJDS3u5Fy2md5lCZLZYlvaKeqPJbjM Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c215ba6bfd84b8fb7e6b170b813b517"}]}] Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 0f8c7f57af21464684837dcce49d4d0b Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e17b9865-cbb3-447a-9976-a7d72f6066e2'} Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:39:32.641929 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.645863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Returning 404 to user: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:39:32.651331 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2d312c58-ce1b-4584-89db-9ead118833d5 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 404 len: 111 microversion: 2.20 time: 0.090730 Sep 25 01:39:32.651952 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2916/5845] 10.222.0.16 () {60 vars in 1280 bytes} [Sun Sep 25 01:39:32 2022] DELETE /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:39:32.663240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:39:32.664299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] [instance: e17b9865-cbb3-447a-9976-a7d72f6066e2] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:39:32.675258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:32.675751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:32.676373 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:32.677535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:39:32.678462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:39:32.679231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:39:32.695297 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] HTTP exception thrown: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Request method failure captured: Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 HTTP/1.1 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL6-vPMDhRANLgNSgFuOdHvUU7PBnsfrdvVugkiMj9YdsWAePivIbU_S0OTkcuSOoOorJon1D_zv9OJtfVdi5ktnD9sn7y9VAM55h-JaJgbQqz_vnQze7zd7yMg8T4GFm3lbhYdC27gGnzYVs4JJDS3u5Fy2md5lCZLZYlvaKeqPJbjM Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c215ba6bfd84b8fb7e6b170b813b517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c215ba6bfd84b8fb7e6b170b813b517"}]}] Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 1c215ba6bfd84b8fb7e6b170b813b517 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-15342436 Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 0f8c7f57af21464684837dcce49d4d0b Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeShelveTestJSON-15342436-project Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e17b9865-cbb3-447a-9976-a7d72f6066e2'} Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.697118 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. Sep 25 01:39:32.702365 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:39:32.703919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] Returning 404 to user: Instance e17b9865-cbb3-447a-9976-a7d72f6066e2 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:39:32.704971 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-478cecb4-2a67-4c63-9bae-5a94c4c28099 tempest-AttachVolumeShelveTestJSON-15342436 tempest-AttachVolumeShelveTestJSON-15342436-project] 10.222.0.16 "GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2" status: 404 len: 111 microversion: 2.20 time: 0.047978 Sep 25 01:39:32.710008 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2930/5846] 10.222.0.16 () {60 vars in 1277 bytes} [Sun Sep 25 01:39:32 2022] GET /compute/v2.1/servers/e17b9865-cbb3-447a-9976-a7d72f6066e2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:39:59.541547 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:59.543440 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:39:59.904008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9bf9ffed-e3c8-4e1e-be1c-b48a8f5cab1d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: .version_select at 0x7f7bea902940>, body: {"keypair": {"name": "tempest-keypair-1716395423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUKFTbko1a9L/5gthLscjKHWUqI87QCROsuDOzZZGyo43idgW4lU/vPQCsiNX0qcWh2u7oNMsj2OHWpZuOQawS0BNDUuNwiQDWQGuWmMFJtGlZL1XRn5NXCJbbDnvM34A=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:39:59.939919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9bf9ffed-e3c8-4e1e-be1c-b48a8f5cab1d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:39:59.953998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9bf9ffed-e3c8-4e1e-be1c-b48a8f5cab1d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for user 843656b1ab4b43cbb3df67b116c754a1 and project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:40:00.015953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9bf9ffed-e3c8-4e1e-be1c-b48a8f5cab1d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.481633 Sep 25 01:40:00.020200 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2917/5847] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:39:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:00.054847 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:00.056076 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=29 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:00.181811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a38f192e-005f-4d34-997a-1f9b7b66ee9f tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1649172204", "availability_zone": "foo_zone"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:00.194277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.aggregate [None req-a38f192e-005f-4d34-997a-1f9b7b66ee9f tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Generated uuid c6846442-ba58-4f58-86eb-9eb5b7edfdec for aggregate {{(pid=122385) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 25 01:40:00.271207 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a38f192e-005f-4d34-997a-1f9b7b66ee9f tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.221694 Sep 25 01:40:00.279345 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2931/5848] 10.222.0.16 () {60 vars in 1164 bytes} [Sun Sep 25 01:40:00 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:00.284858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-466fa6b8-e167-48dc-ae38-08c62c4e4a55 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:00.373137 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-466fa6b8-e167-48dc-ae38-08c62c4e4a55 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.093347 Sep 25 01:40:00.375538 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2918/5849] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:40:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:00.393017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:00.399927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:00.412239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:00.414093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:00.416195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:00.416668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:00.430238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:00.539897 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9536d627-4f94-46ed-ab07-ffddbdb13ec6 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.156801 Sep 25 01:40:00.548318 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2932/5850] 10.222.0.16 () {58 vars in 1176 bytes} [Sun Sep 25 01:40:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:00.555876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9f8ba46a-bf6a-4850-a928-212bc894f12e tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:00.590105 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9f8ba46a-bf6a-4850-a928-212bc894f12e tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.038203 Sep 25 01:40:00.594508 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2919/5851] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 25 01:40:00 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:40:00.607637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53dc19c8-aedb-42c1-af19-eb4da7ade1e0 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:00.628338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53dc19c8-aedb-42c1-af19-eb4da7ade1e0 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:00.631526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53dc19c8-aedb-42c1-af19-eb4da7ade1e0 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:00.633602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53dc19c8-aedb-42c1-af19-eb4da7ade1e0 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:01.382095 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53dc19c8-aedb-42c1-af19-eb4da7ade1e0 tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.778306 Sep 25 01:40:01.393695 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2933/5852] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:40:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:01.395503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d41e13cf-8078-4acf-9b0f-72202ff30bbb tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:01.434839 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d41e13cf-8078-4acf-9b0f-72202ff30bbb tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.041967 Sep 25 01:40:01.438563 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2920/5853] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:40:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:01.450078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd2dfaa0-1d00-44ed-99fd-8899793b9dda tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1880953095", "availability_zone": "foo_zone"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:01.537366 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd2dfaa0-1d00-44ed-99fd-8899793b9dda tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.090918 Sep 25 01:40:01.538282 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2934/5854] 10.222.0.16 () {60 vars in 1173 bytes} [Sun Sep 25 01:40:01 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:01.553543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf4d9961-0e49-4c82-993c-a673273f6fce tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:01.619156 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf4d9961-0e49-4c82-993c-a673273f6fce tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.071390 Sep 25 01:40:01.632402 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2921/5855] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:40:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:01.635198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2752192-8304-4f92-9373-14c33286298f tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:01.648769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2752192-8304-4f92-9373-14c33286298f tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.017603 Sep 25 01:40:01.656301 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2935/5856] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 25 01:40:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:01.667561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53adf045-db85-4061-9045-11823828f08a tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:01.682311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53adf045-db85-4061-9045-11823828f08a tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:01.683082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53adf045-db85-4061-9045-11823828f08a tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:01.683680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53adf045-db85-4061-9045-11823828f08a tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:02.361080 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-53adf045-db85-4061-9045-11823828f08a tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.694587 Sep 25 01:40:02.373003 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2922/5857] 10.222.0.16 () {60 vars in 1194 bytes} [Sun Sep 25 01:40:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:02.375477 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c7942558-d60b-4c12-835f-a6c2499cdfed tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:02.471054 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c7942558-d60b-4c12-835f-a6c2499cdfed tempest-TestAggregatesBasicOps-1364867066 tempest-TestAggregatesBasicOps-1364867066-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.099555 Sep 25 01:40:02.473206 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2936/5858] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 25 01:40:02 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 25 01:40:04.245927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1205009760", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b43f51c-c438-4c62-913f-c7208d0d84ce"}], "security_groups": [{"name": "tempest-securitygroup--1297501735"}], "key_name": "tempest-keypair-1716395423", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:04.509837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] validate_networks() for [('8b43f51c-c438-4c62-913f-c7208d0d84ce', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:40:05.359196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:40:05.360892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:40:05.361748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:40:05.362335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:40:05.363099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:40:05.380340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:05.381090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:05.381730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:05.382746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:05.383522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:05.385095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:05.411566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:40:05.425145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for user 843656b1ab4b43cbb3df67b116c754a1 and project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:40:05.450416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:40:05.453626 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:40:05.518242 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3b744b7-3724-48df-9854-87b3ed281238 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.284953 Sep 25 01:40:05.524771 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2923/5859] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:40:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:40:05.530507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c01dc4d1-5f5d-4497-9fe6-8f2f705efc65 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:05.531265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c01dc4d1-5f5d-4497-9fe6-8f2f705efc65 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:05.693331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c01dc4d1-5f5d-4497-9fe6-8f2f705efc65 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:05.728275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c01dc4d1-5f5d-4497-9fe6-8f2f705efc65 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1238 microversion: 2.1 time: 0.201771 Sep 25 01:40:05.729313 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2937/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:05 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1238 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:06.761379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:06.763506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:06.788929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:06.788929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:06.789461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:06.790405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:06.791656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:06.792525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:06.943952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:06.955566 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89e75eb8-2045-4f07-983c-07d510f43587 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1242 microversion: 2.1 time: 0.200143 Sep 25 01:40:06.960081 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2924/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:06 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:08.002815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:08.004220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:08.028125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:08.036048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:08.036536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:08.039955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:08.040473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:08.040930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:08.228356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:08.248093 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8153625d-4d9f-45d2-bd11-c28897ad31f0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1290 microversion: 2.1 time: 0.247904 Sep 25 01:40:08.262868 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2938/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:07 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1290 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:09.275975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:09.277343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:09.294093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:09.296931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:09.300522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:09.302128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:09.305902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:09.306622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:09.480321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:09.506720 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-400abd1e-a0b8-4a44-9ea5-8ec1f4fab9dc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1296 microversion: 2.1 time: 0.228766 Sep 25 01:40:09.510127 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2925/5863] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:09 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1296 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:10.534402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:10.535274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:10.546349 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:10.553485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:10.554156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:10.554632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:10.555393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:10.555865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:10.556303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:10.842688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:10.852550 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69b29dca-4749-4da1-ad8a-4850637478be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1296 microversion: 2.1 time: 0.323209 Sep 25 01:40:10.872572 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2939/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:10 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1296 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:11.888224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:11.891224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:11.911232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:11.913764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:11.916025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:11.916884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:11.918936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:11.929618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:12.418358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:12.432084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7326ef48-4692-4b3a-918c-31022bf20e19 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.560252 Sep 25 01:40:12.482320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2926/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:11 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:13.461079 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:13.463675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:13.481660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:13.482416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:13.483766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:13.484504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:13.484964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:13.485389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:14.024119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:14.044622 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-409c7a33-e1da-4667-9fcf-992d6978e3a4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.589842 Sep 25 01:40:14.067204 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2940/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:13 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:15.086186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:15.086975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:15.099500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:15.105553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:15.106345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:15.112336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:15.114952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:15.120686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:15.212917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:15.215662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:15.216624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:15.218044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:15.224201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:15.225087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:15.225758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:15.346765 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-00df9eb0-399c-4fc4-8190-077371525c11 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.493204 Sep 25 01:40:15.353567 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2927/5867] 10.222.0.16 () {58 vars in 1185 bytes} [Sun Sep 25 01:40:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:15.435458 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:15.606861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-38946d59-56ea-4524-9fe9-84e9aff993aa req-0ebd0fec-de91-4b0e-aaa0-9d42659cfda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def8c243-fb93-424f-93bc-e4a054207797", "tag": "10ebb590-40d7-45eb-a499-dfdbbd645611"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:15.646580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-38946d59-56ea-4524-9fe9-84e9aff993aa req-0ebd0fec-de91-4b0e-aaa0-9d42659cfda9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:15.647467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-38946d59-56ea-4524-9fe9-84e9aff993aa req-0ebd0fec-de91-4b0e-aaa0-9d42659cfda9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:15.648309 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-38946d59-56ea-4524-9fe9-84e9aff993aa req-0ebd0fec-de91-4b0e-aaa0-9d42659cfda9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:15.685730 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-38946d59-56ea-4524-9fe9-84e9aff993aa req-0ebd0fec-de91-4b0e-aaa0-9d42659cfda9 service nova] Creating event network-changed:10ebb590-40d7-45eb-a499-dfdbbd645611 for instance def8c243-fb93-424f-93bc-e4a054207797 on n-h1-master-1 Sep 25 01:40:15.712021 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-38946d59-56ea-4524-9fe9-84e9aff993aa req-0ebd0fec-de91-4b0e-aaa0-9d42659cfda9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355348 Sep 25 01:40:15.717109 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2928/5868] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:15.724734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1845427982", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "11b89079-e67a-4dbd-98c2-e9a820e14974"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:15.727557 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:15.829752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] validate_networks() for [('11b89079-e67a-4dbd-98c2-e9a820e14974', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:40:15.985351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:15.997896 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0b5de4fc-2f86-40b5-b241-6c16251b3e16 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.917440 Sep 25 01:40:16.025015 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2941/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:15 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:17.027154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:17.027779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:17.036609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:17.037109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:17.037580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:17.050410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:17.050909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:17.051362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:17.487609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:17.514931 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30641722-9154-42f4-ad7b-7673828f7380 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.492290 Sep 25 01:40:17.516143 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2942/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:17 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:17.675659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:40:17.676204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:40:17.676703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:40:17.676972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:40:17.677506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:40:17.707237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:17.707988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:17.708803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:17.710165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:17.711601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:17.712240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:17.743737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Getting quotas for project 26e7627ce0114c99bc81f9e2c8c5e1c0. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:40:17.751588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Getting quotas for user 4693e5435d484d519b806ccddf83e1b9 and project 26e7627ce0114c99bc81f9e2c8c5e1c0. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:40:17.769021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:40:17.772213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:40:17.908014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2b27810-e288-48e1-a32b-ddeee19fbfbe tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.188775 Sep 25 01:40:17.908972 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2929/5871] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:40:17.921776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03eab281-bfbd-436e-99d0-25fef9d556d7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:17.922806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-03eab281-bfbd-436e-99d0-25fef9d556d7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:18.149340 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03eab281-bfbd-436e-99d0-25fef9d556d7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1329 microversion: 2.1 time: 0.232081 Sep 25 01:40:18.160690 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2943/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:17 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1329 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:18.542575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:18.543210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:18.560158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:18.560662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:18.561896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:18.566066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:18.566602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:18.567054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:18.906582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:18.917019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f30fcfd-ce17-41e2-b5a1-94cb24b8bc49 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.380233 Sep 25 01:40:18.920298 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2930/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:18 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:19.188858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:19.189657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:19.212755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:19.213460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:19.214011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:19.214854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:19.215437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:19.216003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:19.366421 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a788be4c-85a5-4ff6-a78d-2921c78b9d5d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1338 microversion: 2.1 time: 0.182013 Sep 25 01:40:19.370572 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2944/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:19 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:19.947606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:19.948401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:19.964636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:19.968328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:19.968843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:19.969717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:19.978036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:19.978630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:20.398252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:20.399228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:20.408772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:20.415506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:20.415506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:20.415506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:20.415915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:20.416494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:20.705251 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df9f339b-155a-4e57-9d3f-aee0786b926b tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1422 microversion: 2.1 time: 0.310806 Sep 25 01:40:20.713247 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2945/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:20 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1422 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:21.166379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:21.183338 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c1ada398-43c5-4f73-9b13-89d911e8faa0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 1.241203 Sep 25 01:40:21.187560 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2931/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:19 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:21.739454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:21.740315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:21.756846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:21.757366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:21.757857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:21.758635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:21.759175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:21.766288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:22.072298 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-650a473d-df2d-4389-8412-b9ff97426235 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.337462 Sep 25 01:40:22.083863 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2946/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:21 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:22.211554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:22.216050 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:22.254579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:22.255123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:22.255572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:22.256299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:22.262134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:22.267356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:22.557016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:22.571549 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-160fa198-1779-4db7-8bd9-63f293f6e425 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.362420 Sep 25 01:40:22.572179 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2932/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:22 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:22.754770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-10b20811-4b36-44b5-8c56-3382294e0412 req-5a713473-de71-4255-90dd-f7ca59b8af63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc2f095-98d3-4cfc-b16c-28481e432b37", "tag": "e5987f48-1efa-47b9-a7d9-6da072efc7c5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:22.787694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-10b20811-4b36-44b5-8c56-3382294e0412 req-5a713473-de71-4255-90dd-f7ca59b8af63 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:22.788342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-10b20811-4b36-44b5-8c56-3382294e0412 req-5a713473-de71-4255-90dd-f7ca59b8af63 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:22.789017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-10b20811-4b36-44b5-8c56-3382294e0412 req-5a713473-de71-4255-90dd-f7ca59b8af63 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:22.827404 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-10b20811-4b36-44b5-8c56-3382294e0412 req-5a713473-de71-4255-90dd-f7ca59b8af63 service nova] Creating event network-changed:e5987f48-1efa-47b9-a7d9-6da072efc7c5 for instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 on n-h1-master-1 Sep 25 01:40:22.839274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-10b20811-4b36-44b5-8c56-3382294e0412 req-5a713473-de71-4255-90dd-f7ca59b8af63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086055 Sep 25 01:40:22.840237 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2947/5879] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:40:23.111045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:23.112079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:23.125137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:23.126213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:23.126866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:23.127810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:23.129118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:23.129819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:23.334876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e074d7a4-da96-434a-a13a-b48cde371f78 req-0775861b-2eb4-4ed4-893f-a02b1c7b53ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def8c243-fb93-424f-93bc-e4a054207797", "name": "network-vif-plugged", "status": "completed", "tag": "10ebb590-40d7-45eb-a499-dfdbbd645611"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:23.362208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e074d7a4-da96-434a-a13a-b48cde371f78 req-0775861b-2eb4-4ed4-893f-a02b1c7b53ca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:23.362719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e074d7a4-da96-434a-a13a-b48cde371f78 req-0775861b-2eb4-4ed4-893f-a02b1c7b53ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:23.363169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e074d7a4-da96-434a-a13a-b48cde371f78 req-0775861b-2eb4-4ed4-893f-a02b1c7b53ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:23.403085 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e074d7a4-da96-434a-a13a-b48cde371f78 req-0775861b-2eb4-4ed4-893f-a02b1c7b53ca service nova] Creating event network-vif-plugged:10ebb590-40d7-45eb-a499-dfdbbd645611 for instance def8c243-fb93-424f-93bc-e4a054207797 on n-h1-master-1 Sep 25 01:40:23.412764 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e074d7a4-da96-434a-a13a-b48cde371f78 req-0775861b-2eb4-4ed4-893f-a02b1c7b53ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080495 Sep 25 01:40:23.414584 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2948/5880] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:23.612590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:23.613710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:23.627209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:23.629700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:23.632460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:23.634656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:23.635343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:23.635951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:23.897790 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea063f80-ee34-45d2-a96a-d719c141f05d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.790725 Sep 25 01:40:23.908881 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2933/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:23 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:24.064790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:24.074708 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7fe1ed06-978c-444e-a254-c463fedd8b48 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.479946 Sep 25 01:40:24.076006 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2949/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:23 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:24.939825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:24.941039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:24.948774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:24.949266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:24.949739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:24.950443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:24.951103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:24.951772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:25.107290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:25.110970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:25.122782 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-195a1ee3-4e41-4beb-ab6f-341461be00f8 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.185750 Sep 25 01:40:25.125980 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2934/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:24 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:25.135591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:25.149140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:25.151744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:25.153297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:25.157237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:25.162452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:25.332343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:25.340600 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7e02a4ca-de3d-487a-89e1-f9e16cb5b014 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1364 microversion: 2.1 time: 0.245421 Sep 25 01:40:25.341654 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2950/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:25 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:26.150722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:26.151964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:26.161667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:26.162230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:26.162994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:26.163922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:26.164581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:26.165189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:26.331122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a696a7b1-29a8-418f-8f9b-c0766c659ce6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.184438 Sep 25 01:40:26.331828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2935/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:26 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:26.363942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:26.364567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:26.372312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:26.372824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:26.373926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:26.374824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:26.375295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:26.375911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:26.526845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:26.536911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c7eb4018-e2c6-47b6-9c69-f99bf2c9f400 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1549 microversion: 2.1 time: 0.176794 Sep 25 01:40:26.537506 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2951/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:26 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:26.559205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:26.559698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:26.567063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:26.567726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:26.568328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:26.569192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:26.569832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:26.570438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:26.656625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6297dab9-bfcf-4450-8452-382ddd606206 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101131 Sep 25 01:40:26.657222 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2936/5887] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:40:26 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:27.355783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:27.356860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:27.364863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:27.366171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:27.366977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:27.367918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:27.368735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:27.369544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:27.667008 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc6ff8fa-109d-412b-8ef3-b393aa371038 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.312746 Sep 25 01:40:27.668276 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2952/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:27 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:28.275718 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:28.276490 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:28.281729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8150db86-f908-4c42-8567-ac3aa843886c req-5ffcd40d-d942-4ee4-81f3-188a4d6eb84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def8c243-fb93-424f-93bc-e4a054207797", "tag": "10ebb590-40d7-45eb-a499-dfdbbd645611"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:28.292674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8150db86-f908-4c42-8567-ac3aa843886c req-5ffcd40d-d942-4ee4-81f3-188a4d6eb84e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:28.293163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8150db86-f908-4c42-8567-ac3aa843886c req-5ffcd40d-d942-4ee4-81f3-188a4d6eb84e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:28.293624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8150db86-f908-4c42-8567-ac3aa843886c req-5ffcd40d-d942-4ee4-81f3-188a4d6eb84e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:28.307102 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8150db86-f908-4c42-8567-ac3aa843886c req-5ffcd40d-d942-4ee4-81f3-188a4d6eb84e service nova] Creating event network-changed:10ebb590-40d7-45eb-a499-dfdbbd645611 for instance def8c243-fb93-424f-93bc-e4a054207797 on n-h1-master-1 Sep 25 01:40:28.312919 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8150db86-f908-4c42-8567-ac3aa843886c req-5ffcd40d-d942-4ee4-81f3-188a4d6eb84e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038676 Sep 25 01:40:28.318440 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2937/5889] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:28.691411 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:28.696669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:28.697488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:28.707973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:28.708634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:28.709191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:28.709938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:28.710470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:28.710807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:28.928301 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e0990dd7-fc3d-4bab-8abe-871ac2287c43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.236866 Sep 25 01:40:28.929686 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2953/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:28 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:29.253448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-126ecacf-ed64-4239-8d39-be33c02cada4 req-c6881488-5763-41bf-ab7c-8e0d1588d6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc2f095-98d3-4cfc-b16c-28481e432b37", "name": "network-vif-plugged", "status": "completed", "tag": "e5987f48-1efa-47b9-a7d9-6da072efc7c5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:29.258552 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:29.274385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-126ecacf-ed64-4239-8d39-be33c02cada4 req-c6881488-5763-41bf-ab7c-8e0d1588d6c9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:29.282807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-126ecacf-ed64-4239-8d39-be33c02cada4 req-c6881488-5763-41bf-ab7c-8e0d1588d6c9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:29.283452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-126ecacf-ed64-4239-8d39-be33c02cada4 req-c6881488-5763-41bf-ab7c-8e0d1588d6c9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:29.311032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-126ecacf-ed64-4239-8d39-be33c02cada4 req-c6881488-5763-41bf-ab7c-8e0d1588d6c9 service nova] Creating event network-vif-plugged:e5987f48-1efa-47b9-a7d9-6da072efc7c5 for instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 on n-h1-master-1 Sep 25 01:40:29.322750 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-126ecacf-ed64-4239-8d39-be33c02cada4 req-c6881488-5763-41bf-ab7c-8e0d1588d6c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073573 Sep 25 01:40:29.323967 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2938/5891] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:29.954561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:29.955085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:29.962896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:29.963390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:29.963844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:29.964548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:29.965005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:29.965482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:30.092766 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=93 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:30.099724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13b41d87-c8e1-4893-878f-659844cf7264 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1464 microversion: 2.1 time: 0.149763 Sep 25 01:40:30.100431 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2954/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:29 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:30.856776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1281683776", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "de297034-30c0-4126-a2a7-5fb6dacb5d82"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:30.911828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] validate_networks() for [('de297034-30c0-4126-a2a7-5fb6dacb5d82', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:40:31.125884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:31.127091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:31.129991 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:31.136476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.137322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.137876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.139205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.141053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.141053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.330517 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:40:31.331244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:40:31.331800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:40:31.332347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:40:31.332775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:40:31.344518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.345012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.345470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.346207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.346665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.347094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.348068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a838362-c4f0-4d08-94d0-67065ef0e957 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1649 microversion: 2.1 time: 0.227778 Sep 25 01:40:31.348765 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2955/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:31 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1649 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:31.355417 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=75 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:31.366397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Getting quotas for project 01604e09ffe9466cafa6cfe2a5867aae. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:40:31.372081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Getting quotas for user 27f69f72a9044ea490c8fd4c4db6bf31 and project 01604e09ffe9466cafa6cfe2a5867aae. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:40:31.372829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:31.373873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:31.380534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.381393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.382095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.382903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.383467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.384269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.385152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:40:31.387786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:40:31.444462 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b594d46b-71d8-4c1c-a878-701fa5b7c16c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592631 Sep 25 01:40:31.445464 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2939/5894] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:40:31.459287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ddb292f-4164-4ab9-8d5c-ebf3daa6a65c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:31.460000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1ddb292f-4164-4ab9-8d5c-ebf3daa6a65c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:31.527634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ddb292f-4164-4ab9-8d5c-ebf3daa6a65c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:31.541111 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ddb292f-4164-4ab9-8d5c-ebf3daa6a65c tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1214 microversion: 2.1 time: 0.087018 Sep 25 01:40:31.542284 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2940/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:31 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:31.565584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-698196c1-9a2f-4f19-82e5-d8c5a637cf6a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1649 microversion: 2.1 time: 0.196572 Sep 25 01:40:31.566739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2956/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:31 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1649 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:31.589813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:31.590435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:31.597002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.597525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.597966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.598664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:31.599121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:31.599542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:31.777384 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c266305-5631-4bdc-a30f-6977897c30a2 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1649 microversion: 2.1 time: 0.193075 Sep 25 01:40:31.781644 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2941/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:31 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1649 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:31.900641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-995928594", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "11b89079-e67a-4dbd-98c2-e9a820e14974"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:31.970641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] validate_networks() for [('11b89079-e67a-4dbd-98c2-e9a820e14974', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:40:32.347683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:40:32.348322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:40:32.348593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:40:32.349017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:40:32.355666 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:40:32.364885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:32.365418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:32.365878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:32.366608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:32.367067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:32.367575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:32.385238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Getting quotas for project 26e7627ce0114c99bc81f9e2c8c5e1c0. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:40:32.391228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Getting quotas for user 4693e5435d484d519b806ccddf83e1b9 and project 26e7627ce0114c99bc81f9e2c8c5e1c0. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:40:32.404046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:40:32.406681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:40:32.453692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5fdf6367-8da5-4b28-9a64-acd6cf19fc7f tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556842 Sep 25 01:40:32.454640 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2957/5898] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:40:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:40:32.465500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c12097e3-b6d8-431c-b066-475ab11844fb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:32.466111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c12097e3-b6d8-431c-b066-475ab11844fb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:32.535728 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c12097e3-b6d8-431c-b066-475ab11844fb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1328 microversion: 2.1 time: 0.073840 Sep 25 01:40:32.536884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2942/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:32 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1328 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:32.569973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:32.570949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:32.581066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:32.584466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:32.585119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:32.586058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:32.586673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:32.587366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:32.681011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:32.695338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21625406-b52f-4347-846a-812f45ea8a3e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1266 microversion: 2.1 time: 0.134964 Sep 25 01:40:32.710097 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2958/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:32 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:33.559182 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:33.560462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:33.568764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:33.569964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:33.570480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:33.571495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:33.572087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:33.572524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:33.654048 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a13bde4-7e79-4672-959a-b2e01c49fa0d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1415 microversion: 2.1 time: 0.098501 Sep 25 01:40:33.659579 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2943/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:33 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1415 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:33.720605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:33.721860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:33.729232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:33.729915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:33.730455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:33.731254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:33.732157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:33.733250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:33.816421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:33.825639 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-79562769-6d15-493d-82a4-31c847802f1f tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1272 microversion: 2.1 time: 0.109303 Sep 25 01:40:33.835396 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2959/5902] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:33 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:34.678981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:34.679525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:34.687016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:34.687737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:34.688183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:34.688887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:34.689342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:34.689793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:34.782891 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfbf8c9f-0cc6-47d3-9436-21d456e1c2be tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1421 microversion: 2.1 time: 0.108412 Sep 25 01:40:34.789629 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2944/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:34 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:34.859088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:34.860188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:34.871517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:34.872353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:34.873968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:34.875350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:34.875983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:34.876521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:35.210244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:35.222693 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c7224ae-5aa5-4c23-b5fa-6606044b7306 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.368380 Sep 25 01:40:35.224074 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2960/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:34 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:35.537024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a8204874-4421-4056-93ad-dbbae8c49324 req-7728e7fe-345c-48d0-af82-3c2944270e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c780258a-6199-4aab-88b1-b9803c1c9c94", "tag": "16a89820-93b8-4180-9ef6-bc7d7c547c95"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:35.547777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a8204874-4421-4056-93ad-dbbae8c49324 req-7728e7fe-345c-48d0-af82-3c2944270e9b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:35.548567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a8204874-4421-4056-93ad-dbbae8c49324 req-7728e7fe-345c-48d0-af82-3c2944270e9b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:35.549000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a8204874-4421-4056-93ad-dbbae8c49324 req-7728e7fe-345c-48d0-af82-3c2944270e9b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:35.561510 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a8204874-4421-4056-93ad-dbbae8c49324 req-7728e7fe-345c-48d0-af82-3c2944270e9b service nova] Creating event network-changed:16a89820-93b8-4180-9ef6-bc7d7c547c95 for instance c780258a-6199-4aab-88b1-b9803c1c9c94 on n-h2-master-1 Sep 25 01:40:35.566932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a8204874-4421-4056-93ad-dbbae8c49324 req-7728e7fe-345c-48d0-af82-3c2944270e9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035042 Sep 25 01:40:35.567862 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2945/5905] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:35.806125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:35.806752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:35.812832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:35.813338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:35.813807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:35.814512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:35.814972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:35.815404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:36.182233 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c8b624b-48eb-495b-852b-b976db1a8e3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.379776 Sep 25 01:40:36.193538 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2961/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:35 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:36.249564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:36.251122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:36.261348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:36.262350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:36.264604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:36.268451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:36.269757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:36.270409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:36.483955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:36.492557 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6c4a7047-662f-4460-9b89-8e364bab198d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.249856 Sep 25 01:40:36.493202 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2946/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:36 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:37.207177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:37.207702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:37.214941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:37.215438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:37.215877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:37.217300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:37.217819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:37.218237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:37.348663 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-26f1b0d4-0151-4cd8-b8a8-e47643350504 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.145182 Sep 25 01:40:37.349219 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2962/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:37 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:37.517011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:37.517757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:37.525351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:37.526074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:37.526508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:37.527206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:37.527649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:37.528243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:37.603825 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3671c3e5-7353-4e54-b91b-7fa57a8ee520 req-3e2ab073-8d72-4600-89a5-c9614cea16f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0338eaec-3da2-4f5f-84bf-cf216ac22a41", "tag": "ec270ef4-6103-4e61-8d7b-5e6bd6cb300d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:37.613902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3671c3e5-7353-4e54-b91b-7fa57a8ee520 req-3e2ab073-8d72-4600-89a5-c9614cea16f9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:37.614484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3671c3e5-7353-4e54-b91b-7fa57a8ee520 req-3e2ab073-8d72-4600-89a5-c9614cea16f9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:37.615140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3671c3e5-7353-4e54-b91b-7fa57a8ee520 req-3e2ab073-8d72-4600-89a5-c9614cea16f9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:37.627056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3671c3e5-7353-4e54-b91b-7fa57a8ee520 req-3e2ab073-8d72-4600-89a5-c9614cea16f9 service nova] Creating event network-changed:ec270ef4-6103-4e61-8d7b-5e6bd6cb300d for instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 on n-h2-master-1 Sep 25 01:40:37.632657 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3671c3e5-7353-4e54-b91b-7fa57a8ee520 req-3e2ab073-8d72-4600-89a5-c9614cea16f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033147 Sep 25 01:40:37.633352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2963/5909] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:40:37.673176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:37.680952 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c98122a-0bb4-450c-85fb-905bc1b7567a tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.168684 Sep 25 01:40:37.681608 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2947/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:37 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:38.372408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:38.374170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:38.382219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:38.382720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:38.390878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:38.390878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:38.390878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:38.390878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:38.705557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:38.706221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:38.714324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:38.714824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:38.715855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:38.716838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:38.717083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:38.717950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:38.751608 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00bec6d7-6d27-4192-be18-af87f6f2e916 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.383327 Sep 25 01:40:38.762056 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2964/5911] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:38 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:39.044093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:39.053383 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-502d3244-30b6-4176-94cc-624d64855b2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.353168 Sep 25 01:40:39.066403 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2948/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:38 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:39.784767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:39.785574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:39.792262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:39.792812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:39.793318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:39.794094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:39.795175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:39.796107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:39.924064 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8440fd74-d05f-4bdd-9f85-02fe62f46ddb tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.142921 Sep 25 01:40:39.924658 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2965/5913] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:39 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:40.076948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:40.077590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:40.084426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:40.084907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:40.085344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:40.086056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:40.086510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:40.086935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:40.215197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:40.223598 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-967690a7-975b-4c47-92b1-f567106145c5 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.150793 Sep 25 01:40:40.224177 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2949/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:40 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:40.947408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:40.947972 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:40.955701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:40.956190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:40.956633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:40.957328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:40.958018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:40.958449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:41.113166 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a52f2446-2742-4eb8-8a6c-cfb2c56f28c7 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.169518 Sep 25 01:40:41.116149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2966/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:40 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:41.248856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:41.249874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:41.256810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:41.257393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:41.257928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:41.258689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:41.259201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:41.259691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:41.356593 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:41.418192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:41.427717 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5a40a637-7639-4395-b112-7393f3a1dd7e tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.183323 Sep 25 01:40:41.428276 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2950/5916] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:41 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:42.136408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:42.137070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:42.144597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:42.145087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:42.145565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:42.146263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:42.146726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:42.147166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:42.273957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4a43340-5b65-4d34-b492-bb10759d8a43 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.141342 Sep 25 01:40:42.274543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2967/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:42 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:42.450570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:42.451943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:42.458794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:42.459280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:42.459716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:42.460406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:42.460868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:42.461295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:42.532627 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:42.596968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:42.605946 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61b63f08-016c-44d5-8236-ab409f33a74d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.159372 Sep 25 01:40:42.606534 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2951/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:42 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:43.297849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:43.298473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:43.300534 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:43.301223 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:43.308764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:43.309255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:43.309726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:43.310459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:43.311610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:43.311763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:43.432348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3fe51acc-6e59-4d74-8ee5-7c1213337404 req-1b487249-9422-4657-979f-f94c2368cb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c780258a-6199-4aab-88b1-b9803c1c9c94", "name": "network-vif-plugged", "status": "completed", "tag": "16a89820-93b8-4180-9ef6-bc7d7c547c95"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:43.443208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3fe51acc-6e59-4d74-8ee5-7c1213337404 req-1b487249-9422-4657-979f-f94c2368cb02 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:43.444104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3fe51acc-6e59-4d74-8ee5-7c1213337404 req-1b487249-9422-4657-979f-f94c2368cb02 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:43.444850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3fe51acc-6e59-4d74-8ee5-7c1213337404 req-1b487249-9422-4657-979f-f94c2368cb02 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:43.458853 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3fe51acc-6e59-4d74-8ee5-7c1213337404 req-1b487249-9422-4657-979f-f94c2368cb02 service nova] Creating event network-vif-plugged:16a89820-93b8-4180-9ef6-bc7d7c547c95 for instance c780258a-6199-4aab-88b1-b9803c1c9c94 on n-h2-master-1 Sep 25 01:40:43.465117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3fe51acc-6e59-4d74-8ee5-7c1213337404 req-1b487249-9422-4657-979f-f94c2368cb02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037674 Sep 25 01:40:43.466044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2952/5919] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:40:43.467027 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bda3920-d3fb-48f4-9335-ef86af8f0f08 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.172740 Sep 25 01:40:43.478551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2968/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:43 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:43.631714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:43.632512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:43.640137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:43.640936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:43.641467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:43.642247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:43.642927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:43.643434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:43.782045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:43.792263 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7585307f-b16c-4a4d-9550-db17f6432773 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.167160 Sep 25 01:40:43.793142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2953/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:43 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:44.490190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:44.490867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:44.498423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:44.499085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:44.499530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:44.500285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:44.500745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:44.501219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:44.751145 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9ce836de-856f-40e4-ab5d-c1b2de38d378 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.264659 Sep 25 01:40:44.751738 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2969/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:44 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:44.815698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:44.816328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:44.823427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:44.823916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:44.824353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:44.825072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:44.825550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:44.826521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:44.974145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:44.983335 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d134ca09-cec3-48b3-a63c-464f00ae06d9 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1314 microversion: 2.1 time: 0.171764 Sep 25 01:40:44.984320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2954/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:44 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:45.483551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4fb93d69-c66c-4c56-9ad5-bb8b2bb74422 req-8e6be897-cb1e-4798-9368-769af0febea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0338eaec-3da2-4f5f-84bf-cf216ac22a41", "name": "network-vif-plugged", "status": "completed", "tag": "ec270ef4-6103-4e61-8d7b-5e6bd6cb300d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:45.493656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4fb93d69-c66c-4c56-9ad5-bb8b2bb74422 req-8e6be897-cb1e-4798-9368-769af0febea9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:45.494269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4fb93d69-c66c-4c56-9ad5-bb8b2bb74422 req-8e6be897-cb1e-4798-9368-769af0febea9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:45.494550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4fb93d69-c66c-4c56-9ad5-bb8b2bb74422 req-8e6be897-cb1e-4798-9368-769af0febea9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:45.507202 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4fb93d69-c66c-4c56-9ad5-bb8b2bb74422 req-8e6be897-cb1e-4798-9368-769af0febea9 service nova] Creating event network-vif-plugged:ec270ef4-6103-4e61-8d7b-5e6bd6cb300d for instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 on n-h2-master-1 Sep 25 01:40:45.512850 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4fb93d69-c66c-4c56-9ad5-bb8b2bb74422 req-8e6be897-cb1e-4798-9368-769af0febea9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033441 Sep 25 01:40:45.513513 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2970/5924] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:45.774803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:45.775425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:45.782115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:45.782601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:45.783038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:45.783738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:45.784190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:45.784630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:45.913302 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b23eb8f-b13a-400c-88f3-32248265e4fc tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.142210 Sep 25 01:40:45.914539 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2955/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:45 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:46.006461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:46.007164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:46.013549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.014361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.014822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.015525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.015974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.016405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.148397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:46.157616 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63f03e30-624d-4998-ae6d-51e7fa9d2119 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1498 microversion: 2.1 time: 0.155322 Sep 25 01:40:46.158389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2971/5926] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:46 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:46.558116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:46.558706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:46.564971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.565486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.565918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.566633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.567079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.567500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.595204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:40:46.673143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-343d0800-66f4-4683-9317-039f4cfa24a1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 204 len: 0 microversion: 2.1 time: 0.118546 Sep 25 01:40:46.673812 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2956/5927] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:40:46 2022] DELETE /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:40:46.682163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:46.682794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:46.690367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.691142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.692055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.692542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.693006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.693530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.834243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:46.842358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-035ba4c5-6a57-4df6-8f92-27743724cb2b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1504 microversion: 2.1 time: 0.163959 Sep 25 01:40:46.842938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2972/5928] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:46 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:46.937524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:46.938442 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:46.945798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.946222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.946660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:46.947395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:46.947827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:46.948244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:47.081365 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f558c18d-d493-4a77-b7ca-7001e1d41705 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1463 microversion: 2.1 time: 0.148857 Sep 25 01:40:47.081967 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2957/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:46 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:47.865889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:47.866517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:47.873781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:47.874277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:47.874811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:47.875518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:47.876087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:47.876700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:47.892253 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:48.019437 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:48.029636 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40d627c3-8ac2-4f88-a8d7-f9407a4e40ec tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1504 microversion: 2.1 time: 0.167770 Sep 25 01:40:48.031217 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2973/5930] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:47 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:48.103483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:48.104224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:48.112163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.112710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.113237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.114022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.114541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.115034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.117683 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:48.248496 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-353416d9-0da0-43b1-99a7-507c03598c41 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1647 microversion: 2.1 time: 0.148754 Sep 25 01:40:48.249269 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2958/5931] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:48 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1647 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:48.272492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:48.273130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:48.279436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.280490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.281158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.281897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.282363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.282871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.537210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f91c61ef-84e8-4816-bce7-58ace6d03873 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1647 microversion: 2.1 time: 0.270017 Sep 25 01:40:48.538070 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2974/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:48 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1647 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:48.559360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:48.559974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:48.567809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.567809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.568075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.568723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.569171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.569633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.757729 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a91c4755-9c6e-49dc-a665-22ccfcc0a121 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1647 microversion: 2.1 time: 0.202067 Sep 25 01:40:48.758465 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2959/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:48 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1647 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:48.780829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:48.781422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:48.792215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.792714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.793162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.793916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.794375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.794807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.820923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:40:48.913357 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e62d323f-e63e-48b1-895d-626167973b3d tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 204 len: 0 microversion: 2.1 time: 0.136439 Sep 25 01:40:48.915398 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2975/5934] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:40:48 2022] DELETE /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:40:48.933963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:48.934592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:48.956425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.956922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.957364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.958104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:48.970204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:48.970967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:48.996882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9d7c7f4b-ba1d-4b5e-85fc-90fcc29c7c70 req-2f70ee97-67f9-4e11-b932-7ab3b00a47d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c780258a-6199-4aab-88b1-b9803c1c9c94", "name": "network-vif-deleted", "tag": "16a89820-93b8-4180-9ef6-bc7d7c547c95"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:49.009021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9d7c7f4b-ba1d-4b5e-85fc-90fcc29c7c70 req-2f70ee97-67f9-4e11-b932-7ab3b00a47d0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:49.009833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9d7c7f4b-ba1d-4b5e-85fc-90fcc29c7c70 req-2f70ee97-67f9-4e11-b932-7ab3b00a47d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:49.010442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9d7c7f4b-ba1d-4b5e-85fc-90fcc29c7c70 req-2f70ee97-67f9-4e11-b932-7ab3b00a47d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:49.021368 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9d7c7f4b-ba1d-4b5e-85fc-90fcc29c7c70 req-2f70ee97-67f9-4e11-b932-7ab3b00a47d0 service nova] Creating event network-vif-deleted:16a89820-93b8-4180-9ef6-bc7d7c547c95 for instance c780258a-6199-4aab-88b1-b9803c1c9c94 on n-h2-master-1 Sep 25 01:40:49.026785 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9d7c7f4b-ba1d-4b5e-85fc-90fcc29c7c70 req-2f70ee97-67f9-4e11-b932-7ab3b00a47d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034108 Sep 25 01:40:49.027403 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2976/5935] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:40:49.056589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:49.057323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:49.064380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:49.065126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:49.065604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:49.066380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:49.066778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:49.067210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:49.118344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-26881d38-9ac0-4b2d-984c-d41eb2ff9923 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1653 microversion: 2.1 time: 0.197372 Sep 25 01:40:49.121803 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2960/5936] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:48 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1653 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:49.146293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:49.154392 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd020a69-32d4-4347-944a-4b20d871f039 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1462 microversion: 2.1 time: 0.102189 Sep 25 01:40:49.155612 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2977/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:49 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:50.143456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:50.144065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:50.151307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:50.151728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:50.152165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:50.152893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:50.153395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:50.153872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:50.178332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:50.179707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:50.192188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:50.193274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:50.194034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:50.195127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:50.197876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:50.198634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:50.244676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:50.245335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:50.245906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:50.246478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lazy-loading 'fault' on Instance uuid c780258a-6199-4aab-88b1-b9803c1c9c94 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:40:50.299457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:50.308843 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-32bf8cec-cc93-48c4-a6db-add210e1f310 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 200 len: 1304 microversion: 2.1 time: 0.134412 Sep 25 01:40:50.309679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2978/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:50 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:50.322167 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2edf12de-1284-473f-87e5-daed1d13b820 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1653 microversion: 2.1 time: 0.183391 Sep 25 01:40:50.322983 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2961/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:50 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1653 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:51.055081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0e287765-c6ed-4f88-9d19-74b17e56943d req-dedffacd-d29b-4b19-afc3-af18474b81ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0338eaec-3da2-4f5f-84bf-cf216ac22a41", "name": "network-vif-deleted", "tag": "ec270ef4-6103-4e61-8d7b-5e6bd6cb300d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:51.078324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0e287765-c6ed-4f88-9d19-74b17e56943d req-dedffacd-d29b-4b19-afc3-af18474b81ad service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.085598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0e287765-c6ed-4f88-9d19-74b17e56943d req-dedffacd-d29b-4b19-afc3-af18474b81ad service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.086159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0e287765-c6ed-4f88-9d19-74b17e56943d req-dedffacd-d29b-4b19-afc3-af18474b81ad service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.103484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0e287765-c6ed-4f88-9d19-74b17e56943d req-dedffacd-d29b-4b19-afc3-af18474b81ad service nova] Creating event network-vif-deleted:ec270ef4-6103-4e61-8d7b-5e6bd6cb300d for instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 on n-h2-master-1 Sep 25 01:40:51.123136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0e287765-c6ed-4f88-9d19-74b17e56943d req-dedffacd-d29b-4b19-afc3-af18474b81ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071622 Sep 25 01:40:51.124144 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2979/5940] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:51.332721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:51.333354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: c780258a-6199-4aab-88b1-b9803c1c9c94] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:51.340302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.340887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.341334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.342063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.343158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.343620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.348806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:51.349659 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:51.357165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.357793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.358595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.358694 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] HTTP exception thrown: Instance c780258a-6199-4aab-88b1-b9803c1c9c94 could not be found. Sep 25 01:40:51.359666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.360328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Request method failure captured: Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 HTTP/1.1 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7GL8STNrG9h0FP2WCGv-bmkYIdGVfSa2Va0Ge3kJHwNHDakg9uLG1XiZSqbZBbcE12sK4DjuZzyz_PKtP_aJlFknnHKl8V8qpsEZUKT7A5EQh-j1-YJYKhEKNQFOFbTg794meqPxzfehreKiX30DrY-YQM9IiTSp8dqMZ1w2frvfbU Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 01604e09ffe9466cafa6cfe2a5867aae Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-VolumesActionsTest-1561556135 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01604e09ffe9466cafa6cfe2a5867aae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01604e09ffe9466cafa6cfe2a5867aae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01604e09ffe9466cafa6cfe2a5867aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01604e09ffe9466cafa6cfe2a5867aae"}]}] Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-VolumesActionsTest-1561556135 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 01604e09ffe9466cafa6cfe2a5867aae Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-VolumesActionsTest-1561556135 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-VolumesActionsTest-1561556135-project Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 27f69f72a9044ea490c8fd4c4db6bf31 Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-VolumesActionsTest-1561556135-project Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: exception: Instance c780258a-6199-4aab-88b1-b9803c1c9c94 could not be found. Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'c780258a-6199-4aab-88b1-b9803c1c9c94'} Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c780258a-6199-4aab-88b1-b9803c1c9c94 could not be found. Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c780258a-6199-4aab-88b1-b9803c1c9c94 could not be found. Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:40:51.360424 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c780258a-6199-4aab-88b1-b9803c1c9c94 could not be found. Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Returning 404 to user: Instance c780258a-6199-4aab-88b1-b9803c1c9c94 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96957eb9-11c4-4531-9b35-95f4065c9c60 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94" status: 404 len: 111 microversion: 2.1 time: 0.032938 Sep 25 01:40:51.378505 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2962/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:51 2022] GET /compute/v2.1/servers/c780258a-6199-4aab-88b1-b9803c1c9c94 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:40:51.379133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.411055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.417471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.417471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.417471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lazy-loading 'fault' on Instance uuid 0338eaec-3da2-4f5f-84bf-cf216ac22a41 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:40:51.439419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-301056560", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "de297034-30c0-4126-a2a7-5fb6dacb5d82"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:51.483801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c9fcc8c-a80e-479f-a401-f4d4c781a163 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 200 len: 1453 microversion: 2.1 time: 0.140736 Sep 25 01:40:51.485341 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2980/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:51 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:51.498087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] validate_networks() for [('de297034-30c0-4126-a2a7-5fb6dacb5d82', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:40:51.878223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:40:51.878629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:40:51.879135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:40:51.879548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:40:51.880265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:40:51.890334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.890817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.891293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.892008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:51.892463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:51.892894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:51.911066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Getting quotas for project 01604e09ffe9466cafa6cfe2a5867aae. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:40:51.916436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Getting quotas for user 27f69f72a9044ea490c8fd4c4db6bf31 and project 01604e09ffe9466cafa6cfe2a5867aae. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:40:51.929633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:40:51.931968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:40:51.980333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73c09dbf-3425-46af-aea4-8d462c35acdf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545692 Sep 25 01:40:51.981164 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2963/5943] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:40:51.992775 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c03d22b8-60d5-4e2a-9051-4e0a8fb8a6d6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:51.993668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c03d22b8-60d5-4e2a-9051-4e0a8fb8a6d6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:52.065246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c03d22b8-60d5-4e2a-9051-4e0a8fb8a6d6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:52.072987 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c03d22b8-60d5-4e2a-9051-4e0a8fb8a6d6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1213 microversion: 2.1 time: 0.083922 Sep 25 01:40:52.073670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2981/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:51 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:52.510123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:52.510992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 0338eaec-3da2-4f5f-84bf-cf216ac22a41] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:52.523034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:52.523850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:52.524467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:52.525335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:52.526126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:52.526732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:52.542220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] HTTP exception thrown: Instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 could not be found. Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Request method failure captured: Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 HTTP/1.1 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7F-CJsvKduNIi_3ixrxy5azZkGDO1s3cLDxJdQ-HLiq9xme3hgaLEypIo0xYZ-sJh_uN3Xikys7slGUI8hOAwKV01nskrrlRSk_6sgDF1VllHY08-iP-_zYpv62NDUr6thJ25gMx6iuaPFQVPd5lTUuRwuIdsCPNauXFn0JZo2HT9o Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 26e7627ce0114c99bc81f9e2c8c5e1c0 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestServerMultinode-1117353913 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e7627ce0114c99bc81f9e2c8c5e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e7627ce0114c99bc81f9e2c8c5e1c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e7627ce0114c99bc81f9e2c8c5e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e7627ce0114c99bc81f9e2c8c5e1c0"}]}] Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestServerMultinode-1117353913 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 26e7627ce0114c99bc81f9e2c8c5e1c0 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestServerMultinode-1117353913 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestServerMultinode-1117353913-project-admin Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4693e5435d484d519b806ccddf83e1b9 Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestServerMultinode-1117353913-project-admin Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 could not be found. Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '0338eaec-3da2-4f5f-84bf-cf216ac22a41'} Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 could not be found. Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 could not be found. Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:40:52.543801 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 could not be found. Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Returning 404 to user: Instance 0338eaec-3da2-4f5f-84bf-cf216ac22a41 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:40:52.549254 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14337e80-a90f-4954-8628-58fe9da0c52a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41" status: 404 len: 111 microversion: 2.1 time: 0.040093 Sep 25 01:40:52.550561 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2964/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:52 2022] GET /compute/v2.1/servers/0338eaec-3da2-4f5f-84bf-cf216ac22a41 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:40:52.555625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:52.556399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:52.566937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:52.567747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:52.568489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:52.569213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:52.569699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:52.570141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:52.596448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:40:52.687906 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-25862509-1019-4eb1-b56c-f0c23fa9ecaf tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 204 len: 0 microversion: 2.1 time: 0.135769 Sep 25 01:40:52.688614 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2982/5946] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:40:52 2022] DELETE /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:40:52.696742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:52.697494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:52.705166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:52.706046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:52.706611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:52.707412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:52.707944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:52.708572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:52.846359 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-378983b5-1fd7-49cb-91c3-a0c01115f81c tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1655 microversion: 2.1 time: 0.153307 Sep 25 01:40:52.846939 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2965/5947] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:52 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:53.096032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:53.096729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:53.103145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:53.103642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:53.104184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:53.104928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:53.105374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:53.105846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:53.223886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:53.236447 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d6017d2-e23c-445b-8ad8-aca2a7a57e6b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1273 microversion: 2.1 time: 0.144929 Sep 25 01:40:53.237753 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2983/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:53 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:53.870021 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:53.870818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:53.878934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:53.879542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:53.880232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:53.881057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:53.881665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:53.882289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:54.168899 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f08aee14-f1e3-4e89-8704-f1508fc81d4a tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1655 microversion: 2.1 time: 0.302731 Sep 25 01:40:54.169639 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2966/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:53 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1655 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:54.261166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:54.263212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:54.272979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:54.274521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:54.274964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:54.276115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:54.276747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:54.277173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:54.520816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:54.545390 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-06212108-a1b7-4036-8118-d6afb88ebf1d tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.289437 Sep 25 01:40:54.561816 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2984/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:54 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:54.732703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-560961b8-dcc8-4c0a-b927-16a9fb5c6ad7 req-2a54a38d-7b77-47a7-b824-f6947ecf858e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b0df65-fa30-4534-9f20-0f5dc4285378", "tag": "63f6891e-d419-44ce-a669-ca70fc53412c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:54.755360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-560961b8-dcc8-4c0a-b927-16a9fb5c6ad7 req-2a54a38d-7b77-47a7-b824-f6947ecf858e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:54.756099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-560961b8-dcc8-4c0a-b927-16a9fb5c6ad7 req-2a54a38d-7b77-47a7-b824-f6947ecf858e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:54.756699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-560961b8-dcc8-4c0a-b927-16a9fb5c6ad7 req-2a54a38d-7b77-47a7-b824-f6947ecf858e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:54.796354 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-560961b8-dcc8-4c0a-b927-16a9fb5c6ad7 req-2a54a38d-7b77-47a7-b824-f6947ecf858e service nova] Creating event network-changed:63f6891e-d419-44ce-a669-ca70fc53412c for instance 77b0df65-fa30-4534-9f20-0f5dc4285378 on n-h2-master-1 Sep 25 01:40:54.804461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-560961b8-dcc8-4c0a-b927-16a9fb5c6ad7 req-2a54a38d-7b77-47a7-b824-f6947ecf858e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075000 Sep 25 01:40:54.806287 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2967/5951] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:54.854172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d5c1560b-04b0-4f07-8037-9505bdb18cf3 req-7d6392cd-86d0-4c76-b38e-4a0f6511510f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc2f095-98d3-4cfc-b16c-28481e432b37", "name": "network-vif-deleted", "tag": "e5987f48-1efa-47b9-a7d9-6da072efc7c5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:40:54.865745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d5c1560b-04b0-4f07-8037-9505bdb18cf3 req-7d6392cd-86d0-4c76-b38e-4a0f6511510f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:54.866617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d5c1560b-04b0-4f07-8037-9505bdb18cf3 req-7d6392cd-86d0-4c76-b38e-4a0f6511510f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:54.867302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d5c1560b-04b0-4f07-8037-9505bdb18cf3 req-7d6392cd-86d0-4c76-b38e-4a0f6511510f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:54.895107 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d5c1560b-04b0-4f07-8037-9505bdb18cf3 req-7d6392cd-86d0-4c76-b38e-4a0f6511510f service nova] Creating event network-vif-deleted:e5987f48-1efa-47b9-a7d9-6da072efc7c5 for instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 on n-h1-master-1 Sep 25 01:40:54.909538 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d5c1560b-04b0-4f07-8037-9505bdb18cf3 req-7d6392cd-86d0-4c76-b38e-4a0f6511510f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056851 Sep 25 01:40:54.910597 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2985/5952] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:40:55.193464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:55.194174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:55.202648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:55.203345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:55.204119 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:55.204902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:55.205373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:55.205849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:55.235733 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:55.239504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:55.240027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:55.240470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:55.240933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lazy-loading 'fault' on Instance uuid 1dc2f095-98d3-4cfc-b16c-28481e432b37 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:40:55.305675 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7e707c59-3c6e-4547-999f-6e40eb41fdd6 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 200 len: 1454 microversion: 2.1 time: 0.116338 Sep 25 01:40:55.306307 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2968/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:55 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:55.575683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:55.576392 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:55.589265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:55.589799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:55.590440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:55.591146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:55.591672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:55.592674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:55.728603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:55.736569 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c21a63b-fdf8-41d5-91fb-0223dce91320 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.166831 Sep 25 01:40:55.737143 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2986/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:55 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:40:56.328290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:56.328910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] [instance: 1dc2f095-98d3-4cfc-b16c-28481e432b37] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:56.336080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:56.336577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:56.337021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:56.337790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:56.338252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:56.338682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:56.352756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] HTTP exception thrown: Instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 could not be found. Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Request method failure captured: Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 HTTP/1.1 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7F-CJsvKduNIi_3ixrxy5azZkGDO1s3cLDxJdQ-HLiq9xme3hgaLEypIo0xYZ-sJh_uN3Xikys7slGUI8hOAwKV01nskrrlRSk_6sgDF1VllHY08-iP-_zYpv62NDUr6thJ25gMx6iuaPFQVPd5lTUuRwuIdsCPNauXFn0JZo2HT9o Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 26e7627ce0114c99bc81f9e2c8c5e1c0 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestServerMultinode-1117353913 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e7627ce0114c99bc81f9e2c8c5e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e7627ce0114c99bc81f9e2c8c5e1c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e7627ce0114c99bc81f9e2c8c5e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e7627ce0114c99bc81f9e2c8c5e1c0"}]}] Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestServerMultinode-1117353913 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 26e7627ce0114c99bc81f9e2c8c5e1c0 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestServerMultinode-1117353913 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestServerMultinode-1117353913-project-admin Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4693e5435d484d519b806ccddf83e1b9 Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestServerMultinode-1117353913-project-admin Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 could not be found. Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1dc2f095-98d3-4cfc-b16c-28481e432b37'} Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 could not be found. Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 could not be found. Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:40:56.354452 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 could not be found. Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] Returning 404 to user: Instance 1dc2f095-98d3-4cfc-b16c-28481e432b37 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cb6de53e-373e-4398-a758-f876bf416405 tempest-TestServerMultinode-1117353913 tempest-TestServerMultinode-1117353913-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37" status: 404 len: 111 microversion: 2.1 time: 0.031444 Sep 25 01:40:56.360290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2969/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:56 2022] GET /compute/v2.1/servers/1dc2f095-98d3-4cfc-b16c-28481e432b37 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:40:56.759708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:56.760625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:56.770595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:56.771260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:56.771720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:56.772443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:56.772906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:56.773343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:57.013240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:57.022667 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d71fabb5-3f61-438a-99da-01d874c2e0c4 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.266963 Sep 25 01:40:57.023795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2987/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:56 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:58.045525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:58.046310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:58.053347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:58.053869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:58.054310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:58.055011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:58.055497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:58.055957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:58.364647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:58.372350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc50ffb6-c6ca-400e-a791-60e174ea1576 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.330919 Sep 25 01:40:58.372908 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2970/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:58 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:40:59.396914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:40:59.397899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:40:59.400966 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:40:59.407766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:59.408457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:59.410322 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:59.411071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:40:59.411545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:40:59.412027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:40:59.620014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:40:59.630570 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c7a5fb5f-04d9-4267-a477-373bd60ddce1 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.237671 Sep 25 01:40:59.646502 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2988/5958] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:40:59 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:00.655673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:00.656281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:00.663569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:00.664047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:00.664482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:00.665171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:00.665647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:00.666066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:00.803794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:00.812841 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2e06e69-8fd2-4221-9c55-fa2c4edd5824 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.161717 Sep 25 01:41:00.813539 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2971/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:00 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:01.117358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d7e641e8-347c-4a88-8060-541fc93d6a5f req-2923aca8-1acd-4de2-8dab-0f1e52a3ae2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b0df65-fa30-4534-9f20-0f5dc4285378", "name": "network-vif-plugged", "status": "completed", "tag": "63f6891e-d419-44ce-a669-ca70fc53412c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:01.129941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7e641e8-347c-4a88-8060-541fc93d6a5f req-2923aca8-1acd-4de2-8dab-0f1e52a3ae2e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:01.130439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7e641e8-347c-4a88-8060-541fc93d6a5f req-2923aca8-1acd-4de2-8dab-0f1e52a3ae2e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:01.130892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7e641e8-347c-4a88-8060-541fc93d6a5f req-2923aca8-1acd-4de2-8dab-0f1e52a3ae2e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:01.135025 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:01.145179 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d7e641e8-347c-4a88-8060-541fc93d6a5f req-2923aca8-1acd-4de2-8dab-0f1e52a3ae2e service nova] Creating event network-vif-plugged:63f6891e-d419-44ce-a669-ca70fc53412c for instance 77b0df65-fa30-4534-9f20-0f5dc4285378 on n-h2-master-1 Sep 25 01:41:01.151112 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d7e641e8-347c-4a88-8060-541fc93d6a5f req-2923aca8-1acd-4de2-8dab-0f1e52a3ae2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037473 Sep 25 01:41:01.152085 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2989/5960] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:01.835925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:01.837028 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:01.846099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:01.847069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:01.847810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:01.848791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:01.849597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:01.850310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:01.901623 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:01.924412 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:02.008018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:02.017482 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a96be49-e375-444a-b7e5-840db853068b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1313 microversion: 2.1 time: 0.184819 Sep 25 01:41:02.033889 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2972/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:01 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:03.037689 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:03.043716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:03.044463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:03.053484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:03.053992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:03.054431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:03.055490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:03.055976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:03.056399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:03.322934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:03.331621 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b8e54df4-d0dd-4055-a2a3-ba4432782d7b tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1497 microversion: 2.1 time: 0.294937 Sep 25 01:41:03.332413 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2990/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:03 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1497 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:03.933514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:03.934645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:03.942910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:03.943920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:03.944545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:03.945450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:03.946253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:03.946831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:03.980808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:41:04.079241 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b358ff3-8dc1-4786-8fb8-3ba3f7ebbedf tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "DELETE /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 204 len: 0 microversion: 2.1 time: 0.149518 Sep 25 01:41:04.080603 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2973/5963] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:41:03 2022] DELETE /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:41:04.089346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:04.090142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:04.097871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:04.098464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:04.099001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:04.099818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:04.100686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:04.101341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:04.266163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:04.277475 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1961cc87-c15e-4547-9b05-93729ea109c6 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1503 microversion: 2.1 time: 0.192034 Sep 25 01:41:04.278670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2991/5964] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:04 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:41:04.627351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:04.627922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:04.633836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:04.634535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:04.635128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:04.636007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:04.636442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:04.637043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:04.665102 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40537c35-84c7-4f51-a99b-20116770898f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/ips" status: 200 len: 145 microversion: 2.1 time: 0.042087 Sep 25 01:41:04.671781 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2974/5965] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:41:04 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:05.301194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:05.302470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:05.310133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:05.311350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:05.312079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:05.312936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:05.313646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:05.314324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:05.494652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:05.507986 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-19df33ad-6cb8-4f9d-897f-b3ed0bb27138 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1503 microversion: 2.1 time: 0.210465 Sep 25 01:41:05.517242 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2992/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:05 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:06.156532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-19d694ea-c01a-4b2f-adfa-234e42efefa4 req-55ba760d-eb9e-4b1b-a230-868a72963560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b0df65-fa30-4534-9f20-0f5dc4285378", "name": "network-vif-deleted", "tag": "63f6891e-d419-44ce-a669-ca70fc53412c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:06.178102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-19d694ea-c01a-4b2f-adfa-234e42efefa4 req-55ba760d-eb9e-4b1b-a230-868a72963560 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:06.179150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-19d694ea-c01a-4b2f-adfa-234e42efefa4 req-55ba760d-eb9e-4b1b-a230-868a72963560 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:06.180037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-19d694ea-c01a-4b2f-adfa-234e42efefa4 req-55ba760d-eb9e-4b1b-a230-868a72963560 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:06.194804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-19d694ea-c01a-4b2f-adfa-234e42efefa4 req-55ba760d-eb9e-4b1b-a230-868a72963560 service nova] Creating event network-vif-deleted:63f6891e-d419-44ce-a669-ca70fc53412c for instance 77b0df65-fa30-4534-9f20-0f5dc4285378 on n-h2-master-1 Sep 25 01:41:06.199818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-19d694ea-c01a-4b2f-adfa-234e42efefa4 req-55ba760d-eb9e-4b1b-a230-868a72963560 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047897 Sep 25 01:41:06.204422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2975/5967] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:06.541089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:06.541870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:06.550775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:06.551586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:06.552277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:06.553612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:06.554460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:06.555264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:06.598932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:06.599343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:06.599782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:06.600233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lazy-loading 'fault' on Instance uuid 77b0df65-fa30-4534-9f20-0f5dc4285378 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:41:06.646406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f69f72a9044ea490c8fd4c4db6bf31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01604e09ffe9466cafa6cfe2a5867aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:06.657195 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d25095b0-20d1-458a-a637-274f99e5e3cc tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 200 len: 1303 microversion: 2.1 time: 0.120654 Sep 25 01:41:06.657836 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2993/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:06 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:06.975092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c5a10f8-a8d5-470f-aedc-a44152704451"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:06.977535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:06.984281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:06.984760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:06.985196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:06.985921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:06.986375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:06.986803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:07.137202 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:07.259067 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-39c89191-0870-4238-83e0-7997e83da9d8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288177 Sep 25 01:41:07.259728 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2976/5969] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:41:06 2022] POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:07.683661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:07.684206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] [instance: 77b0df65-fa30-4534-9f20-0f5dc4285378] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:07.692103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:07.692596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:07.693040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:07.693776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:07.694234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:07.694663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:07.711614 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] HTTP exception thrown: Instance 77b0df65-fa30-4534-9f20-0f5dc4285378 could not be found. Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Request method failure captured: Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 HTTP/1.1 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7GL8STNrG9h0FP2WCGv-bmkYIdGVfSa2Va0Ge3kJHwNHDakg9uLG1XiZSqbZBbcE12sK4DjuZzyz_PKtP_aJlFknnHKl8V8qpsEZUKT7A5EQh-j1-YJYKhEKNQFOFbTg794meqPxzfehreKiX30DrY-YQM9IiTSp8dqMZ1w2frvfbU Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 01604e09ffe9466cafa6cfe2a5867aae Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-VolumesActionsTest-1561556135 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01604e09ffe9466cafa6cfe2a5867aae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01604e09ffe9466cafa6cfe2a5867aae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01604e09ffe9466cafa6cfe2a5867aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01604e09ffe9466cafa6cfe2a5867aae"}]}] Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-VolumesActionsTest-1561556135 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 01604e09ffe9466cafa6cfe2a5867aae Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-VolumesActionsTest-1561556135 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-VolumesActionsTest-1561556135-project Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 27f69f72a9044ea490c8fd4c4db6bf31 Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-VolumesActionsTest-1561556135-project Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 77b0df65-fa30-4534-9f20-0f5dc4285378 could not be found. Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '77b0df65-fa30-4534-9f20-0f5dc4285378'} Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b0df65-fa30-4534-9f20-0f5dc4285378 could not be found. Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b0df65-fa30-4534-9f20-0f5dc4285378 could not be found. Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:41:07.713238 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b0df65-fa30-4534-9f20-0f5dc4285378 could not be found. Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] Returning 404 to user: Instance 77b0df65-fa30-4534-9f20-0f5dc4285378 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6175ac4f-d5bc-4b08-9982-89e8a3f12303 tempest-VolumesActionsTest-1561556135 tempest-VolumesActionsTest-1561556135-project] 10.222.0.16 "GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378" status: 404 len: 111 microversion: 2.1 time: 0.035604 Sep 25 01:41:07.723993 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2994/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:07 2022] GET /compute/v2.1/servers/77b0df65-fa30-4534-9f20-0f5dc4285378 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:41:19.515554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-269f00f2-dc6e-4d5e-9fd5-36fa6c8cc3ff tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:19.519749 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:19.522153 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:19.529747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269f00f2-dc6e-4d5e-9fd5-36fa6c8cc3ff tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:19.531173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269f00f2-dc6e-4d5e-9fd5-36fa6c8cc3ff tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:19.532196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-269f00f2-dc6e-4d5e-9fd5-36fa6c8cc3ff tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:19.566641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-269f00f2-dc6e-4d5e-9fd5-36fa6c8cc3ff tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Going to try to stop instance {{(pid=122384) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:41:19.644249 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-269f00f2-dc6e-4d5e-9fd5-36fa6c8cc3ff tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action" status: 202 len: 0 microversion: 2.1 time: 0.133915 Sep 25 01:41:19.645364 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2977/5971] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:41:19 2022] POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:41:19.656398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:19.657726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:19.665611 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=15 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:19.666555 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=29 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:19.669093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:19.670339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:19.671541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:19.672826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:19.673597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:19.674386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:19.886984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:19.901156 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f903c43-e466-4232-93d8-75cc69a5ffaf tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.251809 Sep 25 01:41:19.902158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2995/5972] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:19 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:20.928906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:20.930342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:20.937484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:20.938326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:20.938932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:20.939864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:20.940482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:20.941070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:21.097952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:21.110315 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6441e911-29bf-4d7b-ab59-d15182c9341a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.186869 Sep 25 01:41:21.112043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2978/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:20 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:22.135341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:22.136632 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:22.146597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:22.149478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:22.150533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:22.154499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:22.157227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:22.158343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:22.370814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:22.380066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1183837-92c6-4411-b3de-1f1337c8ad44 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.249190 Sep 25 01:41:22.381063 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2996/5974] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:22 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:23.406332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:23.407891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:23.416981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:23.417904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:23.418589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:23.419593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:23.420299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:23.421130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:23.608366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:23.621068 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ef590bf-5bf4-4f2f-9dbe-36bfe63b2398 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.220712 Sep 25 01:41:23.622290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2979/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:23 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:24.645652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:24.646474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:24.655210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:24.656177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:24.656866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:24.657839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:24.658872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:24.660402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:24.866254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:24.883007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf289092-2c50-481f-b55b-7e017d4881c5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.242369 Sep 25 01:41:24.885486 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2997/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:24 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:25.910807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:25.912210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:25.923539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:25.929013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:25.929970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:25.931219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:25.931849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:25.932449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:26.115968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:26.128768 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c38b1016-70fc-487b-9c2a-7dd3d718853e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.222629 Sep 25 01:41:26.143677 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2980/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:25 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:27.156303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:27.156936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:27.165141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:27.165659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:27.166309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:27.167299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:27.168218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:27.168807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:27.335303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:27.345460 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f626954-8236-4b4d-8b28-e7403807b3c2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.193776 Sep 25 01:41:27.347547 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2998/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:27 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:28.370278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:28.371033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:28.378861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:28.379465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:28.379915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:28.380618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:28.381078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:28.381541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:28.519088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:28.528367 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0c91d41-0a41-4b25-b57e-b0229f74de56 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.162040 Sep 25 01:41:28.529870 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2981/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:28 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:29.552463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:29.553210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:29.561071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:29.561824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:29.562854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:29.563570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:29.564033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:29.564460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:29.721824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:29.732504 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14ec7d80-7a2f-47f0-8c56-1b713774c67d tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1724 microversion: 2.1 time: 0.183509 Sep 25 01:41:29.733642 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 2999/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:29 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:30.756781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:30.757441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:30.764958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:30.765501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:30.765952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:30.768035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:30.768509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:30.768940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:30.914004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:30.923145 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd9073d3-0d7a-4f2a-b93b-c5431a3fc3f4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1701 microversion: 2.1 time: 0.170372 Sep 25 01:41:30.923745 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2982/5981] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:30 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:30.946243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a13057d1-d2ec-4c31-9b82-eedc9ae81b82 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:30.954738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a13057d1-d2ec-4c31-9b82-eedc9ae81b82 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:30.955325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a13057d1-d2ec-4c31-9b82-eedc9ae81b82 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:30.955839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a13057d1-d2ec-4c31-9b82-eedc9ae81b82 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:30.982505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a13057d1-d2ec-4c31-9b82-eedc9ae81b82 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Going to try to start instance {{(pid=122385) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:41:31.029291 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a13057d1-d2ec-4c31-9b82-eedc9ae81b82 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action" status: 202 len: 0 microversion: 2.1 time: 0.086296 Sep 25 01:41:31.030485 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3000/5982] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:41:30 2022] POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:41:31.041107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:31.041863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:31.049564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:31.050205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:31.050918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:31.052747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:31.053215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:31.053684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:31.258656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:31.275222 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd76d522-31f3-4c48-acfa-81287e6fef98 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1710 microversion: 2.1 time: 0.235979 Sep 25 01:41:31.275657 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2983/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:31 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1710 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:41:32.301295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:32.302757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:32.310783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:32.311690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:32.312368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:32.313356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:32.314107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:32.314789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:32.518303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:32.538256 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-feb54395-e6ae-451b-b66b-bc007efe83f3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1710 microversion: 2.1 time: 0.242329 Sep 25 01:41:32.539279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75474e01-9f2e-44e3-8cae-1472929375dc tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Action: 'create', calling method: .version_select at 0x7f7beb1841f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1800337713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVCCrwk3r8/fH8vr0J3b6bKr5q8MQwrEV0M1se9mV96PZcDSV9byLEaN789uiUKo8xTeO9ko/aqir671zDa9ibNr5UGQnhOMHUBCrh+1DDj5MjRqRpsT7zIHWqeH2o4TQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:32.539980 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3001/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:32 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1710 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:32.573832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-75474e01-9f2e-44e3-8cae-1472929375dc tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Getting quotas for project 8eeb0489ee8f4e9dbbcb33ed3263c0bb. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:41:32.582049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-75474e01-9f2e-44e3-8cae-1472929375dc tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Getting quotas for user cd2b15ca74604287bbc113c051f0ebde and project 8eeb0489ee8f4e9dbbcb33ed3263c0bb. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:41:32.608485 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75474e01-9f2e-44e3-8cae-1472929375dc tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.072777 Sep 25 01:41:32.609098 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2984/5985] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:41:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:41:33.569981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:33.571072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:33.582280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:33.582865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:33.583776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:33.584671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:33.585280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:33.586154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:33.724132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-873697832", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "085f4525-db90-4f85-a333-6736f225a175", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1800337713", "security_groups": [{"name": "tempest-secgroup-smoke-1072641216"}], "networks": [{"uuid": "045b7de1-ebe6-42ac-a59d-9697286a889b"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:33.746260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:33.755460 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0ffdf45a-d878-48ca-ab84-4d5d63d37931 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1714 microversion: 2.1 time: 0.191597 Sep 25 01:41:33.756055 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3002/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:33 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1714 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:33.848196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] validate_networks() for [('045b7de1-ebe6-42ac-a59d-9697286a889b', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:41:34.231323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:41:34.231836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:41:34.232310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:41:34.232845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:41:34.233266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:41:34.242425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:34.242911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:34.243346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:34.244075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:34.244530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:34.244956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:34.263733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Getting quotas for project 8eeb0489ee8f4e9dbbcb33ed3263c0bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:41:34.269378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Getting quotas for user cd2b15ca74604287bbc113c051f0ebde and project 8eeb0489ee8f4e9dbbcb33ed3263c0bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:41:34.340721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:41:34.342966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='085f4525-db90-4f85-a333-6736f225a175',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:41:34.484562 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f5c8986f-ab7f-40f4-9ae3-bf55f84a6e51 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765086 Sep 25 01:41:34.485149 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2985/5987] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:41:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:41:34.496335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b542a170-2b39-4211-868b-99d8e2d2ad40 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:34.496964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b542a170-2b39-4211-868b-99d8e2d2ad40 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:34.551417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b542a170-2b39-4211-868b-99d8e2d2ad40 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:34.558493 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b542a170-2b39-4211-868b-99d8e2d2ad40 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1098 microversion: 2.1 time: 0.066009 Sep 25 01:41:34.559066 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3003/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:34 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1098 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:35.584079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:35.585163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:35.592725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:35.593511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:35.594811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:35.595931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:35.596618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:35.597274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:35.677876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:35.688243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89618f2a-cc5a-47dc-b9b5-ea686599b576 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1204 microversion: 2.1 time: 0.110072 Sep 25 01:41:35.688751 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2986/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:35 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:41:36.712109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:36.712735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:36.720790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:36.721613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:36.722285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:36.723219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:36.723923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:36.724574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:37.293677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:37.303629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a24333c2-78dc-4c66-9fa2-ef8f3853f99a tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1282 microversion: 2.1 time: 0.595272 Sep 25 01:41:37.304551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3004/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:36 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1282 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:37.916213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-4e589e55-953d-4939-92f2-fb240d46eafb req-c45c1891-1514-4a30-a390-d14363e2fa79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:37.928791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4e589e55-953d-4939-92f2-fb240d46eafb req-c45c1891-1514-4a30-a390-d14363e2fa79 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:37.929587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4e589e55-953d-4939-92f2-fb240d46eafb req-c45c1891-1514-4a30-a390-d14363e2fa79 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:37.930234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-4e589e55-953d-4939-92f2-fb240d46eafb req-c45c1891-1514-4a30-a390-d14363e2fa79 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:37.943364 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-4e589e55-953d-4939-92f2-fb240d46eafb req-c45c1891-1514-4a30-a390-d14363e2fa79 service nova] Creating event network-changed:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:41:37.959111 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-4e589e55-953d-4939-92f2-fb240d46eafb req-c45c1891-1514-4a30-a390-d14363e2fa79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236788 Sep 25 01:41:37.959728 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2987/5991] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:38.327782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:38.328408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:38.338127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:38.338972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:38.339623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:38.340544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:38.341268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:38.341930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:38.612668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:38.625026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-031a88f1-96de-44d8-91a5-f7ae280e83ae tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1282 microversion: 2.1 time: 0.301389 Sep 25 01:41:38.626537 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3005/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:38 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1282 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:39.648824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:39.649671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:39.657472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:39.658039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:39.658557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:39.659329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:39.659857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:39.660355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:39.814686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:39.823649 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a6a329f3-0eda-463d-81b7-3cd0d2ad6037 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1282 microversion: 2.1 time: 0.179368 Sep 25 01:41:39.824517 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2988/5993] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:39 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:40.848051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:40.848860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:40.861674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:40.862179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:40.862904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:40.864313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:40.865057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:40.865469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:41.017578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:41.027270 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6d3a346-d886-4be8-8584-74a8ca71ee99 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1282 microversion: 2.1 time: 0.184312 Sep 25 01:41:41.033996 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3006/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:40 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:41:42.051731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:42.052358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:42.059406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:42.059891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:42.060524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:42.061224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:42.061708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:42.062140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:42.202455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:42.210661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d0b15d36-2645-4274-b02e-397f09cd9bc5 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.162873 Sep 25 01:41:42.211565 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2989/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:42 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:43.235812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:43.236493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:43.243544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:43.244165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:43.244613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:43.245318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:43.245804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:43.246295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:43.399204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:43.421254 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec7c7138-5465-4db7-be8e-0af9ad14696d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.189990 Sep 25 01:41:43.421976 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3007/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:43 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:44.444205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:44.444808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:44.447931 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:44.448797 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:44.456118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:44.456611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:44.457054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:44.457788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:44.458432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:44.458867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:44.597639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:44.610508 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ec83dc8-dceb-4b9e-ad30-2970b02c14da tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.170111 Sep 25 01:41:44.625428 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2990/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:44 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:45.636369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:45.636990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:45.640611 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:45.646417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:45.646905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:45.647349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:45.648047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:45.648554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:45.648987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:45.790663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:45.798769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a4f60d5-d9df-4014-be90-b46bf454d00b tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.166376 Sep 25 01:41:45.799390 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3008/5998] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:45 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:46.821313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:46.821960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:46.830227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:46.830711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:46.831148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:46.831838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:46.832307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:46.832728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:46.981245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:46.990756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd424c6e-035b-42d9-bf68-5b4544eb27a7 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.173223 Sep 25 01:41:46.991452 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2991/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:46 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:48.014646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:48.015283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:48.022355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:48.022854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:48.023302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:48.024014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:48.024476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:48.024911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:48.165326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:48.173274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9794ae69-f745-41d0-8088-75d4baa1b1b3 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.162803 Sep 25 01:41:48.173877 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3009/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:48 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:49.196772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:49.197692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:49.206064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:49.206867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:49.207308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:49.208212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:49.208672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:49.209099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:49.356153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:49.365745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf9ca8ab-4096-40a3-85f5-d7a43a989483 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.173469 Sep 25 01:41:49.366743 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2992/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:49 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:50.389428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:50.390164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:50.393216 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=33 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:50.398739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:50.399536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:50.400057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:50.400840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:50.401505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:50.401944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:50.406617 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:50.542826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:50.551672 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64b1541b-ad15-4834-b3d7-a02028a45435 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.166099 Sep 25 01:41:50.552264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3010/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:50 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:51.325713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b1b0844a-1927-492a-a8e9-e9e953f248cc req-ba34c1bd-714b-4961-b51c-8258cbdda80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "name": "network-vif-plugged", "status": "completed", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:51.337394 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:51.341371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1b0844a-1927-492a-a8e9-e9e953f248cc req-ba34c1bd-714b-4961-b51c-8258cbdda80f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:51.342162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1b0844a-1927-492a-a8e9-e9e953f248cc req-ba34c1bd-714b-4961-b51c-8258cbdda80f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:51.342790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1b0844a-1927-492a-a8e9-e9e953f248cc req-ba34c1bd-714b-4961-b51c-8258cbdda80f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:51.355665 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:41:51.358483 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b1b0844a-1927-492a-a8e9-e9e953f248cc req-ba34c1bd-714b-4961-b51c-8258cbdda80f service nova] Creating event network-vif-plugged:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:41:51.365560 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b1b0844a-1927-492a-a8e9-e9e953f248cc req-ba34c1bd-714b-4961-b51c-8258cbdda80f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044243 Sep 25 01:41:51.366862 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2993/6003] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:51.579757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:51.581162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:51.588881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:51.589608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:51.590213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:51.591795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:51.592428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:51.593074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:51.759679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:51.774070 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e91a1df9-1124-4b1f-8106-1cc7303b3980 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.198493 Sep 25 01:41:51.774967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3011/6004] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:51 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:52.802672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:52.803380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:52.816455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:52.817241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:52.817948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:52.818821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:52.819669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:52.820255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:53.019695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:53.029363 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8fa0b07-69c4-45de-b768-696694590097 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1270 microversion: 2.1 time: 0.232536 Sep 25 01:41:53.030234 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2994/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:52 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:54.052391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:54.053069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:54.060447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:54.060960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:54.061414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:54.062141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:54.062597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:54.063020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:54.234246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:54.242517 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-04c9bc5c-5423-4ca0-8011-2af225736875 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1459 microversion: 2.1 time: 0.194056 Sep 25 01:41:54.243139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3012/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:54 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1459 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:54.265702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:54.266268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:54.274807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:54.275521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:54.276208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:54.277296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:54.277926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:54.279043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:54.435604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:54.446114 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c7df851b-a757-479f-a27d-67cabe890319 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1459 microversion: 2.1 time: 0.184864 Sep 25 01:41:54.454159 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2995/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:54 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1459 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:54.474619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d8e230b-119a-4e4c-afad-f1626338ffcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'create', calling method: .version_select at 0x7f7bebd2b940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2042130186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqFR++7LcoqfsNz9IuWEKFFV2r5jwO64Oa7rbHitTZfQwMCMpdU++bljySgYAPsC+zu1W3QGQb2W3ADnpG8OqbJodigrQOlFUHpaV3s5pwQoR1RaOpunmhTaT8o1GcPUw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:54.490902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6d8e230b-119a-4e4c-afad-f1626338ffcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for project fdcd1c5a13e24165971100bc619e7be2. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:41:54.498768 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6d8e230b-119a-4e4c-afad-f1626338ffcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for user 7fa3cce1ff3445eb896fb8bad352ef1f and project fdcd1c5a13e24165971100bc619e7be2. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:41:54.526637 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d8e230b-119a-4e4c-afad-f1626338ffcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.057618 Sep 25 01:41:54.528116 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3013/6008] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:41:54 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:56.094013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-508213854", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "0b5c4761-491b-4d6f-88e5-ac48c4fbf956"}], "key_name": "tempest-TestNetworkBasicOps-2042130186", "security_groups": [{"name": "tempest-secgroup-smoke-102806170"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:56.256731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] validate_networks() for [('0b5c4761-491b-4d6f-88e5-ac48c4fbf956', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:41:56.656925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1121f8c5-5c8e-4263-bc76-ccfa5517698f req-a76f40b6-f4c3-4140-a239-c4fe4215d646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:56.692662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1121f8c5-5c8e-4263-bc76-ccfa5517698f req-a76f40b6-f4c3-4140-a239-c4fe4215d646 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:56.694817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1121f8c5-5c8e-4263-bc76-ccfa5517698f req-a76f40b6-f4c3-4140-a239-c4fe4215d646 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:56.695271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1121f8c5-5c8e-4263-bc76-ccfa5517698f req-a76f40b6-f4c3-4140-a239-c4fe4215d646 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:56.700707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:41:56.701276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:41:56.704140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:41:56.704703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:41:56.705292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:41:56.707585 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1121f8c5-5c8e-4263-bc76-ccfa5517698f req-a76f40b6-f4c3-4140-a239-c4fe4215d646 service nova] Creating event network-changed:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:41:56.716598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:56.717240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:56.718000 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1121f8c5-5c8e-4263-bc76-ccfa5517698f req-a76f40b6-f4c3-4140-a239-c4fe4215d646 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066765 Sep 25 01:41:56.718960 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3014/6009] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:41:56.719158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:56.721655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:56.722403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:56.723060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:56.745220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for project fdcd1c5a13e24165971100bc619e7be2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:41:56.776855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for user 7fa3cce1ff3445eb896fb8bad352ef1f and project fdcd1c5a13e24165971100bc619e7be2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:41:56.798808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:41:56.801521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:41:56.857004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a3008403-333e-4ea4-9b86-18901212fe97 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.797273 Sep 25 01:41:56.858280 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2996/6010] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:41:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:41:56.871978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab1d26a1-dfd1-4592-8b63-d2aeb98d56fd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:56.873090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab1d26a1-dfd1-4592-8b63-d2aeb98d56fd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:57.005452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab1d26a1-dfd1-4592-8b63-d2aeb98d56fd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:57.026744 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab1d26a1-dfd1-4592-8b63-d2aeb98d56fd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1248 microversion: 2.1 time: 0.160608 Sep 25 01:41:57.030023 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3015/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:56 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1248 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:58.052602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:58.053225 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:58.060977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:58.061502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:58.061937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:58.062645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:58.063327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:58.063828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:58.183255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:58.193040 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7668d49f-70e9-4bcb-ae22-ad6ceb766625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1300 microversion: 2.1 time: 0.145250 Sep 25 01:41:58.194222 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2997/6012] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:58 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:41:58.618657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fbe864d4-7705-4754-bdd0-fd99af389906 req-106a4aa3-154f-47c7-91a7-85d9168b8f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:41:58.631515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbe864d4-7705-4754-bdd0-fd99af389906 req-106a4aa3-154f-47c7-91a7-85d9168b8f35 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:58.632079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbe864d4-7705-4754-bdd0-fd99af389906 req-106a4aa3-154f-47c7-91a7-85d9168b8f35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:58.632521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fbe864d4-7705-4754-bdd0-fd99af389906 req-106a4aa3-154f-47c7-91a7-85d9168b8f35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:58.644505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fbe864d4-7705-4754-bdd0-fd99af389906 req-106a4aa3-154f-47c7-91a7-85d9168b8f35 service nova] Creating event network-changed:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:41:58.654602 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fbe864d4-7705-4754-bdd0-fd99af389906 req-106a4aa3-154f-47c7-91a7-85d9168b8f35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039543 Sep 25 01:41:58.655238 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3016/6013] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:41:59.220167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:41:59.220935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:41:59.229441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:59.229936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:59.230369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:59.231345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:41:59.231968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:41:59.232558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:41:59.308909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:41:59.318781 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6852eec7-b919-400c-96bc-535784be7dcd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1306 microversion: 2.1 time: 0.104880 Sep 25 01:41:59.319689 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2998/6014] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:41:59 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:00.187854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e263b5bd-717c-4d3f-bbdc-040200f27fcd req-c191b01c-79d3-4f55-80a9-050c4704a012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009a5e26-1d05-4543-8ad5-0a95cbb90e05", "tag": "1c7a32fd-23f2-4311-890b-1b9369e16db1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:00.199669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e263b5bd-717c-4d3f-bbdc-040200f27fcd req-c191b01c-79d3-4f55-80a9-050c4704a012 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:00.200410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e263b5bd-717c-4d3f-bbdc-040200f27fcd req-c191b01c-79d3-4f55-80a9-050c4704a012 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:00.200860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e263b5bd-717c-4d3f-bbdc-040200f27fcd req-c191b01c-79d3-4f55-80a9-050c4704a012 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:00.213336 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e263b5bd-717c-4d3f-bbdc-040200f27fcd req-c191b01c-79d3-4f55-80a9-050c4704a012 service nova] Creating event network-changed:1c7a32fd-23f2-4311-890b-1b9369e16db1 for instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 on n-h1-master-1 Sep 25 01:42:00.218776 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e263b5bd-717c-4d3f-bbdc-040200f27fcd req-c191b01c-79d3-4f55-80a9-050c4704a012 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036138 Sep 25 01:42:00.219648 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3017/6015] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:00.342964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:00.343573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:00.350416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:00.350899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:00.351334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:00.352032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:00.352485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:00.352911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:00.487826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:00.495738 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1acbd852-0e97-4ed7-8452-8da70abe1622 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1373 microversion: 2.1 time: 0.156866 Sep 25 01:42:00.496320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 2999/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:00 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:00.673029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-99aa42d4-d228-46cd-8890-fb9b658eb4a8 req-3e9ef123-2d19-4965-8042-b83c93d056e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:00.687911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99aa42d4-d228-46cd-8890-fb9b658eb4a8 req-3e9ef123-2d19-4965-8042-b83c93d056e6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:00.688299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99aa42d4-d228-46cd-8890-fb9b658eb4a8 req-3e9ef123-2d19-4965-8042-b83c93d056e6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:00.688741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99aa42d4-d228-46cd-8890-fb9b658eb4a8 req-3e9ef123-2d19-4965-8042-b83c93d056e6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:00.701275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-99aa42d4-d228-46cd-8890-fb9b658eb4a8 req-3e9ef123-2d19-4965-8042-b83c93d056e6 service nova] Creating event network-changed:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:42:00.706848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-99aa42d4-d228-46cd-8890-fb9b658eb4a8 req-3e9ef123-2d19-4965-8042-b83c93d056e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040634 Sep 25 01:42:00.707476 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3018/6017] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:01.519343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:01.520000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:01.526953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:01.527438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:01.527879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:01.528575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:01.529035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:01.529490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:01.661265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:01.669027 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3bebea3-f05c-484b-8e9b-520c0811849f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1373 microversion: 2.1 time: 0.154175 Sep 25 01:42:01.669636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3000/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:01 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:02.693718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:02.694338 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:02.701551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:02.702033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:02.703803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:02.704095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:02.704706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:02.705134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:02.841751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:02.849779 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a931784-7755-4bb2-949c-955b685379e7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1373 microversion: 2.1 time: 0.160482 Sep 25 01:42:02.850351 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3019/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:02 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:03.872567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:03.873189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:03.882854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:03.883453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:03.883904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:03.884702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:03.885233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:03.885701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:04.023008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:04.032677 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c434c8a8-2c2a-46a3-8784-160a5fc79549 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1373 microversion: 2.1 time: 0.164313 Sep 25 01:42:04.033346 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3001/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:03 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:05.055898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:05.056519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:05.063675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:05.064158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:05.064602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:05.065290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:05.065777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:05.066205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:05.200772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:05.208899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5972ab2f-a755-474d-805c-06b74ee08f3c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1373 microversion: 2.1 time: 0.156939 Sep 25 01:42:05.209499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3020/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:05 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:05.807303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e54f8e3c-244b-43d8-b89d-4036a5656265 req-736d058d-c00c-462a-bd57-6efa73884e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009a5e26-1d05-4543-8ad5-0a95cbb90e05", "name": "network-vif-plugged", "status": "completed", "tag": "1c7a32fd-23f2-4311-890b-1b9369e16db1"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:05.819579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e54f8e3c-244b-43d8-b89d-4036a5656265 req-736d058d-c00c-462a-bd57-6efa73884e60 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:05.820098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e54f8e3c-244b-43d8-b89d-4036a5656265 req-736d058d-c00c-462a-bd57-6efa73884e60 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:05.820625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e54f8e3c-244b-43d8-b89d-4036a5656265 req-736d058d-c00c-462a-bd57-6efa73884e60 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:05.833040 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e54f8e3c-244b-43d8-b89d-4036a5656265 req-736d058d-c00c-462a-bd57-6efa73884e60 service nova] Creating event network-vif-plugged:1c7a32fd-23f2-4311-890b-1b9369e16db1 for instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 on n-h1-master-1 Sep 25 01:42:05.838204 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e54f8e3c-244b-43d8-b89d-4036a5656265 req-736d058d-c00c-462a-bd57-6efa73884e60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034672 Sep 25 01:42:05.839080 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3002/6022] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:06.231997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:06.232562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:06.240085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:06.240576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:06.241023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:06.241757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:06.242222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:06.242655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:06.267900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:06.268496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:06.275177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:06.275738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:06.276106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:06.276808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:06.277265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:06.277722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:06.366921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lazy-loading 'services' on Instance uuid def8c243-fb93-424f-93bc-e4a054207797 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:42:06.382446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:06.393798 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a49e65bc-3611-49bf-abf8-43dff6b6709a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1373 microversion: 2.1 time: 0.165718 Sep 25 01:42:06.394516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3021/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:06 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:06.457169 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-738a059d-9a44-4414-b452-feb311b9ca79 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-volume_attachments/4c5a10f8-a8d5-470f-aedc-a44152704451" status: 202 len: 0 microversion: 2.1 time: 0.194438 Sep 25 01:42:06.457830 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3003/6024] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:42:06 2022] DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-volume_attachments/4c5a10f8-a8d5-470f-aedc-a44152704451 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:42:07.431560 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:07.432405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:07.434992 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:07.442147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:07.442637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:07.443082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:07.443779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:07.444236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:07.444663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:07.597035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:07.605206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-364df1f0-c307-4fb7-a652-70fade54af98 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1546 microversion: 2.1 time: 0.177724 Sep 25 01:42:07.605814 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3022/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:07 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:07.625513 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:07.626369 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:07.631616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:07.632343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:07.639665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:07.640152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:07.640669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:07.641376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:07.642037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:07.642468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:07.784336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:07.792220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-259c4602-de8e-4822-986a-86fc40c45b9c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1546 microversion: 2.1 time: 0.168263 Sep 25 01:42:07.793020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3004/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:07 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:09.478376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-de6fc3ee-7335-49c1-b07a-54a49dd2a6b5 req-b71df23b-3036-47d8-99f8-93facbf549d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009a5e26-1d05-4543-8ad5-0a95cbb90e05", "tag": "1c7a32fd-23f2-4311-890b-1b9369e16db1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:09.494901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-de6fc3ee-7335-49c1-b07a-54a49dd2a6b5 req-b71df23b-3036-47d8-99f8-93facbf549d1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:09.496360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-de6fc3ee-7335-49c1-b07a-54a49dd2a6b5 req-b71df23b-3036-47d8-99f8-93facbf549d1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:09.497177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-de6fc3ee-7335-49c1-b07a-54a49dd2a6b5 req-b71df23b-3036-47d8-99f8-93facbf549d1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:09.522715 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-de6fc3ee-7335-49c1-b07a-54a49dd2a6b5 req-b71df23b-3036-47d8-99f8-93facbf549d1 service nova] Creating event network-changed:1c7a32fd-23f2-4311-890b-1b9369e16db1 for instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 on n-h1-master-1 Sep 25 01:42:09.530017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-de6fc3ee-7335-49c1-b07a-54a49dd2a6b5 req-b71df23b-3036-47d8-99f8-93facbf549d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060679 Sep 25 01:42:09.531700 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3023/6027] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:42:11.854347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a029d92-0e4c-4d86-86af-d3b3a70117d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:11.861570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a029d92-0e4c-4d86-86af-d3b3a70117d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:11.862161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a029d92-0e4c-4d86-86af-d3b3a70117d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:11.862672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a029d92-0e4c-4d86-86af-d3b3a70117d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:11.886087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a029d92-0e4c-4d86-86af-d3b3a70117d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Going to try to stop instance {{(pid=122384) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:42:11.927133 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a029d92-0e4c-4d86-86af-d3b3a70117d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action" status: 202 len: 0 microversion: 2.1 time: 0.076549 Sep 25 01:42:11.927857 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3005/6028] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:42:11 2022] POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:42:11.937257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:11.937981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:11.945024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:11.945521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:11.945960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:11.946657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:11.947106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:11.947595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:12.084397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:12.092395 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b090103-05de-4102-81b8-733334d87e2f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.160206 Sep 25 01:42:12.092967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3024/6029] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:11 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:13.118258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:13.119007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:13.125214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:13.126346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:13.126822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:13.127550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:13.128009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:13.128435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:13.265531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:13.274322 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fad5a868-cbcb-4ea8-9a23-58c1b1ac909b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.161383 Sep 25 01:42:13.274877 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3006/6030] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:13 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:14.299337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:14.299988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:14.307105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:14.307594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:14.308033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:14.308722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:14.309180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:14.309637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:14.449529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:14.457734 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22afb0bc-2ef5-423e-89f1-ff6fd073144a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.162979 Sep 25 01:42:14.458310 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3025/6031] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:14 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:15.480010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:15.480680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:15.489434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:15.490262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:15.490730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:15.491463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:15.491922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:15.492320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:15.627469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:15.635750 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbfbb56e-6901-44a9-b07a-b970b26616c7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.159622 Sep 25 01:42:15.636338 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3007/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:15 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:16.660742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:16.661419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:16.668189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:16.668688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:16.669195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:16.669928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:16.670397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:16.670827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:16.806575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:16.815917 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3439b53e-ee79-4982-956c-f68583ca27e1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.159240 Sep 25 01:42:16.816825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3026/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:16 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:17.839831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:17.840446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:17.848201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:17.848683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:17.849121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:17.849841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:17.850296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:17.850722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:17.983799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:17.991756 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b183a7ce-262e-4bd2-b6c8-484e16bef2fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.155860 Sep 25 01:42:17.992347 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3008/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:17 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:19.015735 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:19.016417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:19.025454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:19.026142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:19.027002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:19.028242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:19.028864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:19.029346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:19.174470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:19.183025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d6fbf07-4083-4069-9730-0a5f906060d4 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.171254 Sep 25 01:42:19.183679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3027/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:19 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:20.207000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:20.207722 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:20.215019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:20.215541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:20.216024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:20.216720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:20.217174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:20.217653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:20.358425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:20.368124 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-eddb1619-be00-4db5-ad3c-5aa5a189feb2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.165272 Sep 25 01:42:20.368854 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3009/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:20 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:21.392300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:21.392755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:21.395616 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:21.401135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:21.401660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:21.402109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:21.402809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:21.403272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:21.403705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:21.408851 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=76 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:21.534543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:21.542544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2d7028a-3cb6-47c0-a263-1994160852a9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1678 microversion: 2.1 time: 0.154519 Sep 25 01:42:21.543281 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3028/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:21 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:22.566016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:22.566644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:22.569702 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:22.575216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:22.575701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:22.576131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:22.576826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:22.577276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:22.577723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:22.580992 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:22.716855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:22.725287 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99b752b6-1f0b-4bd8-835e-1efdbee67d62 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1655 microversion: 2.1 time: 0.163216 Sep 25 01:42:22.725892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3010/6038] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:22 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:22.748181 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eca8a9cb-6547-4a34-9ef0-6f8f5ab513be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:22.755681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eca8a9cb-6547-4a34-9ef0-6f8f5ab513be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:22.756170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eca8a9cb-6547-4a34-9ef0-6f8f5ab513be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:22.756610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eca8a9cb-6547-4a34-9ef0-6f8f5ab513be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:22.778919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eca8a9cb-6547-4a34-9ef0-6f8f5ab513be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Going to try to start instance {{(pid=122385) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:42:22.824206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eca8a9cb-6547-4a34-9ef0-6f8f5ab513be tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action" status: 202 len: 0 microversion: 2.1 time: 0.079845 Sep 25 01:42:22.824844 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3029/6039] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:42:22 2022] POST /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:42:22.833910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:22.834705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:22.840846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:22.841333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:22.841793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:22.842481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:22.842926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:22.843380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:22.983666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:22.992087 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a48432c-07f5-475f-9442-39099dd756c8 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1664 microversion: 2.1 time: 0.162934 Sep 25 01:42:22.993322 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3011/6040] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:22 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:24.016315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:24.017050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:24.024953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:24.025476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:24.025928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:24.026634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:24.027099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:24.027540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:24.160730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:24.168813 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2897f96d-c205-42d9-a3d3-41bc9781d3f5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1668 microversion: 2.1 time: 0.156794 Sep 25 01:42:24.169386 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3030/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:24 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:30.637620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:30.638239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:30.638918 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-34e48f05-30f1-4583-a84b-f36aae9aaf0f req-4f3f74da-9625-47d5-a010-d2ddd54debaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:30.646129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:30.646623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:30.647075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:30.647784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:30.648241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:30.648674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:30.651669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-34e48f05-30f1-4583-a84b-f36aae9aaf0f req-4f3f74da-9625-47d5-a010-d2ddd54debaa service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:30.652834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-34e48f05-30f1-4583-a84b-f36aae9aaf0f req-4f3f74da-9625-47d5-a010-d2ddd54debaa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:30.652834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-34e48f05-30f1-4583-a84b-f36aae9aaf0f req-4f3f74da-9625-47d5-a010-d2ddd54debaa service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:30.664447 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-34e48f05-30f1-4583-a84b-f36aae9aaf0f req-4f3f74da-9625-47d5-a010-d2ddd54debaa service nova] Creating event network-changed:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:42:30.670765 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-34e48f05-30f1-4583-a84b-f36aae9aaf0f req-4f3f74da-9625-47d5-a010-d2ddd54debaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035676 Sep 25 01:42:30.671409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3031/6042] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:30.678330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:42:30.769886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-24c8710e-4245-464a-b41b-669843389fcf tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 204 len: 0 microversion: 2.1 time: 0.136666 Sep 25 01:42:30.774887 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3012/6043] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:42:30 2022] DELETE /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:42:30.780111 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:30.780824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:30.787697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:30.788413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:30.788860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:30.789592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:30.790576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:30.791008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:30.928221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:30.937260 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af4e8c01-b51c-49d1-9431-b24f334bf9f1 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1584 microversion: 2.1 time: 0.161390 Sep 25 01:42:30.937769 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3032/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:30 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1584 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:42:31.786856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:31.789212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:31.797613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:31.798101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:31.798580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:31.799268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:31.799721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:31.800147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:31.874685 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92b508a3-bffb-4bb4-b79b-61ccd5a104b2 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05/action" status: 200 len: 24572 microversion: 2.1 time: 0.091835 Sep 25 01:42:31.882173 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3013/6045] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:42:31 2022] POST /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05/action => generated 24572 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:42:31.962802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:31.963429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:31.970395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:31.970886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:31.971335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:31.972048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:31.972511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:31.972941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:32.136110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:32.143993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-041f36ed-7cf5-412c-aa80-0b57311f1686 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1584 microversion: 2.1 time: 0.185321 Sep 25 01:42:32.144581 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3033/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:31 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1584 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:32.998799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-dfb8ffe2-7341-43d5-ab70-4333baf21316 req-050bc8b1-0897-4048-8828-4bf8d1283187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74471fd-466a-4253-b1f6-498808e147fb", "name": "network-vif-deleted", "tag": "6f2a2868-0a71-4aec-b78e-d31bf37e5e62"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:33.010864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dfb8ffe2-7341-43d5-ab70-4333baf21316 req-050bc8b1-0897-4048-8828-4bf8d1283187 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:33.011361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dfb8ffe2-7341-43d5-ab70-4333baf21316 req-050bc8b1-0897-4048-8828-4bf8d1283187 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:33.011801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dfb8ffe2-7341-43d5-ab70-4333baf21316 req-050bc8b1-0897-4048-8828-4bf8d1283187 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:33.024793 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dfb8ffe2-7341-43d5-ab70-4333baf21316 req-050bc8b1-0897-4048-8828-4bf8d1283187 service nova] Creating event network-vif-deleted:6f2a2868-0a71-4aec-b78e-d31bf37e5e62 for instance e74471fd-466a-4253-b1f6-498808e147fb on n-h2-master-1 Sep 25 01:42:33.029662 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-dfb8ffe2-7341-43d5-ab70-4333baf21316 req-050bc8b1-0897-4048-8828-4bf8d1283187 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Sep 25 01:42:33.030270 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3014/6047] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:33.167117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:33.167743 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:33.174804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:33.175236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:33.175678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:33.176378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:33.176845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:33.177276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:33.240325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:33.248910 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5cdf1f9-8871-4dfe-a630-12c8a1397111 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1229 microversion: 2.1 time: 0.085732 Sep 25 01:42:33.249513 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3034/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:33 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:34.273845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:34.275153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:34.281732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:34.282224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:34.282661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:34.283356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:34.283842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:34.284270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:34.351118 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:34.361886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-70e726f3-46f9-4318-97d5-8ea37ceb6f4e tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1229 microversion: 2.1 time: 0.093007 Sep 25 01:42:34.362739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3015/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:34 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:35.384792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:35.385527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:35.392825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:35.393325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:35.393793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:35.394506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:35.394964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:35.395395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:35.464315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:35.472330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e1a35da6-6ce8-41a7-b436-b4ba609c71b4 tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1229 microversion: 2.1 time: 0.091980 Sep 25 01:42:35.472938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3035/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:35 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:36.495747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:36.496408 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:36.503582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:36.504071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:36.504505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:36.505197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:36.505677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:36.506102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:36.585878 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2b15ca74604287bbc113c051f0ebde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeb0489ee8f4e9dbbcb33ed3263c0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:36.593842 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b8751174-7b51-4b75-9005-57b815f5815d tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 200 len: 1229 microversion: 2.1 time: 0.102539 Sep 25 01:42:36.594766 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3016/6051] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:36 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:37.616789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:37.617510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] [instance: e74471fd-466a-4253-b1f6-498808e147fb] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:37.624966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:37.625479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:37.625920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:37.626621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:37.627109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:37.627596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:37.644884 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] HTTP exception thrown: Instance e74471fd-466a-4253-b1f6-498808e147fb could not be found. Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Request method failure captured: Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb HTTP/1.1 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7EgActJqtBNw8L-SVtGZEdLDhQixSoaTylxGufb7czHuLYysHKwn35dphwnC0w9frWw0I6vd44QvhC_KxJjgGr4y_sLmH-RR4La3u-Xbj9qwYptNtDFDRKFPixHFO5sL5QVAnUV97B6g-AzsrVxUeaHxn7vjHbQ8XN_yB4R8vV89UU Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 8eeb0489ee8f4e9dbbcb33ed3263c0bb Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBackupRestore-1760463402 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8eeb0489ee8f4e9dbbcb33ed3263c0bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8eeb0489ee8f4e9dbbcb33ed3263c0bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8eeb0489ee8f4e9dbbcb33ed3263c0bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8eeb0489ee8f4e9dbbcb33ed3263c0bb"}]}] Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBackupRestore-1760463402 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 8eeb0489ee8f4e9dbbcb33ed3263c0bb Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1760463402 Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBackupRestore-1760463402-project Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: cd2b15ca74604287bbc113c051f0ebde Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBackupRestore-1760463402-project Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e74471fd-466a-4253-b1f6-498808e147fb could not be found. Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e74471fd-466a-4253-b1f6-498808e147fb'} Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74471fd-466a-4253-b1f6-498808e147fb could not be found. Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74471fd-466a-4253-b1f6-498808e147fb could not be found. Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:42:37.646579 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74471fd-466a-4253-b1f6-498808e147fb could not be found. Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Returning 404 to user: Instance e74471fd-466a-4253-b1f6-498808e147fb could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8954b7fc-8954-49c3-8d68-99786bff96ad tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb" status: 404 len: 111 microversion: 2.1 time: 0.035292 Sep 25 01:42:37.651655 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3036/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:37 2022] GET /compute/v2.1/servers/e74471fd-466a-4253-b1f6-498808e147fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:42:38.134688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51916221-79ea-4eee-befa-2daa1e21eaef tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] Calling method '.version_select at 0x7f7bea721c10>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:38.155705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51916221-79ea-4eee-befa-2daa1e21eaef tempest-TestVolumeBackupRestore-1760463402 tempest-TestVolumeBackupRestore-1760463402-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1800337713" status: 202 len: 0 microversion: 2.1 time: 0.025274 Sep 25 01:42:38.156764 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3017/6053] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 01:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1800337713 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:42:46.990762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5514c901-1f06-40ab-a19b-b698f35e4eef tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'create', calling method: .version_select at 0x7f7bebb86d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-635830408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6ybDdnyoiCr5H0ua/l43ZwinfzM9wYDmivlP1wunrvdVj+wL4ssEBh+Hrj3ukipZHRQ4IQvauwuMF4ojIazPaD9McGdIlnVM/QYl+CKl5gx2I5KvhXPWmqvuqzxxgVwQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:47.008559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5514c901-1f06-40ab-a19b-b698f35e4eef tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for project fdcd1c5a13e24165971100bc619e7be2. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:42:47.014471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-5514c901-1f06-40ab-a19b-b698f35e4eef tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for user 7fa3cce1ff3445eb896fb8bad352ef1f and project fdcd1c5a13e24165971100bc619e7be2. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:42:47.045642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5514c901-1f06-40ab-a19b-b698f35e4eef tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.057827 Sep 25 01:42:47.045642 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3037/6054] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:42:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:48.422659 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:48.423930 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:48.429148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-125503279", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "b59ee48f-9381-46d1-84fd-0617229a08be"}], "key_name": "tempest-TestNetworkBasicOps-635830408", "security_groups": [{"name": "tempest-secgroup-smoke-1841448458"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:48.567275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] validate_networks() for [('b59ee48f-9381-46d1-84fd-0617229a08be', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:42:49.020248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:42:49.020725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:42:49.021213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:42:49.021746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:42:49.022076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:42:49.037314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:49.038099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:49.040865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:49.041686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:49.042157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:49.042832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:49.078166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for project fdcd1c5a13e24165971100bc619e7be2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:42:49.084703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for user 7fa3cce1ff3445eb896fb8bad352ef1f and project fdcd1c5a13e24165971100bc619e7be2. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:42:49.100840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:42:49.104961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:42:49.178378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6071587d-3332-44ba-8d16-36d5e7c464bb tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.757532 Sep 25 01:42:49.179475 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3018/6055] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:42:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:42:49.187638 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:49.193207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57cdbf61-6b02-40ab-95a5-c65796cb51ec tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:49.193874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57cdbf61-6b02-40ab-95a5-c65796cb51ec tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:49.284807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-57cdbf61-6b02-40ab-95a5-c65796cb51ec tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:49.297479 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57cdbf61-6b02-40ab-95a5-c65796cb51ec tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1247 microversion: 2.1 time: 0.110533 Sep 25 01:42:49.298422 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3038/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:49 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:42:50.323831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:50.324586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:50.330883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:50.331606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:50.332049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:50.332939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:50.333424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:50.333862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:50.414422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:50.424992 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-285e8801-78c5-48d4-a344-0e82f303d138 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1299 microversion: 2.1 time: 0.108591 Sep 25 01:42:50.425624 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3019/6057] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:50 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:51.454253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:51.457252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:51.467562 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:51.480708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:51.482223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:51.482683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:51.484971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:51.487903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:51.488586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:51.745119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:51.753227 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb60002c-c5cf-4a40-a25e-162aa3b36fa6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.307455 Sep 25 01:42:51.753853 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3039/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:51 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:52.568790 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6b93bb2e-3a09-4118-b794-75e63a5cc44a req-d2c1a20c-5c75-4c53-b512-de1ac2e31564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0dc249-bc51-4fc6-bf27-965e5747daa8", "tag": "b51daf95-6efc-4187-9c0f-0c5142c6c3b9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:42:52.585500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6b93bb2e-3a09-4118-b794-75e63a5cc44a req-d2c1a20c-5c75-4c53-b512-de1ac2e31564 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:52.586041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6b93bb2e-3a09-4118-b794-75e63a5cc44a req-d2c1a20c-5c75-4c53-b512-de1ac2e31564 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:52.586643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6b93bb2e-3a09-4118-b794-75e63a5cc44a req-d2c1a20c-5c75-4c53-b512-de1ac2e31564 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:52.599932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6b93bb2e-3a09-4118-b794-75e63a5cc44a req-d2c1a20c-5c75-4c53-b512-de1ac2e31564 service nova] Creating event network-changed:b51daf95-6efc-4187-9c0f-0c5142c6c3b9 for instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 on n-h2-master-1 Sep 25 01:42:52.607307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6b93bb2e-3a09-4118-b794-75e63a5cc44a req-d2c1a20c-5c75-4c53-b512-de1ac2e31564 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045879 Sep 25 01:42:52.608505 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3020/6059] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:42:52.777170 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:52.778144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:52.785662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:52.786447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:52.786973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:52.788522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:52.789208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:52.790286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:53.096711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:53.105725 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-40a01216-696e-4c89-9823-09e8b4ef51dd tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.333280 Sep 25 01:42:53.106493 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3040/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:52 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:54.130958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:54.131744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:54.139075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:54.139784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:54.140412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:54.141275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:54.142058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:54.142809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:54.369424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:54.377987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9445d2c3-701a-495e-ae7c-f6a49ef0a74f tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.252099 Sep 25 01:42:54.390178 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3021/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:54 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:55.401723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:55.403068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:55.410746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:55.420769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:55.421648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:55.422902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:55.423833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:55.424496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:56.008268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:56.028172 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9efa0ad9-1367-4d81-82e4-e0b2d22eaede tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.623080 Sep 25 01:42:56.030470 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3041/6062] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:55 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:57.058453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:57.059196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:57.065674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.066155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.066713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.067990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.068542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.069042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.276838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:57.284929 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55c2e21b-ea51-40b2-bfa2-6f2b9c755341 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.231631 Sep 25 01:42:57.285639 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3022/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:57 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:57.499332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:57.502684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:57.517325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.518157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.518812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.519741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.520622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.521361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.569266 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4607b1a-1d42-4d0f-9fc8-9d6b4b7c53d6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075099 Sep 25 01:42:57.572284 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3042/6064] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:42:57 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:42:57.691299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:57.691967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:57.699761 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.700340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.700946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.701820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.702361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.702953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.737063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:42:57.839405 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06e8e491-a439-4445-a941-177b48587744 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 204 len: 0 microversion: 2.1 time: 0.152796 Sep 25 01:42:57.840832 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3023/6065] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:42:57 2022] DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:42:57.849256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:57.849919 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:57.860157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.861014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.861115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:57.861834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:57.862483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:57.863105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:58.055128 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:58.068270 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cd9537ab-1c4b-464c-b8d8-1dd1afdd5675 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1674 microversion: 2.1 time: 0.222960 Sep 25 01:42:58.069357 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3043/6066] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:57 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:58.333977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:58.334798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:58.350580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:58.350996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:58.352447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:58.354419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:58.355402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:58.358517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:58.562827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:58.573444 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc1f2c56-7fdd-4f4c-a09a-b65b81a8ec67 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.265096 Sep 25 01:42:58.574472 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3024/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:58 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:59.092253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:59.092865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:59.102017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:59.103101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:59.104468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:59.105837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:59.106501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:59.108306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:59.278901 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:59.289874 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-828f7de7-0478-4ec0-8057-0ca7d3d888f9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1674 microversion: 2.1 time: 0.201141 Sep 25 01:42:59.291142 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3044/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:59 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:42:59.596265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:42:59.597665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:42:59.606499 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:59.609802 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:42:59.612642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:59.613141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:59.613680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:59.614414 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:42:59.615239 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:42:59.615382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:42:59.969134 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:42:59.981966 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-728ea1ad-0cf8-463a-9597-aa567ebc79b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.389338 Sep 25 01:42:59.999571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3025/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:42:59 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:00.314562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:00.317669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:00.323286 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:00.339917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:00.340419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:00.340870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:00.341640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:00.342106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:00.342552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:00.627264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:00.636800 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ecdc340f-4b07-43a7-8269-ceaa983f6ee9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1674 microversion: 2.1 time: 0.326089 Sep 25 01:43:00.637433 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3045/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:00 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1674 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:01.009694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:01.010374 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:01.023441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:01.024890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:01.028117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:01.029146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:01.031614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:01.032070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:01.331973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:01.354136 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2d87c7b-4328-4793-a7dc-b7747b8006db tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.349557 Sep 25 01:43:01.357286 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3026/6071] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:01 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:01.596688 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9a72fa29-bc1a-48d1-9406-215b32af1152 req-5a12b755-8859-4aa0-8112-d7abaa2b98b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0dc249-bc51-4fc6-bf27-965e5747daa8", "name": "network-vif-plugged", "status": "completed", "tag": "b51daf95-6efc-4187-9c0f-0c5142c6c3b9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:01.613231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a72fa29-bc1a-48d1-9406-215b32af1152 req-5a12b755-8859-4aa0-8112-d7abaa2b98b1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:01.616187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a72fa29-bc1a-48d1-9406-215b32af1152 req-5a12b755-8859-4aa0-8112-d7abaa2b98b1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:01.617361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9a72fa29-bc1a-48d1-9406-215b32af1152 req-5a12b755-8859-4aa0-8112-d7abaa2b98b1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:01.640474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9a72fa29-bc1a-48d1-9406-215b32af1152 req-5a12b755-8859-4aa0-8112-d7abaa2b98b1 service nova] Creating event network-vif-plugged:b51daf95-6efc-4187-9c0f-0c5142c6c3b9 for instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 on n-h2-master-1 Sep 25 01:43:01.652110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9a72fa29-bc1a-48d1-9406-215b32af1152 req-5a12b755-8859-4aa0-8112-d7abaa2b98b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.540307 Sep 25 01:43:01.665841 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3046/6072] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:43:01.665998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:01.666652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:01.680366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:01.680981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:01.683359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:01.684205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:01.687556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:01.694366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:01.862316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:01.875672 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ce38516-5d52-493e-8b8f-9eb95eb1cda3 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 200 len: 1606 microversion: 2.1 time: 0.214059 Sep 25 01:43:01.893194 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3027/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:01 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 1606 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:02.014242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-43046ee8-ace2-4520-ae12-904714f07144 req-0182b02a-924e-4fbb-a9c9-34fdd1daf577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def8c243-fb93-424f-93bc-e4a054207797", "name": "network-vif-deleted", "tag": "10ebb590-40d7-45eb-a499-dfdbbd645611"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:02.036091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-43046ee8-ace2-4520-ae12-904714f07144 req-0182b02a-924e-4fbb-a9c9-34fdd1daf577 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:02.036581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-43046ee8-ace2-4520-ae12-904714f07144 req-0182b02a-924e-4fbb-a9c9-34fdd1daf577 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:02.037023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-43046ee8-ace2-4520-ae12-904714f07144 req-0182b02a-924e-4fbb-a9c9-34fdd1daf577 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:02.063611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-43046ee8-ace2-4520-ae12-904714f07144 req-0182b02a-924e-4fbb-a9c9-34fdd1daf577 service nova] Creating event network-vif-deleted:10ebb590-40d7-45eb-a499-dfdbbd645611 for instance def8c243-fb93-424f-93bc-e4a054207797 on n-h1-master-1 Sep 25 01:43:02.084025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-43046ee8-ace2-4520-ae12-904714f07144 req-0182b02a-924e-4fbb-a9c9-34fdd1daf577 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059014 Sep 25 01:43:02.090685 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3047/6074] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:02.380554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:02.381798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:02.404474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:02.405173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:02.406068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:02.406945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:02.407571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:02.408170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:02.667503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:02.683724 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9e33d8cb-104a-474b-9aca-5876a2d3fbc9 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1373 microversion: 2.1 time: 0.307371 Sep 25 01:43:02.684598 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3028/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:02 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1373 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:02.902099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:02.902869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:02.915276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:02.916946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:02.917449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:02.918940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:02.921343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:02.922229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:02.942481 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] HTTP exception thrown: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Request method failure captured: Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 HTTP/1.1 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7FvChcFM1KJHDbr03UZMQuZ90j2iMdzHjikiaN5Zl4i86NMJTkkYbC3IK7TlkYdVqIvj4yXUIu-hxCd-Zy9O-2Yfrthk6V0ZJ0UtjhVB5Zq5GwvC34LMRNEeEhw43w-fhTyWuDau4OTuwJPvwnUUyKR61OhuBrGEhy6hNbv9fbzKTM Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3682c1ffb86e44b990db78f7d82ff21c"}]}] Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 843656b1ab4b43cbb3df67b116c754a1 Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: exception: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'def8c243-fb93-424f-93bc-e4a054207797'} Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:02.945160 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:43:02.949861 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:02.951627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Returning 404 to user: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:43:02.952687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d625ad62-3faf-43c2-8b50-0144e4200d6e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 404 len: 111 microversion: 2.1 time: 0.056185 Sep 25 01:43:02.954196 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3048/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:02 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:43:02.970796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-610d1027-41af-4713-a741-9d13b37a7edd tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '.version_select at 0x7f7bea9dcf70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:02.999368 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-610d1027-41af-4713-a741-9d13b37a7edd tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716395423" status: 202 len: 0 microversion: 2.1 time: 0.040837 Sep 25 01:43:03.000353 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3029/6077] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 01:43:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716395423 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:43:03.714706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:03.715447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:03.727805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:03.729893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:03.732011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:03.732830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:03.734810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:03.735250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:03.927849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8cb4927f-a000-4269-ae69-1ac98940247b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: .version_select at 0x7f7bea899160>, body: {"keypair": {"name": "tempest-keypair-21949457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy1aka8lQXNqivkihesozZS4IaelsHZv3VSHefUdCy8/5kQhkq2484GnQZLsftfYBh16z02flWXF1ZeqtCuF7o9j8caMABWAG1F+5fLsnjErLR0+16wDkKxv2FlbdXk6g=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:03.963290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-8cb4927f-a000-4269-ae69-1ac98940247b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:43:03.968700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:03.970999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-8cb4927f-a000-4269-ae69-1ac98940247b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for user 843656b1ab4b43cbb3df67b116c754a1 and project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:43:03.979051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92f6d7cb-6da8-4e22-be4f-c850d3bc4ba0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1545 microversion: 2.1 time: 0.275442 Sep 25 01:43:03.986080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3049/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:03 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1545 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:04.002469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:04.003264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:04.011304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:04.021629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:04.025567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:04.026575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:04.027493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:04.028182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:04.028838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8cb4927f-a000-4269-ae69-1ac98940247b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.104820 Sep 25 01:43:04.033617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3030/6079] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:43:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:43:04.214664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:04.228247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24b6d45f-c6ac-41a1-87b3-ed6d256b99ad tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1545 microversion: 2.1 time: 0.229700 Sep 25 01:43:04.229109 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3050/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:03 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1545 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:05.834481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-400514331", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b43f51c-c438-4c62-913f-c7208d0d84ce"}], "security_groups": [{"name": "tempest-securitygroup--1961571844"}], "key_name": "tempest-keypair-21949457", "user_data": "}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:05.979441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] validate_networks() for [('8b43f51c-c438-4c62-913f-c7208d0d84ce', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:43:06.109481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-727580596", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "151e38ff-cf39-44e9-98c9-a21b4fffd061", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:06.184958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:43:06.544706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:43:06.545144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:43:06.545655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:43:06.546071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:43:06.546745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:43:06.556968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:06.557815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:06.558474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:06.559216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:06.559710 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:06.560147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:06.578034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:43:06.583432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Getting quotas for user 843656b1ab4b43cbb3df67b116c754a1 and project 3682c1ffb86e44b990db78f7d82ff21c. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:43:06.597174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:43:06.599967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:43:06.653166 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99c13c85-a47c-4161-9743-eb4f56c3550e tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.823910 Sep 25 01:43:06.654195 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3031/6081] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:43:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:43:06.667008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b98f5a89-33f7-45ce-af26-c662c3ba17b7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:06.667808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b98f5a89-33f7-45ce-af26-c662c3ba17b7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:06.763893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b98f5a89-33f7-45ce-af26-c662c3ba17b7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:06.773983 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b98f5a89-33f7-45ce-af26-c662c3ba17b7 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1235 microversion: 2.1 time: 0.112288 Sep 25 01:43:06.778964 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3032/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:06 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1235 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:06.943731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:43:06.944513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:43:06.945388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:43:06.946115 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:43:06.946434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:43:06.956997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:06.957767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:06.958417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:06.959361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:06.959827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:06.961016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:06.981936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:43:06.988427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:43:07.081984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:43:07.084097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='151e38ff-cf39-44e9-98c9-a21b4fffd061',volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:43:07.261318 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a3c28af-3aab-4c5e-9fe3-629be4c85737 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155563 Sep 25 01:43:07.268379 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3051/6083] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:43:07.276394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dad2f8ac-e848-4225-a1e1-6f0b3e2b2919 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:07.277901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dad2f8ac-e848-4225-a1e1-6f0b3e2b2919 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:07.360399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dad2f8ac-e848-4225-a1e1-6f0b3e2b2919 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:07.379440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dad2f8ac-e848-4225-a1e1-6f0b3e2b2919 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1056 microversion: 2.1 time: 0.109426 Sep 25 01:43:07.380142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3033/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:07 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1056 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:07.801065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:07.801777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:07.811426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:07.812585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:07.813792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:07.814740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:07.815444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:07.816274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:07.925609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:07.937040 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-44a7e5c5-caaf-4f7f-8be2-4b6a5fcc701c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1287 microversion: 2.1 time: 0.140479 Sep 25 01:43:07.938279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3052/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:07 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:08.406892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:08.408137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:08.417232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:08.417769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:08.418217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:08.418944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:08.419403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:08.419837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:08.516748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:08.532312 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2bea9383-9950-4274-8c6b-1a819c018f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1098 microversion: 2.1 time: 0.130654 Sep 25 01:43:08.533394 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3034/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:08 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1098 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:08.965647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:08.968150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:08.978661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:08.979619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:08.981449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:08.982612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:08.992423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:08.996040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:09.081087 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:09.091860 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a077471-48fd-48bd-a69f-1dda230b55fc tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1293 microversion: 2.1 time: 0.135324 Sep 25 01:43:09.102331 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3053/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:08 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1293 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:09.558518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:09.559252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:09.566812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:09.582985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:09.586862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:09.587997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:09.588681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:09.592327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:09.863743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:09.876834 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f50b21ed-d84a-4335-95f1-40d443bbca51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1172 microversion: 2.1 time: 0.324229 Sep 25 01:43:09.878302 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3035/6088] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:09 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1172 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:10.126261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:10.126797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:10.152440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:10.152955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:10.153436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:10.154161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:10.154632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:10.155061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:10.657868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:10.674619 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0be9848e-0282-42b4-8c5d-ac5b3a9e810b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.561318 Sep 25 01:43:10.690292 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3054/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:10 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:10.900169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-950d9775-5f52-4912-b574-01fd9c88579e req-d2db2186-f503-4803-ac4a-67589b1e0f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e", "tag": "e8246123-e03f-4897-9e1e-680c31ee5514"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:10.910020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:10.910934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:10.934295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:10.935235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:10.938826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:10.939819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:10.942273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:10.944907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-950d9775-5f52-4912-b574-01fd9c88579e req-d2db2186-f503-4803-ac4a-67589b1e0f23 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:10.948045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:10.951211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-950d9775-5f52-4912-b574-01fd9c88579e req-d2db2186-f503-4803-ac4a-67589b1e0f23 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:10.954386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-950d9775-5f52-4912-b574-01fd9c88579e req-d2db2186-f503-4803-ac4a-67589b1e0f23 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:10.995097 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-950d9775-5f52-4912-b574-01fd9c88579e req-d2db2186-f503-4803-ac4a-67589b1e0f23 service nova] Creating event network-changed:e8246123-e03f-4897-9e1e-680c31ee5514 for instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e on n-h1-master-1 Sep 25 01:43:11.007621 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-950d9775-5f52-4912-b574-01fd9c88579e req-d2db2186-f503-4803-ac4a-67589b1e0f23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113050 Sep 25 01:43:11.009858 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3036/6090] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:11.304952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:11.351225 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-081fd553-bcc1-4cab-9fb7-bed7600c5658 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1214 microversion: 2.1 time: 0.444729 Sep 25 01:43:11.351984 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3055/6091] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:10 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1214 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:11.721509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:11.722672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:11.738706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:11.739661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:11.740343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:11.741328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:11.742057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:11.742702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:12.138636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:12.153997 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-666399e5-ff7c-46a5-8874-4d52ce5667c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.452165 Sep 25 01:43:12.154852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3037/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:11 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:12.294548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-01ad4d1d-4ab8-4289-9f4f-69ece2312ba6 req-66cca8a4-153c-4067-ab89-8fd4a18f61b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d039bd-a806-46d4-a79c-06d8c7e60409", "tag": "f2c56379-dc61-42a4-8fd2-b75161654317"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:12.318540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01ad4d1d-4ab8-4289-9f4f-69ece2312ba6 req-66cca8a4-153c-4067-ab89-8fd4a18f61b6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:12.320210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01ad4d1d-4ab8-4289-9f4f-69ece2312ba6 req-66cca8a4-153c-4067-ab89-8fd4a18f61b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:12.320882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-01ad4d1d-4ab8-4289-9f4f-69ece2312ba6 req-66cca8a4-153c-4067-ab89-8fd4a18f61b6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:12.343204 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-01ad4d1d-4ab8-4289-9f4f-69ece2312ba6 req-66cca8a4-153c-4067-ab89-8fd4a18f61b6 service nova] Creating event network-changed:f2c56379-dc61-42a4-8fd2-b75161654317 for instance b4d039bd-a806-46d4-a79c-06d8c7e60409 on n-h1-master-1 Sep 25 01:43:12.357137 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-01ad4d1d-4ab8-4289-9f4f-69ece2312ba6 req-66cca8a4-153c-4067-ab89-8fd4a18f61b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066544 Sep 25 01:43:12.358219 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3056/6093] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:12.373852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:12.374748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:12.381117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:12.381642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:12.382256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:12.383125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:12.394196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:12.394844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:12.696858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:12.711318 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1802ae0d-12c6-4932-8a07-313609626ad6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1214 microversion: 2.1 time: 0.339370 Sep 25 01:43:12.712947 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3038/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:12 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:13.178098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:13.179350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:13.185832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:13.186328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:13.186779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:13.187484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:13.187945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:13.188380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:13.322200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:13.330060 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-192627ac-3d8e-449e-a0e5-33400f0da75a tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.156288 Sep 25 01:43:13.330636 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3057/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:13 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:13.735108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:13.735729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:13.743729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:13.744217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:13.744655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:13.745368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:13.745855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:13.746280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:13.766610 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:13.885816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:13.893771 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6309c1a5-c80b-4f1b-9dbb-61f9aa9696c0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1214 microversion: 2.1 time: 0.162499 Sep 25 01:43:13.894433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3039/6096] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:13 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:14.354101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:14.354796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:14.362267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:14.363005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:14.364007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:14.364748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:14.365213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:14.365674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:14.515672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:14.519582 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:14.526341 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b22036d-8619-4137-9774-0b5478008dea tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.177220 Sep 25 01:43:14.526933 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3058/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:14 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:14.917238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:14.917829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:14.921677 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:14.925847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:14.926323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:14.926747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:14.927433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:14.927881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:14.928306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:15.072570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:15.080449 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e92b06d7-35a8-4cfb-be2e-a8b71d0e69f6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1214 microversion: 2.1 time: 0.168120 Sep 25 01:43:15.081073 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3040/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:14 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:15.550379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:15.551002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:15.558795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:15.559494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:15.559935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:15.560642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:15.561144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:15.561613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:15.703704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:15.721095 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-56ab4f82-648d-4627-883c-932b09b50957 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.174549 Sep 25 01:43:15.721829 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3059/6099] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:15 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:16.104320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:16.105711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:16.112536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:16.113019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:16.113584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:16.114295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:16.114752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:16.115303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:16.263425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:16.272003 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f3a0465-be58-46ca-b760-015bfb8d93c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.171714 Sep 25 01:43:16.273778 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3041/6100] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:16 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:16.745985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:16.746516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:16.753636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:16.754135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:16.754582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:16.755279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:16.755732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:16.756153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:16.895885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:16.903713 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f572f5b0-67e8-4d66-81de-6d00f29f8b34 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.162559 Sep 25 01:43:16.904298 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3060/6101] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:16 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:17.297252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:17.297929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:17.299765 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:17.306672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:17.307152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:17.307593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:17.308288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:17.308743 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:17.309172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:17.376430 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:17.442235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:17.451167 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9a2f3fed-64a9-4cac-bcdf-a7b156caaadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.158860 Sep 25 01:43:17.451745 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3042/6102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:17 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:17.927132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:17.927783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:17.930322 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:17.930987 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:17.937627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:17.938116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:17.938560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:17.939259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:17.939719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:17.940152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:18.230177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-567e653a-fd14-442b-8661-b27ba3d93898 req-a2e5b68e-6a1d-4d36-b7eb-9c10b88799c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e", "name": "network-vif-plugged", "status": "completed", "tag": "e8246123-e03f-4897-9e1e-680c31ee5514"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:18.245052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-567e653a-fd14-442b-8661-b27ba3d93898 req-a2e5b68e-6a1d-4d36-b7eb-9c10b88799c7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:18.245578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-567e653a-fd14-442b-8661-b27ba3d93898 req-a2e5b68e-6a1d-4d36-b7eb-9c10b88799c7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:18.246024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-567e653a-fd14-442b-8661-b27ba3d93898 req-a2e5b68e-6a1d-4d36-b7eb-9c10b88799c7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:18.260827 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-567e653a-fd14-442b-8661-b27ba3d93898 req-a2e5b68e-6a1d-4d36-b7eb-9c10b88799c7 service nova] Creating event network-vif-plugged:e8246123-e03f-4897-9e1e-680c31ee5514 for instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e on n-h1-master-1 Sep 25 01:43:18.266350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-567e653a-fd14-442b-8661-b27ba3d93898 req-a2e5b68e-6a1d-4d36-b7eb-9c10b88799c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041229 Sep 25 01:43:18.267198 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3043/6103] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:43:18.334319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:18.342235 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-abe662c2-7eb8-430f-a1fa-a1ef848408d1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.419022 Sep 25 01:43:18.342818 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3061/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:17 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:18.477798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:18.478499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:18.484606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:18.485087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:18.485555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:18.486267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:18.486715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:18.487143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:18.616994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:18.624923 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ef9e80c5-f788-471b-a006-bd2e4fa82571 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.153215 Sep 25 01:43:18.625890 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3044/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:18 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:19.364713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:19.365341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:19.372611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:19.373108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:19.373587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:19.374292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:19.374757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:19.375192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:19.508278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:19.516077 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d6f9fe7-cf7d-47a0-88f8-310d2f203baa tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1361 microversion: 2.1 time: 0.155346 Sep 25 01:43:19.516650 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3062/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:19 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:19.648780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:19.649421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:19.657091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:19.657619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:19.658060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:19.658756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:19.659210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:19.659638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:19.792210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:19.800324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89927afd-03dd-42c2-852a-cd01d22f0129 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.156132 Sep 25 01:43:19.801104 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3045/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:19 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:20.540567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:20.541192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:20.548115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:20.548596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:20.549038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:20.549756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:20.550209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:20.550633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:20.681476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:20.689150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bfee7315-8bf3-4307-ae3a-1f3b99e1b7d5 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1547 microversion: 2.1 time: 0.153502 Sep 25 01:43:20.689761 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3063/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:20 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:20.711696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:20.712214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:20.719012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:20.719557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:20.719992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:20.720701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:20.721161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:20.721669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:20.801705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0323276a-d2fc-4e10-96da-62a4fafaedd0 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094474 Sep 25 01:43:20.802317 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3046/6109] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 01:43:20 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:20.824215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:20.824828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:20.830801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:20.831284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:20.831724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:20.832409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:20.832860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:20.833282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:21.085861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:21.093873 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc5e2e48-41aa-41ad-b5c3-70aae42d5a69 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.273859 Sep 25 01:43:21.094469 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3064/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:20 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:21.807101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-55752ced-fcd6-4c35-a023-b4e1ebd8e409 req-ec3ad25a-3396-4b7b-993a-1739b5359dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e", "tag": "e8246123-e03f-4897-9e1e-680c31ee5514"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:21.816569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55752ced-fcd6-4c35-a023-b4e1ebd8e409 req-ec3ad25a-3396-4b7b-993a-1739b5359dd5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:21.817045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55752ced-fcd6-4c35-a023-b4e1ebd8e409 req-ec3ad25a-3396-4b7b-993a-1739b5359dd5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:21.817511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-55752ced-fcd6-4c35-a023-b4e1ebd8e409 req-ec3ad25a-3396-4b7b-993a-1739b5359dd5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:21.829126 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-55752ced-fcd6-4c35-a023-b4e1ebd8e409 req-ec3ad25a-3396-4b7b-993a-1739b5359dd5 service nova] Creating event network-changed:e8246123-e03f-4897-9e1e-680c31ee5514 for instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e on n-h1-master-1 Sep 25 01:43:21.834238 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-55752ced-fcd6-4c35-a023-b4e1ebd8e409 req-ec3ad25a-3396-4b7b-993a-1739b5359dd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032577 Sep 25 01:43:21.835135 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3047/6111] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:22.118276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:22.119140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:22.122038 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:22.128933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:22.129576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:22.130102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:22.131299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:22.131996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:22.132553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:22.365067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:22.374050 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53a48c0e-3bbd-4236-8b6a-5236c84054fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.261785 Sep 25 01:43:22.374654 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3065/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:22 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:23.398977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:23.399686 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:23.406175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:23.406661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:23.407100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:23.407817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:23.408273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:23.408701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:23.539314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:23.547143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01d25879-62a7-4b58-9547-33fd290b096a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.153339 Sep 25 01:43:23.547719 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3048/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:23 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:24.570432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:24.571059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:24.577638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:24.578132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:24.578582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:24.579281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:24.579738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:24.580157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:24.715723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:24.723667 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-214b9022-1a6d-477e-baf6-780a349c0a56 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.157982 Sep 25 01:43:24.724248 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3066/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:24 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:25.747962 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:25.748511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:25.755609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:25.756093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:25.757167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:25.757897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:25.758358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:25.758788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:25.888446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:25.896273 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6df73b94-4ac6-474f-bd50-d0f594336ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.152294 Sep 25 01:43:25.897058 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3049/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:25 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:26.278258 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fd3bae15-9cf2-49da-b1a5-957f12142cb9 req-481c1706-140f-4608-bde8-dbc50fe3cba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d039bd-a806-46d4-a79c-06d8c7e60409", "name": "network-vif-plugged", "status": "completed", "tag": "f2c56379-dc61-42a4-8fd2-b75161654317"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:26.291247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd3bae15-9cf2-49da-b1a5-957f12142cb9 req-481c1706-140f-4608-bde8-dbc50fe3cba0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:26.292143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd3bae15-9cf2-49da-b1a5-957f12142cb9 req-481c1706-140f-4608-bde8-dbc50fe3cba0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:26.292586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fd3bae15-9cf2-49da-b1a5-957f12142cb9 req-481c1706-140f-4608-bde8-dbc50fe3cba0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:26.306231 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fd3bae15-9cf2-49da-b1a5-957f12142cb9 req-481c1706-140f-4608-bde8-dbc50fe3cba0 service nova] Creating event network-vif-plugged:f2c56379-dc61-42a4-8fd2-b75161654317 for instance b4d039bd-a806-46d4-a79c-06d8c7e60409 on n-h1-master-1 Sep 25 01:43:26.311371 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fd3bae15-9cf2-49da-b1a5-957f12142cb9 req-481c1706-140f-4608-bde8-dbc50fe3cba0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036926 Sep 25 01:43:26.312518 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3067/6116] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:26.919503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:26.920132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:26.926843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:26.927333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:26.927773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:26.928472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:26.929044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:26.929514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:27.060926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:27.069121 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e236a0c-74cf-46fa-a4c2-e5fd8e9f4eab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1202 microversion: 2.1 time: 0.153167 Sep 25 01:43:27.069734 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3050/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:26 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:28.093922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:28.094644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:28.100871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:28.102042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:28.102492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:28.103193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:28.103658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:28.104091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:28.312863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:28.321514 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ffdc641c-2e26-467b-b7cf-1ff661005093 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1388 microversion: 2.1 time: 0.232909 Sep 25 01:43:28.322099 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3068/6118] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:28 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1388 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:28.344679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:28.345210 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:28.352336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:28.352835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:28.353282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:28.354033 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:28.354496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:28.355020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:28.557739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:28.565558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d485cffe-883c-40d8-955d-d6a8ab60d52c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1388 microversion: 2.1 time: 0.224716 Sep 25 01:43:28.566147 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3051/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:28 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1388 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:28.587121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:28.587830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:28.593924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:28.594521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:28.595081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:28.595809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:28.596332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:28.596825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:29.056909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:29.064709 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00c40e20-db31-4930-be8a-906c1f639d84 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1388 microversion: 2.1 time: 0.481564 Sep 25 01:43:29.065291 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3069/6120] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:28 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1388 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:29.087608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:29.088117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:29.096782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:29.097716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:29.098172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:29.098859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:29.099315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:29.099746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:29.124723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:43:29.199095 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a51f46d0-f92e-4921-83d7-6c618ad5af02 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 204 len: 0 microversion: 2.1 time: 0.115762 Sep 25 01:43:29.199688 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3052/6121] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:43:29 2022] DELETE /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:43:29.208738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:29.209360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:29.216792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:29.217278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:29.217755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:29.218453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:29.218912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:29.219342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:29.353468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:29.361834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15173738-e82f-4d32-bfc0-79b8f9ec2ae1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1394 microversion: 2.1 time: 0.157068 Sep 25 01:43:29.362419 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3070/6122] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:29 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1394 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:30.385453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:30.386164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:30.396584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:30.397069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:30.397533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:30.399447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:30.399909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:30.400334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:30.531570 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:30.540102 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af1158c8-4bb8-4fd2-b57f-983233fe2136 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1394 microversion: 2.1 time: 0.159258 Sep 25 01:43:30.540683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3053/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:30 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1394 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:31.500312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e6266f4e-c5d1-495a-81ae-21f2f5ed9bf9 req-dcb0f308-7e50-4ace-83fb-26f380623b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d039bd-a806-46d4-a79c-06d8c7e60409", "name": "network-vif-deleted", "tag": "f2c56379-dc61-42a4-8fd2-b75161654317"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:31.511839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e6266f4e-c5d1-495a-81ae-21f2f5ed9bf9 req-dcb0f308-7e50-4ace-83fb-26f380623b7a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:31.512380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e6266f4e-c5d1-495a-81ae-21f2f5ed9bf9 req-dcb0f308-7e50-4ace-83fb-26f380623b7a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:31.512756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e6266f4e-c5d1-495a-81ae-21f2f5ed9bf9 req-dcb0f308-7e50-4ace-83fb-26f380623b7a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:31.525679 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e6266f4e-c5d1-495a-81ae-21f2f5ed9bf9 req-dcb0f308-7e50-4ace-83fb-26f380623b7a service nova] Creating event network-vif-deleted:f2c56379-dc61-42a4-8fd2-b75161654317 for instance b4d039bd-a806-46d4-a79c-06d8c7e60409 on n-h1-master-1 Sep 25 01:43:31.533663 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e6266f4e-c5d1-495a-81ae-21f2f5ed9bf9 req-dcb0f308-7e50-4ace-83fb-26f380623b7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Sep 25 01:43:31.534286 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3071/6124] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:31.563299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:31.563915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:31.571303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:31.571791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:31.572224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:31.572927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:31.573371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:31.573820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:31.645099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:31.653256 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d7f7662c-d979-4b7d-974c-fc5c6f182341 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1187 microversion: 2.1 time: 0.093846 Sep 25 01:43:31.653906 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3054/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:31 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:32.678188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:32.678787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:32.686084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:32.686570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:32.687017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:32.687708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:32.688166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:32.688594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:32.755257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:32.763721 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9d8a6c5a-530a-45c9-8fb8-db3438e83afa tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1187 microversion: 2.1 time: 0.091274 Sep 25 01:43:32.764293 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3072/6126] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:32 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:33.787631 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:33.788995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:33.796405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:33.797122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:33.797587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:33.798478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:33.798929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:33.799603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:33.864825 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:33.874438 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59aed738-7d9d-4e02-8910-fbd64b5fcbee tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1187 microversion: 2.1 time: 0.091149 Sep 25 01:43:33.889983 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3055/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:33 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:34.899680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:34.900310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:34.907674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:34.908168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:34.908615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:34.909357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:34.909818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:34.910256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:34.977507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:34.985510 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef660d15-d4a7-4c65-b710-f8677832d855 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1187 microversion: 2.1 time: 0.090729 Sep 25 01:43:34.986113 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3073/6128] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:34 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:36.009249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:36.009960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:36.016806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:36.017296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:36.017771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:36.018469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:36.018927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:36.019356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:36.023557 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:36.052229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:36.052713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:36.053157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:36.053636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid b4d039bd-a806-46d4-a79c-06d8c7e60409 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:43:36.094335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:36.102319 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-653b2c65-6f4d-4af3-8db6-72f1234e9ac9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 200 len: 1192 microversion: 2.1 time: 0.097723 Sep 25 01:43:36.102896 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3056/6129] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:36 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:37.125479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:37.126103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: b4d039bd-a806-46d4-a79c-06d8c7e60409] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:37.133585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:37.134070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:37.134517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:37.135214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:37.135675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:37.136108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:37.150103 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance b4d039bd-a806-46d4-a79c-06d8c7e60409 could not be found. Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 HTTP/1.1 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b4d039bd-a806-46d4-a79c-06d8c7e60409 could not be found. Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b4d039bd-a806-46d4-a79c-06d8c7e60409'} Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4d039bd-a806-46d4-a79c-06d8c7e60409 could not be found. Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d039bd-a806-46d4-a79c-06d8c7e60409 could not be found. Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:37.151766 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d039bd-a806-46d4-a79c-06d8c7e60409 could not be found. Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance b4d039bd-a806-46d4-a79c-06d8c7e60409 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-478aa238-8fd7-4c19-9f4d-09ec12b5e50f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409" status: 404 len: 111 microversion: 2.1 time: 0.031712 Sep 25 01:43:37.156764 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3074/6130] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:37 2022] GET /compute/v2.1/servers/b4d039bd-a806-46d4-a79c-06d8c7e60409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:43:41.121666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:41.122226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:41.136895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:41.137435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:41.137889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:41.138612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:41.139075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:41.139509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:41.184703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:43:41.280878 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5f98568-b685-4258-826e-6424e9a193b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 204 len: 0 microversion: 2.1 time: 0.168145 Sep 25 01:43:41.282192 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3057/6131] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:43:41 2022] DELETE /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:43:41.290884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:41.291511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:41.298456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:41.298946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:41.299576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:41.300287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:41.300750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:41.301214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:41.457773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:41.468084 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97a220d2-e76b-41bf-a693-39b7bc62d3f3 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1551 microversion: 2.1 time: 0.181218 Sep 25 01:43:41.469082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3075/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:41 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:42.229956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1135504947", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "39063a15-459e-42d9-8942-922b1fa61e49", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:42.291286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:43:42.493364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:42.494212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:42.501552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:42.502045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:42.502492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:42.503195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:42.503848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:42.504415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:42.714428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:42.722191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-961e4af3-a74a-4c28-a0c9-6a0eb81ad01d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1551 microversion: 2.1 time: 0.233962 Sep 25 01:43:42.722774 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3076/6133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:42 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1551 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:42.744406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:43:42.744832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:43:42.745307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:43:42.745746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:43:42.746161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:43:42.755019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:42.755498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:42.755935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:42.756716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:42.757445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:42.757863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:42.774663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:43:42.779869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:43:42.837449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:43:42.839576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39063a15-459e-42d9-8942-922b1fa61e49',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:43:42.970395 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4f28e059-3a40-4972-a1b8-3d860967141e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744877 Sep 25 01:43:42.971485 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3058/6134] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:43:42.983308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a087f9d-aa8d-4d74-8a07-c0dfd396b8af tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:42.984194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a087f9d-aa8d-4d74-8a07-c0dfd396b8af tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:43.053029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9a087f9d-aa8d-4d74-8a07-c0dfd396b8af tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:43.060311 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a087f9d-aa8d-4d74-8a07-c0dfd396b8af tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1057 microversion: 2.1 time: 0.080868 Sep 25 01:43:43.061009 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3077/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:42 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1057 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:43.343128 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d96bebea-b56f-4473-a520-23abe82f98f2 req-992e64ab-ba30-433f-91ac-69ece66b3587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0dc249-bc51-4fc6-bf27-965e5747daa8", "name": "network-vif-deleted", "tag": "b51daf95-6efc-4187-9c0f-0c5142c6c3b9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:43.355639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d96bebea-b56f-4473-a520-23abe82f98f2 req-992e64ab-ba30-433f-91ac-69ece66b3587 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:43.356128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d96bebea-b56f-4473-a520-23abe82f98f2 req-992e64ab-ba30-433f-91ac-69ece66b3587 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:43.356772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d96bebea-b56f-4473-a520-23abe82f98f2 req-992e64ab-ba30-433f-91ac-69ece66b3587 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:43.373103 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d96bebea-b56f-4473-a520-23abe82f98f2 req-992e64ab-ba30-433f-91ac-69ece66b3587 service nova] Creating event network-vif-deleted:b51daf95-6efc-4187-9c0f-0c5142c6c3b9 for instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 on n-h2-master-1 Sep 25 01:43:43.378122 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d96bebea-b56f-4473-a520-23abe82f98f2 req-992e64ab-ba30-433f-91ac-69ece66b3587 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039098 Sep 25 01:43:43.378726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3059/6136] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:43.746459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:43.747083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:43.755026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:43.755559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:43.756012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:43.757294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:43.757865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:43.758317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:43.777004 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:43.791125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:43.791621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:43.792073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:43.792528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lazy-loading 'fault' on Instance uuid ad0dc249-bc51-4fc6-bf27-965e5747daa8 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:43:43.834850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:43.842717 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-157aedcd-2fc5-49c2-9828-b27b51d970f1 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 200 len: 1337 microversion: 2.1 time: 0.100417 Sep 25 01:43:43.843289 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3078/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:43 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:44.084306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:44.085067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:44.091621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:44.092150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:44.092591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:44.093291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:44.093783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:44.094244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:44.158799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:44.170774 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb4f646f-6f76-4049-97c7-f2c939777882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1155 microversion: 2.1 time: 0.090743 Sep 25 01:43:44.171351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3060/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:44 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1155 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:44.866096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:44.867598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: ad0dc249-bc51-4fc6-bf27-965e5747daa8] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:44.878399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:44.880034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:44.883031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:44.885052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:44.885882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:44.886692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:44.904166 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] HTTP exception thrown: Instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 could not be found. Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Request method failure captured: Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 HTTP/1.1 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7HcQJWN7Kv7F44OXM-aSRSpZuPtE1USouo300gt1my9lEIwkyruhydpUYbeUnAp4TaLC9PZnfEVk7Z20cOcQ_AHgU2maydQzGGgf4rflBu8uLnS-SVAZ0V9H7kRLV0EAGtByKMlpPvrIRKcu6bdMXqTqav9h2EEVR06P2zi0xa2rp4 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fdcd1c5a13e24165971100bc619e7be2 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdcd1c5a13e24165971100bc619e7be2"}]}] Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fdcd1c5a13e24165971100bc619e7be2 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkBasicOps-1239684923-project Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7fa3cce1ff3445eb896fb8bad352ef1f Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkBasicOps-1239684923-project Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 could not be found. Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ad0dc249-bc51-4fc6-bf27-965e5747daa8'} Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 could not be found. Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 could not be found. Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:44.906402 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 could not be found. Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:44.911446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Returning 404 to user: Instance ad0dc249-bc51-4fc6-bf27-965e5747daa8 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:43:44.912585 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f23a07a-e535-49ea-9480-193644b8bada tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8" status: 404 len: 111 microversion: 2.1 time: 0.050909 Sep 25 01:43:44.914389 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3079/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:44 2022] GET /compute/v2.1/servers/ad0dc249-bc51-4fc6-bf27-965e5747daa8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:43:45.104757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a32e5c3-e96e-4a78-9f80-cdf22f5f7a6b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '.version_select at 0x7f7bf3f49550>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:45.113093 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:45.159721 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a32e5c3-e96e-4a78-9f80-cdf22f5f7a6b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-635830408" status: 202 len: 0 microversion: 2.1 time: 0.065587 Sep 25 01:43:45.161161 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3061/6140] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:43:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-635830408 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:43:45.194509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:45.195396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:45.201621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:45.202125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:45.202566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:45.203460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:45.203921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:45.204351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:45.313717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:45.324266 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-12b204c5-2542-4364-aa39-be5c62ffd172 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1173 microversion: 2.1 time: 0.133271 Sep 25 01:43:45.325223 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3080/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:45 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1173 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:46.352863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:46.362035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:46.373803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:46.374570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:46.375257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:46.376183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:46.376872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:46.377536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:46.545643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d0448615-93d3-4c82-b833-629c4ce8db95 req-d57c735b-1970-4890-9727-e6bf460f8d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5", "tag": "db76683f-af87-422b-a891-ca2c242d69f2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:46.557947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d0448615-93d3-4c82-b833-629c4ce8db95 req-d57c735b-1970-4890-9727-e6bf460f8d48 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:46.558766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d0448615-93d3-4c82-b833-629c4ce8db95 req-d57c735b-1970-4890-9727-e6bf460f8d48 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:46.559382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d0448615-93d3-4c82-b833-629c4ce8db95 req-d57c735b-1970-4890-9727-e6bf460f8d48 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:46.577389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d0448615-93d3-4c82-b833-629c4ce8db95 req-d57c735b-1970-4890-9727-e6bf460f8d48 service nova] Creating event network-changed:db76683f-af87-422b-a891-ca2c242d69f2 for instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 on n-h2-master-1 Sep 25 01:43:46.583237 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d0448615-93d3-4c82-b833-629c4ce8db95 req-d57c735b-1970-4890-9727-e6bf460f8d48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042789 Sep 25 01:43:46.584566 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3081/6142] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:43:46.687227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:46.702217 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3865775c-737c-4913-969e-2ad6cb19a75d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1215 microversion: 2.1 time: 0.355226 Sep 25 01:43:46.702934 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3062/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:46 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1215 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:47.439773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:47.440766 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:47.441165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b75ce4d6-a21c-48cb-9ad4-a7882521930c req-61140eb6-368f-45f2-9237-8745284f3c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009a5e26-1d05-4543-8ad5-0a95cbb90e05", "tag": "1c7a32fd-23f2-4311-890b-1b9369e16db1"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:47.455581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b75ce4d6-a21c-48cb-9ad4-a7882521930c req-61140eb6-368f-45f2-9237-8745284f3c34 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.456357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b75ce4d6-a21c-48cb-9ad4-a7882521930c req-61140eb6-368f-45f2-9237-8745284f3c34 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.456777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.457171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b75ce4d6-a21c-48cb-9ad4-a7882521930c req-61140eb6-368f-45f2-9237-8745284f3c34 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.457315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.457803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.458618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.459097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.461033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.472184 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b75ce4d6-a21c-48cb-9ad4-a7882521930c req-61140eb6-368f-45f2-9237-8745284f3c34 service nova] Creating event network-changed:1c7a32fd-23f2-4311-890b-1b9369e16db1 for instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 on n-h1-master-1 Sep 25 01:43:47.479541 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b75ce4d6-a21c-48cb-9ad4-a7882521930c req-61140eb6-368f-45f2-9237-8745284f3c34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042466 Sep 25 01:43:47.481299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3063/6144] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:43:47.507212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:43:47.650246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5086843-69c2-4dc0-a212-aeb7b273ba44 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 204 len: 0 microversion: 2.1 time: 0.216080 Sep 25 01:43:47.660107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:47.660415 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3082/6145] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:43:47 2022] DELETE /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:43:47.661314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:47.668594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.669353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.670006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.670907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.671527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.672118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.726177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:47.726769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:47.753064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.753597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.754046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.754765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:47.755229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:47.755661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:47.980852 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:47.985373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:47.996489 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-65ec37d1-3ea6-4afe-a63c-8de3b323dc4d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1671 microversion: 2.1 time: 0.340471 Sep 25 01:43:47.997424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae4ff91f-b621-4450-8c00-5a5ebfb7a31b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1215 microversion: 2.1 time: 0.275664 Sep 25 01:43:48.005450 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3083/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:47 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:48.005841 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3064/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:47 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1671 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:49.022652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:49.023718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:49.024146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:49.025392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:49.033018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:49.033663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:49.033938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:49.034302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:49.034814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:49.035323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:49.035515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:49.036003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:49.036445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:49.036651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:49.037098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:49.038360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:49.248949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:49.254066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:49.270664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38c36f84-b404-4f84-85dd-1ace476967f9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1215 microversion: 2.1 time: 0.254250 Sep 25 01:43:49.271256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3084/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:49 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:49.272961 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d8d5c72e-5f34-442f-bdcf-4253cdade781 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1671 microversion: 2.1 time: 0.252991 Sep 25 01:43:49.273911 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3065/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:49 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:49.777864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-82e7cb50-b325-43f4-b83e-672572a6b6f8 req-086b8143-05e6-4f99-9074-3fdde2ed6c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009a5e26-1d05-4543-8ad5-0a95cbb90e05", "name": "network-vif-deleted", "tag": "1c7a32fd-23f2-4311-890b-1b9369e16db1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:43:49.787811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-82e7cb50-b325-43f4-b83e-672572a6b6f8 req-086b8143-05e6-4f99-9074-3fdde2ed6c32 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:49.788431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-82e7cb50-b325-43f4-b83e-672572a6b6f8 req-086b8143-05e6-4f99-9074-3fdde2ed6c32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:49.789189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-82e7cb50-b325-43f4-b83e-672572a6b6f8 req-086b8143-05e6-4f99-9074-3fdde2ed6c32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:49.801609 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-82e7cb50-b325-43f4-b83e-672572a6b6f8 req-086b8143-05e6-4f99-9074-3fdde2ed6c32 service nova] Creating event network-vif-deleted:1c7a32fd-23f2-4311-890b-1b9369e16db1 for instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 on n-h1-master-1 Sep 25 01:43:49.806882 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-82e7cb50-b325-43f4-b83e-672572a6b6f8 req-086b8143-05e6-4f99-9074-3fdde2ed6c32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032885 Sep 25 01:43:49.807569 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3085/6150] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:50.293992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:50.295181 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:50.299330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:50.300121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:50.302326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:50.303324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:50.303457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:50.304347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:50.304803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:50.305228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:50.308354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:50.308858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:50.309501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:50.310362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:50.311168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:50.312060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:50.349755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:50.350917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:50.351456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:50.351993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lazy-loading 'fault' on Instance uuid 009a5e26-1d05-4543-8ad5-0a95cbb90e05 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:43:50.411690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:50.425119 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0be841b9-fb77-4e1c-998a-aec5b6fb3410 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 200 len: 1338 microversion: 2.1 time: 0.130743 Sep 25 01:43:50.425959 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3086/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:50 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:43:50.473311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:50.481612 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c29b0f8f-2138-4ae0-adae-51b6941a480e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.191826 Sep 25 01:43:50.482200 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3066/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:50 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:51.448244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:51.448908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 009a5e26-1d05-4543-8ad5-0a95cbb90e05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:51.456312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:51.456802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:51.457244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:51.457968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:51.458430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:51.458864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:51.472732 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] HTTP exception thrown: Instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 could not be found. Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Request method failure captured: Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 HTTP/1.1 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7HcQJWN7Kv7F44OXM-aSRSpZuPtE1USouo300gt1my9lEIwkyruhydpUYbeUnAp4TaLC9PZnfEVk7Z20cOcQ_AHgU2maydQzGGgf4rflBu8uLnS-SVAZ0V9H7kRLV0EAGtByKMlpPvrIRKcu6bdMXqTqav9h2EEVR06P2zi0xa2rp4 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: fdcd1c5a13e24165971100bc619e7be2 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdcd1c5a13e24165971100bc619e7be2"}]}] Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: fdcd1c5a13e24165971100bc619e7be2 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkBasicOps-1239684923-project Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7fa3cce1ff3445eb896fb8bad352ef1f Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkBasicOps-1239684923-project Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 could not be found. Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '009a5e26-1d05-4543-8ad5-0a95cbb90e05'} Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 could not be found. Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 could not be found. Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:43:51.474448 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 could not be found. Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Returning 404 to user: Instance 009a5e26-1d05-4543-8ad5-0a95cbb90e05 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb0138e1-b488-41f3-8842-881f75103bfa tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05" status: 404 len: 111 microversion: 2.1 time: 0.032257 Sep 25 01:43:51.480567 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3087/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:51 2022] GET /compute/v2.1/servers/009a5e26-1d05-4543-8ad5-0a95cbb90e05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:43:51.504415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:51.505142 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:51.512481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:51.512964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:51.513396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:51.514105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:51.514555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:51.514972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:51.640970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f5494e7-6a15-4d84-9039-95b64581a792 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '.version_select at 0x7f7bf4078dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:51.664839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:51.670730 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f5494e7-6a15-4d84-9039-95b64581a792 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2042130186" status: 202 len: 0 microversion: 2.1 time: 0.033630 Sep 25 01:43:51.671328 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3088/6154] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:43:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2042130186 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:43:51.674634 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf1f3279-ead9-4786-a2fc-ac14982936da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.174429 Sep 25 01:43:51.683581 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3067/6155] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:51 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:52.698637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:52.699448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:52.705855 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:52.712705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:52.713212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:52.713938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:52.714663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:52.715132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:52.715577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:52.928928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:52.936673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f946cb9-eeb3-48ba-941f-171666f038b2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.244331 Sep 25 01:43:52.937264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3089/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:52 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:53.961279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:53.961912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:53.968398 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:53.969727 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:53.971744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:53.972728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:53.973419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:53.974870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:53.975673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:53.976268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:54.272372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:54.281864 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c87d03a2-ef3d-4605-bc81-11789bb5fe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.325290 Sep 25 01:43:54.282679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3068/6157] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:53 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:55.306445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:55.307017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:55.308970 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:43:55.315356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:55.315848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:55.316295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:55.316997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:55.317494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:55.317932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:55.570756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:55.578516 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c68df69a-3e5c-421a-8b10-09fbf1f556dd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.276353 Sep 25 01:43:55.579095 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3090/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:55 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:56.601063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:56.601780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:56.608335 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:56.608820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:56.609283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:56.610002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:56.610458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:56.610900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:56.770170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:56.779547 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce2fd539-eeb8-45c7-bc39-6e2400a71a82 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.182453 Sep 25 01:43:56.780138 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3069/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:56 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:57.701999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:57.702626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:57.711493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:57.712282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:57.712893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:57.713822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:57.714438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:57.715027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:57.741149 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd34a113-52ea-47a1-b953-cc65a307f5fe tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/ips" status: 200 len: 146 microversion: 2.1 time: 0.042352 Sep 25 01:43:57.759668 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3091/6160] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 25 01:43:57 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:43:57.802453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:57.803678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:57.814894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:57.815386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:57.817850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:57.820456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:57.820972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:57.824661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:58.202998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:58.216556 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48d787f3-0894-4a12-b430-414c67f00e81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.418069 Sep 25 01:43:58.217149 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3070/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:57 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:43:59.244341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:43:59.246085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:43:59.255364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:59.255958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:59.256591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:59.257937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:43:59.258828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:43:59.259821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:43:59.522823 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:43:59.537928 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d7d5fd17-b093-4cf5-ae99-d40e0e391a47 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.298392 Sep 25 01:43:59.547840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3092/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:43:59 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:00.345500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:00.353694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:00.367171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:00.369668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:00.370460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:00.371902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:00.374247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:00.374818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:00.567223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:00.569020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:00.576668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:00.577586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:00.578275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:00.579222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:00.579903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:00.580567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:00.766577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:00.776834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6c2c2e0-a576-4fd0-95f2-c17bcaab0122 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.213334 Sep 25 01:44:00.777441 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3093/6163] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:00 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:00.816695 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5554bba6-d7c3-43d3-8297-dc768e920190 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490056 Sep 25 01:44:00.823534 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3071/6164] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:44:00 2022] POST /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:01.065745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5cb1016-de9e-4190-a87d-42381ce0bd62 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'create', calling method: .version_select at 0x7f7beae670d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1968225687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOndMOKh4lbtQvDX4ATiqG4zkJXyu3ntyOZR7p7NVdTy/boRnAp5vixUFnu7N9Z2+Pzi1QCiSBl5m4jmGS70uKuh2Dwd6pV2mddf1tOki0EzEgeGProC0pZq5dsCTiKyLw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:01.082882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c5cb1016-de9e-4190-a87d-42381ce0bd62 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for project fdcd1c5a13e24165971100bc619e7be2. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:44:01.090575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-c5cb1016-de9e-4190-a87d-42381ce0bd62 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for user 7fa3cce1ff3445eb896fb8bad352ef1f and project fdcd1c5a13e24165971100bc619e7be2. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:44:01.118144 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5cb1016-de9e-4190-a87d-42381ce0bd62 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.056269 Sep 25 01:44:01.119179 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3094/6165] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:44:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:01.802795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:01.804597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:01.814842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:01.815422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:01.816612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:01.817766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:01.818850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:01.819772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:01.852675 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:02.071489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:02.082064 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b052a7d2-e406-4f02-b3a8-6498e0132d83 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.285221 Sep 25 01:44:02.083431 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3072/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:01 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:02.376319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-913419382", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "a8db697d-f9b1-4fcf-9d54-5e02f88ce1e9"}], "key_name": "tempest-TestNetworkBasicOps-1968225687", "security_groups": [{"name": "tempest-secgroup-smoke-138842724"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:02.493343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] validate_networks() for [('a8db697d-f9b1-4fcf-9d54-5e02f88ce1e9', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:44:02.845902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-02a64980-6ab4-4dd2-ba27-d7ee74a1508f req-415fffcd-3b01-477e-b36c-766f752bcd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5", "name": "network-vif-plugged", "status": "completed", "tag": "db76683f-af87-422b-a891-ca2c242d69f2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:02.866804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-02a64980-6ab4-4dd2-ba27-d7ee74a1508f req-415fffcd-3b01-477e-b36c-766f752bcd40 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:02.867878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-02a64980-6ab4-4dd2-ba27-d7ee74a1508f req-415fffcd-3b01-477e-b36c-766f752bcd40 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:02.868718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-02a64980-6ab4-4dd2-ba27-d7ee74a1508f req-415fffcd-3b01-477e-b36c-766f752bcd40 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:02.943897 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:44:02.944590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:44:02.945238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:44:02.945856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:44:02.946600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:44:02.955745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-02a64980-6ab4-4dd2-ba27-d7ee74a1508f req-415fffcd-3b01-477e-b36c-766f752bcd40 service nova] Creating event network-vif-plugged:db76683f-af87-422b-a891-ca2c242d69f2 for instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 on n-h2-master-1 Sep 25 01:44:02.965104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:02.965642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:02.966082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:02.966812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:02.967270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:02.967694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:02.971664 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-02a64980-6ab4-4dd2-ba27-d7ee74a1508f req-415fffcd-3b01-477e-b36c-766f752bcd40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156682 Sep 25 01:44:02.972828 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3073/6167] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:44:02.989658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for project fdcd1c5a13e24165971100bc619e7be2. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:44:03.002029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Getting quotas for user 7fa3cce1ff3445eb896fb8bad352ef1f and project fdcd1c5a13e24165971100bc619e7be2. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:44:03.065979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:44:03.071250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:44:03.108122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:03.109070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:03.128510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:03.132109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:03.133321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:03.134258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:03.134895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:03.136347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:03.220671 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43d4d99c-f5b6-4b0c-bcba-cb6d218c6116 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847223 Sep 25 01:44:03.233543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3095/6168] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:44:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:44:03.257032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8d12c70b-cdb2-4df1-a09b-c54dd5c2d62b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:03.258610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8d12c70b-cdb2-4df1-a09b-c54dd5c2d62b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:03.362683 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d12c70b-cdb2-4df1-a09b-c54dd5c2d62b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:03.372154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8d12c70b-cdb2-4df1-a09b-c54dd5c2d62b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1248 microversion: 2.1 time: 0.137164 Sep 25 01:44:03.373045 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3096/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:03 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:03.482496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:03.494232 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b51542b-b94b-487e-ade9-397a4eff41d7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.393102 Sep 25 01:44:03.495156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3074/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:03 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:04.398264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:04.398949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:04.406959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:04.407464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:04.407913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:04.408630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:04.409094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:04.409554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:04.484431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:04.493096 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e49933d1-8d2e-40ae-aaf8-f36fc9e5a0a8 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1300 microversion: 2.1 time: 0.099597 Sep 25 01:44:04.494480 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3097/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:04 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:04.516332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:04.517053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:04.524354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:04.524937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:04.525468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:04.526242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:04.526774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:04.527271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:04.675571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:04.689467 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-572b6a73-9c1a-47ce-963a-aa2c6f8887e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1203 microversion: 2.1 time: 0.175085 Sep 25 01:44:04.691764 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3075/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:04 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:05.517205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:05.518024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:05.526589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:05.527087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:05.527925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:05.529122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:05.529793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:05.530695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:05.716164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:05.716867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:05.726320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:05.727814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:05.728511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:05.729556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:05.730386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:05.731040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:05.790385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:05.799598 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2844723b-e116-474b-aad3-75cd13e42d4a tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.286745 Sep 25 01:44:05.800554 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3098/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:05 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:05.992231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:06.000161 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-220314cc-6762-4949-9e12-2729e4a89f60 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1390 microversion: 2.1 time: 0.288797 Sep 25 01:44:06.011700 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3076/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:05 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1390 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:06.023277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:06.024206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:06.030838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.031627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.032287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.033223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.033947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.034570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.054230 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:06.271416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:06.280693 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1c49da17-37e5-4031-8ba0-84788a3cabdd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1390 microversion: 2.1 time: 0.260947 Sep 25 01:44:06.282124 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3099/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:06 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:06.310635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:06.311288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:06.327412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.327918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.328365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.329088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.329601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.330037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.823631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:06.824248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:06.831108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.831592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.832034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.832746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.833202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.834150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.859358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:06.870319 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a021b8f3-5e10-4860-9da3-bb003e7f71e7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1390 microversion: 2.1 time: 0.569334 Sep 25 01:44:06.871329 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3077/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:06 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:06.892646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:06.893149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:06.900108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.900627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.901072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.901809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:06.902263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:06.902693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:06.930795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:44:07.011876 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9e1492bd-95e7-4b6a-925e-9d8c54d97fc9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 204 len: 0 microversion: 2.1 time: 0.122828 Sep 25 01:44:07.012703 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3078/6177] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:44:06 2022] DELETE /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:44:07.018160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fee5866c-b832-44c8-9038-2f85b561793e req-e997962b-81ac-4e9a-93d4-278157d1fa67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ef55fa-0b03-4fce-b37b-f195bd465871", "tag": "6955384d-04b7-42e1-b19c-0386f60c0526"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:07.028071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fee5866c-b832-44c8-9038-2f85b561793e req-e997962b-81ac-4e9a-93d4-278157d1fa67 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:07.028568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fee5866c-b832-44c8-9038-2f85b561793e req-e997962b-81ac-4e9a-93d4-278157d1fa67 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:07.029004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fee5866c-b832-44c8-9038-2f85b561793e req-e997962b-81ac-4e9a-93d4-278157d1fa67 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:07.040862 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fee5866c-b832-44c8-9038-2f85b561793e req-e997962b-81ac-4e9a-93d4-278157d1fa67 service nova] Creating event network-changed:6955384d-04b7-42e1-b19c-0386f60c0526 for instance 31ef55fa-0b03-4fce-b37b-f195bd465871 on n-h1-master-1 Sep 25 01:44:07.051853 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fee5866c-b832-44c8-9038-2f85b561793e req-e997962b-81ac-4e9a-93d4-278157d1fa67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037893 Sep 25 01:44:07.052519 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3079/6178] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:07.057757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:07.058538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:07.065265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:07.065796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:07.066240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:07.066955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:07.067409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:07.067839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:07.084733 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:07.092824 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17a0884d-47bb-4f91-8751-ede919306f74 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.273147 Sep 25 01:44:07.101757 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3100/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:06 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:07.291109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:07.298984 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8486285-e5cd-42f8-8b80-3a3b6296d155 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1396 microversion: 2.1 time: 0.245215 Sep 25 01:44:07.299566 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3080/6180] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:07 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1396 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:08.115884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:08.116505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:08.123403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:08.123895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:08.124343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:08.125046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:08.125534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:08.125972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:08.257718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:08.265325 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-96898629-ddf4-421a-80b4-0d96004f070b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.153401 Sep 25 01:44:08.265923 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3101/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:08 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:08.324259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:08.324902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:08.332147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:08.332642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:08.333085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:08.334009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:08.334466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:08.334981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:08.467015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:08.475441 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-518a9140-0dd3-476a-a16b-acf72d0143b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1396 microversion: 2.1 time: 0.154797 Sep 25 01:44:08.476165 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3081/6182] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:08 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1396 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:09.288576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:09.289250 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:09.296441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:09.296930 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:09.297372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:09.298132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:09.298593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:09.299026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:09.497796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1f987392-c5a8-4906-b81d-2afd18ff8db5 req-7fdfeeb7-67f5-4961-a0f9-d200c119924b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5", "name": "network-vif-deleted", "tag": "db76683f-af87-422b-a891-ca2c242d69f2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:09.520972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1f987392-c5a8-4906-b81d-2afd18ff8db5 req-7fdfeeb7-67f5-4961-a0f9-d200c119924b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:09.523847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1f987392-c5a8-4906-b81d-2afd18ff8db5 req-7fdfeeb7-67f5-4961-a0f9-d200c119924b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:09.523847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1f987392-c5a8-4906-b81d-2afd18ff8db5 req-7fdfeeb7-67f5-4961-a0f9-d200c119924b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:09.532628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:09.543017 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95ffa723-3667-43f1-b215-eaaae5594625 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.258564 Sep 25 01:44:09.543683 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1f987392-c5a8-4906-b81d-2afd18ff8db5 req-7fdfeeb7-67f5-4961-a0f9-d200c119924b service nova] Creating event network-vif-deleted:db76683f-af87-422b-a891-ca2c242d69f2 for instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 on n-h2-master-1 Sep 25 01:44:09.543998 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3102/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:09 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:09.558588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1f987392-c5a8-4906-b81d-2afd18ff8db5 req-7fdfeeb7-67f5-4961-a0f9-d200c119924b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065950 Sep 25 01:44:09.559732 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3082/6184] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:09.564739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:09.565622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:09.574306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:09.574810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:09.575251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:09.576169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:09.576633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:09.577275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:09.650127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:09.660099 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29215b4e-824c-49ea-8e34-d971abfdf80a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1188 microversion: 2.1 time: 0.114924 Sep 25 01:44:09.660688 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3103/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:09 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:10.570814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:10.571992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:10.578416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:10.578912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:10.579357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:10.580098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:10.580556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:10.580989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:10.683905 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:10.684545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:10.692086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:10.692874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:10.693742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:10.694641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:10.695282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:10.695892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:10.752542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:10.761654 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdfae5c1-d48e-4e3d-9508-27b2ab962d02 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.197963 Sep 25 01:44:10.762587 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3083/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:10 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:10.776540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:10.785594 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82d77f1d-6891-443a-9a52-0954917c9d51 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1188 microversion: 2.1 time: 0.105364 Sep 25 01:44:10.786188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3104/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:10 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:11.788356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:11.789008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:11.796597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:11.797184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:11.798547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:11.799325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:11.799850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:11.800386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:11.809304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:11.810571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:11.817125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:11.817653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:11.818815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:11.819527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:11.820165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:11.820768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:11.903792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:11.912939 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-75c73d40-c07c-4347-9615-8a84b0790af0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1188 microversion: 2.1 time: 0.107239 Sep 25 01:44:11.913562 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3105/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:11 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:11.969675 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:11.978230 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-91a01a49-bf92-4bf2-a5da-7bf599349ea0 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.193928 Sep 25 01:44:11.979069 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3084/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:11 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:12.494884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7a1303f0-0f00-4587-97c3-0a92c81febe5 req-50ee300b-920c-48cb-9827-636a9b283c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ef55fa-0b03-4fce-b37b-f195bd465871", "name": "network-vif-plugged", "status": "completed", "tag": "6955384d-04b7-42e1-b19c-0386f60c0526"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:12.505528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7a1303f0-0f00-4587-97c3-0a92c81febe5 req-50ee300b-920c-48cb-9827-636a9b283c97 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.505956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7a1303f0-0f00-4587-97c3-0a92c81febe5 req-50ee300b-920c-48cb-9827-636a9b283c97 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.506537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7a1303f0-0f00-4587-97c3-0a92c81febe5 req-50ee300b-920c-48cb-9827-636a9b283c97 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.520010 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7a1303f0-0f00-4587-97c3-0a92c81febe5 req-50ee300b-920c-48cb-9827-636a9b283c97 service nova] Creating event network-vif-plugged:6955384d-04b7-42e1-b19c-0386f60c0526 for instance 31ef55fa-0b03-4fce-b37b-f195bd465871 on n-h1-master-1 Sep 25 01:44:12.525837 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7a1303f0-0f00-4587-97c3-0a92c81febe5 req-50ee300b-920c-48cb-9827-636a9b283c97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037450 Sep 25 01:44:12.526873 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3106/6190] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:12.887310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:12.889605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:12.897617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.898392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.899031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.899949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.900581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.901176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.938008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:12.939494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:12.944281 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f5c9b779-4d9e-4c42-9d95-53205471b159 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061101 Sep 25 01:44:12.944887 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3085/6191] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:44:12 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:12.952002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.952899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.953825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.954717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.955336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.955925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.956052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:12.956485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:12.964062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.964563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.965004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.965756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:12.966217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:12.966642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:12.987158 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:13.004295 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd352a87-04d7-4964-9ad4-f60213333057 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6" status: 200 len: 194 microversion: 2.1 time: 0.052684 Sep 25 01:44:13.011014 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3086/6192] 10.222.0.16 () {58 vars in 1413 bytes} [Sun Sep 25 01:44:12 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:13.011014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:13.013669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:13.023541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:13.024229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:13.024834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:13.025750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:13.026376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:13.026806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:13.041728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:13.051669 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8ade8e9-84e3-4aea-ba14-5f7ecded45ad tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1188 microversion: 2.1 time: 0.119277 Sep 25 01:44:13.067703 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3107/6193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:12 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1188 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:13.182533 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:13.191155 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ff1bf551-125b-42d1-843c-df308f7ca683 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1373 microversion: 2.1 time: 0.184241 Sep 25 01:44:13.200039 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3087/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:13 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:14.075255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:14.075805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:14.077731 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:14.085009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.085539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.086195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.086910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.087374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.087805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.121673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.122175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.122617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.123075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:44:14.185326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:14.194888 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c8b1f0e-303f-45fc-980c-3f874c3bd3eb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 200 len: 1193 microversion: 2.1 time: 0.123636 Sep 25 01:44:14.195810 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3108/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:14 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:14.215237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:14.215867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:14.223177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.223660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.224231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.225437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.225953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.226382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.375877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:14.391004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9fa105c-4b77-41fa-9375-2b445d55109b tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1544 microversion: 2.1 time: 0.179694 Sep 25 01:44:14.392113 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3088/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:14 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:14.395211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d118bf0-da2b-4617-992b-e03f86e9090e"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:14.397618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:14.403705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.404196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.404637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.405632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.406096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.406525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.413766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:14.414396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:14.421318 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.421850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.422295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.423048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:14.423493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:14.423924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:14.444021 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:14.565653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:14.578772 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1b1680b-e350-4ff5-943c-ce0b19c181d4 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1544 microversion: 2.1 time: 0.168901 Sep 25 01:44:14.579626 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3089/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:14 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:14.681127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-00dcd455-9967-4749-9adb-f9741637240b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "POST /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291826 Sep 25 01:44:14.681983 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3109/6198] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 01:44:14 2022] POST /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:44:15.219541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:15.220851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:15.228241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:15.228733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:15.229179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:15.229911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:15.230371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:15.230802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:15.245394 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 could not be found. Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 HTTP/1.1 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 could not be found. Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5'} Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 could not be found. Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 could not be found. Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:15.247029 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 could not be found. Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af16b493-9e88-4159-b8a8-7a518ad6152a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5" status: 404 len: 111 microversion: 2.1 time: 0.032943 Sep 25 01:44:15.252267 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3090/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:15 2022] GET /compute/v2.1/servers/6b906ae6-ae54-43ac-9b36-1dfc0c2b0ea5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:44:16.335133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-69e2e55f-f49a-487b-80c2-165a58904234 req-03e9cd67-c16c-448b-af6c-32750f5aca8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ef55fa-0b03-4fce-b37b-f195bd465871", "tag": "6955384d-04b7-42e1-b19c-0386f60c0526"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:16.358915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-69e2e55f-f49a-487b-80c2-165a58904234 req-03e9cd67-c16c-448b-af6c-32750f5aca8c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:16.359401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-69e2e55f-f49a-487b-80c2-165a58904234 req-03e9cd67-c16c-448b-af6c-32750f5aca8c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:16.359833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-69e2e55f-f49a-487b-80c2-165a58904234 req-03e9cd67-c16c-448b-af6c-32750f5aca8c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:16.387814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-69e2e55f-f49a-487b-80c2-165a58904234 req-03e9cd67-c16c-448b-af6c-32750f5aca8c service nova] Creating event network-changed:6955384d-04b7-42e1-b19c-0386f60c0526 for instance 31ef55fa-0b03-4fce-b37b-f195bd465871 on n-h1-master-1 Sep 25 01:44:16.405698 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-69e2e55f-f49a-487b-80c2-165a58904234 req-03e9cd67-c16c-448b-af6c-32750f5aca8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075083 Sep 25 01:44:16.410449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3110/6200] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:26.839901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:26.842365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:26.845231 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:26.846102 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:26.854281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:26.854817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:26.855260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:26.855973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:26.856849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:26.856849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:26.892989 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e95c753-1eef-4c26-8b6f-f12518ffc17c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057146 Sep 25 01:44:26.893896 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3091/6201] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:44:26 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:27.038891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:27.039642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:27.043878 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:27.044534 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:27.048636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:27.049131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:27.049638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:27.050350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:27.050821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:27.051256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:27.084839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-832701a8-86e6-4217-b66c-9ea0317a5701 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6" status: 200 len: 194 microversion: 2.1 time: 0.050257 Sep 25 01:44:27.085485 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3111/6202] 10.222.0.16 () {58 vars in 1413 bytes} [Sun Sep 25 01:44:27 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:27.095870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:27.096370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:27.103161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:27.103723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:27.104221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:27.105013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:27.105559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:27.105985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:27.202917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lazy-loading 'services' on Instance uuid 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:44:27.292742 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c124345-3290-458a-9bc8-411de76ca2d9 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6" status: 202 len: 0 microversion: 2.1 time: 0.200649 Sep 25 01:44:27.293339 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3092/6203] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:44:27 2022] DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/0ce8cdd0-d86d-4ea4-a7df-d01baa3230d6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:44:32.696523 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:32.697137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:32.704325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:32.704813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:32.705248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:32.705976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:32.706430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:32.706855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:32.738268 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-726ea88f-e3a2-49c1-8fc0-0b1829914ab2 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/5d118bf0-da2b-4617-992b-e03f86e9090e" status: 200 len: 194 microversion: 2.1 time: 0.046243 Sep 25 01:44:32.739058 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3112/6204] 10.222.0.16 () {58 vars in 1413 bytes} [Sun Sep 25 01:44:32 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/5d118bf0-da2b-4617-992b-e03f86e9090e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:32.751705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:32.752288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:32.759199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:32.759678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:32.760105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:32.760789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:32.761238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:32.761686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:32.843530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lazy-loading 'services' on Instance uuid 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:44:32.915896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6306ca1-21d0-4fe3-a3ca-4264c2f6d556 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/5d118bf0-da2b-4617-992b-e03f86e9090e" status: 202 len: 0 microversion: 2.1 time: 0.168948 Sep 25 01:44:32.919855 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3093/6205] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 01:44:32 2022] DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments/5d118bf0-da2b-4617-992b-e03f86e9090e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:44:37.660059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-465756139", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3b5f0b52-4f76-416d-b609-cc975fadfa0f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:37.755277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:44:38.369348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:38.371771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:38.379875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.380188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.380655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.381326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.381810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.382243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.414953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-549240fa-014e-49f1-9cc4-060c796495c1 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049995 Sep 25 01:44:38.415728 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3094/6206] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:44:38 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:44:38.422051 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:44:38.422489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:44:38.422975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:44:38.423394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:44:38.423847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:44:38.434834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.435326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.435797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.436535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.436999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.437469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.455674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:44:38.461031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:44:38.473488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:44:38.475556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3b5f0b52-4f76-416d-b609-cc975fadfa0f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:44:38.534567 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:38.537333 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:38.543520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.544007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.544445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.545142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.545621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.546047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.550780 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f5c2b4e2-f892-4b98-92ff-0105f44f890c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895713 Sep 25 01:44:38.552047 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3113/6207] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:44:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:44:38.562984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7588af4-86aa-49f0-a783-d481530598c1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:38.563612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7588af4-86aa-49f0-a783-d481530598c1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:38.579526 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7c88e86f-23ff-48a7-a810-5d2b650b4bce tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049084 Sep 25 01:44:38.585916 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3095/6208] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 01:44:38 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:44:38.632647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e7588af4-86aa-49f0-a783-d481530598c1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:38.639791 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7588af4-86aa-49f0-a783-d481530598c1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1056 microversion: 2.1 time: 0.080575 Sep 25 01:44:38.640577 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3114/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:38 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1056 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:38.650510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:38.651217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:38.657865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.658347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.658876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.659572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.660020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.660477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.686371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:44:38.768275 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7aee9e5d-7bcd-449c-a2ed-e2c918cfd766 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 204 len: 0 microversion: 2.1 time: 0.121292 Sep 25 01:44:38.769093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3096/6210] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:44:38 2022] DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:44:38.778190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:38.778833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:38.786306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.786806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.787252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.787959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:38.788418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:38.789088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:38.923245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:38.931856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b87fead-5f69-4e07-9b82-d443868f654f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1672 microversion: 2.1 time: 0.157614 Sep 25 01:44:38.932536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3115/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:38 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:39.663065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:39.664412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:39.670478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:39.670972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:39.671416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:39.672152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:39.672615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:39.673043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:39.762756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:39.772293 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af608337-e894-4811-9e1a-2b5b97d7d9ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1126 microversion: 2.1 time: 0.113068 Sep 25 01:44:39.773151 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3097/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:39 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1126 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:39.957769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:39.958495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:39.966459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:39.967024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:39.967534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:39.968345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:39.968820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:39.969252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:40.235101 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:40.245500 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7bea4bf5-5c97-4a8d-9272-0efc07a91c21 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1672 microversion: 2.1 time: 0.292556 Sep 25 01:44:40.246784 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3116/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:39 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:40.764373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:40.769592 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:40.777111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:40.777635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:40.778083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:40.779154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:40.779812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:40.780665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:40.797038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:40.797863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:40.807915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:40.808574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:40.809061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:40.811190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:40.811841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:40.812295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:40.858312 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2aded91e-5509-4b11-8f79-dd922c70af9d tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871/action" status: 200 len: 24559 microversion: 2.1 time: 0.097656 Sep 25 01:44:40.859000 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3098/6214] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:44:40 2022] POST /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871/action => generated 24559 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:44:41.189282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:41.198734 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6ec69c8-398e-4427-8367-7228348e5f9f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.406329 Sep 25 01:44:41.199321 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3117/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:40 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:41.273992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:41.274976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:41.283421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:41.283980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:41.284530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:41.286597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:41.287683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:41.288227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:41.674625 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:41.683594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b9827191-339a-4e0d-8c1a-c6364965dec6 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1672 microversion: 2.1 time: 0.416205 Sep 25 01:44:41.684625 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3099/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:41 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1672 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:41.878476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6534abee-1abf-4db4-a0e1-decfbaf7797e req-50ee1491-88d0-4528-ae5c-c6776ed188c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8708e0e6-57dd-410b-b1f3-4c75ba015f63", "tag": "4598469b-f104-4c9a-b3b3-6687a167e374"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:41.894849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6534abee-1abf-4db4-a0e1-decfbaf7797e req-50ee1491-88d0-4528-ae5c-c6776ed188c2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:41.895905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6534abee-1abf-4db4-a0e1-decfbaf7797e req-50ee1491-88d0-4528-ae5c-c6776ed188c2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:41.897028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6534abee-1abf-4db4-a0e1-decfbaf7797e req-50ee1491-88d0-4528-ae5c-c6776ed188c2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:41.914397 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6534abee-1abf-4db4-a0e1-decfbaf7797e req-50ee1491-88d0-4528-ae5c-c6776ed188c2 service nova] Creating event network-changed:4598469b-f104-4c9a-b3b3-6687a167e374 for instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 on n-h2-master-1 Sep 25 01:44:41.920412 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6534abee-1abf-4db4-a0e1-decfbaf7797e req-50ee1491-88d0-4528-ae5c-c6776ed188c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050942 Sep 25 01:44:41.921518 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3118/6217] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:42.224423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:42.225193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:42.233067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:42.233676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:42.234382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:42.235176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:42.235849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:42.236350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:42.598478 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:42.611509 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9739abf-bab7-4f1b-ae83-102605ce6fb4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.392760 Sep 25 01:44:42.623687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3100/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:42 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:42.709848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:42.711215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:42.719856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:42.720690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:42.721295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:42.722274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:42.722942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:42.723539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:42.831637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843656b1ab4b43cbb3df67b116c754a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3682c1ffb86e44b990db78f7d82ff21c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:42.845353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-137710a5-ae44-4a78-8929-f7b4fa90e065 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 200 len: 1320 microversion: 2.1 time: 0.141651 Sep 25 01:44:42.846177 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3119/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:42 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 1320 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:43.635117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:43.635734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:43.647870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:43.648215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:43.648644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:43.649336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:43.649813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:43.650772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:43.850703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:43.862364 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f2705ae-6c55-4633-a143-210ffbddca30 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.231327 Sep 25 01:44:43.864290 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3101/6220] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:43 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:43.872808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:43.873447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:43.883452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:43.883992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:43.884481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:43.885862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:43.886728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:43.887478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:43.914182 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] HTTP exception thrown: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Request method failure captured: Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e HTTP/1.1 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7FvChcFM1KJHDbr03UZMQuZ90j2iMdzHjikiaN5Zl4i86NMJTkkYbC3IK7TlkYdVqIvj4yXUIu-hxCd-Zy9O-2Yfrthk6V0ZJ0UtjhVB5Zq5GwvC34LMRNEeEhw43w-fhTyWuDau4OTuwJPvwnUUyKR61OhuBrGEhy6hNbv9fbzKTM Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3682c1ffb86e44b990db78f7d82ff21c"}]}] Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 843656b1ab4b43cbb3df67b116c754a1 Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e'} Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:43.916165 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:43.920514 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:43.921645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Returning 404 to user: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:43.922689 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-960b885e-4d36-453a-a912-2cb4c7bdf31f tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 404 len: 111 microversion: 2.1 time: 0.053879 Sep 25 01:44:43.923566 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3120/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:43 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:44:43.932703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67ef6616-4c07-455f-be17-8d1e1f838353 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '.version_select at 0x7f7beab3b040>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:43.949001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d7c70719-d9b4-4a46-b41b-a1d1b628ae07 req-a5535114-15f5-4960-a707-e0de155b6356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e", "name": "network-vif-deleted", "tag": "e8246123-e03f-4897-9e1e-680c31ee5514"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:43.959702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7c70719-d9b4-4a46-b41b-a1d1b628ae07 req-a5535114-15f5-4960-a707-e0de155b6356 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:43.960871 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67ef6616-4c07-455f-be17-8d1e1f838353 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21949457" status: 202 len: 0 microversion: 2.1 time: 0.031241 Sep 25 01:44:43.962576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7c70719-d9b4-4a46-b41b-a1d1b628ae07 req-a5535114-15f5-4960-a707-e0de155b6356 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:43.962858 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3102/6222] 10.222.0.16 () {58 vars in 1215 bytes} [Sun Sep 25 01:44:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21949457 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:44:43.965164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d7c70719-d9b4-4a46-b41b-a1d1b628ae07 req-a5535114-15f5-4960-a707-e0de155b6356 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:43.980123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d7c70719-d9b4-4a46-b41b-a1d1b628ae07 req-a5535114-15f5-4960-a707-e0de155b6356 service nova] Creating event network-vif-deleted:e8246123-e03f-4897-9e1e-680c31ee5514 for instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e on n-h1-master-1 Sep 25 01:44:43.985553 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d7c70719-d9b4-4a46-b41b-a1d1b628ae07 req-a5535114-15f5-4960-a707-e0de155b6356 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040307 Sep 25 01:44:43.986852 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3121/6223] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:44.891422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:44.894156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:44.906849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:44.908132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:44.908842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:44.910587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:44.911432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:44.912101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:45.117873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:45.128502 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-579797b3-5e8c-4144-a105-51d30f7fb7ce tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.241114 Sep 25 01:44:45.130114 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3103/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:44 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:46.157369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:46.158678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:46.169240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:46.170233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:46.171419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:46.172141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:46.172779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:46.173371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:46.332882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:46.340965 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17eac747-5954-4faa-9813-83054d4c8e3a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.188264 Sep 25 01:44:46.341578 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3122/6225] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:46 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:47.368278 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:47.369734 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:47.377455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:47.378447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:47.379428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:47.381619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:47.381619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:47.381619 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:47.555265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:47.569014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f0ec256e-9910-4fb1-9940-e30f8402c97f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.204966 Sep 25 01:44:47.569924 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3104/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:47 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:48.593244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:48.593946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:48.596867 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:48.603553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:48.604206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:48.604756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:48.605621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:48.606182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:48.606716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:48.646926 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:48.758272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:48.766648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ada9c083-4b2b-418d-b457-5345c9c1e876 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.177571 Sep 25 01:44:48.767410 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3123/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:48 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:49.790802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:49.791632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:49.799502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:49.800140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:49.801696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:49.802577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:49.803140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:49.803672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:49.949342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:49.953152 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:49.959053 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c1b143c2-5b04-4796-ae96-7e56f80a40f3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.172309 Sep 25 01:44:49.959963 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3105/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:49 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:50.981972 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:50.982770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:50.991282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:50.991781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:50.992469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:50.993391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:50.993885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:50.994332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:51.141345 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:51.150440 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-52bf0c3c-65ad-4f23-955c-483126c043a3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.172638 Sep 25 01:44:51.151036 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3124/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:50 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:51.541104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:51.541861 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:51.550507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:51.552019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:51.552590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:51.553488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:51.554022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:51.554533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:51.570754 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] HTTP exception thrown: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Request method failure captured: Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e HTTP/1.1 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7FvChcFM1KJHDbr03UZMQuZ90j2iMdzHjikiaN5Zl4i86NMJTkkYbC3IK7TlkYdVqIvj4yXUIu-hxCd-Zy9O-2Yfrthk6V0ZJ0UtjhVB5Zq5GwvC34LMRNEeEhw43w-fhTyWuDau4OTuwJPvwnUUyKR61OhuBrGEhy6hNbv9fbzKTM Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3682c1ffb86e44b990db78f7d82ff21c"}]}] Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 843656b1ab4b43cbb3df67b116c754a1 Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e'} Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:51.572540 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Returning 404 to user: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-50995058-0368-4ad3-ab90-19f5cd5c5e9c tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 404 len: 111 microversion: 2.1 time: 0.037218 Sep 25 01:44:51.580148 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3106/6230] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:44:51 2022] DELETE /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:44:51.584515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:51.585438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:51.592386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:51.592959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:51.593485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:51.594283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:51.594806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:51.595300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:51.609962 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] HTTP exception thrown: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Request method failure captured: Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e HTTP/1.1 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7FvChcFM1KJHDbr03UZMQuZ90j2iMdzHjikiaN5Zl4i86NMJTkkYbC3IK7TlkYdVqIvj4yXUIu-hxCd-Zy9O-2Yfrthk6V0ZJ0UtjhVB5Zq5GwvC34LMRNEeEhw43w-fhTyWuDau4OTuwJPvwnUUyKR61OhuBrGEhy6hNbv9fbzKTM Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3682c1ffb86e44b990db78f7d82ff21c"}]}] Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 843656b1ab4b43cbb3df67b116c754a1 Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e'} Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:51.611721 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Returning 404 to user: Instance 9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed787a47-c734-4b01-92e7-03c7364d9439 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e" status: 404 len: 111 microversion: 2.1 time: 0.034281 Sep 25 01:44:51.616995 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3125/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:51 2022] GET /compute/v2.1/servers/9d6bdd9d-aa9b-4d66-91e7-3ebba6965a5e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:44:51.982901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:51.985104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:51.991232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:51.991725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:51.992168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:51.992867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:51.993548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:51.993983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:52.065727 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-080a81a9-dcc0-40a4-ac0d-273a3a6d74ae tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "POST /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871/action" status: 200 len: 32634 microversion: 2.1 time: 0.086490 Sep 25 01:44:52.067335 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3107/6232] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:44:51 2022] POST /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871/action => generated 32634 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:44:52.173861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:52.174609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:52.181714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:52.182204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:52.182638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:52.183330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:52.183884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:52.184623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:52.328595 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:52.338148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b01f6a5f-91dc-428f-ad03-97a932cf4a0d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.168104 Sep 25 01:44:52.350094 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3126/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:52 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:53.112966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:53.119463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0ff65c6c-c5a4-4985-b6fb-7061f16e9cf2 req-c2e53358-fa6e-420e-b553-c6501adfd80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ef55fa-0b03-4fce-b37b-f195bd465871", "tag": "6955384d-04b7-42e1-b19c-0386f60c0526"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:53.121952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:53.135207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0ff65c6c-c5a4-4985-b6fb-7061f16e9cf2 req-c2e53358-fa6e-420e-b553-c6501adfd80f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.137669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.138352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.139037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0ff65c6c-c5a4-4985-b6fb-7061f16e9cf2 req-c2e53358-fa6e-420e-b553-c6501adfd80f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.139636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.140254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0ff65c6c-c5a4-4985-b6fb-7061f16e9cf2 req-c2e53358-fa6e-420e-b553-c6501adfd80f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.141135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.146459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.147115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.161309 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0ff65c6c-c5a4-4985-b6fb-7061f16e9cf2 req-c2e53358-fa6e-420e-b553-c6501adfd80f service nova] Creating event network-changed:6955384d-04b7-42e1-b19c-0386f60c0526 for instance 31ef55fa-0b03-4fce-b37b-f195bd465871 on n-h1-master-1 Sep 25 01:44:53.176905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0ff65c6c-c5a4-4985-b6fb-7061f16e9cf2 req-c2e53358-fa6e-420e-b553-c6501adfd80f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060864 Sep 25 01:44:53.178700 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3127/6234] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:53.189266 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:44:53.283620 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1303bdc0-a6f5-4d71-ab37-a0e4ed1f89b7 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 204 len: 0 microversion: 2.1 time: 0.174397 Sep 25 01:44:53.289277 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3108/6235] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:44:53 2022] DELETE /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:44:53.295840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:53.296819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:53.305558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.306337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.306957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.307862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.308492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.309094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.363419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:53.364562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:53.371889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.372524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.373084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.373987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:53.374548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:53.375075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:53.889058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:53.898645 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a5f6087f-9e88-414a-a5a8-4bb069a6efe4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.539539 Sep 25 01:44:53.901894 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3109/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:53 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:53.948006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:53.957973 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-804409ed-30c2-46b3-9fe3-b639bcb95664 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1669 microversion: 2.1 time: 0.667770 Sep 25 01:44:53.959236 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3128/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:53 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1669 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:54.927685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:54.928309 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:54.945352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:54.946152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:54.946750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:54.947637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:54.948258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:54.948840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:54.982343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:54.983593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:54.992956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:54.995865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:54.996360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:54.997311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:54.997979 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:54.998611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:55.308717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:55.320514 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-efcc77bd-397f-4dee-9f3e-874d156fb337 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1168 microversion: 2.1 time: 0.396885 Sep 25 01:44:55.322299 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3110/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:54 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1168 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:55.386989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa3cce1ff3445eb896fb8bad352ef1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdcd1c5a13e24165971100bc619e7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:55.398007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22f933c8-5dc4-464e-b4d3-8242edaa6ec6 tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 200 len: 1669 microversion: 2.1 time: 0.419645 Sep 25 01:44:55.412924 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3129/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:54 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 1669 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:44:55.551145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3c785586-3084-467f-91ce-0b2402926539 req-94db9eba-847e-4033-8346-7308b17386d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ef55fa-0b03-4fce-b37b-f195bd465871", "name": "network-vif-deleted", "tag": "6955384d-04b7-42e1-b19c-0386f60c0526"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:44:55.561459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3c785586-3084-467f-91ce-0b2402926539 req-94db9eba-847e-4033-8346-7308b17386d1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:55.562401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3c785586-3084-467f-91ce-0b2402926539 req-94db9eba-847e-4033-8346-7308b17386d1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:55.563320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3c785586-3084-467f-91ce-0b2402926539 req-94db9eba-847e-4033-8346-7308b17386d1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:55.576521 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3c785586-3084-467f-91ce-0b2402926539 req-94db9eba-847e-4033-8346-7308b17386d1 service nova] Creating event network-vif-deleted:6955384d-04b7-42e1-b19c-0386f60c0526 for instance 31ef55fa-0b03-4fce-b37b-f195bd465871 on n-h1-master-1 Sep 25 01:44:55.582854 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3c785586-3084-467f-91ce-0b2402926539 req-94db9eba-847e-4033-8346-7308b17386d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035981 Sep 25 01:44:55.587720 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3111/6240] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:44:55.988138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:55.988838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:55.995644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:55.996140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:55.996587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:55.997294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:55.997783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:55.998218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.012875 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] HTTP exception thrown: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Request method failure captured: Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 HTTP/1.1 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7FvChcFM1KJHDbr03UZMQuZ90j2iMdzHjikiaN5Zl4i86NMJTkkYbC3IK7TlkYdVqIvj4yXUIu-hxCd-Zy9O-2Yfrthk6V0ZJ0UtjhVB5Zq5GwvC34LMRNEeEhw43w-fhTyWuDau4OTuwJPvwnUUyKR61OhuBrGEhy6hNbv9fbzKTM Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3682c1ffb86e44b990db78f7d82ff21c"}]}] Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 843656b1ab4b43cbb3df67b116c754a1 Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: exception: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'def8c243-fb93-424f-93bc-e4a054207797'} Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:56.014596 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Returning 404 to user: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d62e55d6-d599-4ef4-995b-21eadc6c566b tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 404 len: 111 microversion: 2.1 time: 0.031945 Sep 25 01:44:56.018923 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3130/6241] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:44:55 2022] DELETE /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:44:56.026741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:56.027451 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] [instance: def8c243-fb93-424f-93bc-e4a054207797] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:56.033956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:56.034441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:56.035062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.036008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:56.036471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:56.036901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.050348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] HTTP exception thrown: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Request method failure captured: Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 HTTP/1.1 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7FvChcFM1KJHDbr03UZMQuZ90j2iMdzHjikiaN5Zl4i86NMJTkkYbC3IK7TlkYdVqIvj4yXUIu-hxCd-Zy9O-2Yfrthk6V0ZJ0UtjhVB5Zq5GwvC34LMRNEeEhw43w-fhTyWuDau4OTuwJPvwnUUyKR61OhuBrGEhy6hNbv9fbzKTM Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3682c1ffb86e44b990db78f7d82ff21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3682c1ffb86e44b990db78f7d82ff21c"}]}] Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3682c1ffb86e44b990db78f7d82ff21c Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-AttachVolumeTestJSON-238526259 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 843656b1ab4b43cbb3df67b116c754a1 Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-AttachVolumeTestJSON-238526259-project Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: exception: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'def8c243-fb93-424f-93bc-e4a054207797'} Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:56.052180 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] Returning 404 to user: Instance def8c243-fb93-424f-93bc-e4a054207797 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ff221af-a50a-484f-8276-238bfe7aa334 tempest-AttachVolumeTestJSON-238526259 tempest-AttachVolumeTestJSON-238526259-project] 10.222.0.16 "GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797" status: 404 len: 111 microversion: 2.1 time: 0.031990 Sep 25 01:44:56.061610 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3112/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:56 2022] GET /compute/v2.1/servers/def8c243-fb93-424f-93bc-e4a054207797 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:44:56.351361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:56.352445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:56.360538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:56.361064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:56.361545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.362255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:56.362719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:56.363768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.426219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:56.426847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] [instance: 31ef55fa-0b03-4fce-b37b-f195bd465871] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:56.433275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:56.434026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:56.434665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.435387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:56.435852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:56.436280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:56.451966 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] HTTP exception thrown: Instance 31ef55fa-0b03-4fce-b37b-f195bd465871 could not be found. Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Request method failure captured: Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 HTTP/1.1 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7HcQJWN7Kv7F44OXM-aSRSpZuPtE1USouo300gt1my9lEIwkyruhydpUYbeUnAp4TaLC9PZnfEVk7Z20cOcQ_AHgU2maydQzGGgf4rflBu8uLnS-SVAZ0V9H7kRLV0EAGtByKMlpPvrIRKcu6bdMXqTqav9h2EEVR06P2zi0xa2rp4 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: fdcd1c5a13e24165971100bc619e7be2 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdcd1c5a13e24165971100bc619e7be2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdcd1c5a13e24165971100bc619e7be2"}]}] Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: fdcd1c5a13e24165971100bc619e7be2 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestNetworkBasicOps-1239684923 Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestNetworkBasicOps-1239684923-project Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7fa3cce1ff3445eb896fb8bad352ef1f Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestNetworkBasicOps-1239684923-project Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 31ef55fa-0b03-4fce-b37b-f195bd465871 could not be found. Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '31ef55fa-0b03-4fce-b37b-f195bd465871'} Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ef55fa-0b03-4fce-b37b-f195bd465871 could not be found. Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ef55fa-0b03-4fce-b37b-f195bd465871 could not be found. Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:44:56.453863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ef55fa-0b03-4fce-b37b-f195bd465871 could not be found. Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Returning 404 to user: Instance 31ef55fa-0b03-4fce-b37b-f195bd465871 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:44:56.458526 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-adba35d1-447a-4a59-a4b4-08d845031e6c tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871" status: 404 len: 111 microversion: 2.1 time: 0.033726 Sep 25 01:44:56.459309 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3113/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:56 2022] GET /compute/v2.1/servers/31ef55fa-0b03-4fce-b37b-f195bd465871 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:44:56.606801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:56.617686 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a50da851-4fd3-4984-b88e-d0988903dc26 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.272477 Sep 25 01:44:56.634188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3131/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:56 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:56.648782 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f059bdcd-3fc0-4afa-bd4f-b94eec838bba tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] Calling method '.version_select at 0x7f7bea70af70>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:56.692949 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f059bdcd-3fc0-4afa-bd4f-b94eec838bba tempest-TestNetworkBasicOps-1239684923 tempest-TestNetworkBasicOps-1239684923-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1968225687" status: 202 len: 0 microversion: 2.1 time: 0.048211 Sep 25 01:44:56.696021 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3114/6245] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 25 01:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1968225687 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:44:57.643465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:57.644727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:57.647681 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:57.653150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:57.653765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:57.654305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:57.655434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:57.655902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:57.656338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:57.660650 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=93 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:57.968209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:57.977628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b86bff57-15d6-425f-b37d-6e159849dca4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.338054 Sep 25 01:44:57.978216 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3132/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:57 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:44:59.003159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:44:59.005737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:44:59.010455 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:44:59.021221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:59.022436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:59.023070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:59.023998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:44:59.024634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:44:59.025616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:44:59.261111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:44:59.273585 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-41c84d91-9821-419c-b52d-828c26ae3ee3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.275373 Sep 25 01:44:59.277234 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3115/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:44:58 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:00.298460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:00.299411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:00.311173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:00.312215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:00.313035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:00.314532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:00.315260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:00.317088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:00.647974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:00.661142 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62d66c5c-dd61-4976-ae22-a2147c2810bd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.366528 Sep 25 01:45:00.661874 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3133/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:00 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:01.685565 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:01.686186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:01.695142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:01.695967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:01.696718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:01.697447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:01.698058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:01.698956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:01.916824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:01.926281 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22a4943e-4e78-4931-9ce8-7059fd952457 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.245124 Sep 25 01:45:01.927143 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3116/6249] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:01 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:02.952264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:02.952902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:02.960571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:02.961270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:02.961747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:02.962451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:02.962912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:02.963343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:03.113989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:03.123489 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef8d9e3d-a773-4024-948f-b71f448d2a16 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.175180 Sep 25 01:45:03.124848 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3134/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:02 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:04.149249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:04.150477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:04.158571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:04.159946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:04.161246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:04.165365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:04.166046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:04.166483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:04.417627 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:04.428466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c5f052f-b012-4b78-bb4a-75d1b391772b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.283999 Sep 25 01:45:04.429070 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3117/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:04 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:05.453336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:05.454414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:05.474628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:05.475465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:05.476100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:05.476978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:05.477624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:05.478210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:05.654253 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:05.667312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4874a6af-e49f-4940-b4fd-9db0f3b131d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.216914 Sep 25 01:45:05.686752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3135/6252] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:05 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:06.647080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e1a0e2a7-c2cc-481b-a7d9-c16b0cb3fa84 req-827bde14-2cc0-4ef8-b3b9-bf0bb085cf7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8708e0e6-57dd-410b-b1f3-4c75ba015f63", "name": "network-vif-plugged", "status": "completed", "tag": "4598469b-f104-4c9a-b3b3-6687a167e374"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:06.666451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e1a0e2a7-c2cc-481b-a7d9-c16b0cb3fa84 req-827bde14-2cc0-4ef8-b3b9-bf0bb085cf7a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:06.666939 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e1a0e2a7-c2cc-481b-a7d9-c16b0cb3fa84 req-827bde14-2cc0-4ef8-b3b9-bf0bb085cf7a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:06.667377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e1a0e2a7-c2cc-481b-a7d9-c16b0cb3fa84 req-827bde14-2cc0-4ef8-b3b9-bf0bb085cf7a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:06.681628 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e1a0e2a7-c2cc-481b-a7d9-c16b0cb3fa84 req-827bde14-2cc0-4ef8-b3b9-bf0bb085cf7a service nova] Creating event network-vif-plugged:4598469b-f104-4c9a-b3b3-6687a167e374 for instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 on n-h2-master-1 Sep 25 01:45:06.687826 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e1a0e2a7-c2cc-481b-a7d9-c16b0cb3fa84 req-827bde14-2cc0-4ef8-b3b9-bf0bb085cf7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055167 Sep 25 01:45:06.689237 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3118/6253] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:45:06.696981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:06.698878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:06.709382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:06.710182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:06.714600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:06.716211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:06.716934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:06.717643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:07.470016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:07.481026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-824fec4c-df88-4632-aab5-54f5351eb243 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.789519 Sep 25 01:45:07.486161 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3136/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:06 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:08.510536 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:08.511470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:08.524154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:08.524676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:08.525112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:08.525937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:08.526586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:08.527019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:08.800316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:08.813379 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b9e372a-c9bd-4bfc-9cd3-225db31c5d1a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1202 microversion: 2.1 time: 0.307917 Sep 25 01:45:08.828555 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3119/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:08 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1202 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:09.841476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:09.842794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:09.851464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:09.851961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:09.852715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:09.853810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:09.854449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:09.855060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.122896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:10.137560 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-951168f0-bb10-4da1-9a89-e9984e510c78 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1388 microversion: 2.1 time: 0.299977 Sep 25 01:45:10.143049 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3137/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:09 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1388 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:10.170950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:10.171713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:10.180734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.181547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.182213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.183092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.183860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.184773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.439591 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:10.448478 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-738ccda0-b663-4e00-8f07-1a0906ecf078 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1388 microversion: 2.1 time: 0.282646 Sep 25 01:45:10.449642 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3120/6257] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:10 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1388 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:10.477839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:10.478757 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:10.489708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.490664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.491285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.492328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.492946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.493567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.685565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:10.694660 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f0045a9a-4595-485e-8093-afb7cd13a48c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1388 microversion: 2.1 time: 0.223147 Sep 25 01:45:10.695838 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3138/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:10 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1388 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:10.793250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:10.793872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:10.801865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.802920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.803468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.804431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.805339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.805915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.836638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:45:10.955383 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5790050e-90f3-43c0-b999-ff8831edbde0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 204 len: 0 microversion: 2.1 time: 0.167056 Sep 25 01:45:10.967855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:10.968876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:10.972467 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3121/6259] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:45:10 2022] DELETE /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:45:10.978440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.979144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.979735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:10.980711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:10.986924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:10.987941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:11.282634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:11.297091 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f011099a-17a8-4292-b406-f332bab676b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1394 microversion: 2.1 time: 0.332807 Sep 25 01:45:11.300716 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3139/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:10 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1394 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:12.326554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:12.327936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:12.335735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:12.336562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:12.337203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:12.338488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:12.339470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:12.340184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:12.927312 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:12.936070 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6317793f-a0a4-44a8-8af8-370bcbb126c8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1394 microversion: 2.1 time: 0.615988 Sep 25 01:45:12.942292 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3122/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:12 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1394 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:13.974983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:13.975715 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:13.994926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:13.998534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:13.999242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:14.006398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:14.007348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:14.009130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:14.038944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-288e584b-51f9-4a63-9171-588083111ab0 req-4d29c00d-c44a-40b7-8361-6fec11de8957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8708e0e6-57dd-410b-b1f3-4c75ba015f63", "name": "network-vif-deleted", "tag": "4598469b-f104-4c9a-b3b3-6687a167e374"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:14.089080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-288e584b-51f9-4a63-9171-588083111ab0 req-4d29c00d-c44a-40b7-8361-6fec11de8957 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:14.091273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-288e584b-51f9-4a63-9171-588083111ab0 req-4d29c00d-c44a-40b7-8361-6fec11de8957 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:14.092332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-288e584b-51f9-4a63-9171-588083111ab0 req-4d29c00d-c44a-40b7-8361-6fec11de8957 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:14.125712 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-288e584b-51f9-4a63-9171-588083111ab0 req-4d29c00d-c44a-40b7-8361-6fec11de8957 service nova] Creating event network-vif-deleted:4598469b-f104-4c9a-b3b3-6687a167e374 for instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 on n-h2-master-1 Sep 25 01:45:14.136224 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-288e584b-51f9-4a63-9171-588083111ab0 req-4d29c00d-c44a-40b7-8361-6fec11de8957 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113739 Sep 25 01:45:14.139732 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3123/6262] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:45:14.248613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:14.258644 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e33bf483-d7c8-4d2e-b057-e25ef149dd3c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1187 microversion: 2.1 time: 0.295841 Sep 25 01:45:14.259590 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3140/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:13 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1187 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:45:15.282768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:15.283481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:15.300867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:15.301369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:15.301835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:15.302548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:15.335992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:15.336580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:15.397543 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:15.553936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:15.567393 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-753c77e1-924b-4bea-8990-aca44ce6f579 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1187 microversion: 2.1 time: 0.287321 Sep 25 01:45:15.569676 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3124/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:15 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1187 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:16.594178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:16.595499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:16.604766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:16.605524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:16.606244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:16.607196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:16.607867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:16.608646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:16.705100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:16.717958 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6a84c9e-cdb7-4481-9c95-4d1d48c473e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1187 microversion: 2.1 time: 0.127676 Sep 25 01:45:16.719625 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3141/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:16 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1187 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:17.748198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:17.750567 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:17.760280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:17.761088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:17.761854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:17.762757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:17.763632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:17.764262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:17.861669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:17.876191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd4fc5f7-8c38-49c7-bb88-59aec1c483ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1187 microversion: 2.1 time: 0.133369 Sep 25 01:45:17.891274 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3142/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:17 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:17.957616 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6846fa34-4e32-4f56-b633-8b5e44ead0a8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Action: 'create', calling method: .version_select at 0x7f7beab3b040>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1469401926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV6/S3GXGnuK6AENqYoX/7BZVNOignz9c880x5wgW+HwOfM1/i2d0WCXCtBr7nJKv6d9r6kxRypOapRrBoUGxf8oICP9QDwSSbYIoejT5/NgV65khsxqUALKgqIiQwa7w=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:18.008428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6846fa34-4e32-4f56-b633-8b5e44ead0a8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Getting quotas for project b9cacbcf9a194a09b0df90cdd54dc482. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:45:18.018127 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-6846fa34-4e32-4f56-b633-8b5e44ead0a8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Getting quotas for user 63d2512caf0f4a00a8962db23bd4803d and project b9cacbcf9a194a09b0df90cdd54dc482. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:45:18.050924 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6846fa34-4e32-4f56-b633-8b5e44ead0a8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.416287 Sep 25 01:45:18.058342 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3125/6267] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:45:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:45:18.899829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:18.900591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:18.913377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:18.914018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:18.914468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:18.915400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:18.915856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:18.916282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:19.031001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:19.045309 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16072c63-6e8b-4e4f-9ad2-fa9c361ac996 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1187 microversion: 2.1 time: 0.149427 Sep 25 01:45:19.062063 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3143/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:18 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1187 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:19.856066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1765864927", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1469401926", "security_groups": [{"name": "tempest-secgroup-smoke-27500646"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7c5c8542-301c-41f4-b36a-df1050cecb8f"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:20.048171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] validate_networks() for [('7c5c8542-301c-41f4-b36a-df1050cecb8f', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:45:20.071458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:20.073019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:20.085964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:20.087070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:20.087734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:20.089303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:20.090056 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:20.090701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:20.264865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:20.283757 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03c0bb63-cad7-4e67-a7c5-d203738f793e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1187 microversion: 2.1 time: 0.217287 Sep 25 01:45:20.284732 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3144/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:20 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1187 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:20.936256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Getting quotas for project b9cacbcf9a194a09b0df90cdd54dc482. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:45:20.947701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Getting quotas for user 63d2512caf0f4a00a8962db23bd4803d and project b9cacbcf9a194a09b0df90cdd54dc482. Resources: dict_keys(['metadata_items']) {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:45:20.965250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:45:20.965795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:45:20.966597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:45:20.967083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:45:20.967596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:45:20.980173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:20.980669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:20.981792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:20.982744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:20.983960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:20.984443 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:21.009247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Getting quotas for project b9cacbcf9a194a09b0df90cdd54dc482. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:45:21.016046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Getting quotas for user 63d2512caf0f4a00a8962db23bd4803d and project b9cacbcf9a194a09b0df90cdd54dc482. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:45:21.030741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:45:21.033382 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:45:21.095924 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84497259-00be-4902-9418-aae010263079 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.245399 Sep 25 01:45:21.097972 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3126/6270] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:45:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:45:21.108619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1427abb9-e031-466e-9678-e6d075202ae0 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:21.109239 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1427abb9-e031-466e-9678-e6d075202ae0 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:21.233133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1427abb9-e031-466e-9678-e6d075202ae0 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:21.248387 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1427abb9-e031-466e-9678-e6d075202ae0 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1303 microversion: 2.1 time: 0.137271 Sep 25 01:45:21.249151 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3145/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:21 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:21.309714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:21.310360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:21.333634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:21.334217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:21.334677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:21.335418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:21.335888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:21.336317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:21.397732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:21.398230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:21.398722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:21.399141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid 8708e0e6-57dd-410b-b1f3-4c75ba015f63 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:45:21.489294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:21.497500 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ebbceae-7a26-4a98-9488-259312f8aadb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 200 len: 1146 microversion: 2.1 time: 0.191053 Sep 25 01:45:21.516101 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3127/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:21 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 1146 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:22.272496 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:22.273204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:22.283822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:22.285116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:22.287300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:22.288656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:22.289680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:22.291336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:22.423903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:22.440413 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c376afc-1086-4643-a50b-06a7ee6940ea tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1299 microversion: 2.1 time: 0.171038 Sep 25 01:45:22.457828 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3146/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:22 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:22.524318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:22.525684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:22.538332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:22.539143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:22.539793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:22.540715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:22.541253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:22.541796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:22.575554 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 HTTP/1.1 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8708e0e6-57dd-410b-b1f3-4c75ba015f63'} Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:45:22.577950 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:22.582729 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:22.585238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:45:22.586537 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e7e431dc-d284-4b03-ab49-32a8e0f68235 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 404 len: 111 microversion: 2.1 time: 0.066281 Sep 25 01:45:22.588515 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3128/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:22 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:45:23.464184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:23.465361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:23.480942 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:23.482483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:23.484533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:23.485491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:23.487620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:23.488370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:23.654419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:23.663930 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b16ad2f3-b342-4389-8777-f1dfe1cb973a tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1361 microversion: 2.1 time: 0.203494 Sep 25 01:45:23.664514 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3147/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:23 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:24.693687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:24.695059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:24.706891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:24.707759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:24.709169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:24.710764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:24.713190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:24.715864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:24.898083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:24.899177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:24.919315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:24.920416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:24.923271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:24.924128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:24.925184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:24.927741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:24.969801 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 HTTP/1.1 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '8708e0e6-57dd-410b-b1f3-4c75ba015f63'} Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:45:24.976796 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:24.981563 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:45:24.982385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:24.982841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:45:24.985880 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aef2c0ae-2d3d-43de-bb56-841b2701b505 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.297767 Sep 25 01:45:24.986128 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16d240e7-f619-44c4-aa08-7bf5c0438635 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 404 len: 111 microversion: 2.1 time: 0.096959 Sep 25 01:45:24.986476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3129/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:24 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:25.001685 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3148/6277] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:45:24 2022] DELETE /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:45:25.001956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:25.001956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 8708e0e6-57dd-410b-b1f3-4c75ba015f63] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:25.003964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:25.017477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:25.019031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:25.019991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:25.020633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:25.021228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:25.047972 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 HTTP/1.1 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '8708e0e6-57dd-410b-b1f3-4c75ba015f63'} Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:45:25.056850 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. Sep 25 01:45:25.061794 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:45:25.063894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 8708e0e6-57dd-410b-b1f3-4c75ba015f63 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:45:25.066864 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-45dee40c-92ec-4b9c-be01-5324afdb56d5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63" status: 404 len: 111 microversion: 2.1 time: 0.075255 Sep 25 01:45:25.074906 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3130/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:24 2022] GET /compute/v2.1/servers/8708e0e6-57dd-410b-b1f3-4c75ba015f63 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:45:26.008694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:26.010904 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:26.022002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:26.022824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:26.023462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:26.026489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:26.027170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:26.027819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:26.033233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1ddfaec3-9f6d-4211-87e9-0288cb2e2da9 req-9ee88fb7-a61b-4aab-945f-82924ef90af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df7986e-4752-49fc-942c-56322a161418", "tag": "2e30edd9-846a-4be6-bd05-0534b36adaf6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:26.059724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1ddfaec3-9f6d-4211-87e9-0288cb2e2da9 req-9ee88fb7-a61b-4aab-945f-82924ef90af7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:26.060557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1ddfaec3-9f6d-4211-87e9-0288cb2e2da9 req-9ee88fb7-a61b-4aab-945f-82924ef90af7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:26.061004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1ddfaec3-9f6d-4211-87e9-0288cb2e2da9 req-9ee88fb7-a61b-4aab-945f-82924ef90af7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:26.088593 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1ddfaec3-9f6d-4211-87e9-0288cb2e2da9 req-9ee88fb7-a61b-4aab-945f-82924ef90af7 service nova] Creating event network-changed:2e30edd9-846a-4be6-bd05-0534b36adaf6 for instance 1df7986e-4752-49fc-942c-56322a161418 on n-h1-master-1 Sep 25 01:45:26.104578 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1ddfaec3-9f6d-4211-87e9-0288cb2e2da9 req-9ee88fb7-a61b-4aab-945f-82924ef90af7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.552357 Sep 25 01:45:26.109576 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3149/6279] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:45:26.369890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:26.379250 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dfafbf13-20ef-4107-b38e-656adccd79f9 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.373281 Sep 25 01:45:26.380420 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3131/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:26 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:45:27.417026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:27.417026 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:27.423998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:27.425451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:27.426115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:27.427535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:27.428105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:27.430208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:27.591812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:27.601297 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ffdb350d-9b60-462d-b1b5-a00aa3007bdf tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.197948 Sep 25 01:45:27.602556 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3150/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:27 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:28.626733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:28.628113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:28.636066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:28.636658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:28.637166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:28.637973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:28.638498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:28.639021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:28.790652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:28.800708 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0e3a17a-e1ac-43fb-96f4-fbca02de59d4 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.177785 Sep 25 01:45:28.802044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3132/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:28 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:29.826190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:29.826877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:29.836400 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=40 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:29.839786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:29.840946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:29.841754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:29.842978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:29.843980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:29.844875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:29.853116 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:30.018805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:30.029246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-35012577-97fb-406d-b1f3-b53f0c629e48 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.208719 Sep 25 01:45:30.030691 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3151/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:29 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:30.973579 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0e682820-a3aa-4eee-a829-fe81f5377fc8 req-986704df-b321-4384-b42c-e2a45d460860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df7986e-4752-49fc-942c-56322a161418", "name": "network-vif-plugged", "status": "completed", "tag": "2e30edd9-846a-4be6-bd05-0534b36adaf6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:30.987660 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:30.998592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0e682820-a3aa-4eee-a829-fe81f5377fc8 req-986704df-b321-4384-b42c-e2a45d460860 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:31.000092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0e682820-a3aa-4eee-a829-fe81f5377fc8 req-986704df-b321-4384-b42c-e2a45d460860 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:31.000840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0e682820-a3aa-4eee-a829-fe81f5377fc8 req-986704df-b321-4384-b42c-e2a45d460860 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:31.016204 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:31.023190 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0e682820-a3aa-4eee-a829-fe81f5377fc8 req-986704df-b321-4384-b42c-e2a45d460860 service nova] Creating event network-vif-plugged:2e30edd9-846a-4be6-bd05-0534b36adaf6 for instance 1df7986e-4752-49fc-942c-56322a161418 on n-h1-master-1 Sep 25 01:45:31.030763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0e682820-a3aa-4eee-a829-fe81f5377fc8 req-986704df-b321-4384-b42c-e2a45d460860 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063309 Sep 25 01:45:31.031676 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3133/6284] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:45:31.058803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:31.059424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:31.067362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:31.067858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:31.068303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:31.069015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:31.069500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:31.069966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:31.241456 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:31.252806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:31.261966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-45d99d8d-5f4d-4b75-bcdc-41a65d4c5335 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.206899 Sep 25 01:45:31.262656 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3152/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:31 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:32.289799 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:32.290519 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:32.293650 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:32.302675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:32.303171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:32.303605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:32.304561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:32.305423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:32.305920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:32.458919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:32.473170 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96e4c5c7-0bd5-461c-8930-97b80180dbfe tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1427 microversion: 2.1 time: 0.186374 Sep 25 01:45:32.473969 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3134/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:32 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:33.497210 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:33.498245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:33.506190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:33.506704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:33.507137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:33.508047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:33.508675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:33.509122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:33.663030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:33.671194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8675e05a-6a4e-487c-909f-687c1b710365 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1606 microversion: 2.1 time: 0.177812 Sep 25 01:45:33.671783 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3153/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:33 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1606 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:33.694574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:33.695731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:33.703208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:33.703695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:33.704135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:33.704843 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:33.705899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:33.706325 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:33.855193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:33.863406 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10024aea-64c6-4715-a547-8920fe1d2088 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1606 microversion: 2.1 time: 0.173651 Sep 25 01:45:33.864264 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3135/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:33 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1606 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:33.886084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:33.887003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:33.893615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:33.894411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:33.894869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:33.895585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:33.896053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:33.896486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:34.050736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:34.059255 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4490950c-e195-4450-8f7c-e4cdb9b698da tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1606 microversion: 2.1 time: 0.176992 Sep 25 01:45:34.068103 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3154/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:33 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1606 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:34.264470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Calling method '.version_select at 0x7f7beb1f0430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:34.266549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:34.267405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:34.268258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:34.289798 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:34.290558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:34.291164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:34.304380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:34.304862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:34.305296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:34.339776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ab173e65-c044-4deb-b38f-852ffca4b7f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379 tempest-PortsAdminExtendedAttrsIpV6TestJSON-868307379-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.262891 Sep 25 01:45:34.350898 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3136/6290] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:45:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:45:36.826785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5ec748fc-8cfd-446f-9b49-b95ae117557c req-6d49d645-4474-4c22-b6ec-f3d857473555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df7986e-4752-49fc-942c-56322a161418", "tag": "2e30edd9-846a-4be6-bd05-0534b36adaf6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:36.840072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ec748fc-8cfd-446f-9b49-b95ae117557c req-6d49d645-4474-4c22-b6ec-f3d857473555 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:36.840953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ec748fc-8cfd-446f-9b49-b95ae117557c req-6d49d645-4474-4c22-b6ec-f3d857473555 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:36.841625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5ec748fc-8cfd-446f-9b49-b95ae117557c req-6d49d645-4474-4c22-b6ec-f3d857473555 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:36.855252 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5ec748fc-8cfd-446f-9b49-b95ae117557c req-6d49d645-4474-4c22-b6ec-f3d857473555 service nova] Creating event network-changed:2e30edd9-846a-4be6-bd05-0534b36adaf6 for instance 1df7986e-4752-49fc-942c-56322a161418 on n-h1-master-1 Sep 25 01:45:36.862018 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5ec748fc-8cfd-446f-9b49-b95ae117557c req-6d49d645-4474-4c22-b6ec-f3d857473555 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038422 Sep 25 01:45:36.862929 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3155/6291] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:45:48.464464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1394783289", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fbeb816f-c510-44b6-8a32-ff7cb95fb8ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:48.478082 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=9 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:48.478876 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=54 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:48.532835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:45:48.901458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:45:48.901896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:45:48.902378 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:45:48.902795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:45:48.903211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:45:48.913098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:48.913622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:48.914068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:48.914801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:48.915261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:48.915692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:48.933688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:45:48.939015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:45:48.999396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:45:49.001578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbeb816f-c510-44b6-8a32-ff7cb95fb8ca',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:45:49.143614 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7fab355c-612b-4c14-806d-2cd46b013af3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682815 Sep 25 01:45:49.144277 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3137/6292] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:45:49.154271 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=9 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:49.155219 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=25 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:49.160417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-60bf4486-1185-4eb6-81ff-067c4778e6fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:49.161142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-60bf4486-1185-4eb6-81ff-067c4778e6fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:49.388019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-60bf4486-1185-4eb6-81ff-067c4778e6fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:49.403991 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-60bf4486-1185-4eb6-81ff-067c4778e6fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1071 microversion: 2.1 time: 0.252072 Sep 25 01:45:49.404726 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3156/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:49 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1071 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:50.432433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:50.433148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:50.443517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:50.444272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:50.444888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:50.445839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:50.446472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:50.447073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:50.527368 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:50.536381 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b59187c6-f119-4a67-91cf-1b5c7e7cb62b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1187 microversion: 2.1 time: 0.109264 Sep 25 01:45:50.558130 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3138/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:50 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:51.563893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:51.569207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:51.597834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:51.598653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:51.599270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:51.600174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:51.600798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:51.601392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:51.888173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:51.897670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ffda9f1f-6e27-488f-ab07-a9a7ee058562 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1229 microversion: 2.1 time: 0.337986 Sep 25 01:45:51.898524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3157/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:51 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1229 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:52.336506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-64310d6d-2dc8-4e7c-8fdd-69c7476dd85d req-1205538e-e734-457b-a88f-0b6d262a6d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd9ae5e-277a-4e82-8dc8-3c0279da047b", "tag": "4eccb78e-795a-41ab-bc8f-02f5821fdd56"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:45:52.361191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64310d6d-2dc8-4e7c-8fdd-69c7476dd85d req-1205538e-e734-457b-a88f-0b6d262a6d3f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:52.364345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64310d6d-2dc8-4e7c-8fdd-69c7476dd85d req-1205538e-e734-457b-a88f-0b6d262a6d3f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:52.367157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-64310d6d-2dc8-4e7c-8fdd-69c7476dd85d req-1205538e-e734-457b-a88f-0b6d262a6d3f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:52.398247 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-64310d6d-2dc8-4e7c-8fdd-69c7476dd85d req-1205538e-e734-457b-a88f-0b6d262a6d3f service nova] Creating event network-changed:4eccb78e-795a-41ab-bc8f-02f5821fdd56 for instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b on n-h2-master-1 Sep 25 01:45:52.411071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-64310d6d-2dc8-4e7c-8fdd-69c7476dd85d req-1205538e-e734-457b-a88f-0b6d262a6d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078951 Sep 25 01:45:52.412084 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3139/6296] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:45:52.925689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:52.927473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:52.947218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:52.949347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:52.950510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:52.953653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:52.955698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:52.957912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:53.250509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:53.261681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cfc26398-3cad-45f9-b478-628f2d1455f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1229 microversion: 2.1 time: 0.343324 Sep 25 01:45:53.279782 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3158/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:52 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1229 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:54.289877 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:54.290767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:54.298073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:54.298762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:54.299209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:54.299970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:54.300620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:54.301050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:54.553306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:54.567766 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48c8b89d-557f-4bd8-bf7c-d063bd51fedc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1229 microversion: 2.1 time: 0.281858 Sep 25 01:45:54.582936 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3140/6298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:54 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1229 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:55.592401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:55.593018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:55.602290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:55.602783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:55.603225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:55.603933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:55.604386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:55.604824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:55.766780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:55.780418 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a347aaec-67f1-4b54-99ce-73f38e390be8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1229 microversion: 2.1 time: 0.191483 Sep 25 01:45:55.783457 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3159/6299] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:55 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1229 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:56.804340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:56.807039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:56.814960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:56.815702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:56.816416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:56.817337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:56.817839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:56.818267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:56.965636 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:56.974732 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-994b902c-7401-47d1-8f1e-0f9331d96842 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.174265 Sep 25 01:45:56.975407 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3141/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:56 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:57.997274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:57.998087 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:58.005216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:58.005824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:58.006332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:58.007096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:58.007622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:58.008134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:58.143704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:58.151520 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a460e3a-589b-4cd4-9127-47cd4a434815 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.158119 Sep 25 01:45:58.152342 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3160/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:57 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:45:59.174507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:45:59.175108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:45:59.177906 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:59.178662 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:45:59.185028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:59.185548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:59.185993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:59.186702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:45:59.187186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:45:59.187588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:45:59.419228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:45:59.427386 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c231130f-795b-43e9-bd3e-5925a1f8262f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.256786 Sep 25 01:45:59.428265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3142/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:45:59 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:00.453236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:00.453236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:00.454493 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:00.460020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:00.460519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:00.460967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:00.461711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:00.462175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:00.462612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:00.713565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:00.721391 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a67bbb1-ae27-4238-8967-1a8b0e975d0c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.274222 Sep 25 01:46:00.723259 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3161/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:00 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:01.746859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:01.748226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:01.757304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:01.758267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:01.758940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:01.760170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:01.760840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:01.761814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:02.364040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:02.373284 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e3d7b300-e664-42a1-a118-bb7d23d71905 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.630123 Sep 25 01:46:02.374245 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3143/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:01 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:03.397787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:03.398420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:03.405932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:03.406731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:03.407163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:03.407883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:03.408350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:03.408783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:03.662661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:03.670350 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b5438f08-6cc8-47e6-9a85-9de9e02b62f8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.276689 Sep 25 01:46:03.671123 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3162/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:03 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:04.694277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:04.695148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:04.702478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:04.703315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:04.703986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:04.704854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:04.705377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:04.706479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:04.856968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:04.872915 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d14ceee0-71cf-49cf-ac0d-9b24bbb9b43a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.182846 Sep 25 01:46:04.873625 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3144/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:04 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:05.896311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:05.897039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:05.904074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:05.904562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:05.905275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:05.906002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:05.906464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:05.906893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:06.168340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:06.176384 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d2318345-9cbf-4397-8a7d-15fb6378eb08 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.284114 Sep 25 01:46:06.176955 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3163/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:05 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:06.732873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2b635fb3-820a-4907-bd6e-d544b96fee6b req-fad8127d-1bd0-40d7-a75b-ea3f51da87e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd9ae5e-277a-4e82-8dc8-3c0279da047b", "name": "network-vif-plugged", "status": "completed", "tag": "4eccb78e-795a-41ab-bc8f-02f5821fdd56"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:46:06.746954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2b635fb3-820a-4907-bd6e-d544b96fee6b req-fad8127d-1bd0-40d7-a75b-ea3f51da87e8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:06.748059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2b635fb3-820a-4907-bd6e-d544b96fee6b req-fad8127d-1bd0-40d7-a75b-ea3f51da87e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:06.748435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2b635fb3-820a-4907-bd6e-d544b96fee6b req-fad8127d-1bd0-40d7-a75b-ea3f51da87e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:06.763773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2b635fb3-820a-4907-bd6e-d544b96fee6b req-fad8127d-1bd0-40d7-a75b-ea3f51da87e8 service nova] Creating event network-vif-plugged:4eccb78e-795a-41ab-bc8f-02f5821fdd56 for instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b on n-h2-master-1 Sep 25 01:46:06.769249 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2b635fb3-820a-4907-bd6e-d544b96fee6b req-fad8127d-1bd0-40d7-a75b-ea3f51da87e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041008 Sep 25 01:46:06.770113 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3145/6308] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:46:07.200254 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:07.200904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:07.208004 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:07.208488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:07.208923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:07.209642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:07.210097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:07.210521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:07.461819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:07.469894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0275a40-5f33-4c0c-b559-da30e0aaf559 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.274037 Sep 25 01:46:07.470884 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3164/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:07 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:08.495572 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:08.523458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:08.523458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:08.523458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:08.523458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:08.523458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:08.524440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:08.524790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:08.709155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:08.717197 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb51a1d9-a258-438a-8dc7-e12c0dbaedc3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1217 microversion: 2.1 time: 0.227114 Sep 25 01:46:08.717824 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3146/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:08 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:09.740922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:09.741580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:09.748100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:09.748594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:09.749042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:09.749779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:09.750246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:09.750679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:09.898637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:09.906863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5825d92-f711-4b6c-9b56-eb9e280c19ab tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1403 microversion: 2.1 time: 0.170146 Sep 25 01:46:09.907449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3165/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:09 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:09.929362 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:09.930279 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:09.937419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:09.937985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:09.938502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:09.939278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:09.939824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:09.941001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:10.152365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:10.160766 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-16975cd0-bccf-4297-ba7a-65ec89680dc7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1403 microversion: 2.1 time: 0.235312 Sep 25 01:46:10.161351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3147/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:09 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1403 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:10.183588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-218402568"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:46:10.186038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:10.192751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:10.193242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:10.193718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:10.194421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:10.194877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:10.195307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:10.292275 n-d-master-1 devstack@n-api.service[122385]: INFO nova.compute.api [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Attempting to quiesce instance before volume snapshot. Sep 25 01:46:10.376462 n-d-master-1 devstack@n-api.service[122385]: INFO nova.compute.api [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 25 01:46:10.460806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Creating snapshot from volume fbeb816f-c510-44b6-8a32-ff7cb95fb8ca. {{(pid=122385) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 25 01:46:11.583123 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc9ad460-6c95-409c-b5d3-acd69e50d7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b/action" status: 202 len: 0 microversion: 2.1 time: 1.403149 Sep 25 01:46:11.589527 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3166/6313] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:46:10 2022] POST /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b/action => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 01:46:12.817030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-466894306", "imageRef": "87e9bdc5-a5d3-4229-ac5f-f60c22eb010a", "flavorRef": "452", "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:46:12.906963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:46:13.573162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:13.573805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:13.582059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:13.582581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:13.583039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:13.583773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:13.584245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:13.584700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:13.619739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bcd97960-3978-4931-aa33-683013b73be8 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051620 Sep 25 01:46:13.621211 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3167/6314] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 25 01:46:13 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418/os-server-password => generated 116 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:46:14.034490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:46:14.034997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:46:14.035487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:46:14.035901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:46:14.036347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:46:14.045646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:14.046645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:14.046862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:14.047694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:14.048218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:14.048714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:14.067054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:46:14.072400 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:46:14.085534 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:46:14.088136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b1661cd4-9910-4503-a569-189b602f5a9f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:46:14.168691 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79191e55-97d1-44fd-84ac-6db91cdf2b59 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355934 Sep 25 01:46:14.174022 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3148/6315] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:46:14.180991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cac4555d-9cb5-4d12-a7b9-2cbccff2f288 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:14.181497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cac4555d-9cb5-4d12-a7b9-2cbccff2f288 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:14.251312 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cac4555d-9cb5-4d12-a7b9-2cbccff2f288 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:14.261790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cac4555d-9cb5-4d12-a7b9-2cbccff2f288 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1229 microversion: 2.1 time: 0.084914 Sep 25 01:46:14.262656 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3168/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:14 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:15.288079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:15.288701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:15.295493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:15.295982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:15.296433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:15.297254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:15.297744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:15.298174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:15.360914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:15.369360 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dbc8950c-de1c-48d0-9f28-1ccb6a0934e8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1281 microversion: 2.1 time: 0.086746 Sep 25 01:46:15.369977 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3149/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:15 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:16.400832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:16.406102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:16.437858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:16.438703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:16.439355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:16.440843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:16.443507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:16.444593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:16.865482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:16.881444 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-47161149-cc26-438a-ba3f-743880a05e50 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.491407 Sep 25 01:46:16.882096 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3169/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:16 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:17.695784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fcd90357-115c-4ab7-aefd-f15016b378c0 req-6f30fe92-1878-46b0-91c5-9165e65bddce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c37408-d0b7-4fc1-aa18-67d28e50b48f", "tag": "c02acf97-dd26-40d7-9ed7-6ce7c6141eed"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:46:17.712098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fcd90357-115c-4ab7-aefd-f15016b378c0 req-6f30fe92-1878-46b0-91c5-9165e65bddce service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:17.712969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fcd90357-115c-4ab7-aefd-f15016b378c0 req-6f30fe92-1878-46b0-91c5-9165e65bddce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:17.714594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fcd90357-115c-4ab7-aefd-f15016b378c0 req-6f30fe92-1878-46b0-91c5-9165e65bddce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:17.770988 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fcd90357-115c-4ab7-aefd-f15016b378c0 req-6f30fe92-1878-46b0-91c5-9165e65bddce service nova] Creating event network-changed:c02acf97-dd26-40d7-9ed7-6ce7c6141eed for instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f on n-h1-master-1 Sep 25 01:46:17.780752 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fcd90357-115c-4ab7-aefd-f15016b378c0 req-6f30fe92-1878-46b0-91c5-9165e65bddce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091489 Sep 25 01:46:17.784566 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3150/6319] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:46:17.909753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:17.911084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:17.930557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:17.932124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:17.932772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:17.933916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:17.934588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:17.937285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:18.222845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:18.231164 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df104057-ced5-4ee0-b0c1-969be34bfda0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.326134 Sep 25 01:46:18.232112 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3170/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:17 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:19.258089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:19.259159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:19.261121 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:19.271210 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:19.277337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:19.279683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:19.280901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:19.281639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:19.282488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:19.298631 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=65 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:19.615259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:19.626526 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a4596b6-e6db-4b55-ad8b-66318007b724 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.374138 Sep 25 01:46:19.627205 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3151/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:19 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:20.652244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:20.653197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:20.656680 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=35 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:20.662999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:20.665863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:20.666613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:20.668633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:20.670349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:20.671953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:20.685746 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:21.101559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:21.115912 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7b379b83-c134-4f46-81ac-5e383b713569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.465115 Sep 25 01:46:21.119301 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3171/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:20 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:22.150835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:22.152758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:22.165848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:22.166609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:22.167216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:22.169692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:22.170655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:22.171296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:22.746622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:22.755268 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9947fd83-33ed-4875-b254-4c8c83827f11 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.610820 Sep 25 01:46:22.758023 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3152/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:22 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:23.800661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:23.805269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:23.824076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:23.824983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:23.825737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:23.826881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:23.827676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:23.828448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:24.202439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:24.244653 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b623b555-55fa-40d8-8234-c7ed2c2d082b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.464767 Sep 25 01:46:24.245980 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3172/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:23 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:25.273353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:25.274224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:25.286130 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:25.295484 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:25.304837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:25.310388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:25.316926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:25.317777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:25.318254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:25.318684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:25.730990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:25.769336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-34896ee3-f781-4944-aecc-f325672c3c9c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.492338 Sep 25 01:46:25.772434 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3153/6325] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:25 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:26.813381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:26.815194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:26.820849 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:26.823413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:26.824358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:26.824841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:26.825752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:26.826379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:26.827078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:27.111493 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:27.121766 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8634fa01-7c65-462b-879c-5d586e0dfa04 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.312177 Sep 25 01:46:27.133262 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3173/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:26 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:28.157679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:28.158789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:28.170819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:28.171577 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:28.172030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:28.172880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:28.173398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:28.174196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:28.484272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:28.506786 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7157090f-5c20-4e03-9823-89860757abea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.356045 Sep 25 01:46:28.509270 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3154/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:28 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:29.537204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:29.538168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:29.551774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:29.552658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:29.553388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:29.554440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:29.556767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:29.557533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:29.826295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:29.854086 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc3e61b7-1cd5-42e8-a5ba-b01c03f9c7e4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.318304 Sep 25 01:46:29.871122 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3174/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:29 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:30.896373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:30.898469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:30.906897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:30.909158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:30.909854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:30.910790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:30.911425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:30.912868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:31.080990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:31.103124 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a9efd059-9fb6-48d8-8c7e-469cc47861ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.211950 Sep 25 01:46:31.111361 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3155/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:30 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:32.137677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:32.138358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:32.155422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:32.155928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:32.156383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:32.157100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:32.157605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:32.158078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:32.413518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:32.444894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6377cc4-6bdf-4d6c-ad4b-e1bd5faa50be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.314895 Sep 25 01:46:32.449896 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3175/6330] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:32 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:33.476842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:33.478367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:33.493687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:33.495832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:33.496524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:33.497654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:33.498211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:33.498622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:33.757216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:33.787991 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-076339be-78a7-47cb-b09b-427fda04b7d6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.314859 Sep 25 01:46:33.791529 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3156/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:33 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:34.833770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:34.835487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:34.854684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:34.855508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:34.858367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:34.859151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:34.859647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:34.860107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:35.135078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:35.145646 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5cb67297-13dd-48bb-81f3-61b3cdf936cf tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1341 microversion: 2.1 time: 0.329365 Sep 25 01:46:35.159950 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3176/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:34 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1341 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:36.169681 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:36.175206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:36.182869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:36.183364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:36.184084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:36.184917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:36.185511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:36.186032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:36.691317 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:36.701240 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7c94ea41-0da1-4b08-8bdc-1c86ab15c6d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.535496 Sep 25 01:46:36.702271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3157/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:36 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:37.725985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:37.726622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:37.734215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:37.734696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:37.735196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:37.736523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:37.737138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:37.743816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:37.965362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:37.976236 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7cb331ab-26fc-4386-b861-7d942e4ff0b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.253983 Sep 25 01:46:37.978314 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3177/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:37 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:46:39.007440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:39.008100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:39.014967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:39.015465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:39.015931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:39.016650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:39.017740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:39.018450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:39.259950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:39.268701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ee5ff2b-0cdc-4edd-9cc7-07c60be9b158 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.265367 Sep 25 01:46:39.269433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3158/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:39 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:40.293390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:40.294432 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:40.302640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:40.303146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:40.303762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:40.304619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:40.305100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:40.305573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:40.539455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:40.547793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7c5dca41-2fe6-4179-b2a6-3977aa5cb0d3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.258929 Sep 25 01:46:40.549109 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3178/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:40 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:41.572179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:41.572845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:41.580472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:41.581040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:41.581565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:41.582300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:41.582758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:41.583183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:41.877486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:41.887120 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-537549be-d674-4c08-b31f-351156c5f2b7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.318746 Sep 25 01:46:41.887935 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3159/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:41 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:42.911522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:42.912406 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:42.919909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:42.920700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:42.921441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:42.922321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:42.922802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:42.923296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:43.155474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:43.164914 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f273598d-b10a-4a3e-bf10-ebf2b7bbd651 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.257691 Sep 25 01:46:43.165690 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3179/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:42 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:46:44.189711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:44.190295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:44.199483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:44.200132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:44.200584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:44.201310 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:44.201818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:44.202248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:44.409639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:44.418590 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18af5374-be71-4e62-9857-d0995a4b3ba1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.233949 Sep 25 01:46:44.419183 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3160/6339] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:44 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:45.290752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e9e07a72-13b0-40ee-887e-f51130ffa45c req-9d689b67-5c44-465b-b971-4d642305f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c37408-d0b7-4fc1-aa18-67d28e50b48f", "name": "network-vif-plugged", "status": "completed", "tag": "c02acf97-dd26-40d7-9ed7-6ce7c6141eed"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:46:45.303858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e9e07a72-13b0-40ee-887e-f51130ffa45c req-9d689b67-5c44-465b-b971-4d642305f2b2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:45.304638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e9e07a72-13b0-40ee-887e-f51130ffa45c req-9d689b67-5c44-465b-b971-4d642305f2b2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:45.305341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e9e07a72-13b0-40ee-887e-f51130ffa45c req-9d689b67-5c44-465b-b971-4d642305f2b2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:45.317983 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e9e07a72-13b0-40ee-887e-f51130ffa45c req-9d689b67-5c44-465b-b971-4d642305f2b2 service nova] Creating event network-vif-plugged:c02acf97-dd26-40d7-9ed7-6ce7c6141eed for instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f on n-h1-master-1 Sep 25 01:46:45.323256 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e9e07a72-13b0-40ee-887e-f51130ffa45c req-9d689b67-5c44-465b-b971-4d642305f2b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Sep 25 01:46:45.324435 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3180/6340] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:46:45.451781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:45.455729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:45.463675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:45.464170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:45.466002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:45.467140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:45.467833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:45.468494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:45.694765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:45.703869 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0e4e891f-15e0-4b6c-a023-e882da204706 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1375 microversion: 2.1 time: 0.265220 Sep 25 01:46:45.705638 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3161/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:45 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1375 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:46.730952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:46.732262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:46.739530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:46.740068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:46.740523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:46.741240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:46.741744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:46.742188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:46.878606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:46.886623 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9b319ce-a748-426c-9417-6c198cc8812a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1562 microversion: 2.1 time: 0.160851 Sep 25 01:46:46.887216 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3181/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:46 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:46.912646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:46.913313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:46.923160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:46.924054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:46.924390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:46.925102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:46.925605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:46.926235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:47.082112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:47.090749 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55e0ad6c-2b7e-4730-b5f8-61e31a099d36 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1562 microversion: 2.1 time: 0.182029 Sep 25 01:46:47.091601 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3162/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:46 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:47.178221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:47.178744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:47.184738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:47.185237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:47.185720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:47.186626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:47.187096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:47.187533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:47.218007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:46:47.322534 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15652634-aa0c-4bac-a33d-987e37df5626 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 204 len: 0 microversion: 2.1 time: 0.149089 Sep 25 01:46:47.325440 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3182/6344] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:46:47 2022] DELETE /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:46:47.333020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:47.333673 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:47.340582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:47.341303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:47.342114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:47.343015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:47.343831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:47.344276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:47.505463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:47.513448 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-88cae995-525d-4c47-a83b-e1cc684e5e2d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1568 microversion: 2.1 time: 0.185052 Sep 25 01:46:47.530410 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3163/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:47 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:48.540395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:48.541053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:48.550849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:48.551462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:48.551931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:48.552959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:48.553950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:48.554448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:48.736673 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:48.746257 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0a79c5e-e6e2-4e2f-b991-da2c707f5cf3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1568 microversion: 2.1 time: 0.210519 Sep 25 01:46:48.746635 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3183/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:48 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:49.613851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-39d3a981-f9ed-47cc-ae00-ae7ed680db6e req-7b861d63-5b47-455f-9ead-c22832122659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c37408-d0b7-4fc1-aa18-67d28e50b48f", "name": "network-vif-deleted", "tag": "c02acf97-dd26-40d7-9ed7-6ce7c6141eed"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:46:49.625228 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=26 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:49.628341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-39d3a981-f9ed-47cc-ae00-ae7ed680db6e req-7b861d63-5b47-455f-9ead-c22832122659 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:49.629774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-39d3a981-f9ed-47cc-ae00-ae7ed680db6e req-7b861d63-5b47-455f-9ead-c22832122659 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:49.630376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-39d3a981-f9ed-47cc-ae00-ae7ed680db6e req-7b861d63-5b47-455f-9ead-c22832122659 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:49.639626 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=78 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:49.666713 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-39d3a981-f9ed-47cc-ae00-ae7ed680db6e req-7b861d63-5b47-455f-9ead-c22832122659 service nova] Creating event network-vif-deleted:c02acf97-dd26-40d7-9ed7-6ce7c6141eed for instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f on n-h1-master-1 Sep 25 01:46:49.674009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-39d3a981-f9ed-47cc-ae00-ae7ed680db6e req-7b861d63-5b47-455f-9ead-c22832122659 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064701 Sep 25 01:46:49.680723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3164/6347] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:46:49.771110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:49.771868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:49.785088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:49.785783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:49.787190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:49.788217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:49.789239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:49.789998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:50.023418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:50.034006 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7507494f-4585-4a90-8667-0ea009885684 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1360 microversion: 2.1 time: 0.267393 Sep 25 01:46:50.034603 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3184/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:49 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:51.060072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:51.062791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:51.072460 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:51.073479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:51.074170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:51.075018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:51.075696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:51.076317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:51.159254 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:51.167515 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b22d7e34-8f93-48ea-aae9-a024ba6da527 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1360 microversion: 2.1 time: 0.112076 Sep 25 01:46:51.168422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3165/6349] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:51 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1360 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:52.192410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:52.193183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:52.196372 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:52.202099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:52.202742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:52.203393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:52.204332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:52.204799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:52.205358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:52.208958 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:46:52.281357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:52.290815 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a9b4e12-953d-4f29-9917-6fe31593b02f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1360 microversion: 2.1 time: 0.103894 Sep 25 01:46:52.291617 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3185/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:52 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1360 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:53.317224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:53.317744 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:53.324905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:53.325391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:53.326083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:53.326796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:53.327247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:53.327675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:53.403746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:53.420270 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3fb694b9-8ae7-472d-9bc3-25a20ab5b376 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1360 microversion: 2.1 time: 0.107881 Sep 25 01:46:53.433044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3166/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:53 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1360 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:46:54.445394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:54.445394 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:54.452130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:54.452770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:54.453508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:54.454547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:54.455126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:54.455673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:54.493681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:54.494779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:54.495374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:54.495952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid e9c37408-d0b7-4fc1-aa18-67d28e50b48f {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:46:54.542320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:46:54.552474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec8976ed-75c0-45dc-b3ff-5e1ae72dfc03 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 200 len: 1365 microversion: 2.1 time: 0.112041 Sep 25 01:46:54.552902 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3186/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:54 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:46:55.588245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:55.588914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:55.597582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:55.598082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:55.598622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:55.599350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:55.599938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:55.600377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:55.615401 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f HTTP/1.1 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e9c37408-d0b7-4fc1-aa18-67d28e50b48f'} Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:46:55.617192 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d3de3a82-da91-4d40-aee6-acad0a8e79f1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 404 len: 111 microversion: 2.1 time: 0.034751 Sep 25 01:46:55.626619 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3167/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:46:55 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:46:59.925833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:46:59.926363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:46:59.933429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:59.933965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:59.934424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:59.935137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:46:59.935611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:46:59.936066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:46:59.962495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:47:00.048960 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21ecbf55-ddf7-4655-8a9f-88f64e17d344 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 204 len: 0 microversion: 2.1 time: 0.126168 Sep 25 01:47:00.052995 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3187/6354] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:46:59 2022] DELETE /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:47:00.058157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:00.058812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:00.068655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:00.069140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:00.069624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:00.070383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:00.070837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:00.071436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:00.206063 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:00.215184 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9b6d2075-535d-4f69-8247-6af04473b3da tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1409 microversion: 2.1 time: 0.160955 Sep 25 01:47:00.215774 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3168/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:00 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:01.239934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:01.240557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:01.249430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:01.249951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:01.250618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:01.251609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:01.252328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:01.252761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:01.401385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:01.409836 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-378ac49e-c0ff-468b-9619-9d90c666967b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1409 microversion: 2.1 time: 0.174532 Sep 25 01:47:01.410415 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3188/6356] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:01 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:02.434385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:02.435796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:02.451552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:02.452452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:02.453105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:02.454676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:02.457459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:02.460918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:02.562158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8aeb3200-6059-4715-ba89-68a5bbcae291 req-8c26dc07-3938-4a74-b9b7-1711b53fa8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd9ae5e-277a-4e82-8dc8-3c0279da047b", "name": "network-vif-deleted", "tag": "4eccb78e-795a-41ab-bc8f-02f5821fdd56"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:47:02.575828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:02.584344 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc2effb7-50f8-4b58-b9c5-d827b9cdf999 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1202 microversion: 2.1 time: 0.154090 Sep 25 01:47:02.585809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8aeb3200-6059-4715-ba89-68a5bbcae291 req-8c26dc07-3938-4a74-b9b7-1711b53fa8a3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:02.585988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8aeb3200-6059-4715-ba89-68a5bbcae291 req-8c26dc07-3938-4a74-b9b7-1711b53fa8a3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:02.586632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8aeb3200-6059-4715-ba89-68a5bbcae291 req-8c26dc07-3938-4a74-b9b7-1711b53fa8a3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:02.588625 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3189/6357] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:02 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:02.620041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8aeb3200-6059-4715-ba89-68a5bbcae291 req-8c26dc07-3938-4a74-b9b7-1711b53fa8a3 service nova] Creating event network-vif-deleted:4eccb78e-795a-41ab-bc8f-02f5821fdd56 for instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b on n-h2-master-1 Sep 25 01:47:02.628488 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8aeb3200-6059-4715-ba89-68a5bbcae291 req-8c26dc07-3938-4a74-b9b7-1711b53fa8a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328143 Sep 25 01:47:02.635996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3169/6358] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:47:03.611783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:03.613746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:03.621521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:03.622303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:03.623267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:03.624537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:03.625419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:03.626272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:03.699091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:03.710581 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16570bca-558f-4a09-8f1a-5ec67a8627d9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1202 microversion: 2.1 time: 0.101912 Sep 25 01:47:03.726215 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3190/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:03 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1202 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:04.735694 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:04.737214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:04.744970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:04.745808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:04.746476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:04.747420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:04.748180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:04.748828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:04.819309 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:04.828324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8fad5cf3-3c51-4003-b43a-9fe5e297ae15 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1202 microversion: 2.1 time: 0.097351 Sep 25 01:47:04.829771 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3170/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:04 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:05.852279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:05.852984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:05.861485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:05.861990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:05.862448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:05.863168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:05.863670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:05.865508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:05.955636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:05.966626 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db0988ea-64a7-4f24-8d72-65c21e8579ec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1202 microversion: 2.1 time: 0.118259 Sep 25 01:47:05.967850 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3191/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:05 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1202 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:06.994648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:06.995383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:07.002720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:07.003442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:07.004150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:07.005021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:07.006056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:07.006671 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:07.043844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:07.044423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:07.044937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:07.045482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid 7fd9ae5e-277a-4e82-8dc8-3c0279da047b {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:47:07.094152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:07.104173 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09d850f5-7e95-4cb0-b25d-513724e686cc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 200 len: 1207 microversion: 2.1 time: 0.113087 Sep 25 01:47:07.119346 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3171/6362] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:06 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 1207 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:08.128736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:08.129375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:08.137290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:08.137844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:08.138305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:08.139028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:08.139502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:08.139976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:08.155482 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b HTTP/1.1 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '7fd9ae5e-277a-4e82-8dc8-3c0279da047b'} Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:08.157187 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c3d225b0-81d3-46a9-a551-0020cab93f9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 404 len: 111 microversion: 2.1 time: 0.034699 Sep 25 01:47:08.165362 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3192/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:08 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:47:10.315671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:10.316401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:10.324142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:10.324992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:10.325680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:10.326787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:10.327481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:10.328141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:10.347061 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f HTTP/1.1 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: exception: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'e9c37408-d0b7-4fc1-aa18-67d28e50b48f'} Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:47:10.349735 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.355637 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.360578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:47:10.362009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-36915303-5a7a-43a2-a4f0-f603cd0eb2d8 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 404 len: 111 microversion: 2.1 time: 0.051007 Sep 25 01:47:10.363363 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3172/6364] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:47:10 2022] DELETE /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:47:10.371876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:10.372862 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: e9c37408-d0b7-4fc1-aa18-67d28e50b48f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:10.380940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:10.381642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:10.382105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:10.383159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:10.383642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:10.387581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:10.406561 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f HTTP/1.1 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: exception: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'e9c37408-d0b7-4fc1-aa18-67d28e50b48f'} Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:10.409570 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance e9c37408-d0b7-4fc1-aa18-67d28e50b48f could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:47:10.415285 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad8b6ba2-d385-4676-bf23-107c64639ada tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f" status: 404 len: 111 microversion: 2.1 time: 0.047367 Sep 25 01:47:10.420171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3193/6365] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:10 2022] GET /compute/v2.1/servers/e9c37408-d0b7-4fc1-aa18-67d28e50b48f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:47:10.973235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:10.973801 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:10.980080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:10.980570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:10.981010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:10.981760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:10.982219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:10.982651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:10.998013 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b HTTP/1.1 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '7fd9ae5e-277a-4e82-8dc8-3c0279da047b'} Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:47:10.999582 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c720bd19-dd91-45fd-bc8d-6e857a0ec45c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 404 len: 111 microversion: 2.1 time: 0.031980 Sep 25 01:47:11.006429 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3173/6366] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:47:10 2022] DELETE /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:47:11.012025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:11.012671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 7fd9ae5e-277a-4e82-8dc8-3c0279da047b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:11.019361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:11.019862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:11.020315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:11.021080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:11.021548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:11.021986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:11.036454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b HTTP/1.1 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '7fd9ae5e-277a-4e82-8dc8-3c0279da047b'} Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:47:11.038027 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 7fd9ae5e-277a-4e82-8dc8-3c0279da047b could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dde8443e-dcfe-4cfd-9d50-4afef5968941 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b" status: 404 len: 111 microversion: 2.1 time: 0.031760 Sep 25 01:47:11.043358 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3194/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:11 2022] GET /compute/v2.1/servers/7fd9ae5e-277a-4e82-8dc8-3c0279da047b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:47:11.119888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9e513ee9-652d-4a57-927f-1596d28d7717 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: .version_select at 0x7f7bea70aaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1335563694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaUVZ1anEN9aXFd/JQgR3CXsSAUP/d3na+1Zu2mcHOsESq6SdvdK1Kr/wiUFEiXSC9yBB/UkrM4lsxpQSTUOo6Dmt/a44jtmY2uUZ6L00MFI/IU76MgeSWGIEMFCsugcA=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:47:11.135297 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9e513ee9-652d-4a57-927f-1596d28d7717 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:47:11.140258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-9e513ee9-652d-4a57-927f-1596d28d7717 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:47:11.164787 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9e513ee9-652d-4a57-927f-1596d28d7717 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.048792 Sep 25 01:47:11.165386 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3174/6368] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:47:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:47:30.163674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-372739420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1335563694", "security_groups": [{"name": "tempest-secgroup-smoke-1457604719"}], "block_device_mapping_v2": [{"uuid": "b68b5cd4-981f-4a5d-8ff4-39dc68c7a85f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:47:30.175473 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:30.176301 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:30.309280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:47:30.697347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:47:30.697820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:47:30.698314 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:47:30.698742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:47:30.699173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:47:30.708422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:30.708927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:30.709383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:30.710161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:30.710631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:30.711075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:30.729229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:47:30.734725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:47:30.794442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:47:30.796696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b68b5cd4-981f-4a5d-8ff4-39dc68c7a85f',volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:47:30.932307 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [d27bc8d4-983c-4294-a289-0342e31edcf3] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:47:31.942193 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [d27bc8d4-983c-4294-a289-0342e31edcf3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44772. Sep 25 01:47:31.945989 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64cf14e0-4ffc-494b-95f6-d39bfd933fa9 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.786427 Sep 25 01:47:31.946949 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3195/6369] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:47:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:47:31.959743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17740ab3-6154-49fd-9335-97a3c7f20459 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:31.960406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17740ab3-6154-49fd-9335-97a3c7f20459 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:31.963633 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=41 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:31.964595 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:31.967726 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:32.031446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-17740ab3-6154-49fd-9335-97a3c7f20459 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:32.039602 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17740ab3-6154-49fd-9335-97a3c7f20459 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1094 microversion: 2.1 time: 0.084176 Sep 25 01:47:32.041017 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3175/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:31 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:47:33.066299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:33.066937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:33.073901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:33.074759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:33.075431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:33.076364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:33.077168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:33.077998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:33.165478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:33.175056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5718ce6a-f044-4628-a4c5-f01d938f1171 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1210 microversion: 2.1 time: 0.114681 Sep 25 01:47:33.175633 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3196/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:33 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:34.203108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:34.205838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:34.218345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:34.219307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:34.220582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:34.221841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:34.222476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:34.223444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:34.441794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:34.450076 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aaece109-761e-4e4e-a120-7faf083602c5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1278 microversion: 2.1 time: 0.253878 Sep 25 01:47:34.451278 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3176/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:34 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:34.862491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b435b94e-dde7-4410-ac71-c6de9aca34bc req-fdd59a11-1fff-425a-a6c4-5794f25e1ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b04850d-a5af-44aa-b3cb-5053383c29df", "tag": "76881bbf-ae61-4543-a39d-11c4edd723db"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:47:34.882397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b435b94e-dde7-4410-ac71-c6de9aca34bc req-fdd59a11-1fff-425a-a6c4-5794f25e1ba3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:34.885791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b435b94e-dde7-4410-ac71-c6de9aca34bc req-fdd59a11-1fff-425a-a6c4-5794f25e1ba3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:34.888462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b435b94e-dde7-4410-ac71-c6de9aca34bc req-fdd59a11-1fff-425a-a6c4-5794f25e1ba3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:34.906591 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b435b94e-dde7-4410-ac71-c6de9aca34bc req-fdd59a11-1fff-425a-a6c4-5794f25e1ba3 service nova] Creating event network-changed:76881bbf-ae61-4543-a39d-11c4edd723db for instance 9b04850d-a5af-44aa-b3cb-5053383c29df on n-h2-master-1 Sep 25 01:47:34.933613 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b435b94e-dde7-4410-ac71-c6de9aca34bc req-fdd59a11-1fff-425a-a6c4-5794f25e1ba3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075730 Sep 25 01:47:34.934236 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3197/6373] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:47:35.473076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:35.474335 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:35.484054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:35.485238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:35.486068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:35.487107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:35.487753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:35.488369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:35.723197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:35.732003 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9fc8eaf8-5bf5-41f8-ae60-75e054ffa606 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1278 microversion: 2.1 time: 0.263482 Sep 25 01:47:35.732600 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3177/6374] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:35 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:36.757903 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:36.758894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:36.767307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:36.767932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:36.768393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:36.769115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:36.769698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:36.770091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:36.908818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:36.916804 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-99c8b428-1c8b-4a05-a141-5da8f8172f5f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1278 microversion: 2.1 time: 0.163379 Sep 25 01:47:36.917419 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3198/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:36 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:37.940554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:37.941417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:37.948520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:37.949010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:37.949475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:37.950187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:37.950646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:37.951075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:38.096894 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:38.104823 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-89c9aec8-3ad8-4383-866d-bb4b67ef7b17 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1278 microversion: 2.1 time: 0.168466 Sep 25 01:47:38.105389 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3178/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:37 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:39.127910 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:39.128544 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:39.135337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:39.135836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:39.136294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:39.136999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:39.137503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:39.137947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:39.269100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:39.276794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f39c8e40-58cc-43a0-9f4d-418375667dea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.152910 Sep 25 01:47:39.277363 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3199/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:39 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:40.301452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:40.302083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:40.308705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:40.309192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:40.309661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:40.310360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:40.310818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:40.311249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:40.453129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:40.461134 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0a3d8053-6bd4-40aa-a1d7-19478dae116d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.164150 Sep 25 01:47:40.461751 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3179/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:40 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:41.485634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:41.486661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:41.489683 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:41.490395 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:41.496363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:41.496869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:41.497328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:41.498069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:41.498544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:41.498994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:41.628985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:41.636681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88c6ad86-0f38-4597-9334-ce4fb49e2d81 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.156307 Sep 25 01:47:41.637248 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3200/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:41 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:47:42.661619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:42.662197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:42.664864 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:47:42.670777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:42.671267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:42.671707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:42.673043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:42.673529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:42.673989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:42.818353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:42.826479 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14cfe015-631f-4757-97a7-36ff2a9f3d28 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.168921 Sep 25 01:47:42.827155 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3180/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:42 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:43.849433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:43.850012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:43.856992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:43.857525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:43.857983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:43.858691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:43.859163 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:43.860328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:44.002198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:44.010142 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-65ecf67a-dc12-43f5-9995-3744a0c560a6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.164644 Sep 25 01:47:44.010718 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3201/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:43 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:45.036701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:45.037499 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:45.044610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:45.045095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:45.045576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:45.046312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:45.046896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:45.048071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:45.197582 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:45.207182 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0f9ed6f4-1b66-4900-80c5-ee4c98cb8587 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.177532 Sep 25 01:47:45.207605 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3181/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:45 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:46.229677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:46.230290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:46.237695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:46.238447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:46.238918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:46.239650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:46.240309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:46.240764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:46.381214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:46.395381 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1e6b9096-7458-4899-a620-4b52fee27b61 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.169426 Sep 25 01:47:46.395967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3202/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:46 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:47.418369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:47.419036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:47.426913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:47.427469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:47.427971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:47.428726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:47.429246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:47.429779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:47.573783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:47.583621 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1679ae5e-495d-4463-9364-0cd6d897bdd4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.168889 Sep 25 01:47:47.584215 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3182/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:47 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:48.606552 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:48.607188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:48.614016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:48.614518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:48.614972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:48.615936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:48.616152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:48.616592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:48.757856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:48.769964 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-66b7a0ca-f9f5-4ad3-9379-aaca524dbd31 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.167007 Sep 25 01:47:48.781619 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3203/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:48 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:49.217468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-eb2fe007-9493-43e6-a1f0-52c5dc1e5161 req-8693ba89-2da7-48c5-b72c-145faf6be71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b04850d-a5af-44aa-b3cb-5053383c29df", "name": "network-vif-plugged", "status": "completed", "tag": "76881bbf-ae61-4543-a39d-11c4edd723db"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:47:49.230360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eb2fe007-9493-43e6-a1f0-52c5dc1e5161 req-8693ba89-2da7-48c5-b72c-145faf6be71a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:49.231135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eb2fe007-9493-43e6-a1f0-52c5dc1e5161 req-8693ba89-2da7-48c5-b72c-145faf6be71a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:49.231901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-eb2fe007-9493-43e6-a1f0-52c5dc1e5161 req-8693ba89-2da7-48c5-b72c-145faf6be71a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:49.246610 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-eb2fe007-9493-43e6-a1f0-52c5dc1e5161 req-8693ba89-2da7-48c5-b72c-145faf6be71a service nova] Creating event network-vif-plugged:76881bbf-ae61-4543-a39d-11c4edd723db for instance 9b04850d-a5af-44aa-b3cb-5053383c29df on n-h2-master-1 Sep 25 01:47:49.251710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-eb2fe007-9493-43e6-a1f0-52c5dc1e5161 req-8693ba89-2da7-48c5-b72c-145faf6be71a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038641 Sep 25 01:47:49.252315 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3183/6386] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:47:49.794528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:49.795472 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:49.803767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:49.804274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:49.804920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:49.806159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:49.806706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:49.807157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:49.944882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:49.952559 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f9e3922-5303-47cd-8682-66295ef8423d tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1266 microversion: 2.1 time: 0.162777 Sep 25 01:47:49.953889 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3204/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:49 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:50.977159 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:50.977892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:50.985507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:50.986153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:50.986696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:50.987551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:50.988109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:50.988614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:51.132330 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:51.142297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2006ce6-27b6-4dc9-877e-cdc55e4de09b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1453 microversion: 2.1 time: 0.170245 Sep 25 01:47:51.142920 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3184/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:50 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:51.165162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:47:51.165840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:47:51.173082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:51.173628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:51.174092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:51.174813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:51.175290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:51.175746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:51.309360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:47:51.317714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a1ba4353-6b2d-4dcc-b6e2-392ea2f41930 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1453 microversion: 2.1 time: 0.156389 Sep 25 01:47:51.318295 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3205/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:47:51 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:47:53.354883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-302a0ea0-7601-4ba4-b35d-b3d6e8b07bf5 req-acbce0fe-17dd-4eb2-aa47-bfd45aabf89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b04850d-a5af-44aa-b3cb-5053383c29df", "tag": "76881bbf-ae61-4543-a39d-11c4edd723db"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:47:53.365901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-302a0ea0-7601-4ba4-b35d-b3d6e8b07bf5 req-acbce0fe-17dd-4eb2-aa47-bfd45aabf89d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:47:53.366370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-302a0ea0-7601-4ba4-b35d-b3d6e8b07bf5 req-acbce0fe-17dd-4eb2-aa47-bfd45aabf89d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:47:53.367081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-302a0ea0-7601-4ba4-b35d-b3d6e8b07bf5 req-acbce0fe-17dd-4eb2-aa47-bfd45aabf89d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:47:53.378845 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-302a0ea0-7601-4ba4-b35d-b3d6e8b07bf5 req-acbce0fe-17dd-4eb2-aa47-bfd45aabf89d service nova] Creating event network-changed:76881bbf-ae61-4543-a39d-11c4edd723db for instance 9b04850d-a5af-44aa-b3cb-5053383c29df on n-h2-master-1 Sep 25 01:47:53.386067 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-302a0ea0-7601-4ba4-b35d-b3d6e8b07bf5 req-acbce0fe-17dd-4eb2-aa47-bfd45aabf89d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Sep 25 01:47:53.386067 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3185/6390] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:48:25.153915 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:25.154956 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=58 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:25.336634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-320a11bd-7519-4b8b-87aa-ea526ab7563f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: .version_select at 0x7f7bebd2bf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1036882048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6R/d6ajcqTJgXZIaFHDovHgXGEAnh+Mz0SF0LWTpvIxzNo609WXG1mke2QBTbsImjiC4C+9mKIYgAmh0ehuDByfLGGAp8ve2pP8hZinTb6RRA0l7zJuJRds+/AmrqfWw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:48:25.352278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-320a11bd-7519-4b8b-87aa-ea526ab7563f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:48:25.357534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-320a11bd-7519-4b8b-87aa-ea526ab7563f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:48:25.370928 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-320a11bd-7519-4b8b-87aa-ea526ab7563f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:48:26.378439 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [None req-320a11bd-7519-4b8b-87aa-ea526ab7563f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45454. Sep 25 01:48:26.395466 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-320a11bd-7519-4b8b-87aa-ea526ab7563f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.247197 Sep 25 01:48:26.396104 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3206/6391] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:48:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:48:32.485225 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=24 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:32.486485 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=52 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:32.491706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-391293517", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "62dccc63-c32f-4783-9123-48fc40392de4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1036882048", "security_groups": [{"name": "tempest-secgroup-smoke-483851621"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:48:32.627748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] validate_networks() for [('62dccc63-c32f-4783-9123-48fc40392de4', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:48:33.075681 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:48:33.076114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:48:33.076763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:48:33.077189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:48:33.077643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:48:33.088226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:33.088980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:33.096235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:33.097500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:33.098184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:33.098804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:33.124290 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:48:33.130505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:48:33.144307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:48:33.146776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:48:33.199127 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a66042c9-f3cd-44cc-9d38-0eeb6673889f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716842 Sep 25 01:48:33.199699 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3186/6392] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:48:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:48:33.211572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-03db78c4-72eb-47d6-b70b-2bd8568c9f58 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:33.212494 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-03db78c4-72eb-47d6-b70b-2bd8568c9f58 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:33.311942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-03db78c4-72eb-47d6-b70b-2bd8568c9f58 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:33.322151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-03db78c4-72eb-47d6-b70b-2bd8568c9f58 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1266 microversion: 2.1 time: 0.114974 Sep 25 01:48:33.323109 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3207/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:33 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:34.346065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:34.346798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:34.354508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:34.355276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:34.355908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:34.356626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:34.357085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:34.357773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:34.445843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:34.454649 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b3f1fbbb-ba8a-43c1-bdd6-5b8c474eb165 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1318 microversion: 2.1 time: 0.113682 Sep 25 01:48:34.455259 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3187/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:34 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1318 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:35.478530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:35.479201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:35.487574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:35.488726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:35.489234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:35.490379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:35.490983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:35.491527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:35.642955 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:35.651932 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d561ac7-fa0e-43d0-8f4c-575a17b7ac9d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.177568 Sep 25 01:48:35.652531 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3208/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:35 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:36.363379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9de53402-6f7e-4035-9eea-73665fe71d87 req-ed58064c-a3d7-4125-b2d9-24fe13dad26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:48:36.374568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9de53402-6f7e-4035-9eea-73665fe71d87 req-ed58064c-a3d7-4125-b2d9-24fe13dad26b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:36.375928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9de53402-6f7e-4035-9eea-73665fe71d87 req-ed58064c-a3d7-4125-b2d9-24fe13dad26b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:36.376362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9de53402-6f7e-4035-9eea-73665fe71d87 req-ed58064c-a3d7-4125-b2d9-24fe13dad26b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:36.397174 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9de53402-6f7e-4035-9eea-73665fe71d87 req-ed58064c-a3d7-4125-b2d9-24fe13dad26b service nova] Creating event network-changed:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h1-master-1 Sep 25 01:48:36.403333 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9de53402-6f7e-4035-9eea-73665fe71d87 req-ed58064c-a3d7-4125-b2d9-24fe13dad26b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043816 Sep 25 01:48:36.403962 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3188/6396] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:48:36.676270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:36.676914 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:36.684208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:36.684709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:36.685167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:36.685992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:36.686464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:36.686911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:36.822876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:36.830947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be7afc04-1eba-4b85-928f-24badd3f203b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.159147 Sep 25 01:48:36.831528 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3209/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:36 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:37.854940 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:37.855646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:37.862591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:37.863079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:37.863520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:37.864219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:37.864674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:37.865103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:38.000435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:38.008417 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-183fcf07-c92e-4c8a-b161-8e4c94b1977f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.158709 Sep 25 01:48:38.008996 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3189/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:37 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:39.031625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:39.032285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:39.038913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:39.039414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:39.039870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:39.040577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:39.041049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:39.041525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:39.172172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:39.179959 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e4dcee29-ddd2-4c64-b136-533e6109e2a4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.152559 Sep 25 01:48:39.180538 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3210/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:39 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:40.203079 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:40.203958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:40.211616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:40.212105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:40.212541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:40.213242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:40.214079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:40.214507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:40.349630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:40.357477 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd87d93d-41ad-4918-b571-0a83f352c5f8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.158363 Sep 25 01:48:40.358053 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3190/6400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:40 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:41.382206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:41.382843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:41.390029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:41.390530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:41.391920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:41.392387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:41.392856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:41.393294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:41.526419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:41.535599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef63c164-0d80-41ce-8a03-99312beb7c1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.157568 Sep 25 01:48:41.536098 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3211/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:41 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:41.703131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-746ea59f-4ca4-4977-ab90-9a88c7eb783e req-f723ef64-b52f-40ec-bf04-ded157635f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "name": "network-vif-plugged", "status": "completed", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:48:41.713534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-746ea59f-4ca4-4977-ab90-9a88c7eb783e req-f723ef64-b52f-40ec-bf04-ded157635f6b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:41.714031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-746ea59f-4ca4-4977-ab90-9a88c7eb783e req-f723ef64-b52f-40ec-bf04-ded157635f6b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:41.714462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-746ea59f-4ca4-4977-ab90-9a88c7eb783e req-f723ef64-b52f-40ec-bf04-ded157635f6b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:41.725973 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-746ea59f-4ca4-4977-ab90-9a88c7eb783e req-f723ef64-b52f-40ec-bf04-ded157635f6b service nova] Creating event network-vif-plugged:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h1-master-1 Sep 25 01:48:41.730904 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-746ea59f-4ca4-4977-ab90-9a88c7eb783e req-f723ef64-b52f-40ec-bf04-ded157635f6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101476 Sep 25 01:48:41.731482 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3191/6402] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:48:42.558063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:42.558702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:42.566202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:42.566710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:42.567173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:42.567886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:42.568364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:42.568812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:42.698044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:42.705858 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cc140cc1-43db-438c-b349-1931eb80d6fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1391 microversion: 2.1 time: 0.151701 Sep 25 01:48:42.706435 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3212/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:42 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:43.726320 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:43.726995 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:43.731060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:43.731759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:43.739265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:43.739753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:43.740191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:43.740883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:43.741338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:43.741789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:43.880032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:43.888802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b01160ae-d65d-4af3-87e8-c1f3c92049fa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1563 microversion: 2.1 time: 0.164365 Sep 25 01:48:43.889373 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3192/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:43 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:43.911536 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:43.912192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:43.914058 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:48:43.920704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:43.921209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:43.921839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:43.923147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:43.923639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:43.924070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:44.056353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:44.064700 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8e5ada85-e032-40bf-aab8-c7be42fcfbeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1563 microversion: 2.1 time: 0.156978 Sep 25 01:48:44.065266 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3213/6405] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:43 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:48:45.640450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:48:45.641161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:48:45.643828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-73aa15ab-62a1-4353-8103-0d0816f8ba49 req-7f2d0cf2-b9b3-4285-9cb8-f055d8e29d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:48:45.648518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:45.649134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:45.649675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:45.650646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:45.651105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:45.651531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:45.657964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-73aa15ab-62a1-4353-8103-0d0816f8ba49 req-7f2d0cf2-b9b3-4285-9cb8-f055d8e29d7b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:48:45.657964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-73aa15ab-62a1-4353-8103-0d0816f8ba49 req-7f2d0cf2-b9b3-4285-9cb8-f055d8e29d7b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:48:45.657964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-73aa15ab-62a1-4353-8103-0d0816f8ba49 req-7f2d0cf2-b9b3-4285-9cb8-f055d8e29d7b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:48:45.669878 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-73aa15ab-62a1-4353-8103-0d0816f8ba49 req-7f2d0cf2-b9b3-4285-9cb8-f055d8e29d7b service nova] Creating event network-changed:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h1-master-1 Sep 25 01:48:45.675898 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-73aa15ab-62a1-4353-8103-0d0816f8ba49 req-7f2d0cf2-b9b3-4285-9cb8-f055d8e29d7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037089 Sep 25 01:48:45.676829 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3214/6406] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:48:45.794916 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:48:45.804070 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15cd39f8-4745-46a1-99f1-d60a223a8485 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1563 microversion: 2.1 time: 0.168011 Sep 25 01:48:45.804690 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3193/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:48:45 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:09.062027 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:09.062794 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=38 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:09.067397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:09.069755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:09.077816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:09.078323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:09.078784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:09.079502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:09.079973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:09.080425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:09.155771 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4615ced7-4d96-43a3-b2d6-857fcedb1598 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action" status: 200 len: 24565 microversion: 2.1 time: 0.095618 Sep 25 01:49:09.156462 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3215/6408] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:49:09 2022] POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action => generated 24565 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:49:19.906530 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:19.907153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:19.909317 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:19.910000 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=36 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:19.919025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:19.919512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:19.919952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:19.920652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:19.921110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:19.921575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.151646 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99ab095e-d435-41e1-b8ff-51c224727915 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1832 microversion: 2.1 time: 0.249445 Sep 25 01:49:20.152523 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3194/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:19 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1832 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:20.176622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:20.177339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:20.181592 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:20.182260 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:20.188495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:20.188996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:20.189477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.190188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:20.190693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:20.191139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.325241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:20.334748 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-57f7f3ca-25a1-428a-8029-320c198eff70 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1681 microversion: 2.1 time: 0.162866 Sep 25 01:49:20.336051 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3216/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:20 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:20.442838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:20.445779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:20.452209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:20.452768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:20.453209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.453941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:20.454410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:20.454840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.529186 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b7255335-029a-428c-a3a5-78f78b7a93a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action" status: 200 len: 32638 microversion: 2.1 time: 0.090635 Sep 25 01:49:20.530090 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3195/6411] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:49:20 2022] POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action => generated 32638 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:49:20.673271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:20.675005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:20.682702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:20.683203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:20.683657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.685022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:20.685519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:20.685964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:20.857563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f2384bc2c52453d9bd0ce9d5f1754c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6768fcf2a21b47309da69f215ec784f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:20.858188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] flavor_id is None. Assuming migration. {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 25 01:49:20.858676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:49:21.050675 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3476f475-6a54-480c-a774-fe3d958da491 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action" status: 202 len: 0 microversion: 2.1 time: 0.381356 Sep 25 01:49:21.051214 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3217/6412] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:49:20 2022] POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:49:21.060653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:21.061365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:21.069695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:21.071041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:21.071779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:21.072908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:21.073575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:21.074123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:21.222497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:21.230575 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6eebb68f-26f5-4f5e-b61b-512849c8b8b0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1690 microversion: 2.1 time: 0.174313 Sep 25 01:49:21.231148 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3196/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:21 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:22.255806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:22.256525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:22.263759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:22.264277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:22.264728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:22.265705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:22.266184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:22.266631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:22.400646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:22.408714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-899bb35a-d2eb-4029-abd0-4bded4a30f41 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1690 microversion: 2.1 time: 0.157954 Sep 25 01:49:22.409295 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3218/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:22 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:23.433168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:23.433822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:23.440660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:23.441179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:23.441649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:23.442344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:23.442804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:23.443232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:23.575422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:23.583275 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ba06c44-0701-4eb1-862d-22c440bedba1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.155129 Sep 25 01:49:23.583851 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3197/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:23 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:24.607625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:24.608291 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:24.614982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:24.615479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:24.615932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:24.616635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:24.617270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:24.617722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:24.755858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:24.764487 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b9642e1-0a4c-4c01-8e34-1678afb3ac83 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.160779 Sep 25 01:49:24.765050 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3219/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:24 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:25.788521 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:25.789483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:25.797673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:25.798285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:25.798759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:25.799646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:25.800216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:25.800947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:25.946669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:25.955286 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf93df2f-375e-423f-8286-0b63a137e72c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.171064 Sep 25 01:49:25.955864 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3198/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:25 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:49:26.979337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:26.980023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:26.987168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:26.987734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:26.988095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:26.988846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:26.989316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:26.989860 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:27.163574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:27.171955 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-165c5ee6-be74-4816-9e33-45568ba8520e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.196849 Sep 25 01:49:27.172551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3220/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:26 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:28.196703 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:28.197288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:28.204133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:28.204623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:28.205067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:28.205791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:28.206255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:28.206681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:28.345002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:28.353490 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-91f920ea-553e-4966-9b0f-253f27a8425e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.161366 Sep 25 01:49:28.354071 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3199/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:28 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:29.376886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:29.377589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:29.384450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:29.384958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:29.385439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:29.386158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:29.386636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:29.387085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:29.522604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:29.531457 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b23a166a-3107-486a-8829-9b5e66f5c20a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.158664 Sep 25 01:49:29.532033 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3221/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:29 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:30.556411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:30.557019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:30.564204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:30.564693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:30.565134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:30.565863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:30.566323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:30.566754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:30.698183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:30.705948 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f9c1385-6f6a-4793-81e6-d9bc2f2e8c96 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.154492 Sep 25 01:49:30.706558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3200/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:30 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:31.730055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:31.730698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:31.737891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:31.738392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:31.738850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:31.739554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:31.740027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:31.740470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:31.872689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:31.880379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c405cc28-7692-4506-820e-d94df2c7c9cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.154401 Sep 25 01:49:31.880952 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3222/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:31 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:32.905051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:32.905812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:32.912768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:32.913260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:32.913729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:32.914428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:32.915108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:32.915539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:33.050889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:33.059581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43645aff-c6a2-4d2d-ab2c-6cf69437f9e8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.158750 Sep 25 01:49:33.060146 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3201/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:32 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:49:34.082388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:34.082991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:34.090120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:34.090611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:34.091062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:34.091841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:34.092306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:34.092748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:34.224384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:34.232902 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa973c9f-5154-4d2b-b495-42bddbe31043 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.154338 Sep 25 01:49:34.233493 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3223/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:34 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:35.256146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:35.256759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:35.264406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:35.264884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:35.265320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:35.266035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:35.266480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:35.266901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:35.486191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:35.495176 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2e933ba-750d-4f7a-ba22-ffc200142a79 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.242908 Sep 25 01:49:35.495814 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3202/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:35 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:36.518956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:36.519582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:36.527350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:36.527842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:36.528294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:36.528992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:36.529485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:36.530178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:36.660908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:36.668920 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb32fc77-abfd-4b9b-bd89-832676060408 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.153846 Sep 25 01:49:36.669514 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3224/6426] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:36 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:37.692064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:37.692682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:37.700147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:37.700661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:37.701106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:37.701815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:37.702266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:37.702714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:37.835743 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:37.843649 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79a0e208-9066-4fc4-b695-11a8eca75174 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.155497 Sep 25 01:49:37.844223 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3203/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:37 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:38.866890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:38.867774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:38.875404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:38.875897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:38.876363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:38.877101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:38.877581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:38.878029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:39.007940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:39.016442 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-72e0312b-1831-42ee-b08e-344380cb1788 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.153485 Sep 25 01:49:39.017036 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3225/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:38 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:40.039912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:40.040668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:40.047529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:40.048009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:40.048452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:40.049146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:40.049626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:40.050053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:40.189650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:40.197969 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1ffd3215-493b-44eb-a386-00d92cd0e7b3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1695 microversion: 2.1 time: 0.162612 Sep 25 01:49:40.198558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3204/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:40 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:41.221651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:41.222308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:41.229913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:41.230889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:41.230889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:41.231563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:41.232100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:41.232454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:41.443710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:41.452945 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df212019-aa3c-439a-93f5-8a0fcd3e912c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1694 microversion: 2.1 time: 0.235293 Sep 25 01:49:41.453571 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3226/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:41 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1694 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:41.663679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "name": "network-vif-unplugged", "status": "completed", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:41.675738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:41.676326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:41.676840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:41.689884 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] Creating event network-vif-unplugged:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h2-master-1 Sep 25 01:49:41.695431 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] Instance f90018e0-e7be-47c9-b405-6062936eb3a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:49:41.707811 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-625e17a6-ed52-4b7f-9edc-f25e476d6d4e req-8e45f6d9-d69f-4879-9aa6-806e681aa830 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046720 Sep 25 01:49:41.708451 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3205/6431] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:49:42.476077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:42.477375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:42.484437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:42.484946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:42.485426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:42.486160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:42.486636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:42.487082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:42.708248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:42.716668 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d0191388-4571-4fcb-add4-50202df48d69 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1694 microversion: 2.1 time: 0.244478 Sep 25 01:49:42.717254 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3227/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:42 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:43.736363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:43.740187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:43.740948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:43.746802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:43.747284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:43.747715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:43.750100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:43.750609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:43.751070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:43.751926 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:43.752410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:43.752855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:43.760335 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] Creating event network-changed:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h2-master-1 Sep 25 01:49:43.765814 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] Instance f90018e0-e7be-47c9-b405-6062936eb3a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:49:43.776612 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-29d1b044-e839-470e-834c-22ce17d9807b req-d4fcafa3-68e1-433d-8002-c141ddda8103 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045347 Sep 25 01:49:43.777225 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3206/6433] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:49:43.890158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:43.898139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-557bbea2-cd79-4c5e-a694-2540365857a9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1692 microversion: 2.1 time: 0.162071 Sep 25 01:49:43.899080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3228/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:43 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:44.924252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:44.924881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:44.931575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:44.932000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:44.932470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:44.933221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:44.933791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:44.934203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:45.068941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:45.077534 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0fc1823c-25e2-46e8-ae48-09e41879afe8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1692 microversion: 2.1 time: 0.158454 Sep 25 01:49:45.078111 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3207/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:44 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:46.100323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:46.101098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:46.108480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:46.108983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:46.109474 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:46.110198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:46.110669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:46.111114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:46.245978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:46.253802 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d4a93d17-0cb1-4e4c-81bb-8e2d0b9e2ccc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1689 microversion: 2.1 time: 0.157614 Sep 25 01:49:46.254400 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3229/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:46 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:46.277031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:46.277606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:46.284685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:46.285212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:46.285678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:46.286403 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:46.286860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:46.287294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:46.350719 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23348628-3f64-4135-933b-c5f2a88484fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action" status: 204 len: 0 microversion: 2.1 time: 0.077910 Sep 25 01:49:46.351540 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3208/6437] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:49:46 2022] POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:49:46.359993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:46.360913 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:46.373544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:46.374053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:46.374818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:46.375876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:46.376346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:46.376786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:46.526685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:46.530532 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:46.536994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-240030a3-4376-4794-a25d-80e3b5c993f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1689 microversion: 2.1 time: 0.180756 Sep 25 01:49:46.541510 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3230/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:46 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:47.561424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:47.562130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:47.569065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:47.569579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:47.570015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:47.571553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:47.572005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:47.572431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:47.712662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:47.720622 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-04dc3e18-0bea-4aaa-ae66-ef5512b731c1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1689 microversion: 2.1 time: 0.163409 Sep 25 01:49:47.721209 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3209/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:47 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:47.958555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-21f9fea5-838c-4d28-8a1f-7ab6d6a57b99 req-dab7cadf-dc20-4379-af1c-78cefd487189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "name": "network-vif-plugged", "status": "completed", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:47.973575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-21f9fea5-838c-4d28-8a1f-7ab6d6a57b99 req-dab7cadf-dc20-4379-af1c-78cefd487189 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:47.974166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-21f9fea5-838c-4d28-8a1f-7ab6d6a57b99 req-dab7cadf-dc20-4379-af1c-78cefd487189 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:47.974832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-21f9fea5-838c-4d28-8a1f-7ab6d6a57b99 req-dab7cadf-dc20-4379-af1c-78cefd487189 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:47.989009 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-21f9fea5-838c-4d28-8a1f-7ab6d6a57b99 req-dab7cadf-dc20-4379-af1c-78cefd487189 service nova] Creating event network-vif-plugged:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h2-master-1 Sep 25 01:49:47.994208 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-21f9fea5-838c-4d28-8a1f-7ab6d6a57b99 req-dab7cadf-dc20-4379-af1c-78cefd487189 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039725 Sep 25 01:49:47.994755 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3231/6440] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:49:48.746196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:48.747016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:48.753237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:48.753847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:48.754301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:48.755014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:48.755488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:48.755929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:48.791110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:48.791639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:48.797753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:48.798247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:48.798684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:48.799382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:48.799842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:48.800269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:48.815941 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:48.828730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:49:48.893259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:48.902327 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e3757e7-422d-49a6-b9b6-71dd3079f356 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1681 microversion: 2.1 time: 0.161489 Sep 25 01:49:48.910590 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3232/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:48 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:49:48.917951 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46594b84-a2a8-4fb3-994f-af9f83777ecb tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 204 len: 0 microversion: 2.1 time: 0.242102 Sep 25 01:49:48.921908 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3210/6442] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:49:48 2022] DELETE /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:49:48.927140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:48.927789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:48.934292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:48.934737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:48.935237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:48.935993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:48.936476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:48.936925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:49.083864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:49.092406 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-62e62a13-5f0f-4bea-9234-f1da9fb279b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1577 microversion: 2.1 time: 0.169303 Sep 25 01:49:49.092981 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3233/6443] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:48 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:49:50.115767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:50.116466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:50.120111 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:50.125923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:50.126411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:50.126866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:50.127556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:50.128006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:50.128431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:50.264203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:50.272010 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84552ab9-5bb6-4071-8700-0564154cc672 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1577 microversion: 2.1 time: 0.160560 Sep 25 01:49:50.272625 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3211/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:50 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:51.295192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:51.295975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:51.298857 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=39 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:49:51.305759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:51.306294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:51.306753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:51.307476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:51.307953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:51.308396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:51.390201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:51.397894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f73e0c2-3939-40c1-87dc-b4065498a882 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1509 microversion: 2.1 time: 0.106672 Sep 25 01:49:51.398487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3234/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:51 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1509 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:49:51.577167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b47e913b-7490-4824-9bea-1a0db43c7ea5 req-18d08011-0d6c-4206-91ad-5f58c4a364fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b04850d-a5af-44aa-b3cb-5053383c29df", "name": "network-vif-deleted", "tag": "76881bbf-ae61-4543-a39d-11c4edd723db"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:51.591593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b47e913b-7490-4824-9bea-1a0db43c7ea5 req-18d08011-0d6c-4206-91ad-5f58c4a364fc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:51.592078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b47e913b-7490-4824-9bea-1a0db43c7ea5 req-18d08011-0d6c-4206-91ad-5f58c4a364fc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:51.592517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b47e913b-7490-4824-9bea-1a0db43c7ea5 req-18d08011-0d6c-4206-91ad-5f58c4a364fc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:51.609280 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b47e913b-7490-4824-9bea-1a0db43c7ea5 req-18d08011-0d6c-4206-91ad-5f58c4a364fc service nova] Creating event network-vif-deleted:76881bbf-ae61-4543-a39d-11c4edd723db for instance 9b04850d-a5af-44aa-b3cb-5053383c29df on n-h2-master-1 Sep 25 01:49:51.615432 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b47e913b-7490-4824-9bea-1a0db43c7ea5 req-18d08011-0d6c-4206-91ad-5f58c4a364fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041993 Sep 25 01:49:51.616083 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3212/6446] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:49:52.424740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:52.425585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:52.437372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:52.438157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:52.438623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:52.439365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:52.439851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:52.440300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:52.512953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:52.522353 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bf13c26-cfcc-4988-af6c-133a20b9f2be tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1225 microversion: 2.1 time: 0.104566 Sep 25 01:49:52.523061 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3235/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:52 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:53.548022 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:53.548684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:53.555385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:53.555870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:53.556306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:53.556993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:53.557462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:53.557889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:53.621272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:53.629152 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2e96df36-3e73-4ce3-b09f-281eaddf4dec tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1225 microversion: 2.1 time: 0.086368 Sep 25 01:49:53.630089 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3213/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:53 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:54.652285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:54.652877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:54.659948 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:54.660455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:54.660918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:54.661659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:54.662137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:54.662585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:54.726331 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:54.734295 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd4d033f-a8c2-4760-adf9-bebf19a2668f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1225 microversion: 2.1 time: 0.086035 Sep 25 01:49:54.734888 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3236/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:54 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:55.758154 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:55.758794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:55.766453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:55.767052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:55.767368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:55.768075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:55.768531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:55.768957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:55.804793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:55.805284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:55.805780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:55.806234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid 9b04850d-a5af-44aa-b3cb-5053383c29df {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:49:55.854163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:55.861812 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f8e9c01-56a2-47ba-8d3b-2cc9336c89b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 200 len: 1230 microversion: 2.1 time: 0.107502 Sep 25 01:49:55.862433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3214/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:55 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:56.885929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:56.886590 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:56.893470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:56.893974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:56.894435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:56.895141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:56.895617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:56.896061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:56.909571 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df HTTP/1.1 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9b04850d-a5af-44aa-b3cb-5053383c29df'} Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:49:56.911217 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab39a9e9-10cd-4a79-b68f-74c3f1b7fe7c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 404 len: 111 microversion: 2.1 time: 0.030768 Sep 25 01:49:56.917764 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3237/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:56 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:49:56.963111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-825103124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1335563694", "security_groups": [{"name": "tempest-secgroup-smoke-1457604719"}], "block_device_mapping_v2": [{"uuid": "b68b5cd4-981f-4a5d-8ff4-39dc68c7a85f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:49:57.076875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:49:57.448114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:49:57.448549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:49:57.449030 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:49:57.449468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:49:57.449889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:49:57.459234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:57.459715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:57.460145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:57.461727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:57.462226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:57.462649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:57.479475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:49:57.484732 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:49:57.544292 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:49:57.546539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b68b5cd4-981f-4a5d-8ff4-39dc68c7a85f',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:49:57.675106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5dfc3c29-66ee-468c-bd19-9d9a162fe57a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716602 Sep 25 01:49:57.675754 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3215/6452] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:49:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:49:57.687951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-98f18fca-fb3c-430f-9c8b-d1f28f52c438 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:57.688750 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-98f18fca-fb3c-430f-9c8b-d1f28f52c438 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:57.744740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98f18fca-fb3c-430f-9c8b-d1f28f52c438 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:57.752265 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-98f18fca-fb3c-430f-9c8b-d1f28f52c438 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1094 microversion: 2.1 time: 0.068929 Sep 25 01:49:57.753437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3238/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:57 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:58.776392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:58.777013 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:58.783527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:58.784018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:58.784458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:58.785149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:58.785638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:58.786065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:58.852885 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:49:58.861997 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4823a00f-1576-4841-97ec-271a31f587fd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1192 microversion: 2.1 time: 0.090397 Sep 25 01:49:58.862586 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3216/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:58 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:49:59.887499 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:49:59.888759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:49:59.898718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:59.899073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:59.900050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:49:59.901932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:49:59.902424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:49:59.902876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:00.454747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:00.463284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c0554b8-bd3a-4da8-8edf-c5b5e570a7ea tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1278 microversion: 2.1 time: 0.579640 Sep 25 01:50:00.468571 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3239/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:49:59 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1278 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:00.715458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a9539491-ba26-45b0-a619-9eac9c61a660 req-9d5468bf-2b36-4d65-ad6a-affe4cf4b2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051ca5f3-5da2-4b07-8400-b843751976f7", "tag": "5ba2a1c9-3f81-4af8-b1c8-206656cd068e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:00.733346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9539491-ba26-45b0-a619-9eac9c61a660 req-9d5468bf-2b36-4d65-ad6a-affe4cf4b2b4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:00.734214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9539491-ba26-45b0-a619-9eac9c61a660 req-9d5468bf-2b36-4d65-ad6a-affe4cf4b2b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:00.734850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a9539491-ba26-45b0-a619-9eac9c61a660 req-9d5468bf-2b36-4d65-ad6a-affe4cf4b2b4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:00.747447 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a9539491-ba26-45b0-a619-9eac9c61a660 req-9d5468bf-2b36-4d65-ad6a-affe4cf4b2b4 service nova] Creating event network-changed:5ba2a1c9-3f81-4af8-b1c8-206656cd068e for instance 051ca5f3-5da2-4b07-8400-b843751976f7 on n-h2-master-1 Sep 25 01:50:00.753025 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a9539491-ba26-45b0-a619-9eac9c61a660 req-9d5468bf-2b36-4d65-ad6a-affe4cf4b2b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047682 Sep 25 01:50:00.753810 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3217/6456] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:01.488091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:01.489813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:01.497275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:01.498105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:01.498586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:01.499382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:01.499863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:01.500307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:01.707712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:01.716793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c85e2ab9-ed56-4d61-a1f8-279938fa84ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1278 microversion: 2.1 time: 0.232674 Sep 25 01:50:01.717388 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3240/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:01 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:02.741364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:02.742598 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:02.748879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:02.749365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:02.749832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:02.750533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:02.750986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:02.751416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:02.897243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:02.905865 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b6ffe5e-cb99-43a0-9f5e-d102ca3bab55 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1278 microversion: 2.1 time: 0.169623 Sep 25 01:50:02.906448 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3218/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:02 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:03.928266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:03.928850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:03.936250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:03.936748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:03.937203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:03.937941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:03.938425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:03.938861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:04.072868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:04.080784 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90bb1c66-cc78-40e1-ade9-0ee42139f300 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.156525 Sep 25 01:50:04.081370 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3241/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:03 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:05.107774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:05.108393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:05.115240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:05.115777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:05.116217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:05.117090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:05.117586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:05.118014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:05.252434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:05.260698 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-370dcd56-cffe-4735-933a-6348394dbc9e tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.160915 Sep 25 01:50:05.261265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3219/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:05 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:06.283657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:06.284299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:06.292267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:06.292772 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:06.293230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:06.293969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:06.294442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:06.294889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:06.426083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:06.434283 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-228ef870-1d87-4519-b3fa-7d406c4f2b9a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.154830 Sep 25 01:50:06.434856 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3242/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:06 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:50:07.457211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:07.457859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:07.465380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:07.465888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:07.466323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:07.467011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:07.467463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:07.467885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:07.471896 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:07.494976 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:07.609434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:07.617758 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-085b3510-8481-4801-993f-cbe58c1d74a1 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.164269 Sep 25 01:50:07.618349 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3220/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:07 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:08.641108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:08.641788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:08.644382 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:08.650554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:08.651068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:08.651532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:08.652248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:08.652726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:08.653177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:08.783165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:08.791236 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-19406805-8f4b-475d-a7e8-4d608071deca tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.154120 Sep 25 01:50:08.791833 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3243/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:08 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:09.814018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:09.814621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:09.821488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:09.821970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:09.822409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:09.823092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:09.823539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:09.823957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:09.955849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:09.965762 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1402219-0d9b-473a-a4e3-49ae45a83277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.155772 Sep 25 01:50:09.966334 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3221/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:09 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:10.988335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:10.988972 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:10.996340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:10.996841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:10.997299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:10.998031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:10.998505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:10.998946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:11.134755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:11.142474 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92e0efb4-1a98-4030-8c36-777c651b9283 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.158241 Sep 25 01:50:11.143048 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3244/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:10 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:12.165356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:12.166005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:12.173093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:12.173676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:12.174118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:12.174806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:12.175264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:12.175690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:12.307044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:12.315045 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-234fc070-ebe8-4513-8f12-b6d558f11b4c tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.153754 Sep 25 01:50:12.315644 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3222/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:12 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:13.339309 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:13.339937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:13.347236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:13.347736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:13.348199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:13.348903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:13.349378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:13.349846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:13.486617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:13.495314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e357560e-d2e4-4620-ac9c-f2255ffefe9b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.160677 Sep 25 01:50:13.495889 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3245/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:13 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:13.916394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-112f6985-1f62-4cbb-8330-8655ed32cc94 req-aaa8e92a-e1e2-4743-b807-68920c1beeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051ca5f3-5da2-4b07-8400-b843751976f7", "name": "network-vif-plugged", "status": "completed", "tag": "5ba2a1c9-3f81-4af8-b1c8-206656cd068e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:13.927398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-112f6985-1f62-4cbb-8330-8655ed32cc94 req-aaa8e92a-e1e2-4743-b807-68920c1beeca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:13.927942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-112f6985-1f62-4cbb-8330-8655ed32cc94 req-aaa8e92a-e1e2-4743-b807-68920c1beeca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:13.928370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-112f6985-1f62-4cbb-8330-8655ed32cc94 req-aaa8e92a-e1e2-4743-b807-68920c1beeca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:13.939949 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-112f6985-1f62-4cbb-8330-8655ed32cc94 req-aaa8e92a-e1e2-4743-b807-68920c1beeca service nova] Creating event network-vif-plugged:5ba2a1c9-3f81-4af8-b1c8-206656cd068e for instance 051ca5f3-5da2-4b07-8400-b843751976f7 on n-h2-master-1 Sep 25 01:50:13.945741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-112f6985-1f62-4cbb-8330-8655ed32cc94 req-aaa8e92a-e1e2-4743-b807-68920c1beeca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033336 Sep 25 01:50:13.947019 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3223/6468] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:14.519781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:14.520419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:14.527978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:14.528504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:14.528967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:14.529970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:14.530446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:14.530893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:14.666902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:14.674871 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80b21894-cffd-48b0-9f55-ac11a6d7f8c3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1266 microversion: 2.1 time: 0.159096 Sep 25 01:50:14.675462 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3246/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:14 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:15.700165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:15.700875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:15.707124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:15.707610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:15.708043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:15.708737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:15.709191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:15.709651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:15.844944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:15.852782 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe678a9b-abc7-41d0-a282-76ddc953b18b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1452 microversion: 2.1 time: 0.158335 Sep 25 01:50:15.853357 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3224/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:15 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:15.875684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:15.876315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:15.888883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:15.889384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:15.889866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:15.890603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:15.891074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:15.891511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:16.026166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:16.034283 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-17bfb24f-2a07-4fdd-8f09-5f58152d1050 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1452 microversion: 2.1 time: 0.162559 Sep 25 01:50:16.034851 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3247/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:15 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:17.321285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:17.321840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:17.329163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:17.329777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:17.330312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:17.331090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:17.331616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:17.332252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:17.360175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:50:17.446710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46840578-e510-4d3a-9995-1075d4c5e120 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 204 len: 0 microversion: 2.1 time: 0.128944 Sep 25 01:50:17.447642 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3225/6472] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:50:17 2022] DELETE /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:50:17.456270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:17.457007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:17.466441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:17.466955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:17.467423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:17.468149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:17.468662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:17.469109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:17.681290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:17.689125 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a6a8547a-3199-4359-a9bd-d75585a1b6e7 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1730 microversion: 2.1 time: 0.237030 Sep 25 01:50:17.703983 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3248/6473] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:17 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:17.837475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c6553be8-a0a8-4a49-87a7-85d65b2d35ab req-b7521b35-aaa9-430e-9056-ee79af2aada7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051ca5f3-5da2-4b07-8400-b843751976f7", "tag": "5ba2a1c9-3f81-4af8-b1c8-206656cd068e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:17.847709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c6553be8-a0a8-4a49-87a7-85d65b2d35ab req-b7521b35-aaa9-430e-9056-ee79af2aada7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:17.848069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c6553be8-a0a8-4a49-87a7-85d65b2d35ab req-b7521b35-aaa9-430e-9056-ee79af2aada7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:17.848501 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c6553be8-a0a8-4a49-87a7-85d65b2d35ab req-b7521b35-aaa9-430e-9056-ee79af2aada7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:17.852692 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:17.861791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c6553be8-a0a8-4a49-87a7-85d65b2d35ab req-b7521b35-aaa9-430e-9056-ee79af2aada7 service nova] Creating event network-changed:5ba2a1c9-3f81-4af8-b1c8-206656cd068e for instance 051ca5f3-5da2-4b07-8400-b843751976f7 on n-h2-master-1 Sep 25 01:50:17.867486 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c6553be8-a0a8-4a49-87a7-85d65b2d35ab req-b7521b35-aaa9-430e-9056-ee79af2aada7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 Sep 25 01:50:17.868408 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3226/6474] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:18.844073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:18.845524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:18.853105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:18.853644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:18.854110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:18.854878 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:18.855354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:18.855801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:18.859373 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:19.029325 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:19.040626 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8121582c-0daa-46cd-b0d6-1b343fd1aa20 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1730 microversion: 2.1 time: 0.330221 Sep 25 01:50:19.041781 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3249/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:18 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:19.166733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:19.169152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:19.177760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:19.178518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:19.179215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:19.179995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:19.180458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:19.181143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:19.264489 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fa7b42f8-e7b0-476a-bfe7-e1f61542de20 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action" status: 200 len: 24572 microversion: 2.1 time: 0.103108 Sep 25 01:50:19.265212 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3227/6476] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:50:19 2022] POST /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6/action => generated 24572 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:50:20.065465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:20.066275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:20.073864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:20.074362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:20.074818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:20.075528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:20.075996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:20.076553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:20.146295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d2512caf0f4a00a8962db23bd4803d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cacbcf9a194a09b0df90cdd54dc482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:20.154925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc1ee243-a0e8-4b57-a744-6544f808c5f2 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 200 len: 1664 microversion: 2.1 time: 0.094359 Sep 25 01:50:20.155492 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3250/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:20 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 1664 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:20.286455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-09bcee68-c824-45a1-be9b-290e486d0a9f req-13cc43b0-6fe1-4a69-9056-e7bd187e4800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df7986e-4752-49fc-942c-56322a161418", "name": "network-vif-deleted", "tag": "2e30edd9-846a-4be6-bd05-0534b36adaf6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:20.295488 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:20.301117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-09bcee68-c824-45a1-be9b-290e486d0a9f req-13cc43b0-6fe1-4a69-9056-e7bd187e4800 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:20.301653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-09bcee68-c824-45a1-be9b-290e486d0a9f req-13cc43b0-6fe1-4a69-9056-e7bd187e4800 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:20.302152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-09bcee68-c824-45a1-be9b-290e486d0a9f req-13cc43b0-6fe1-4a69-9056-e7bd187e4800 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:20.638054 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-09bcee68-c824-45a1-be9b-290e486d0a9f req-13cc43b0-6fe1-4a69-9056-e7bd187e4800 service nova] Creating event network-vif-deleted:2e30edd9-846a-4be6-bd05-0534b36adaf6 for instance 1df7986e-4752-49fc-942c-56322a161418 on n-h1-master-1 Sep 25 01:50:20.642963 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-09bcee68-c824-45a1-be9b-290e486d0a9f req-13cc43b0-6fe1-4a69-9056-e7bd187e4800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360776 Sep 25 01:50:20.643576 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3228/6478] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:21.178417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:21.179886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:21.187104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:21.187599 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:21.188049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:21.188763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:21.189226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:21.189702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:21.203887 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] HTTP exception thrown: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Request method failure captured: Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 HTTP/1.1 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7KlFern3UAgec8VuFdM5J-9C16X19eibkZSoh7NOnjJIMwdMe06ojHP4mptjbkUlPBKPeNFjxTwH6-8smB57iWY5BICOmDeQR50E_q1L5xqx2Fr58JzWMTZxOMMB0oNL25xHcnhLpfI7s0hFyXhlBuAyvmzmKktJ5ps5GBTjg7sFDg Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: b9cacbcf9a194a09b0df90cdd54dc482 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9cacbcf9a194a09b0df90cdd54dc482"}]}] Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: b9cacbcf9a194a09b0df90cdd54dc482 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestServerBasicOps-1239427504-project Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 63d2512caf0f4a00a8962db23bd4803d Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestServerBasicOps-1239427504-project Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1df7986e-4752-49fc-942c-56322a161418'} Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:21.205706 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Returning 404 to user: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f90fcb2-030c-43a0-8e38-3a313a1b3387 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 404 len: 111 microversion: 2.1 time: 0.032741 Sep 25 01:50:21.211993 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3251/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:21 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:50:21.679577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:21.680308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:21.687085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:21.688198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:21.688642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:21.689346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:21.689841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:21.690273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:21.704637 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] HTTP exception thrown: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Request method failure captured: Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 HTTP/1.1 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7KlFern3UAgec8VuFdM5J-9C16X19eibkZSoh7NOnjJIMwdMe06ojHP4mptjbkUlPBKPeNFjxTwH6-8smB57iWY5BICOmDeQR50E_q1L5xqx2Fr58JzWMTZxOMMB0oNL25xHcnhLpfI7s0hFyXhlBuAyvmzmKktJ5ps5GBTjg7sFDg Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: b9cacbcf9a194a09b0df90cdd54dc482 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9cacbcf9a194a09b0df90cdd54dc482"}]}] Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: b9cacbcf9a194a09b0df90cdd54dc482 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestServerBasicOps-1239427504-project Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 63d2512caf0f4a00a8962db23bd4803d Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestServerBasicOps-1239427504-project Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '1df7986e-4752-49fc-942c-56322a161418'} Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:50:21.706492 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Returning 404 to user: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-28a7a612-10ed-4eac-8f49-4f426054c871 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 404 len: 111 microversion: 2.1 time: 0.033784 Sep 25 01:50:21.712461 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3229/6480] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:50:21 2022] DELETE /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:50:21.717965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:21.718637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] [instance: 1df7986e-4752-49fc-942c-56322a161418] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:21.720488 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=38 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:21.726294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:21.726795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:21.727252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:21.727966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:21.728443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:21.728888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:21.744284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] HTTP exception thrown: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Request method failure captured: Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 HTTP/1.1 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7KlFern3UAgec8VuFdM5J-9C16X19eibkZSoh7NOnjJIMwdMe06ojHP4mptjbkUlPBKPeNFjxTwH6-8smB57iWY5BICOmDeQR50E_q1L5xqx2Fr58JzWMTZxOMMB0oNL25xHcnhLpfI7s0hFyXhlBuAyvmzmKktJ5ps5GBTjg7sFDg Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: b9cacbcf9a194a09b0df90cdd54dc482 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9cacbcf9a194a09b0df90cdd54dc482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9cacbcf9a194a09b0df90cdd54dc482"}]}] Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: b9cacbcf9a194a09b0df90cdd54dc482 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestServerBasicOps-1239427504 Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestServerBasicOps-1239427504-project Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 63d2512caf0f4a00a8962db23bd4803d Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestServerBasicOps-1239427504-project Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '1df7986e-4752-49fc-942c-56322a161418'} Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:21.745869 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Returning 404 to user: Instance 1df7986e-4752-49fc-942c-56322a161418 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb539f31-bda3-4376-bc2e-0817d58ab774 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418" status: 404 len: 111 microversion: 2.1 time: 0.033263 Sep 25 01:50:21.752065 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3252/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:21 2022] GET /compute/v2.1/servers/1df7986e-4752-49fc-942c-56322a161418 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:50:21.914412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63eef869-6802-4c47-a592-6604f144b760 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] Calling method '.version_select at 0x7f7bea61fe50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:21.939892 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63eef869-6802-4c47-a592-6604f144b760 tempest-TestServerBasicOps-1239427504 tempest-TestServerBasicOps-1239427504-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1469401926" status: 202 len: 0 microversion: 2.1 time: 0.029621 Sep 25 01:50:21.940359 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3230/6482] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 25 01:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1469401926 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:50:42.050161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:42.050806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:42.053287 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:42.053985 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=15 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:42.060227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:42.060741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:42.061207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:42.062075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:42.062557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:42.063011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:42.189138 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-04588913-ef59-418e-bf89-d6b070fed665 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1832 microversion: 2.1 time: 0.142694 Sep 25 01:50:42.189837 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3253/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:42 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1832 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:43.346581 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=9 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:43.347414 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:43.351337 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-576acd91-d9e8-4d87-9f04-6243f5c13f73 req-c7a41446-e89c-49bb-a6eb-2ee4f7459a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:43.353372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:43.354003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:43.361894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:43.362630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:43.363389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:43.363537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-576acd91-d9e8-4d87-9f04-6243f5c13f73 req-c7a41446-e89c-49bb-a6eb-2ee4f7459a53 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:43.363864 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-576acd91-d9e8-4d87-9f04-6243f5c13f73 req-c7a41446-e89c-49bb-a6eb-2ee4f7459a53 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:43.363993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:43.364315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-576acd91-d9e8-4d87-9f04-6243f5c13f73 req-c7a41446-e89c-49bb-a6eb-2ee4f7459a53 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:43.364488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:43.365500 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:43.377766 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-576acd91-d9e8-4d87-9f04-6243f5c13f73 req-c7a41446-e89c-49bb-a6eb-2ee4f7459a53 service nova] Creating event network-changed:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h2-master-1 Sep 25 01:50:43.384391 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-576acd91-d9e8-4d87-9f04-6243f5c13f73 req-c7a41446-e89c-49bb-a6eb-2ee4f7459a53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037434 Sep 25 01:50:43.385391 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3254/6484] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:43.398072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:50:43.494741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d23902a-58da-47a7-8cbe-1ce5c59fb3f6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 204 len: 0 microversion: 2.1 time: 0.149944 Sep 25 01:50:43.495711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3231/6485] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:50:43 2022] DELETE /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:50:43.504930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:43.505686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:43.512627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:43.513134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:43.513624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:43.514368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:43.514841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:43.515282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:43.666288 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:43.674206 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-25e9808c-4b6b-4e98-a62d-7ef05659be8e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1687 microversion: 2.1 time: 0.173875 Sep 25 01:50:43.674795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3255/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:43 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:44.700574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:44.701320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:44.708668 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:44.709155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:44.709680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:44.711435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:44.712024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:44.712453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:44.925907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:44.934275 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f8ab54d2-d455-44a2-b4c8-2cdee9ebc77d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1687 microversion: 2.1 time: 0.238654 Sep 25 01:50:44.935227 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3232/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:44 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1687 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:45.517808 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-35d5803b-da4f-45fe-a845-ee4fd6d2a2a3 req-0fd6226c-9a8f-4baf-bec4-318c95283030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90018e0-e7be-47c9-b405-6062936eb3a6", "name": "network-vif-deleted", "tag": "f8d8d68b-8b8c-437f-8a2b-e8569e2c879b"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:45.528175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-35d5803b-da4f-45fe-a845-ee4fd6d2a2a3 req-0fd6226c-9a8f-4baf-bec4-318c95283030 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:45.528670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-35d5803b-da4f-45fe-a845-ee4fd6d2a2a3 req-0fd6226c-9a8f-4baf-bec4-318c95283030 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:45.529120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-35d5803b-da4f-45fe-a845-ee4fd6d2a2a3 req-0fd6226c-9a8f-4baf-bec4-318c95283030 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:45.794388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-35d5803b-da4f-45fe-a845-ee4fd6d2a2a3 req-0fd6226c-9a8f-4baf-bec4-318c95283030 service nova] Creating event network-vif-deleted:f8d8d68b-8b8c-437f-8a2b-e8569e2c879b for instance f90018e0-e7be-47c9-b405-6062936eb3a6 on n-h2-master-1 Sep 25 01:50:45.799723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-35d5803b-da4f-45fe-a845-ee4fd6d2a2a3 req-0fd6226c-9a8f-4baf-bec4-318c95283030 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285532 Sep 25 01:50:45.800339 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3256/6488] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:45.957913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:45.958535 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:45.966115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:45.966539 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:45.966983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:45.967672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:45.968123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:45.968550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:46.001038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:46.001566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:46.002003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:46.002453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lazy-loading 'fault' on Instance uuid f90018e0-e7be-47c9-b405-6062936eb3a6 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:50:46.044808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:46.053820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a5da8de-f76f-4ad3-86d4-4787cb5cb633 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 200 len: 1356 microversion: 2.1 time: 0.099799 Sep 25 01:50:46.054399 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3233/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:45 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:47.083820 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:47.084531 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: f90018e0-e7be-47c9-b405-6062936eb3a6] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:47.091054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:47.091549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:47.092000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:47.092695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:47.093182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:47.093632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:47.107294 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] HTTP exception thrown: Instance f90018e0-e7be-47c9-b405-6062936eb3a6 could not be found. Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Request method failure captured: Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 HTTP/1.1 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Nob4r3tr2Imx8l38IewJ1BarkA00tQHpkr4a0KPWRKsiG0TwSrecs4vJrUdJ1vjJRUQaNvpRInoaocKSH-TdloVfDriXoflyRq-tKDRE6NUOetvkwShAH9zBdCmnNn30LyD2IToQtrZSNp3EcWO96l-BZsdreYXwl1wno9AZYfl38 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2935e753a36e4a25b0362b13a4c12ebf"}]}] Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7d3b3eec24d94748b8b55a52a0e3e422 Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f90018e0-e7be-47c9-b405-6062936eb3a6 could not be found. Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f90018e0-e7be-47c9-b405-6062936eb3a6'} Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90018e0-e7be-47c9-b405-6062936eb3a6 could not be found. Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90018e0-e7be-47c9-b405-6062936eb3a6 could not be found. Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:47.108920 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90018e0-e7be-47c9-b405-6062936eb3a6 could not be found. Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Returning 404 to user: Instance f90018e0-e7be-47c9-b405-6062936eb3a6 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4c16a582-9599-4056-89e3-5663b6b2ad39 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6" status: 404 len: 111 microversion: 2.1 time: 0.031648 Sep 25 01:50:47.114788 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3257/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:47 2022] GET /compute/v2.1/servers/f90018e0-e7be-47c9-b405-6062936eb3a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:50:50.394546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a6d16b5-3d11-49f1-9267-a019002cfe52 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '.version_select at 0x7f7bea9ee940>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:50.430948 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a6d16b5-3d11-49f1-9267-a019002cfe52 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1036882048" status: 202 len: 0 microversion: 2.1 time: 0.040091 Sep 25 01:50:50.431596 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3234/6491] 10.222.0.16 () {58 vars in 1284 bytes} [Sun Sep 25 01:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1036882048 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:50:50.463436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9266f79d-fc7c-4d2e-aa81-739e31290723 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: .version_select at 0x7f7beaa4f8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1260438932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUcyj2t0Zs3V5REv/ahi1e11wOafAYriFaE6afqQOZB7L1UOfy0dl/pzYsPAGxGThQp9jMHxMJZwV/u9T8ak3E4l4AsB0/yBmmtPJPg1BogFEqMv53KQzg2Glt5LGxcSQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:50.481859 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9266f79d-fc7c-4d2e-aa81-739e31290723 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:50:50.487037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9266f79d-fc7c-4d2e-aa81-739e31290723 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:50:50.512253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9266f79d-fc7c-4d2e-aa81-739e31290723 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053355 Sep 25 01:50:50.512854 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3258/6492] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:50:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:50:56.162457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-612280395", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "af1514bd-e39d-4ea0-be34-3e360175d9ca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1260438932", "security_groups": [{"name": "tempest-secgroup-smoke-727907347"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:50:56.195238 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:56.592243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] validate_networks() for [('af1514bd-e39d-4ea0-be34-3e360175d9ca', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:50:57.090924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:50:57.091377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:50:57.091840 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:50:57.092293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:50:57.092715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:50:57.101759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:57.102285 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:57.102742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:57.103465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:57.103928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:57.104365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:57.121956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:50:57.127303 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:50:57.140486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:50:57.142853 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:50:57.191474 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e9c88dfe-b2c2-42be-b66f-f3f93e12e31c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038246 Sep 25 01:50:57.193249 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3235/6493] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:50:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:50:57.205390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3d1e4f5e-dfbc-4c63-89a3-4cababf51c6f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:57.206381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3d1e4f5e-dfbc-4c63-89a3-4cababf51c6f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:57.209174 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=18 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:50:57.340227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3d1e4f5e-dfbc-4c63-89a3-4cababf51c6f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:57.347697 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3d1e4f5e-dfbc-4c63-89a3-4cababf51c6f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1266 microversion: 2.1 time: 0.146506 Sep 25 01:50:57.348543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3259/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:57 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:50:58.372792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:58.373765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:58.383106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:58.385032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:58.385732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:58.386985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:58.387450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:58.387884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:58.476226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:58.486071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bf2abaac-aca8-47f1-9295-7efcb1b0161e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1318 microversion: 2.1 time: 0.118720 Sep 25 01:50:58.486672 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3236/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:58 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:50:59.511572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:50:59.514224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:50:59.526276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:59.526956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:59.527546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:59.529394 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:50:59.530367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:50:59.531057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:50:59.682769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:50:59.692368 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-301c5c9f-95e6-4c7a-99c4-ddc9a3ce28d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.185121 Sep 25 01:50:59.692970 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3260/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:50:59 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:00.614414 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d82180a3-c4b2-4643-b90d-ce839a0a7b06 req-bb07254a-b54e-4bea-9aad-df1d563ca304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:00.624769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d82180a3-c4b2-4643-b90d-ce839a0a7b06 req-bb07254a-b54e-4bea-9aad-df1d563ca304 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:00.625266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d82180a3-c4b2-4643-b90d-ce839a0a7b06 req-bb07254a-b54e-4bea-9aad-df1d563ca304 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:00.625746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d82180a3-c4b2-4643-b90d-ce839a0a7b06 req-bb07254a-b54e-4bea-9aad-df1d563ca304 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:00.636773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d82180a3-c4b2-4643-b90d-ce839a0a7b06 req-bb07254a-b54e-4bea-9aad-df1d563ca304 service nova] Creating event network-changed:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:51:00.641738 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d82180a3-c4b2-4643-b90d-ce839a0a7b06 req-bb07254a-b54e-4bea-9aad-df1d563ca304 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110941 Sep 25 01:51:00.642343 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3237/6497] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:51:00.716790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:00.717323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:00.724701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:00.726016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:00.726604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:00.727325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:00.727798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:00.728240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:00.862704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:00.870587 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10f85150-a754-4af8-b230-a9d235e00546 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.157925 Sep 25 01:51:00.871170 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3261/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:00 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:01.895064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:01.895800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:01.902358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:01.902868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:01.903290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:01.903979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:01.904436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:01.905127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:02.039717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:02.047546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d1a9d1da-594a-4609-9a00-44a619e4fdd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.157658 Sep 25 01:51:02.048125 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3238/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:01 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:03.071012 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:03.071635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:03.078594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:03.079098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:03.079558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:03.080275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:03.080962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:03.081424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:03.211816 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:03.219623 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b37c36c2-eedb-43dc-8968-3f73c49b3220 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.153335 Sep 25 01:51:03.220203 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3262/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:03 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:04.243089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:04.243938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:04.250882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:04.251375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:04.251820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:04.252528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:04.253019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:04.253476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:04.395425 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:04.405046 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b37f894a-9a18-491c-bfc7-1a90e7a57c91 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.166216 Sep 25 01:51:04.405664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3239/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:04 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:51:05.427409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:05.428130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:05.435539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:05.436039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:05.436494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:05.437201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:05.437722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:05.438155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:05.576441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:05.585044 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f062b698-1480-4d81-b01b-11575c035e9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.160949 Sep 25 01:51:05.585921 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3263/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:05 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:06.251011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d5af08c4-2550-42d7-bfa3-e6aef719cd94 req-ecb621ba-5d5e-4967-9c40-82e92d324361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "name": "network-vif-plugged", "status": "completed", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:06.262780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d5af08c4-2550-42d7-bfa3-e6aef719cd94 req-ecb621ba-5d5e-4967-9c40-82e92d324361 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:06.263283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d5af08c4-2550-42d7-bfa3-e6aef719cd94 req-ecb621ba-5d5e-4967-9c40-82e92d324361 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:06.263750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d5af08c4-2550-42d7-bfa3-e6aef719cd94 req-ecb621ba-5d5e-4967-9c40-82e92d324361 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:06.275154 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d5af08c4-2550-42d7-bfa3-e6aef719cd94 req-ecb621ba-5d5e-4967-9c40-82e92d324361 service nova] Creating event network-vif-plugged:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:51:06.280406 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d5af08c4-2550-42d7-bfa3-e6aef719cd94 req-ecb621ba-5d5e-4967-9c40-82e92d324361 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032867 Sep 25 01:51:06.281018 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3240/6503] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:51:06.608562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:06.609275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:06.617043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:06.617613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:06.618073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:06.618795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:06.619265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:06.619707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:06.758445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:06.766189 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-44f69da1-d55f-479d-99a0-d0bdfbcda7ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1391 microversion: 2.1 time: 0.161588 Sep 25 01:51:06.766773 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3264/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:06 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:07.788148 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:07.788909 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:07.794504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:07.795241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:07.802273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:07.802762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:07.803753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:07.804523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:07.804976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:07.805495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:07.954492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:07.964719 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-78822934-1473-48c5-9833-edcbe406358a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1563 microversion: 2.1 time: 0.178054 Sep 25 01:51:07.965738 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3241/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:07 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:07.989109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:07.989871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:07.992060 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:07.998696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:07.999213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:07.999707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:08.000732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:08.001219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:08.001691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:08.155749 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:08.165236 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c3e5acd-7521-4761-80ee-634869539731 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1563 microversion: 2.1 time: 0.180182 Sep 25 01:51:08.165828 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3265/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:07 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:09.784929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ea7d86ec-db4a-4ec8-aad7-2167716a6d06 req-a54b95f0-85c8-4064-9d54-1df6aeb57a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:09.786937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:09.787797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:09.795097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:09.795673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:09.796406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:09.797132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:09.797848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:09.798337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:09.801121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea7d86ec-db4a-4ec8-aad7-2167716a6d06 req-a54b95f0-85c8-4064-9d54-1df6aeb57a6d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:09.801706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea7d86ec-db4a-4ec8-aad7-2167716a6d06 req-a54b95f0-85c8-4064-9d54-1df6aeb57a6d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:09.802391 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ea7d86ec-db4a-4ec8-aad7-2167716a6d06 req-a54b95f0-85c8-4064-9d54-1df6aeb57a6d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:09.815019 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ea7d86ec-db4a-4ec8-aad7-2167716a6d06 req-a54b95f0-85c8-4064-9d54-1df6aeb57a6d service nova] Creating event network-changed:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:51:09.821289 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ea7d86ec-db4a-4ec8-aad7-2167716a6d06 req-a54b95f0-85c8-4064-9d54-1df6aeb57a6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039921 Sep 25 01:51:09.822218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3266/6507] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:51:09.954890 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:09.963385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a096ed2-5562-4f83-9b5a-b6e97e7c3e99 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1563 microversion: 2.1 time: 0.186353 Sep 25 01:51:09.964111 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3242/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:09 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:33.252995 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:33.253819 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=38 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:33.259094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:33.261374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:33.269265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:33.269803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:33.270268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:33.271019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:33.271501 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:33.271953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:33.340968 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38238dfb-35bc-422b-bfb8-fb777f55f9f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action" status: 200 len: 24570 microversion: 2.1 time: 0.089809 Sep 25 01:51:33.341874 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3267/6509] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:51:33 2022] POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:51:44.084990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:44.085633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:44.087983 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:44.088769 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=36 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:44.094765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.095252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.095692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.096417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.096877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.097306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.230805 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d9c5d58c-9b40-4341-8dce-64aa42da9bbf tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1833 microversion: 2.1 time: 0.149728 Sep 25 01:51:44.231380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3243/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:44 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:44.253941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:44.254658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:44.258407 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:44.259075 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:51:44.265289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.265806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.266259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.266962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.267433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.267874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.398584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:44.407099 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ead50f36-0537-442d-b5c5-6aa7a78edfb2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1682 microversion: 2.1 time: 0.157410 Sep 25 01:51:44.407675 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3268/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:44 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:44.508961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:44.511163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:44.517116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.517634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.518075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.518763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.519218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.519644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.593655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d90c7d7e-ae18-4060-8825-82bff7f6f996 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action" status: 200 len: 32637 microversion: 2.1 time: 0.088759 Sep 25 01:51:44.594479 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3244/6512] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:51:44 2022] POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action => generated 32637 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:51:44.748850 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:44.749371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:44.756950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.757477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.757943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.758655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:44.759135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:44.759582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:44.787073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f2384bc2c52453d9bd0ce9d5f1754c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6768fcf2a21b47309da69f215ec784f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:44.787908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] flavor_id is None. Assuming migration. {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 25 01:51:44.788380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:51:44.895915 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [d27bc8d4-983c-4294-a289-0342e31edcf3] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:51:45.905721 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [d27bc8d4-983c-4294-a289-0342e31edcf3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46076. Sep 25 01:51:45.909576 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-63f87b86-13b4-455d-a47d-1e7092a32dc0 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action" status: 202 len: 0 microversion: 2.1 time: 1.164640 Sep 25 01:51:45.914624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3269/6513] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:51:44 2022] POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:51:45.919987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:45.920705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:45.931001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:45.931913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:45.932054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:45.932825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:45.933254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:45.933923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:46.113725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:46.121838 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c15b4288-2ac5-45cb-ba1d-621aac8f9f92 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1691 microversion: 2.1 time: 0.206064 Sep 25 01:51:46.122420 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3245/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:45 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:47.151563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:47.152227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:47.160248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:47.160780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:47.161236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:47.161994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:47.163210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:47.163672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:47.308235 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:47.316721 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5853744b-b809-45ef-a92d-d00b88ab826c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1691 microversion: 2.1 time: 0.175952 Sep 25 01:51:47.317313 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3270/6515] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:47 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:48.340269 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:48.340909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:48.348096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:48.348590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:48.349034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:48.350338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:48.350772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:48.351268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:48.536137 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:48.545137 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59b172d5-f051-4c28-8d09-ae97e9ccc3b9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.208799 Sep 25 01:51:48.545765 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3246/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:48 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:49.569388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:49.570605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:49.578479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:49.579145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:49.579500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:49.580230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:49.580711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:49.581158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:49.724002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:49.733055 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d534f31d-2ee5-4150-89e5-63d66282df5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.167540 Sep 25 01:51:49.733679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3271/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:49 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:50.756842 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:50.757389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:50.764166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:50.764650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:50.765087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:50.765875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:50.766323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:50.766748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:50.903441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:50.911703 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-614a3ee3-4957-4162-909d-31ef4520ff88 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.159371 Sep 25 01:51:50.912419 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3247/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:50 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:51.936706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:51.937454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:51.944640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:51.945083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:51.945580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:51.946301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:51.946778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:51.947227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:52.091024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:52.099350 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a533fe26-4725-4249-a662-192334fbcc09 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.166300 Sep 25 01:51:52.099798 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3272/6519] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:51 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:53.122654 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:53.123271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:53.130372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:53.131019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:53.131648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:53.132370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:53.132836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:53.133262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:53.308369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:53.322327 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ebc12587-8ea1-4f01-8496-de0fc7acb129 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.203208 Sep 25 01:51:53.323633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3248/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:53 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:54.351997 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:54.353576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:54.361200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:54.361750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:54.362208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:54.363180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:54.364063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:54.364538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:54.564090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:54.575865 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe8b9bd8-874a-4b61-b88c-280e56495679 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.229740 Sep 25 01:51:54.576445 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3273/6521] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:54 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:55.609043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:55.609819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:55.617927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:55.618408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:55.618846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:55.619578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:55.620059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:55.620488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:55.760315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:55.768307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec6e6458-6d3e-471e-97a7-520e04fbe474 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.163137 Sep 25 01:51:55.768888 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3249/6522] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:55 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:56.794108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:56.795336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:56.803563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:56.804846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:56.805304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:56.806330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:56.806831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:56.807255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:56.951729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:56.960974 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1bc57462-6b56-431e-ab56-20270742d1d1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.171478 Sep 25 01:51:56.961687 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3274/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:56 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:57.984097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:57.984718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:57.991568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:57.992060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:57.992502 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:57.993199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:57.993679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:57.994113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:58.128467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:58.137251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-587f3603-eef5-4777-a965-1f2877dab81e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.157073 Sep 25 01:51:58.137941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3250/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:57 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:58.273439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1476863556", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1335563694", "security_groups": [{"name": "tempest-secgroup-smoke-1457604719"}], "block_device_mapping_v2": [{"uuid": "97ef0c5a-c0a6-47c1-9c19-d3cbdf27dfad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "daa3ccc5-9504-4a8e-a27c-000e04525f61"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:51:58.385827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] validate_networks() for [('daa3ccc5-9504-4a8e-a27c-000e04525f61', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:51:58.755100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:51:58.755548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:51:58.756047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:51:58.757105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:51:58.757589 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:51:58.766540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:58.767038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:58.767489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:58.768240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:58.768712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:58.769155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:58.786352 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:51:58.792351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Getting quotas for user 3e4dec25611148a99a5103582540a52e and project 3132ad168f614e279ea7695322517136. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:51:58.850712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:51:58.852838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97ef0c5a-c0a6-47c1-9c19-d3cbdf27dfad',volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:51:58.978853 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88c574c5-5e16-4e44-b74b-4b6d7e78a3d4 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710085 Sep 25 01:51:58.979503 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3275/6525] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:51:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:51:58.990689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ef726ac-ef2e-4494-91c5-be8b6b4cefe2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:58.991768 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3ef726ac-ef2e-4494-91c5-be8b6b4cefe2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:59.052405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3ef726ac-ef2e-4494-91c5-be8b6b4cefe2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:59.060547 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ef726ac-ef2e-4494-91c5-be8b6b4cefe2 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1095 microversion: 2.1 time: 0.073725 Sep 25 01:51:59.061197 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3251/6526] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:58 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:51:59.161244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:51:59.162010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:51:59.172333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:59.172912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:59.173463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:59.174293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:51:59.174837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:51:59.175345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:51:59.312491 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:51:59.320793 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b336048d-83d9-40a0-b9d9-5a8c7790c470 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.163379 Sep 25 01:51:59.321570 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3276/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:51:59 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:00.083122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:00.083738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:00.092424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:00.092921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:00.093369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:00.094172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:00.094620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:00.095055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:00.163665 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:00.172389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-98ec315c-3073-49d7-8630-b29b5303ba76 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1193 microversion: 2.1 time: 0.092463 Sep 25 01:52:00.172976 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3252/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:00 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:00.344390 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:00.345031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:00.352932 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:00.353475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:00.353946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:00.355241 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:00.355720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:00.356170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:00.496789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:00.506060 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-546bc9bd-bfc1-4f3a-ac31-62a6749b7263 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.165740 Sep 25 01:52:00.507149 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3277/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:00 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:01.195850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:01.196485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:01.203422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:01.203918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:01.204362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:01.205073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:01.205558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:01.205991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:01.273334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:01.282391 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-54f0cf66-ecf0-4639-98f4-7a7537d0297b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1211 microversion: 2.1 time: 0.091187 Sep 25 01:52:01.282988 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3253/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:01 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:01.532874 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:01.534465 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:01.542863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:01.544207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:01.545321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:01.546356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:01.547333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:01.548047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:01.707963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:01.717790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c250e612-e1fd-4d46-adec-e852c344287e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.190968 Sep 25 01:52:01.718373 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3278/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:01 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:02.172029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c412f9fe-6a2b-4a80-8bfa-26a120ceab56 req-8345a84b-9996-4e79-b802-d135232b9228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e02cb0f-108c-4543-bd33-38efeb551cce", "tag": "86c5b4cc-0651-46b1-8f24-400c9433318d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:02.184252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c412f9fe-6a2b-4a80-8bfa-26a120ceab56 req-8345a84b-9996-4e79-b802-d135232b9228 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:02.184759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c412f9fe-6a2b-4a80-8bfa-26a120ceab56 req-8345a84b-9996-4e79-b802-d135232b9228 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:02.185247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c412f9fe-6a2b-4a80-8bfa-26a120ceab56 req-8345a84b-9996-4e79-b802-d135232b9228 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:02.202636 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c412f9fe-6a2b-4a80-8bfa-26a120ceab56 req-8345a84b-9996-4e79-b802-d135232b9228 service nova] Creating event network-changed:86c5b4cc-0651-46b1-8f24-400c9433318d for instance 5e02cb0f-108c-4543-bd33-38efeb551cce on n-h1-master-1 Sep 25 01:52:02.207919 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c412f9fe-6a2b-4a80-8bfa-26a120ceab56 req-8345a84b-9996-4e79-b802-d135232b9228 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039566 Sep 25 01:52:02.208538 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3254/6532] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:52:02.306538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:02.307175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:02.313386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:02.313916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:02.314525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:02.315369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:02.316018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:02.316464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:02.455303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:02.464218 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82be5d8c-c31d-4296-ba19-2fa8003a12e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1279 microversion: 2.1 time: 0.161556 Sep 25 01:52:02.464885 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3279/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:02 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:02.743764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:02.744401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:02.751355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:02.751855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:02.752301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:02.753021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:02.753521 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:02.753980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:02.894816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:02.905965 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a2da354-72fe-446c-b70f-30a4ccfe96ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.167479 Sep 25 01:52:02.906937 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3255/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:02 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:03.486613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:03.487247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:03.494874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:03.495377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:03.495832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:03.496545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:03.497023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:03.497496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:03.641118 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:03.650002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e73bb1be-1bb0-4d9d-b8d2-a25ef7a1ae39 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1279 microversion: 2.1 time: 0.167147 Sep 25 01:52:03.650605 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3280/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:03 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:03.930251 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:03.930886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:03.937946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:03.938442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:03.938886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:03.939618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:03.940082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:03.940516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:04.075544 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:04.083435 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f26388e0-bbca-42ff-ab73-aed9f068dc40 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.157379 Sep 25 01:52:04.084016 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3256/6536] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:03 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:04.674571 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:04.675178 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:04.683112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:04.683569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:04.684033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:04.684751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:04.685230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:04.685721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:04.822097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:04.829848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b5e93ba-672e-4132-8673-609556f7c200 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1279 microversion: 2.1 time: 0.159299 Sep 25 01:52:04.830426 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3281/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:04 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:05.107926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:05.108559 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:05.116013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:05.116540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:05.116991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:05.117726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:05.118189 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:05.118622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:05.259231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:05.267533 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40b22602-fe71-4fc1-b95a-b32a8df82848 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1696 microversion: 2.1 time: 0.163495 Sep 25 01:52:05.268285 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3257/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:05 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:05.854243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:05.854883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:05.861769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:05.862273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:05.862731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:05.863437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:05.863910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:05.864354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:06.000773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:06.009220 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-37b8c2c6-4fe1-4c0a-b6b7-3dcc4f4604e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.159638 Sep 25 01:52:06.009846 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3282/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:05 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:06.292387 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:06.293008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:06.299897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:06.300390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:06.300826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:06.301552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:06.302007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:06.302434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:06.540467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:06.548415 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38875be5-2844-4361-b5f2-9c1a0d4c3684 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1695 microversion: 2.1 time: 0.260100 Sep 25 01:52:06.549038 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3258/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:06 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:06.694247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "name": "network-vif-unplugged", "status": "completed", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:06.703579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:06.704070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:06.704515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:06.716725 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] Creating event network-vif-unplugged:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h2-master-1 Sep 25 01:52:06.719253 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:06.723303 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] Instance 87c4ea12-1413-4a09-8665-124a7644aa10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:52:06.735727 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b42ca0a3-8f1f-486d-aa52-bc6dbe8d49e7 req-91a13f64-b4e7-4eed-a0c7-8c8778f30eb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116967 Sep 25 01:52:06.736735 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3283/6541] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:52:07.032541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:07.033349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:07.040308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:07.040833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:07.041279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:07.042024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:07.042489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:07.042948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:07.321455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:07.329460 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-edf689d3-bf05-42fe-8646-ff749b080589 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.301137 Sep 25 01:52:07.330138 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3259/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:07 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:07.574727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:07.575582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:07.582291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:07.582797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:07.583259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:07.583980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:07.585001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:07.585624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:07.797027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:07.805554 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01229c54-21c0-4579-9561-84cc0bba6a60 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1695 microversion: 2.1 time: 0.237056 Sep 25 01:52:07.806148 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3284/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:07 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1695 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:08.352832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:08.353529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:08.360404 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:08.360887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:08.361329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:08.362047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:08.362510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:08.362938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:08.501939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:08.511004 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ebcf6f4e-2838-4f31-92b8-ec7f90648a89 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.162153 Sep 25 01:52:08.511591 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3260/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:08 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:08.759532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:08.772959 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:08.773648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:08.774106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:08.777303 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:08.789214 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] Creating event network-changed:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h2-master-1 Sep 25 01:52:08.795333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] Instance 87c4ea12-1413-4a09-8665-124a7644aa10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:52:08.800605 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:08.808116 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-95098545-83a4-4d12-9ec8-35838a4db9f7 req-95974137-d43e-4176-b20d-8e0c8f232ef7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054234 Sep 25 01:52:08.808861 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3285/6545] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:52:08.829061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:08.829736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:08.836835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:08.837328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:08.837801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:08.838547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:08.839009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:08.839545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:08.859258 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=100 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:08.994381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:09.003019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ce8fc6f-960b-4175-8efb-669ea0eb66ce tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1693 microversion: 2.1 time: 0.178047 Sep 25 01:52:09.003692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3261/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:08 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:09.535070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:09.535827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:09.542978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:09.543484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:09.543944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:09.544654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:09.545141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:09.545625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:09.680409 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:09.688153 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-34cd4ca9-762d-48c0-921f-256d3b44b277 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.157452 Sep 25 01:52:09.688720 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3286/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:09 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:10.027855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:10.028472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:10.030580 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:10.036739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:10.037234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:10.037995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:10.039213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:10.040009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:10.040801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:10.184208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:10.192951 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86ea20eb-8b17-4ed2-83de-a7817ea7744a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1693 microversion: 2.1 time: 0.169107 Sep 25 01:52:10.194207 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3262/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:10 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:10.712801 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:10.713454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:10.721207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:10.721875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:10.722454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:10.723355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:10.723837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:10.724316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:10.887609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:10.896763 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64a249ff-bb55-4eac-a424-2e94e00b5642 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.189031 Sep 25 01:52:10.897765 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3287/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:10 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:11.220174 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:11.220769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:11.228640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:11.229123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:11.229643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:11.230401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:11.230857 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:11.231336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:11.467498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:11.476129 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7aeb2673-08cd-4729-a869-586157dab133 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1693 microversion: 2.1 time: 0.259748 Sep 25 01:52:11.476815 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3263/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:11 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1693 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:11.922344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:11.923001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:11.930598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:11.931149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:11.931602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:11.932312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:11.932783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:11.933224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:12.064244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:12.072225 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5f1d5b5e-48b4-4e43-83e9-4c15c6cfd161 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.153818 Sep 25 01:52:12.072804 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3288/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:11 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:12.500394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:12.500978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:12.509455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:12.509950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:12.510389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:12.511095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:12.511552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:12.511977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:12.653256 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:12.661503 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e201aef9-ad7b-4da0-98db-9a72e9d85d9f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1690 microversion: 2.1 time: 0.165182 Sep 25 01:52:12.662112 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3264/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:12 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:12.693558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:12.694263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:12.700512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:12.701146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:12.701706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:12.702490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:12.702975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:12.703420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:12.815216 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4227b8ef-403f-49af-9291-3abf43230da6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action" status: 202 len: 0 microversion: 2.1 time: 0.125529 Sep 25 01:52:12.815827 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3289/6553] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:52:12 2022] POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:52:12.824268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:12.824883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:12.831313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:12.831785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:12.832220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:12.832937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:12.833396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:12.833817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:13.062220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:13.070913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-530358d1-9acb-46d6-b41a-1448643bf2cd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1689 microversion: 2.1 time: 0.250527 Sep 25 01:52:13.071633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3265/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:12 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1689 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:13.096687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:13.097433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:13.104611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:13.105327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:13.105950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:13.106817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:13.107464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:13.108050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:13.326995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:13.336154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2bde5503-a1b1-4727-9673-34789817e45b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.244498 Sep 25 01:52:13.345698 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3290/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:13 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:14.095319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:14.095942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:14.102802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:14.103291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:14.103733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:14.104437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:14.104899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:14.105333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:14.235059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:14.243617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6575341-a1da-4999-b152-c05146f9a4d3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1689 microversion: 2.1 time: 0.152304 Sep 25 01:52:14.244200 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3266/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:14 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:14.359876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:14.361154 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:14.364064 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:14.370303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:14.370807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:14.371402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:14.372128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:14.372602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:14.373044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:14.414779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "name": "network-vif-plugged", "status": "completed", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:14.424041 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=51 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:14.426801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:14.427289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:14.427770 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:14.443322 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] Creating event network-vif-plugged:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h2-master-1 Sep 25 01:52:14.449505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] Instance 87c4ea12-1413-4a09-8665-124a7644aa10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:52:14.462010 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d2e3d81e-10b8-43c7-94e1-f87be7114fa0 req-8bbc5261-8203-4588-b0fe-49aaa3438f63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051421 Sep 25 01:52:14.462951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3267/6557] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:52:14.515534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:14.524567 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f0516924-1697-439d-960f-37ef9fd3f027 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.168612 Sep 25 01:52:14.525507 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3291/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:14 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:15.267917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:15.268656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:15.275988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:15.276505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:15.276952 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:15.277696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:15.278159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:15.278597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:15.421806 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:15.431015 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b0eac82a-15bb-4fc6-a097-94cb3da342ae tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1689 microversion: 2.1 time: 0.167368 Sep 25 01:52:15.431740 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3268/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:15 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:15.548279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:15.548807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:15.556385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:15.556890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:15.557349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:15.558092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:15.558570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:15.559018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:15.693925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:15.702148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5682a638-388c-408b-8103-496cfeee6549 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.157902 Sep 25 01:52:15.702724 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3292/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:15 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:16.454437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:16.455239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:16.463411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:16.464124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:16.464836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:16.465632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:16.466109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:16.466792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:16.478298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-043fed89-9a7d-4a0a-bb98-aea074d7070d req-f11ca5c8-b152-4237-aa9f-2d2c96017198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e02cb0f-108c-4543-bd33-38efeb551cce", "name": "network-vif-plugged", "status": "completed", "tag": "86c5b4cc-0651-46b1-8f24-400c9433318d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:16.497282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-043fed89-9a7d-4a0a-bb98-aea074d7070d req-f11ca5c8-b152-4237-aa9f-2d2c96017198 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:16.497808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-043fed89-9a7d-4a0a-bb98-aea074d7070d req-f11ca5c8-b152-4237-aa9f-2d2c96017198 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:16.498264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-043fed89-9a7d-4a0a-bb98-aea074d7070d req-f11ca5c8-b152-4237-aa9f-2d2c96017198 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:16.516209 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-043fed89-9a7d-4a0a-bb98-aea074d7070d req-f11ca5c8-b152-4237-aa9f-2d2c96017198 service nova] Creating event network-vif-plugged:86c5b4cc-0651-46b1-8f24-400c9433318d for instance 5e02cb0f-108c-4543-bd33-38efeb551cce on n-h1-master-1 Sep 25 01:52:16.521242 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-043fed89-9a7d-4a0a-bb98-aea074d7070d req-f11ca5c8-b152-4237-aa9f-2d2c96017198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046667 Sep 25 01:52:16.522511 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3293/6561] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:52:16.704364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:16.714027 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a9a56ae-7c8c-4d89-9aac-7ae3cb326b27 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1689 microversion: 2.1 time: 0.263186 Sep 25 01:52:16.714987 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3269/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:16 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:52:16.726550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:16.727533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:16.739622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:16.740707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:16.741328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:16.742411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:16.743358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:16.744214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:16.749218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "name": "network-vif-unplugged", "status": "completed", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:16.760723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:16.761494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:16.762146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:16.786557 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] Creating event network-vif-unplugged:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:52:16.792511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] Instance 87c4ea12-1413-4a09-8665-124a7644aa10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:52:16.804354 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e38bb937-5393-4cb5-87b8-77affad30060 req-9892b8d2-0590-40fc-9cf1-e78c1f10dc25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059535 Sep 25 01:52:16.805052 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3270/6563] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:52:16.901272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:16.909814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6dc5f903-f0fc-4e85-9fbb-ceefacb59556 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.187977 Sep 25 01:52:16.910496 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3294/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:16 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:17.741695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:17.742409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:17.748531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:17.749026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:17.749507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:17.750221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:17.750687 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:17.751121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:17.889522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:17.897287 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-977cc8e2-5de7-4b11-97b2-be7b9815e5e5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1689 microversion: 2.1 time: 0.160877 Sep 25 01:52:17.897891 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3271/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:17 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:17.933270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:17.934137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:17.942036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:17.942546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:17.943014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:17.944592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:17.945068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:17.945540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:18.082993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:18.091396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8beb2f7b-6f01-4a13-a5f8-8ae4a5e1a91a tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1267 microversion: 2.1 time: 0.162187 Sep 25 01:52:18.091987 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3295/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:17 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:18.828816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:18.839557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:18.840038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:18.840474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:18.852568 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] Creating event network-changed:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:52:18.857875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] Instance 87c4ea12-1413-4a09-8665-124a7644aa10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:52:18.868336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b58d106e-45ab-4064-b260-b4c220d745ce req-ffb10414-4d60-46bc-a4dd-31db253f60a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043307 Sep 25 01:52:18.868945 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3272/6567] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:52:18.920171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:18.920817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:18.926953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:18.927460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:18.928580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:18.929317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:18.929828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:18.930277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:19.115464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:19.116109 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:19.122505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:19.123002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:19.123444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:19.124158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:19.124615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:19.125049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:19.137358 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:19.145788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-baf41f59-1214-4bbb-be35-f8eff9c45a0e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1689 microversion: 2.1 time: 0.229500 Sep 25 01:52:19.161455 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3296/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:18 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:19.330237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:19.338265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0487e59-3a81-4609-a155-e632451310fc tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1454 microversion: 2.1 time: 0.227245 Sep 25 01:52:19.338850 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3273/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:19 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:52:19.360744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:19.361426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:19.368502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:19.368949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:19.369430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:19.370151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:19.370629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:19.371106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:19.586759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:19.595087 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0d7abe9-6e5e-4342-9fe5-be0b2e34d569 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1454 microversion: 2.1 time: 0.238209 Sep 25 01:52:19.596277 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3297/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:19 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:20.172481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:20.173102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:20.180834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:20.181604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:20.192093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:20.209625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:20.210756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:20.213975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:20.541774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:20.550428 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f7b3410-6827-4ff0-af70-9215a59c4fd1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1682 microversion: 2.1 time: 0.383096 Sep 25 01:52:20.551369 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3274/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:20 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1682 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:21.902408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bc3cbe40-7fc9-45dc-94ac-f52766456eda req-0847bff7-a4bd-484b-879b-131243f767c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e02cb0f-108c-4543-bd33-38efeb551cce", "tag": "86c5b4cc-0651-46b1-8f24-400c9433318d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:21.913814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bc3cbe40-7fc9-45dc-94ac-f52766456eda req-0847bff7-a4bd-484b-879b-131243f767c8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:21.914407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bc3cbe40-7fc9-45dc-94ac-f52766456eda req-0847bff7-a4bd-484b-879b-131243f767c8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:21.914937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bc3cbe40-7fc9-45dc-94ac-f52766456eda req-0847bff7-a4bd-484b-879b-131243f767c8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:21.926633 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bc3cbe40-7fc9-45dc-94ac-f52766456eda req-0847bff7-a4bd-484b-879b-131243f767c8 service nova] Creating event network-changed:86c5b4cc-0651-46b1-8f24-400c9433318d for instance 5e02cb0f-108c-4543-bd33-38efeb551cce on n-h1-master-1 Sep 25 01:52:21.932522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bc3cbe40-7fc9-45dc-94ac-f52766456eda req-0847bff7-a4bd-484b-879b-131243f767c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034266 Sep 25 01:52:21.933119 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3298/6572] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:52:22.687377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-08c57967-7a90-4c59-84c5-4150eef2571b req-09ec7082-3398-4506-a698-aafee019e4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "name": "network-vif-plugged", "status": "completed", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:22.699295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08c57967-7a90-4c59-84c5-4150eef2571b req-09ec7082-3398-4506-a698-aafee019e4c0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:22.699783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08c57967-7a90-4c59-84c5-4150eef2571b req-09ec7082-3398-4506-a698-aafee019e4c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:22.700282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08c57967-7a90-4c59-84c5-4150eef2571b req-09ec7082-3398-4506-a698-aafee019e4c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:22.719355 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-08c57967-7a90-4c59-84c5-4150eef2571b req-09ec7082-3398-4506-a698-aafee019e4c0 service nova] Creating event network-vif-plugged:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:52:22.730887 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-08c57967-7a90-4c59-84c5-4150eef2571b req-09ec7082-3398-4506-a698-aafee019e4c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047254 Sep 25 01:52:22.731514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3275/6573] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:52:46.832053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:46.834456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:46.836847 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=15 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:46.837734 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:46.846270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:46.846778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:46.847240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:46.847967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:46.848445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:46.848895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:46.923258 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-02960d3a-9449-4e07-a795-f8213f372998 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action" status: 200 len: 63189 microversion: 2.1 time: 0.095656 Sep 25 01:52:46.923942 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3299/6574] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:52:46 2022] POST /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10/action => generated 63189 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:52:53.219098 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:53.219809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:53.222070 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=17 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:53.222788 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=76 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:52:53.230758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:53.231245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:53.231679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:53.232371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:53.232821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:53.233245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:53.362090 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c41a9a92-c975-4ec6-aace-a2dcd74615c7 tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1833 microversion: 2.1 time: 0.147396 Sep 25 01:52:53.362666 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3276/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:53 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1833 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:54.220333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:54.220953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:54.223980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f78c2210-f3c0-4236-ae8b-543aff498411 req-11620102-4c24-41cc-a6f8-d5e8e0e14e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:54.227989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:54.228502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:54.229024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:54.229779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:54.230372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:54.230705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:54.236612 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f78c2210-f3c0-4236-ae8b-543aff498411 req-11620102-4c24-41cc-a6f8-d5e8e0e14e55 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:54.237344 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f78c2210-f3c0-4236-ae8b-543aff498411 req-11620102-4c24-41cc-a6f8-d5e8e0e14e55 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:54.237987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f78c2210-f3c0-4236-ae8b-543aff498411 req-11620102-4c24-41cc-a6f8-d5e8e0e14e55 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:54.249997 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f78c2210-f3c0-4236-ae8b-543aff498411 req-11620102-4c24-41cc-a6f8-d5e8e0e14e55 service nova] Creating event network-changed:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:52:54.255463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f78c2210-f3c0-4236-ae8b-543aff498411 req-11620102-4c24-41cc-a6f8-d5e8e0e14e55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035848 Sep 25 01:52:54.256723 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3277/6576] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:52:54.258781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:52:54.343640 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9da5fde1-f962-4543-b40e-f926f3492cb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 204 len: 0 microversion: 2.1 time: 0.127308 Sep 25 01:52:54.344159 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3300/6577] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:52:54 2022] DELETE /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:52:54.353745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:54.354643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:54.360957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:54.361570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:54.362092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:54.363407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:54.363407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:54.363839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:54.517096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:54.524789 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9e285059-1658-4d84-86f0-bca9b191c3a5 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1688 microversion: 2.1 time: 0.175557 Sep 25 01:52:54.525718 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3278/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:54 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:55.549416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:55.550153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:55.558423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:55.558925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:55.559382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:55.560097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:55.560572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:55.561015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:55.696151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:55.704675 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e86c74d5-6c47-493c-98ac-b691040b3eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1688 microversion: 2.1 time: 0.159567 Sep 25 01:52:55.705239 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3301/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:55 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:56.376039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6e473310-99d5-45e8-b5a6-b6f7e75848d3 req-f14600af-abbb-4f52-aba2-977b46841a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4ea12-1413-4a09-8665-124a7644aa10", "name": "network-vif-deleted", "tag": "c4363c1f-a516-4408-b5b6-a4413836540f"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:52:56.386856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6e473310-99d5-45e8-b5a6-b6f7e75848d3 req-f14600af-abbb-4f52-aba2-977b46841a70 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:56.387492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6e473310-99d5-45e8-b5a6-b6f7e75848d3 req-f14600af-abbb-4f52-aba2-977b46841a70 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:56.388331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6e473310-99d5-45e8-b5a6-b6f7e75848d3 req-f14600af-abbb-4f52-aba2-977b46841a70 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:56.400589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6e473310-99d5-45e8-b5a6-b6f7e75848d3 req-f14600af-abbb-4f52-aba2-977b46841a70 service nova] Creating event network-vif-deleted:c4363c1f-a516-4408-b5b6-a4413836540f for instance 87c4ea12-1413-4a09-8665-124a7644aa10 on n-h1-master-1 Sep 25 01:52:56.406282 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6e473310-99d5-45e8-b5a6-b6f7e75848d3 req-f14600af-abbb-4f52-aba2-977b46841a70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034237 Sep 25 01:52:56.406910 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3279/6580] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:52:56.728246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:56.728906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:56.736616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:56.737121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:56.737606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:56.738326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:56.738796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:56.739234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:56.777039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:56.777613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:56.778106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:56.778594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lazy-loading 'fault' on Instance uuid 87c4ea12-1413-4a09-8665-124a7644aa10 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:52:56.821103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:52:56.829698 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3bbf4ea0-9065-4526-9bba-28520dfcc676 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 200 len: 1356 microversion: 2.1 time: 0.105402 Sep 25 01:52:56.830278 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3302/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:56 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:52:57.855588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:52:57.856296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 87c4ea12-1413-4a09-8665-124a7644aa10] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:52:57.862527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:57.863011 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:57.863453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:57.864145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:52:57.864601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:52:57.865037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:52:57.878140 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] HTTP exception thrown: Instance 87c4ea12-1413-4a09-8665-124a7644aa10 could not be found. Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Request method failure captured: Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 HTTP/1.1 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Nob4r3tr2Imx8l38IewJ1BarkA00tQHpkr4a0KPWRKsiG0TwSrecs4vJrUdJ1vjJRUQaNvpRInoaocKSH-TdloVfDriXoflyRq-tKDRE6NUOetvkwShAH9zBdCmnNn30LyD2IToQtrZSNp3EcWO96l-BZsdreYXwl1wno9AZYfl38 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2935e753a36e4a25b0362b13a4c12ebf"}]}] Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 7d3b3eec24d94748b8b55a52a0e3e422 Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 87c4ea12-1413-4a09-8665-124a7644aa10 could not be found. Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '87c4ea12-1413-4a09-8665-124a7644aa10'} Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c4ea12-1413-4a09-8665-124a7644aa10 could not be found. Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c4ea12-1413-4a09-8665-124a7644aa10 could not be found. Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:52:57.879758 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c4ea12-1413-4a09-8665-124a7644aa10 could not be found. Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Returning 404 to user: Instance 87c4ea12-1413-4a09-8665-124a7644aa10 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b2f63b4-f64b-4dcb-9b3f-393b4ada84f1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10" status: 404 len: 111 microversion: 2.1 time: 0.031374 Sep 25 01:52:57.883772 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3280/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:52:57 2022] GET /compute/v2.1/servers/87c4ea12-1413-4a09-8665-124a7644aa10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:53:00.858948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bef7c91f-a963-442c-bd0c-b4eeba01b6c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '.version_select at 0x7f7beae74a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:00.879441 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bef7c91f-a963-442c-bd0c-b4eeba01b6c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1260438932" status: 202 len: 0 microversion: 2.1 time: 0.025248 Sep 25 01:53:00.880261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3303/6583] 10.222.0.16 () {58 vars in 1284 bytes} [Sun Sep 25 01:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1260438932 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:53:00.919245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf5ad878-feb9-40fc-af26-c86e5ce6ad81 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: .version_select at 0x7f7bea92e550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1677393960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/UNrTss5RxxO7eKmc2OHU9eQ6hd6G8r/mOUWL923iZfXiZDSy8lok5TZiPPyOIGQZzi/PtKQZQjVSPxXnBhQSRZL0F6aRwo8oJ7o901Ts4GKAxp5yP2IRt+z7p1HsgDQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:00.935487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cf5ad878-feb9-40fc-af26-c86e5ce6ad81 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:53:00.941321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-cf5ad878-feb9-40fc-af26-c86e5ce6ad81 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:53:00.965916 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf5ad878-feb9-40fc-af26-c86e5ce6ad81 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050654 Sep 25 01:53:00.966418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3281/6584] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:53:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:53:06.720578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-373832610", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "b2f40efb-a8f1-4e12-a24b-fcccd5101163"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1677393960", "security_groups": [{"name": "tempest-secgroup-smoke-917474584"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:06.825968 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:06.840806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] validate_networks() for [('b2f40efb-a8f1-4e12-a24b-fcccd5101163', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:53:07.293145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:53:07.293663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:53:07.294346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:53:07.294779 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:53:07.295216 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:53:07.304887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:07.305396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:07.305881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:07.306634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:07.307137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:07.307584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:07.326295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:53:07.332169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:53:07.350086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:53:07.352565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:53:07.412947 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9d965fbd-1cc8-403f-90e7-1e456f1bcdbd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697300 Sep 25 01:53:07.414221 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3304/6585] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:53:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:53:07.427204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c68b0d7-36b9-4150-bf5f-e4bb7fc96a64 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:07.427833 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3c68b0d7-36b9-4150-bf5f-e4bb7fc96a64 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:07.514315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3c68b0d7-36b9-4150-bf5f-e4bb7fc96a64 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:07.524950 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c68b0d7-36b9-4150-bf5f-e4bb7fc96a64 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1266 microversion: 2.1 time: 0.101840 Sep 25 01:53:07.535744 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3282/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:07 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:08.551025 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:08.552819 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:08.563792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:08.564386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:08.564849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:08.565804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:08.566282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:08.566732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:08.696147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:08.708385 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e3623f24-3239-4c8c-a924-83efbe390ba9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1326 microversion: 2.1 time: 0.160768 Sep 25 01:53:08.733135 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3305/6587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:08 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:09.740135 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:09.740843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:09.743447 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=18 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:09.751815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:09.752598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:09.753266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:09.754220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:09.754884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:09.755504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:09.989267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:10.002129 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-12d131a9-2630-4ec7-9311-f1a71beaedea tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.265880 Sep 25 01:53:10.002739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3283/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:09 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:53:10.379471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-dd3fd52b-35a8-4b03-881c-aed5826440b9 req-e648293b-f024-43a7-b1e6-7a82816d7d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:10.393426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dd3fd52b-35a8-4b03-881c-aed5826440b9 req-e648293b-f024-43a7-b1e6-7a82816d7d0e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:10.394171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dd3fd52b-35a8-4b03-881c-aed5826440b9 req-e648293b-f024-43a7-b1e6-7a82816d7d0e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:10.394720 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dd3fd52b-35a8-4b03-881c-aed5826440b9 req-e648293b-f024-43a7-b1e6-7a82816d7d0e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:10.407443 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-dd3fd52b-35a8-4b03-881c-aed5826440b9 req-e648293b-f024-43a7-b1e6-7a82816d7d0e service nova] Creating event network-changed:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h2-master-1 Sep 25 01:53:10.419628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-dd3fd52b-35a8-4b03-881c-aed5826440b9 req-e648293b-f024-43a7-b1e6-7a82816d7d0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044821 Sep 25 01:53:10.421695 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3306/6589] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:53:11.026924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:11.027553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:11.034762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:11.035251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:11.035694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:11.036392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:11.036851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:11.037313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:11.171622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:11.179352 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e370296e-045c-4e50-b09c-3be53842481a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.156523 Sep 25 01:53:11.179951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3284/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:11 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:12.205014 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:12.205777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:12.212219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:12.212737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:12.214008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:12.214901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:12.215382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:12.215838 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:12.348248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:12.356559 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d96aaf99-2f58-46be-894c-2312be532a7e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.156961 Sep 25 01:53:12.357137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3307/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:12 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:13.379725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:13.380547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:13.388943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:13.389471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:13.390102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:13.390923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:13.391485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:13.391938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:13.532186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:13.540032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81627487-ca34-4cc4-a5d6-b2bdace8352b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.164138 Sep 25 01:53:13.540585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3285/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:13 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:14.564856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:14.565529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:14.572567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:14.573116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:14.573634 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:14.574651 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:14.575211 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:14.575660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:14.709508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:14.718131 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2540207-7742-4294-89a5-0dfee6740535 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.157205 Sep 25 01:53:14.718725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3308/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:14 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:15.741495 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:15.742141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:15.751052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:15.751591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:15.752096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:15.752900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:15.753441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:15.753884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:15.904615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:15.914394 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8bf51632-adc0-4df2-8f55-a1d7e1b50b66 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.177333 Sep 25 01:53:15.915088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3286/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:15 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:16.828056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-54c01cac-c26a-4cbc-a512-7db5d4b35961 req-6bc53dfb-f326-4583-9dfb-85af0c593a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "name": "network-vif-plugged", "status": "completed", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:16.839791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-54c01cac-c26a-4cbc-a512-7db5d4b35961 req-6bc53dfb-f326-4583-9dfb-85af0c593a45 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:16.840369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-54c01cac-c26a-4cbc-a512-7db5d4b35961 req-6bc53dfb-f326-4583-9dfb-85af0c593a45 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:16.841673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-54c01cac-c26a-4cbc-a512-7db5d4b35961 req-6bc53dfb-f326-4583-9dfb-85af0c593a45 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:16.854644 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-54c01cac-c26a-4cbc-a512-7db5d4b35961 req-6bc53dfb-f326-4583-9dfb-85af0c593a45 service nova] Creating event network-vif-plugged:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h2-master-1 Sep 25 01:53:16.864130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-54c01cac-c26a-4cbc-a512-7db5d4b35961 req-6bc53dfb-f326-4583-9dfb-85af0c593a45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040474 Sep 25 01:53:16.864918 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3309/6595] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:53:16.938549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:16.939196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:16.946073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:16.946566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:16.947040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:16.947749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:16.948213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:16.948646 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:17.122289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:17.130197 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0ad7b237-9c42-401c-a90b-3b243d86f507 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.196509 Sep 25 01:53:17.130787 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3287/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:16 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:18.150844 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:18.151554 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:18.157771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:18.158564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:18.160349 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:18.167639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:18.168136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:18.168592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:18.169790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:18.170264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:18.170707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:18.315327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:18.323247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1e9faca-0740-429a-89c1-000ce8065bb6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1391 microversion: 2.1 time: 0.173484 Sep 25 01:53:18.323839 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3310/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:18 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:19.345863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:19.346489 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:19.348421 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:19.354689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:19.355179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:19.355624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:19.356326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:19.356785 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:19.357218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:19.487179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:19.495500 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92890883-478e-4a71-9b0f-dba1fcc405c8 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1564 microversion: 2.1 time: 0.153730 Sep 25 01:53:19.496081 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3288/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:19 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:19.519355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:19.520019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:19.526876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:19.527379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:19.527847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:19.528569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:19.529050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:19.529586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:19.661417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:19.669240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93713bd9-9690-490d-8568-ce12cc435078 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1564 microversion: 2.1 time: 0.153835 Sep 25 01:53:19.670403 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3311/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:19 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:21.722641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:21.723409 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:21.724633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3f5c089e-2046-494e-8aef-ae85c90ad6d5 req-4bdab308-aac5-4016-aa9e-8aa6bcc9c78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:21.731440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:21.731928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:21.733360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:21.734306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:21.734769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:21.735392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:21.735505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3f5c089e-2046-494e-8aef-ae85c90ad6d5 req-4bdab308-aac5-4016-aa9e-8aa6bcc9c78b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:21.735986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3f5c089e-2046-494e-8aef-ae85c90ad6d5 req-4bdab308-aac5-4016-aa9e-8aa6bcc9c78b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:21.736439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3f5c089e-2046-494e-8aef-ae85c90ad6d5 req-4bdab308-aac5-4016-aa9e-8aa6bcc9c78b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:21.747927 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3f5c089e-2046-494e-8aef-ae85c90ad6d5 req-4bdab308-aac5-4016-aa9e-8aa6bcc9c78b service nova] Creating event network-changed:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h2-master-1 Sep 25 01:53:21.753171 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3f5c089e-2046-494e-8aef-ae85c90ad6d5 req-4bdab308-aac5-4016-aa9e-8aa6bcc9c78b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031968 Sep 25 01:53:21.753923 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3312/6600] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:53:21.969808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:21.978577 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-350602d5-064c-4e97-9fca-af2243829c15 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1564 microversion: 2.1 time: 0.260263 Sep 25 01:53:21.994390 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3289/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:21 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1564 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:53.273319 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:53.274164 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=38 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:53.333127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:53.335569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:53.342379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:53.342898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:53.343361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:53.344066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:53.344540 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:53.344984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:53.418379 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d855f797-0252-48cc-a547-d84bc412f8a3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action" status: 200 len: 24572 microversion: 2.1 time: 0.147254 Sep 25 01:53:53.419052 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3313/6602] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:53:53 2022] POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action => generated 24572 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:53:55.697389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:55.697895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:55.700555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ee46bb18-40fb-45d4-9dc7-11a7ca7388eb req-5619b836-7f04-4d1b-b512-ffe7080bf00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e02cb0f-108c-4543-bd33-38efeb551cce", "tag": "86c5b4cc-0651-46b1-8f24-400c9433318d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:55.700951 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:55.702586 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=42 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:53:55.708267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:55.708827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:55.709331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:55.710156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:55.710685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:55.711177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:55.713135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ee46bb18-40fb-45d4-9dc7-11a7ca7388eb req-5619b836-7f04-4d1b-b512-ffe7080bf00e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:55.713834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ee46bb18-40fb-45d4-9dc7-11a7ca7388eb req-5619b836-7f04-4d1b-b512-ffe7080bf00e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:55.714284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ee46bb18-40fb-45d4-9dc7-11a7ca7388eb req-5619b836-7f04-4d1b-b512-ffe7080bf00e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:55.726599 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ee46bb18-40fb-45d4-9dc7-11a7ca7388eb req-5619b836-7f04-4d1b-b512-ffe7080bf00e service nova] Creating event network-changed:86c5b4cc-0651-46b1-8f24-400c9433318d for instance 5e02cb0f-108c-4543-bd33-38efeb551cce on n-h1-master-1 Sep 25 01:53:55.731869 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ee46bb18-40fb-45d4-9dc7-11a7ca7388eb req-5619b836-7f04-4d1b-b512-ffe7080bf00e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035411 Sep 25 01:53:55.732711 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3314/6603] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:53:55.741747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:53:55.825467 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2fe99324-e704-4151-9d53-5a3f11d1b34b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 204 len: 0 microversion: 2.1 time: 0.131731 Sep 25 01:53:55.827257 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3290/6604] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:53:55 2022] DELETE /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:53:55.836884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:55.837642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:55.844346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:55.844874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:55.845754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:55.846069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:55.846541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:55.847195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:55.984185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:55.992596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ed125a00-15be-447b-9495-0d49a84f5f91 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1577 microversion: 2.1 time: 0.160722 Sep 25 01:53:55.993275 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3315/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:55 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:57.018683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:57.019399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:57.026316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:57.026802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:57.027244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:57.027935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:57.028392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:57.028819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:57.229970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:57.238149 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-81aeb4ea-2f89-453f-8df9-3a80d559806b tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1577 microversion: 2.1 time: 0.224648 Sep 25 01:53:57.238725 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3291/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:57 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:53:58.233607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-dc13b693-7c81-4d82-a2d4-f698ea8bcb4e req-1d85d560-75ca-4078-8383-f03bb171d243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e02cb0f-108c-4543-bd33-38efeb551cce", "name": "network-vif-deleted", "tag": "86c5b4cc-0651-46b1-8f24-400c9433318d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:53:58.245074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dc13b693-7c81-4d82-a2d4-f698ea8bcb4e req-1d85d560-75ca-4078-8383-f03bb171d243 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:58.245527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dc13b693-7c81-4d82-a2d4-f698ea8bcb4e req-1d85d560-75ca-4078-8383-f03bb171d243 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:58.245985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dc13b693-7c81-4d82-a2d4-f698ea8bcb4e req-1d85d560-75ca-4078-8383-f03bb171d243 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:58.260097 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-dc13b693-7c81-4d82-a2d4-f698ea8bcb4e req-1d85d560-75ca-4078-8383-f03bb171d243 service nova] Creating event network-vif-deleted:86c5b4cc-0651-46b1-8f24-400c9433318d for instance 5e02cb0f-108c-4543-bd33-38efeb551cce on n-h1-master-1 Sep 25 01:53:58.264590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:58.265433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:58.265573 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-dc13b693-7c81-4d82-a2d4-f698ea8bcb4e req-1d85d560-75ca-4078-8383-f03bb171d243 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Sep 25 01:53:58.266360 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3316/6607] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:53:58.274616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:58.275112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:58.275587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:58.276298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:58.276763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:58.277198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:58.339829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:58.348852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-274197d7-5ef9-4bd3-b34e-76fec153c1e0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1226 microversion: 2.1 time: 0.089672 Sep 25 01:53:58.349630 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3292/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:58 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:53:59.374814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:53:59.375549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:53:59.381870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:59.382374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:59.382828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:59.383537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:53:59.384136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:53:59.384583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:53:59.454946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:53:59.463080 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9204af48-8781-4370-a1c6-7f4139702dc6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1226 microversion: 2.1 time: 0.094545 Sep 25 01:53:59.463666 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3317/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:53:59 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:00.486470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:00.487096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:00.494257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:00.494750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:00.495194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:00.495904 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:00.496365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:00.496807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:00.564082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:00.571928 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a02165d0-562b-44be-a62c-4a625c1548b5 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1226 microversion: 2.1 time: 0.089927 Sep 25 01:54:00.572501 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3293/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:00 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:01.595454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:01.596229 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:01.603467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:01.603970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:01.604429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:01.605132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:01.605641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:01.606084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:01.672423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:01.680323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bbd3c0b5-c553-4069-9c84-2615721a2957 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1226 microversion: 2.1 time: 0.089443 Sep 25 01:54:01.681115 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3318/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:01 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:02.704370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:02.704997 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:02.711903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:02.712393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:02.712847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:02.713575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:02.714039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:02.714474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:02.745786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:02.746273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:02.746715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:02.747172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid 5e02cb0f-108c-4543-bd33-38efeb551cce {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:54:02.787865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:02.795628 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a1d31cd9-6667-49e0-8fb1-d83aa75568e6 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 200 len: 1231 microversion: 2.1 time: 0.095723 Sep 25 01:54:02.796237 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3294/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:02 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:03.818784 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:03.819447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 5e02cb0f-108c-4543-bd33-38efeb551cce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:03.826466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:03.826969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:03.827423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:03.828130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:03.828601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:03.829044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:03.842864 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 5e02cb0f-108c-4543-bd33-38efeb551cce could not be found. Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce HTTP/1.1 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 5e02cb0f-108c-4543-bd33-38efeb551cce could not be found. Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5e02cb0f-108c-4543-bd33-38efeb551cce'} Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e02cb0f-108c-4543-bd33-38efeb551cce could not be found. Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e02cb0f-108c-4543-bd33-38efeb551cce could not be found. Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:03.844558 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e02cb0f-108c-4543-bd33-38efeb551cce could not be found. Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 5e02cb0f-108c-4543-bd33-38efeb551cce could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe7b02db-bbae-4ec0-a74e-3d0a6e868da7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce" status: 404 len: 111 microversion: 2.1 time: 0.031282 Sep 25 01:54:03.848139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3319/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:03 2022] GET /compute/v2.1/servers/5e02cb0f-108c-4543-bd33-38efeb551cce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:54:10.072405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:10.073524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:10.074603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f2c1d2ce-9f9a-4280-b351-b12cfb4edee8 req-4488d745-b80f-4e90-b65d-7cae94c7dbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051ca5f3-5da2-4b07-8400-b843751976f7", "tag": "5ba2a1c9-3f81-4af8-b1c8-206656cd068e"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:10.081182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:10.081917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:10.082536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:10.083407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:10.084017 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:10.084601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:10.085264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f2c1d2ce-9f9a-4280-b351-b12cfb4edee8 req-4488d745-b80f-4e90-b65d-7cae94c7dbcd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:10.085780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f2c1d2ce-9f9a-4280-b351-b12cfb4edee8 req-4488d745-b80f-4e90-b65d-7cae94c7dbcd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:10.086224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f2c1d2ce-9f9a-4280-b351-b12cfb4edee8 req-4488d745-b80f-4e90-b65d-7cae94c7dbcd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:10.099094 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f2c1d2ce-9f9a-4280-b351-b12cfb4edee8 req-4488d745-b80f-4e90-b65d-7cae94c7dbcd service nova] Creating event network-changed:5ba2a1c9-3f81-4af8-b1c8-206656cd068e for instance 051ca5f3-5da2-4b07-8400-b843751976f7 on n-h2-master-1 Sep 25 01:54:10.104508 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f2c1d2ce-9f9a-4280-b351-b12cfb4edee8 req-4488d745-b80f-4e90-b65d-7cae94c7dbcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033405 Sep 25 01:54:10.106115 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3320/6614] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:54:10.116164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:54:10.200109 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4288326f-3077-4bee-a59c-f024857992e3 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 204 len: 0 microversion: 2.1 time: 0.131164 Sep 25 01:54:10.201650 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3295/6615] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:54:10 2022] DELETE /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:54:10.210565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:10.211434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:10.219611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:10.220431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:10.221071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:10.221944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:10.222420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:10.222867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:10.395238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:10.403232 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-75c714fc-87e9-4224-96b3-458b065356b0 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1577 microversion: 2.1 time: 0.197064 Sep 25 01:54:10.404502 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3321/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:10 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:11.428081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:11.428819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:11.436085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:11.436572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:11.437014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:11.437746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:11.438206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:11.438639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:11.611049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:11.618971 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-278a10ed-58c5-4193-9917-1cc4d5c45968 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1577 microversion: 2.1 time: 0.195265 Sep 25 01:54:11.619559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3296/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:11 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:12.644431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:12.645016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:12.652132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:12.652708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:12.653175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:12.654578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:12.655513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:12.655971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:12.898641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0c27db00-0524-4fa5-96d6-635470350730 req-4a671146-6094-4916-ac0a-3f9b9adfeb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051ca5f3-5da2-4b07-8400-b843751976f7", "name": "network-vif-deleted", "tag": "5ba2a1c9-3f81-4af8-b1c8-206656cd068e"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:12.904776 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:12.910844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0c27db00-0524-4fa5-96d6-635470350730 req-4a671146-6094-4916-ac0a-3f9b9adfeb34 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:12.911415 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0c27db00-0524-4fa5-96d6-635470350730 req-4a671146-6094-4916-ac0a-3f9b9adfeb34 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:12.911917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0c27db00-0524-4fa5-96d6-635470350730 req-4a671146-6094-4916-ac0a-3f9b9adfeb34 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:12.915146 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-393c2826-778f-45a7-abd2-b2112bd4e726 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1458 microversion: 2.1 time: 0.274821 Sep 25 01:54:12.924191 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0c27db00-0524-4fa5-96d6-635470350730 req-4a671146-6094-4916-ac0a-3f9b9adfeb34 service nova] Creating event network-vif-deleted:5ba2a1c9-3f81-4af8-b1c8-206656cd068e for instance 051ca5f3-5da2-4b07-8400-b843751976f7 on n-h2-master-1 Sep 25 01:54:12.931922 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3322/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:12 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1458 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:12.934487 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0c27db00-0524-4fa5-96d6-635470350730 req-4a671146-6094-4916-ac0a-3f9b9adfeb34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040228 Sep 25 01:54:12.935725 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3297/6619] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:54:13.940160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:13.940835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:13.948046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:13.948555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:13.949016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:13.949756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:13.950231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:13.951203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:14.016483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:14.024466 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-708642e1-02a8-4a05-b1e4-9da7172ed2ae tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1225 microversion: 2.1 time: 0.088272 Sep 25 01:54:14.025129 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3323/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:13 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:15.050056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:15.050876 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:15.057264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:15.057871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:15.058399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:15.059173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:15.059708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:15.060713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:15.126462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:15.134465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-769ed99e-2706-4968-b98f-10cd06a8b06f tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1225 microversion: 2.1 time: 0.089893 Sep 25 01:54:15.135041 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3298/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:15 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:16.158971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:16.159603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:16.166783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:16.167281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:16.167736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:16.168447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:16.168916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:16.170086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:16.238511 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:16.247314 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6d2276a-ae3d-4b33-a4e9-be457d0a9389 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1225 microversion: 2.1 time: 0.092484 Sep 25 01:54:16.248873 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3324/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:16 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:17.271250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:17.271870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:17.278713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:17.279253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:17.279688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:17.280648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:17.281102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:17.281555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:17.314974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:17.315451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:17.315888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:17.316337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lazy-loading 'fault' on Instance uuid 051ca5f3-5da2-4b07-8400-b843751976f7 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:54:17.360351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4dec25611148a99a5103582540a52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ad168f614e279ea7695322517136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:17.368131 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f28f7d69-03dd-4a87-82bb-63e9ae3ae083 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 200 len: 1230 microversion: 2.1 time: 0.100827 Sep 25 01:54:17.368706 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3299/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:17 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:18.391953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:18.392599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 051ca5f3-5da2-4b07-8400-b843751976f7] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:18.399526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:18.400030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:18.400493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:18.401205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:18.401709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:18.402157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:18.418718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 051ca5f3-5da2-4b07-8400-b843751976f7 could not be found. Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 HTTP/1.1 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 051ca5f3-5da2-4b07-8400-b843751976f7 could not be found. Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '051ca5f3-5da2-4b07-8400-b843751976f7'} Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051ca5f3-5da2-4b07-8400-b843751976f7 could not be found. Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051ca5f3-5da2-4b07-8400-b843751976f7 could not be found. Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:18.420911 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051ca5f3-5da2-4b07-8400-b843751976f7 could not be found. Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 051ca5f3-5da2-4b07-8400-b843751976f7 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-247a28b7-4b0d-4afa-ac4e-5ca7e8cc98ef tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7" status: 404 len: 111 microversion: 2.1 time: 0.034603 Sep 25 01:54:18.424678 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3325/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:18 2022] GET /compute/v2.1/servers/051ca5f3-5da2-4b07-8400-b843751976f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:54:18.871793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:18.872341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:18.879332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:18.879827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:18.880274 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:18.880971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:18.881455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:18.881891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:18.895338 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df HTTP/1.1 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '9b04850d-a5af-44aa-b3cb-5053383c29df'} Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:54:18.897020 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5500fe8b-53e2-4b2f-8d8d-148ab2abfdfd tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 404 len: 111 microversion: 2.1 time: 0.030631 Sep 25 01:54:18.900671 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3300/6625] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:54:18 2022] DELETE /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:54:18.908220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:18.908883 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] [instance: 9b04850d-a5af-44aa-b3cb-5053383c29df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:18.914853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:18.915351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:18.915808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:18.916512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:18.916982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:18.917442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:18.931656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] HTTP exception thrown: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Request method failure captured: Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df HTTP/1.1 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7IgNi143iPzOeHg-yEEMQFr5b1fZCzvTuvbs8k9FbAEiZwGe2yITrtf1MALgrZVQtJZ9MrkVbLM1v4C3cl5RBVscaUfo24qVXErhqYV7MF4kA2KC57dHzbXok4U2HZkTysTWlbJG-RKRp3_zjJZQ7o9XwZiqsMTz__s4E1SJgNdDSo Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3132ad168f614e279ea7695322517136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3132ad168f614e279ea7695322517136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3132ad168f614e279ea7695322517136"}]}] Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3132ad168f614e279ea7695322517136 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestVolumeBootPattern-1341811025 Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 3e4dec25611148a99a5103582540a52e Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestVolumeBootPattern-1341811025-project Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9b04850d-a5af-44aa-b3cb-5053383c29df'} Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:18.933242 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Returning 404 to user: Instance 9b04850d-a5af-44aa-b3cb-5053383c29df could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c51f504-749b-41ff-a563-0c9f3d6726a7 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df" status: 404 len: 111 microversion: 2.1 time: 0.031379 Sep 25 01:54:18.937648 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3326/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:18 2022] GET /compute/v2.1/servers/9b04850d-a5af-44aa-b3cb-5053383c29df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:54:22.384849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dd9efc7-abb2-4ca6-85a8-3f7fce588425 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] Calling method '.version_select at 0x7f7bea838310>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:22.406977 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5dd9efc7-abb2-4ca6-85a8-3f7fce588425 tempest-TestVolumeBootPattern-1341811025 tempest-TestVolumeBootPattern-1341811025-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1335563694" status: 202 len: 0 microversion: 2.1 time: 0.025901 Sep 25 01:54:22.407562 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3301/6627] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 25 01:54:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1335563694 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:54:23.818346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:23.819007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:23.821820 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=29 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:23.827966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:23.828467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:23.828920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:23.829655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:23.830124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:23.830565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:23.833330 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=59 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:24.001265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:24.009966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73deef85-e538-4b8e-b191-a35a11683e63 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1683 microversion: 2.1 time: 0.195259 Sep 25 01:54:24.011100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3327/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:23 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:24.129168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:24.132472 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:24.138713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:24.139296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:24.139838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:24.140630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:24.141780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:24.142294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:24.210406 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9582f689-a77c-4509-837f-6701bc2582af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action" status: 200 len: 32646 microversion: 2.1 time: 0.085962 Sep 25 01:54:24.211719 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3302/6629] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:54:24 2022] POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action => generated 32646 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:54:24.550619 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:24.551255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:24.559799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:24.560302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:24.560922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:24.561854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:24.562326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:24.562764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:24.704918 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13ebc039-d81b-49cb-a7ab-9a951f71e9aa tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1834 microversion: 2.1 time: 0.293606 Sep 25 01:54:24.705547 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3328/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:24 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1834 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:24.736124 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:24.738794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:24.746156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:24.746757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:24.747782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:24.748571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:24.749105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:24.749645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:24.790177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lazy-loading 'flavor' on Instance uuid 03e5c665-61a2-4a99-b28c-33e629e3ae61 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:54:24.803841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Going to try to live migrate instance to another host {{(pid=122384) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 25 01:54:24.848485 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:27.180853 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75c7a1b6-878b-4622-8cf6-e3fb67506d1a tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action" status: 202 len: 0 microversion: 2.1 time: 2.448821 Sep 25 01:54:27.181934 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3303/6631] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:54:24 2022] POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action => generated 0 bytes in 2451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:54:27.191145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:27.191794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:27.200698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:27.201221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:27.201719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:27.202460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:27.202940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:27.203392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:27.373795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:27.385682 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-98a6c936-a136-4b0e-b56c-5b090cb8a6fe tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.198365 Sep 25 01:54:27.387084 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3329/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:27 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:28.419678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:28.420732 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:28.423768 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:28.442108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:28.442991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:28.443736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:28.444811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:28.445475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:28.446092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:28.715539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:28.724525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2dfa8bc7-bb70-40a4-b273-5578f46d28d6 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.314278 Sep 25 01:54:28.725306 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3304/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:28 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:54:28.836457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-8d7d4cd0-52fa-4556-b3a6-c98fbe6a80d6 req-30ce09be-e53e-4ba5-991b-7db5b320814d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "name": "network-vif-unplugged", "status": "completed", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:28.847876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8d7d4cd0-52fa-4556-b3a6-c98fbe6a80d6 req-30ce09be-e53e-4ba5-991b-7db5b320814d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:28.848376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8d7d4cd0-52fa-4556-b3a6-c98fbe6a80d6 req-30ce09be-e53e-4ba5-991b-7db5b320814d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:28.848912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-8d7d4cd0-52fa-4556-b3a6-c98fbe6a80d6 req-30ce09be-e53e-4ba5-991b-7db5b320814d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:28.860922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-8d7d4cd0-52fa-4556-b3a6-c98fbe6a80d6 req-30ce09be-e53e-4ba5-991b-7db5b320814d service nova] Creating event network-vif-unplugged:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h2-master-1 Sep 25 01:54:28.866488 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-8d7d4cd0-52fa-4556-b3a6-c98fbe6a80d6 req-30ce09be-e53e-4ba5-991b-7db5b320814d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034954 Sep 25 01:54:28.867107 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3330/6634] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:54:29.750364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:29.751480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:29.759193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:29.759689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:29.760317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:29.761038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:29.761538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:29.761976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:29.920728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:29.928639 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67d74413-d016-40da-908e-a72de28b0a10 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.182962 Sep 25 01:54:29.929219 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3305/6635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:29 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:30.909122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-717cd81d-24c2-44d5-bda6-add15ac6cd58 req-13a175e2-f4d5-4681-98e0-3607598e6f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:30.921233 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-717cd81d-24c2-44d5-bda6-add15ac6cd58 req-13a175e2-f4d5-4681-98e0-3607598e6f44 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:30.921764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-717cd81d-24c2-44d5-bda6-add15ac6cd58 req-13a175e2-f4d5-4681-98e0-3607598e6f44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:30.922208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-717cd81d-24c2-44d5-bda6-add15ac6cd58 req-13a175e2-f4d5-4681-98e0-3607598e6f44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:30.934839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-717cd81d-24c2-44d5-bda6-add15ac6cd58 req-13a175e2-f4d5-4681-98e0-3607598e6f44 service nova] Creating event network-changed:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h2-master-1 Sep 25 01:54:30.940419 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-717cd81d-24c2-44d5-bda6-add15ac6cd58 req-13a175e2-f4d5-4681-98e0-3607598e6f44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035726 Sep 25 01:54:30.941044 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3331/6636] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:54:30.953324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:30.953991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:30.961879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:30.962378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:30.962834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:30.963552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:30.964016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:30.964438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:31.214913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:31.224301 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a074241b-0105-43d7-9094-858834fd7567 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.275755 Sep 25 01:54:31.224944 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3306/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:30 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:32.252060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:32.252806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:32.259013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:32.259446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:32.259900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:32.260597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:32.261061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:32.261525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:32.394947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:32.403706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-440c46cd-39e9-4fff-abe9-31764fd90d3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.157746 Sep 25 01:54:32.404282 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3332/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:32 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:54:33.427031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:33.427661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:33.435102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:33.435592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:33.436038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:33.436734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:33.437198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:33.437658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:33.573527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:33.581690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-02142c87-2e79-4cb5-80da-75640bef40c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.158506 Sep 25 01:54:33.582272 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3307/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:33 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:34.605138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:34.605873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:34.612940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:34.613478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:34.613945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:34.614664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:34.615144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:34.615593 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:34.756627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:34.765185 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1297ccec-99db-428a-b5f7-68931c5f1800 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.163992 Sep 25 01:54:34.765835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3333/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:34 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:35.789271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:35.789919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:35.797184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:35.797694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:35.798138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:35.798825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:35.799280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:35.799705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:35.938912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:35.947009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8b8d943a-e7f1-484f-a700-d3b53743aeeb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1693 microversion: 2.1 time: 0.161637 Sep 25 01:54:35.947600 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3308/6641] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:35 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:36.972132 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:36.972778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:36.982222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:36.982736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:36.983202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:36.983936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:36.984418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:36.984871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.117144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:37.125176 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8e7d77a2-bd1a-4459-9257-30cd25331b5d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1683 microversion: 2.1 time: 0.157922 Sep 25 01:54:37.125800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3334/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:36 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:54:37.147887 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:37.148808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:37.156423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:37.156916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:37.157367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.158109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:37.158572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:37.159007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.297221 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf73cc90-89b8-411f-8b26-d88f86c53ddb tempest-TestNetworkAdvancedServerOps-131871064 tempest-TestNetworkAdvancedServerOps-131871064-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1834 microversion: 2.1 time: 0.152989 Sep 25 01:54:37.298239 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3309/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:37 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1834 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:54:37.321152 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:37.321830 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:37.328775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:37.329628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:37.330104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.332289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:37.332972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:37.333626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.486637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:37.498729 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d3720e2-a738-4f3c-a90f-8a6636ded33c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1683 microversion: 2.1 time: 0.181597 Sep 25 01:54:37.499592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3335/6644] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:37 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:37.600477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:37.602750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:37.608875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:37.609369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:37.609844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.610548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:37.611010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:37.611448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:37.690485 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0fae7b28-1bc4-4ba2-963d-fef8e8e4e463 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action" status: 200 len: 38567 microversion: 2.1 time: 0.093678 Sep 25 01:54:37.691317 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3310/6645] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:54:37 2022] POST /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61/action => generated 38567 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:54:38.675010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2d1d1174-4b5a-48c2-ae83-1e6c335491f7 req-db2e4b97-83b1-46f7-9ac1-a63c09974371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:38.682008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:38.682554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:38.689777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:38.690296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:38.690557 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d1d1174-4b5a-48c2-ae83-1e6c335491f7 req-db2e4b97-83b1-46f7-9ac1-a63c09974371 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:38.690763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:38.691049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d1d1174-4b5a-48c2-ae83-1e6c335491f7 req-db2e4b97-83b1-46f7-9ac1-a63c09974371 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:38.691490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2d1d1174-4b5a-48c2-ae83-1e6c335491f7 req-db2e4b97-83b1-46f7-9ac1-a63c09974371 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:38.691601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:38.692015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:38.692470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:38.708861 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2d1d1174-4b5a-48c2-ae83-1e6c335491f7 req-db2e4b97-83b1-46f7-9ac1-a63c09974371 service nova] Creating event network-changed:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h1-master-1 Sep 25 01:54:38.714153 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2d1d1174-4b5a-48c2-ae83-1e6c335491f7 req-db2e4b97-83b1-46f7-9ac1-a63c09974371 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043107 Sep 25 01:54:38.715043 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3311/6646] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:54:38.724411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:54:38.805371 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-21a5c61b-69c0-451d-920d-8d76eecd017f tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 204 len: 0 microversion: 2.1 time: 0.139258 Sep 25 01:54:38.809974 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3336/6647] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:54:38 2022] DELETE /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:54:38.817110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:38.817859 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:38.825272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:38.825830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:38.826280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:38.827220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:38.828029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:38.829494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:38.966816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:38.975191 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-38d53ab6-d9bf-4fe9-9dca-12f3dda1d23e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1689 microversion: 2.1 time: 0.163178 Sep 25 01:54:38.975771 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3312/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:38 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:39.999090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:39.999858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:40.006473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:40.006986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:40.007449 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:40.008172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:40.008644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:40.009095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:40.078145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:40.086148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-491e2e93-684e-4483-a6a1-64a019151554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 200 len: 1351 microversion: 2.1 time: 0.092051 Sep 25 01:54:40.086727 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3337/6649] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:39 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:40.731166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5055b2cf-f7c3-4457-91fd-c5d666a8b3af req-3355d821-9358-40bf-bca5-441dde2b9d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e5c665-61a2-4a99-b28c-33e629e3ae61", "name": "network-vif-deleted", "tag": "2ee50f2d-74b8-494d-b7ba-3422f2b43247"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:40.741359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5055b2cf-f7c3-4457-91fd-c5d666a8b3af req-3355d821-9358-40bf-bca5-441dde2b9d26 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:40.741882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5055b2cf-f7c3-4457-91fd-c5d666a8b3af req-3355d821-9358-40bf-bca5-441dde2b9d26 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:40.742324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5055b2cf-f7c3-4457-91fd-c5d666a8b3af req-3355d821-9358-40bf-bca5-441dde2b9d26 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:40.756608 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5055b2cf-f7c3-4457-91fd-c5d666a8b3af req-3355d821-9358-40bf-bca5-441dde2b9d26 service nova] Creating event network-vif-deleted:2ee50f2d-74b8-494d-b7ba-3422f2b43247 for instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 on n-h1-master-1 Sep 25 01:54:40.761498 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5055b2cf-f7c3-4457-91fd-c5d666a8b3af req-3355d821-9358-40bf-bca5-441dde2b9d26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034289 Sep 25 01:54:40.762155 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3313/6650] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:54:41.111133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:41.111804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 03e5c665-61a2-4a99-b28c-33e629e3ae61] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:41.118671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:41.119177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:41.119643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:41.120370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:41.120850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:41.121303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:41.136584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] HTTP exception thrown: Instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 could not be found. Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Request method failure captured: Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 HTTP/1.1 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Nob4r3tr2Imx8l38IewJ1BarkA00tQHpkr4a0KPWRKsiG0TwSrecs4vJrUdJ1vjJRUQaNvpRInoaocKSH-TdloVfDriXoflyRq-tKDRE6NUOetvkwShAH9zBdCmnNn30LyD2IToQtrZSNp3EcWO96l-BZsdreYXwl1wno9AZYfl38 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2935e753a36e4a25b0362b13a4c12ebf"}]}] Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7d3b3eec24d94748b8b55a52a0e3e422 Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 could not be found. Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '03e5c665-61a2-4a99-b28c-33e629e3ae61'} Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 could not be found. Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 could not be found. Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:41.138399 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 could not be found. Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Returning 404 to user: Instance 03e5c665-61a2-4a99-b28c-33e629e3ae61 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b0aa216-0b23-46d3-b825-53eb0ef26efa tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61" status: 404 len: 111 microversion: 2.1 time: 0.033714 Sep 25 01:54:41.142077 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3338/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:41 2022] GET /compute/v2.1/servers/03e5c665-61a2-4a99-b28c-33e629e3ae61 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:54:44.445052 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4076bb47-974b-4491-919a-8c2904cf6009 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '.version_select at 0x7f7bea9ef1f0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:44.464857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4076bb47-974b-4491-919a-8c2904cf6009 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1677393960" status: 202 len: 0 microversion: 2.1 time: 0.024015 Sep 25 01:54:44.466658 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3314/6652] 10.222.0.16 () {58 vars in 1284 bytes} [Sun Sep 25 01:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1677393960 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:54:44.500438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b494ee56-e1a3-4d7e-85a7-84c6c7881ae2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: .version_select at 0x7f7beace6160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-861511934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEc4GoSzRpIh5zHEfVeMh7tiVhnpJiq2IRTxyNJDYRmecgTMsrDhlu4JzmwhSjjIqPwab6DWYOdHiUO6BzfISYsDalcgXjOJYy+IY+0ZDL/Fkti+83prJr9zxXap5Chw=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:44.518614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-b494ee56-e1a3-4d7e-85a7-84c6c7881ae2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:54:44.523811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-b494ee56-e1a3-4d7e-85a7-84c6c7881ae2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:54:44.548265 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b494ee56-e1a3-4d7e-85a7-84c6c7881ae2 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052575 Sep 25 01:54:44.548864 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3339/6653] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:54:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:54:50.165927 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-128347554", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "31309c26-9ecd-4daa-b55e-80954b4809da"}], "key_name": "tempest-TestNetworkAdvancedServerOps-861511934", "security_groups": [{"name": "tempest-secgroup-smoke-1038404901"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:50.283224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] validate_networks() for [('31309c26-9ecd-4daa-b55e-80954b4809da', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:54:50.691161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:54:50.691595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:54:50.692078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:54:50.692500 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:54:50.692919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:54:50.702891 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:50.703383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:50.703833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:50.704572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:50.705036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:50.705496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:50.723819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:54:50.729131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Getting quotas for user 7d3b3eec24d94748b8b55a52a0e3e422 and project 2935e753a36e4a25b0362b13a4c12ebf. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:54:50.741996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:54:50.744436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:54:50.793020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e315af0d-8849-4e18-bd2a-e906227f717a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.632441 Sep 25 01:54:50.794106 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3315/6654] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:54:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:54:50.806985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6dcdf3d2-431c-43f3-9bc6-1a21fb6122f9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:50.807561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6dcdf3d2-431c-43f3-9bc6-1a21fb6122f9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:50.862448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6dcdf3d2-431c-43f3-9bc6-1a21fb6122f9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:50.869822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6dcdf3d2-431c-43f3-9bc6-1a21fb6122f9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1265 microversion: 2.1 time: 0.066741 Sep 25 01:54:50.870638 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3340/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:50 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:51.895006 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:51.895637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:51.910855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:51.911556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:51.912223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:51.913395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:51.914304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:51.915048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:52.008168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:52.019406 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10191d2e-97d6-4889-9dc9-104e78c606af tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1317 microversion: 2.1 time: 0.128835 Sep 25 01:54:52.029580 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3316/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:51 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:53.042430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:53.043384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:53.045590 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:53.055910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:53.056466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:53.056931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:53.057706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:53.058188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:53.058681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:53.505712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:53.514812 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5715e1e2-2c7a-4c41-bbd4-09f841541f1a tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.475843 Sep 25 01:54:53.516258 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3341/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:53 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:54.153464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f1ca15b0-011a-40bb-8079-2fec77e02999 req-a9fea095-6231-421e-b36d-03aee7494b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375a6796-9bf3-41c8-9bd4-9fb412064a60", "tag": "2b43521c-0ba7-47c3-8dd2-943f3cb5849c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:54:54.165137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f1ca15b0-011a-40bb-8079-2fec77e02999 req-a9fea095-6231-421e-b36d-03aee7494b0b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:54.165715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f1ca15b0-011a-40bb-8079-2fec77e02999 req-a9fea095-6231-421e-b36d-03aee7494b0b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:54.166251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f1ca15b0-011a-40bb-8079-2fec77e02999 req-a9fea095-6231-421e-b36d-03aee7494b0b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:54.179269 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f1ca15b0-011a-40bb-8079-2fec77e02999 req-a9fea095-6231-421e-b36d-03aee7494b0b service nova] Creating event network-changed:2b43521c-0ba7-47c3-8dd2-943f3cb5849c for instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 on n-h1-master-1 Sep 25 01:54:54.184921 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f1ca15b0-011a-40bb-8079-2fec77e02999 req-a9fea095-6231-421e-b36d-03aee7494b0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035840 Sep 25 01:54:54.185650 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3317/6658] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:54:54.540057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:54.541339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:54.544027 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:54.549419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:54.549954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:54.550423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:54.551152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:54.551633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:54.552084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:54.712179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:54.720611 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ef55c412-37cd-41dc-9cb9-f8920ee973b1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.184703 Sep 25 01:54:54.721204 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3342/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:54 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:55.744698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:55.745428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:55.751924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:55.752424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:55.752867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:55.753607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:55.754075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:55.754515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:55.758951 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:54:55.987935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:55.996535 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3af5499c-a14b-4ee6-91e6-715ee29b8905 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.256841 Sep 25 01:54:55.997237 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3318/6660] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:55 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:57.019993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:57.020628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:57.028198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:57.028765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:57.029227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:57.029961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:57.030695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:57.031138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:57.165805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:57.174154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e8c19f0-dc76-4d57-ac27-4cd121aa3113 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.158111 Sep 25 01:54:57.174731 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3343/6661] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:57 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:58.196982 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:58.197623 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:58.204839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:58.205321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:58.205788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:58.206479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:58.206927 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:58.207349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:58.338718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:58.346545 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-639da790-fe56-475b-aad0-a69d88a494f4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.153521 Sep 25 01:54:58.347127 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3319/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:58 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:54:59.369341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:54:59.370022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:54:59.377689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:59.378193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:59.378650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:59.379357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:54:59.379831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:54:59.380295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:54:59.516426 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:54:59.524484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23d51791-e1a9-4e72-9c6f-d2d5be68dcd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.159112 Sep 25 01:54:59.525056 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3344/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:54:59 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:00.547800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:00.548450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:00.551200 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:00.556631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:00.557127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:00.557616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:00.558351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:00.558816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:00.559251 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:00.692637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:00.701128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6e1d936-988a-4761-b340-dcfc18163fd3 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.157383 Sep 25 01:55:00.701731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3320/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:00 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:01.250719 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:01.381419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-db47393b-4288-4091-9c49-f2f2bcec563e req-fdc1a11b-ef80-485c-9f6f-5256ce7210c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375a6796-9bf3-41c8-9bd4-9fb412064a60", "name": "network-vif-plugged", "status": "completed", "tag": "2b43521c-0ba7-47c3-8dd2-943f3cb5849c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:55:01.391180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-db47393b-4288-4091-9c49-f2f2bcec563e req-fdc1a11b-ef80-485c-9f6f-5256ce7210c3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:01.391681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-db47393b-4288-4091-9c49-f2f2bcec563e req-fdc1a11b-ef80-485c-9f6f-5256ce7210c3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:01.392134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-db47393b-4288-4091-9c49-f2f2bcec563e req-fdc1a11b-ef80-485c-9f6f-5256ce7210c3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:01.403174 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-db47393b-4288-4091-9c49-f2f2bcec563e req-fdc1a11b-ef80-485c-9f6f-5256ce7210c3 service nova] Creating event network-vif-plugged:2b43521c-0ba7-47c3-8dd2-943f3cb5849c for instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 on n-h1-master-1 Sep 25 01:55:01.408530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-db47393b-4288-4091-9c49-f2f2bcec563e req-fdc1a11b-ef80-485c-9f6f-5256ce7210c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163268 Sep 25 01:55:01.409128 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3345/6665] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:55:01.724697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:01.725310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:01.727151 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:01.727813 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:01.735317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:01.735795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:01.736232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:01.736922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:01.737373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:01.737825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:01.871348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:01.879246 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6f888f99-b470-4d4c-b4a3-0fa4663ab6cc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1391 microversion: 2.1 time: 0.158489 Sep 25 01:55:01.879853 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3321/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:01 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:02.904351 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:02.905199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:02.911747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:02.912260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:02.912833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:02.913556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:02.914104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:02.914602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:03.049523 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:03.057442 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3510ccc-ac8e-4003-87da-7f49bd764683 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1563 microversion: 2.1 time: 0.158467 Sep 25 01:55:03.058014 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3346/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:02 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:03.079357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:03.079985 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:03.086869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:03.087363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:03.087817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:03.088525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:03.088989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:03.090145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:03.226391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:03.235173 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e58a893d-4bba-4fc9-aef1-848bdaea729d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1563 microversion: 2.1 time: 0.159685 Sep 25 01:55:03.235747 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3322/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:03 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:04.823013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:04.825246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:04.825610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-ae069cae-fe1a-4eac-9a1b-81de0aa01e22 req-56a937bc-bd80-4aa7-9cc4-d1bfeee2bb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375a6796-9bf3-41c8-9bd4-9fb412064a60", "tag": "2b43521c-0ba7-47c3-8dd2-943f3cb5849c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:55:04.832672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:04.833229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:04.833730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:04.834469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:04.834953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:04.835404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:04.838113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae069cae-fe1a-4eac-9a1b-81de0aa01e22 req-56a937bc-bd80-4aa7-9cc4-d1bfeee2bb44 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:04.838113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae069cae-fe1a-4eac-9a1b-81de0aa01e22 req-56a937bc-bd80-4aa7-9cc4-d1bfeee2bb44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:04.838113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-ae069cae-fe1a-4eac-9a1b-81de0aa01e22 req-56a937bc-bd80-4aa7-9cc4-d1bfeee2bb44 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:04.851928 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-ae069cae-fe1a-4eac-9a1b-81de0aa01e22 req-56a937bc-bd80-4aa7-9cc4-d1bfeee2bb44 service nova] Creating event network-changed:2b43521c-0ba7-47c3-8dd2-943f3cb5849c for instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 on n-h1-master-1 Sep 25 01:55:04.857708 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-ae069cae-fe1a-4eac-9a1b-81de0aa01e22 req-56a937bc-bd80-4aa7-9cc4-d1bfeee2bb44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036306 Sep 25 01:55:04.858805 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3323/6669] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:55:05.061153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:05.069210 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-209a706d-f5ea-4ccc-81da-b0e0a9566eb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1563 microversion: 2.1 time: 0.250987 Sep 25 01:55:05.070181 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3347/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:04 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:30.336229 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:30.336904 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=31 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:30.342178 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:55:30.344457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:30.351458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:30.351977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:30.352424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:30.353123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:30.353616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:30.354052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:30.425661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3fcf487e-9620-4bc8-a6c1-2635d1384bb0 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60/action" status: 200 len: 24566 microversion: 2.1 time: 0.091292 Sep 25 01:55:30.426364 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3324/6671] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:55:30 2022] POST /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60/action => generated 24566 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:55:41.522679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:55:41.525520 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:41.528429 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=11 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:41.529393 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=38 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:41.538037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:41.538515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:41.538973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:41.539694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:41.540179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:41.540626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:41.619948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:55:41.620423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:55:41.620921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:55:41.621354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:55:41.621821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:55:41.682104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:41.688494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:41.688989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:41.689484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:41.690220 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:41.690697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:41.691180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:41.718848 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d2801962-dc2d-468f-ae16-4d2afe2dfcee tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60/action" status: 202 len: 1137 microversion: 2.1 time: 0.202748 Sep 25 01:55:41.719509 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3348/6672] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:55:41 2022] POST /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60/action => generated 1137 bytes in 204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 25 01:55:41.739610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:41.740328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:41.744219 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:41.745079 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:55:41.753796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:41.754295 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:41.754809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:41.755630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:41.756113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:41.756551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:41.892891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:41.900739 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-775008b0-7326-4b74-ad9c-af5ba0d36abb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.165410 Sep 25 01:55:41.901314 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3325/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:41 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:42.924839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:42.925509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:42.932408 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:42.932914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:42.933376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:42.934113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:42.934600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:42.935050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:43.065699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:43.073522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d08aec74-bddf-4123-a524-4e4839563bfc tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.152819 Sep 25 01:55:43.074099 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3349/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:42 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:44.096773 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:44.097447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:44.104328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:44.104818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:44.105264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:44.105998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:44.106463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:44.106899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:44.241853 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:44.250463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a02783af-b8b4-4155-a296-e50be9c9a692 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.158263 Sep 25 01:55:44.251033 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3326/6675] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:44 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:45.274067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:45.274700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:45.282454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:45.282956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:45.283412 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:45.284124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:45.284595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:45.285039 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:45.415773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:45.423834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0eb595c6-fb65-44a2-903c-ae60bb03342b tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.153764 Sep 25 01:55:45.424400 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3350/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:45 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:46.447700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:46.448322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:46.456866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:46.456866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:46.456866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:46.457360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:46.457509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:46.457937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:46.596083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:46.603860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a5c5c48-b358-42bc-a6da-09893e3fb18c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.160100 Sep 25 01:55:46.604418 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3327/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:46 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:47.628459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:47.629093 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:47.635958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:47.636461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:47.636922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:47.637660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:47.638137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:47.638583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:47.771680 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:47.779642 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-635efc96-94f4-42b4-9372-f03e66dc8cfd tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.155056 Sep 25 01:55:47.780256 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3351/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:47 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:48.803612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:48.804238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:48.811332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:48.811831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:48.812277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:48.812986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:48.813543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:48.813985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:48.945968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:48.954011 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fde8268e-c153-4b2b-97a9-d8afe8ec29f7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.154415 Sep 25 01:55:48.954605 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3328/6679] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:48 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:49.977896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:49.978447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:49.986121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:49.986628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:49.987091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:49.987819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:49.988326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:49.988778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:50.126205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:50.133922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92f75ef1-ba88-40b1-a33f-4f36d59758a1 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.160112 Sep 25 01:55:50.134500 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3352/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:49 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:51.158993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:51.159612 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:51.166474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:51.166959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:51.167397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:51.168092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:51.168550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:51.168980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:51.300196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:51.307886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc72619d-f214-4779-b4fb-c0914ba984c7 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.153782 Sep 25 01:55:51.308458 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3329/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:51 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:52.337506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:52.338075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:52.346206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:52.346709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:52.347213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:52.347922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:52.348421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:52.348861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:52.484723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:52.492553 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ea69f7e6-824e-47aa-a613-4f6e93171eb4 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.159059 Sep 25 01:55:52.493126 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3353/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:52 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:53.516110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:53.516856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:53.524841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:53.525338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:53.525814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:53.526530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:53.526995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:53.527434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:53.658655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:53.666456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f413d2d2-c64d-43e7-8556-ea0d2d2ebd7c tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.154371 Sep 25 01:55:53.667034 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3330/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:53 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:54.691088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:54.691641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:54.698174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:54.698672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:54.699127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:54.699829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:54.700296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:54.700739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:54.836519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:54.844936 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eec0a462-12f7-4c9c-87d2-3214e208b125 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.157776 Sep 25 01:55:54.845580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3354/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:54 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:55.868231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:55.868858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:55.875540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:55.876032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:55.876465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:55.877167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:55.877660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:55.878091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:56.007909 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:56.015661 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11400f4d-98c2-4311-9a9b-018960d425ec tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.151568 Sep 25 01:55:56.016340 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3331/6685] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:55 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:57.038946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:57.039579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:57.046632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:57.047132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:57.048159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:57.048869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:57.049345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:57.049813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:57.179574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:57.187265 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b95b54b1-a0e6-4837-9ab2-6f2cc16b221d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.152254 Sep 25 01:55:57.187870 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3355/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:57 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:58.211088 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:58.211711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:58.218546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:58.219035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:58.219478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:58.220170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:58.220639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:58.221060 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:58.478524 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:58.487139 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3f665d9-a009-4a5a-9121-09a3af545c23 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1691 microversion: 2.1 time: 0.280047 Sep 25 01:55:58.487727 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3332/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:58 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:55:59.510947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:55:59.511613 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:55:59.519511 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:59.520156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:59.520673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:59.521514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:55:59.522580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:55:59.523041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:55:59.709548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:55:59.717271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-540c6db9-d712-434c-ab31-a8bae14218ed tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1697 microversion: 2.1 time: 0.210298 Sep 25 01:55:59.717862 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3356/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:55:59 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:56:00.740856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:00.741448 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:00.748287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:00.748772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:00.749214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:00.749969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:00.750454 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:00.751029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:00.891568 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:56:00.899617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-df91b3fc-5dcf-47c0-aec5-7e8e032767d9 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1697 microversion: 2.1 time: 0.162820 Sep 25 01:56:00.900194 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3333/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:56:00 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:56:01.924483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:01.925046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:01.932034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:01.932535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:01.932993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:01.933812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:01.934290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:01.934734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:02.068071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:56:02.075893 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-478b412f-6794-459e-9696-a1b530096893 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1682 microversion: 2.1 time: 0.156154 Sep 25 01:56:02.076479 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3357/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:56:01 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:56:03.542214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-cbfb493b-6707-4b56-a867-1e103b83f273 req-4bbf66bf-48af-4991-8e59-061f1c6b8abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375a6796-9bf3-41c8-9bd4-9fb412064a60", "name": "network-vif-plugged", "status": "completed", "tag": "2b43521c-0ba7-47c3-8dd2-943f3cb5849c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:56:03.554323 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cbfb493b-6707-4b56-a867-1e103b83f273 req-4bbf66bf-48af-4991-8e59-061f1c6b8abe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:03.554815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cbfb493b-6707-4b56-a867-1e103b83f273 req-4bbf66bf-48af-4991-8e59-061f1c6b8abe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:03.555322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cbfb493b-6707-4b56-a867-1e103b83f273 req-4bbf66bf-48af-4991-8e59-061f1c6b8abe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:03.570286 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-cbfb493b-6707-4b56-a867-1e103b83f273 req-4bbf66bf-48af-4991-8e59-061f1c6b8abe service nova] Creating event network-vif-plugged:2b43521c-0ba7-47c3-8dd2-943f3cb5849c for instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 on n-h1-master-1 Sep 25 01:56:03.575458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-cbfb493b-6707-4b56-a867-1e103b83f273 req-4bbf66bf-48af-4991-8e59-061f1c6b8abe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036981 Sep 25 01:56:03.576066 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3334/6691] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:56:26.275942 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:56:26.278215 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:26.281132 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=24 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:26.282601 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:26.289274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:26.289809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:26.290273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:26.290990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:26.291467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:26.291916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:26.361332 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f278dd79-f8cb-451d-91c2-c9ea1c5335bb tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "POST /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60/action" status: 200 len: 24563 microversion: 2.1 time: 0.089365 Sep 25 01:56:26.362019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3358/6692] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:56:26 2022] POST /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60/action => generated 24563 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:56:38.351708 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=20 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:38.352870 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=56 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:38.355528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-597b72ed-77db-4bc5-9b9f-91e941c1ba9d req-58151a95-c7eb-47d7-975b-b497eeffaae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375a6796-9bf3-41c8-9bd4-9fb412064a60", "tag": "2b43521c-0ba7-47c3-8dd2-943f3cb5849c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:56:38.357685 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:38.358291 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:38.362090 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:38.364292 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:56:38.366951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:38.367858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:38.368299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:38.369369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:38.370057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:38.370499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:38.371194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-597b72ed-77db-4bc5-9b9f-91e941c1ba9d req-58151a95-c7eb-47d7-975b-b497eeffaae3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:38.371697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-597b72ed-77db-4bc5-9b9f-91e941c1ba9d req-58151a95-c7eb-47d7-975b-b497eeffaae3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:38.372149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-597b72ed-77db-4bc5-9b9f-91e941c1ba9d req-58151a95-c7eb-47d7-975b-b497eeffaae3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:38.388921 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-597b72ed-77db-4bc5-9b9f-91e941c1ba9d req-58151a95-c7eb-47d7-975b-b497eeffaae3 service nova] Creating event network-changed:2b43521c-0ba7-47c3-8dd2-943f3cb5849c for instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 on n-h1-master-1 Sep 25 01:56:38.394883 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-597b72ed-77db-4bc5-9b9f-91e941c1ba9d req-58151a95-c7eb-47d7-975b-b497eeffaae3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043627 Sep 25 01:56:38.395697 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3359/6693] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:56:38.398678 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:56:38.484902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-501c4e95-6a61-44ed-914e-fd701ec76518 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 204 len: 0 microversion: 2.1 time: 0.135857 Sep 25 01:56:38.486581 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3335/6694] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:56:38 2022] DELETE /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:56:38.496059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:38.496888 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:38.504808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:38.505396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:38.506019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:38.506817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:38.507381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:38.507900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:38.989564 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:56:38.997477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ac8fb66-5855-4266-8e02-7d1135da6554 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1688 microversion: 2.1 time: 0.506488 Sep 25 01:56:38.998231 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3360/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:56:38 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1688 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:56:40.023352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:40.024220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:40.031125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:40.031616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:40.032065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:40.033282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:40.033921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:40.034483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:40.222872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:56:40.230992 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73fa17c3-86a7-4ffa-92ea-9c549182cb03 tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1688 microversion: 2.1 time: 0.211914 Sep 25 01:56:40.231798 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3336/6696] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:56:40 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:56:40.682546 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-4d999737-0ede-46dd-827d-e515eda7d823 req-21a8c9a2-698c-4a3c-a2e1-193de8478714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375a6796-9bf3-41c8-9bd4-9fb412064a60", "name": "network-vif-deleted", "tag": "2b43521c-0ba7-47c3-8dd2-943f3cb5849c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:56:40.693014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4d999737-0ede-46dd-827d-e515eda7d823 req-21a8c9a2-698c-4a3c-a2e1-193de8478714 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:40.693555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4d999737-0ede-46dd-827d-e515eda7d823 req-21a8c9a2-698c-4a3c-a2e1-193de8478714 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:40.694005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-4d999737-0ede-46dd-827d-e515eda7d823 req-21a8c9a2-698c-4a3c-a2e1-193de8478714 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:40.705125 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-4d999737-0ede-46dd-827d-e515eda7d823 req-21a8c9a2-698c-4a3c-a2e1-193de8478714 service nova] Creating event network-vif-deleted:2b43521c-0ba7-47c3-8dd2-943f3cb5849c for instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 on n-h1-master-1 Sep 25 01:56:40.710070 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-4d999737-0ede-46dd-827d-e515eda7d823 req-21a8c9a2-698c-4a3c-a2e1-193de8478714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103161 Sep 25 01:56:40.710662 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3361/6697] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:56:41.255288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:41.255818 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:41.262621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:41.263102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:41.263538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:41.264232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:41.264683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:41.265108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:41.297771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:41.298291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:41.299015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:41.299473 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lazy-loading 'fault' on Instance uuid 375a6796-9bf3-41c8-9bd4-9fb412064a60 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:56:41.342891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3b3eec24d94748b8b55a52a0e3e422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2935e753a36e4a25b0362b13a4c12ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:56:41.352356 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-560eb3a1-6290-4480-8aca-524e2463fd3d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 200 len: 1355 microversion: 2.1 time: 0.101480 Sep 25 01:56:41.353135 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3337/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:56:41 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:56:42.376755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:42.377421 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] [instance: 375a6796-9bf3-41c8-9bd4-9fb412064a60] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:56:42.384433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:42.384939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:42.385416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:42.386144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:56:42.386617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:56:42.387063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:56:42.401434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] HTTP exception thrown: Instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 could not be found. Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Request method failure captured: Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 HTTP/1.1 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Nob4r3tr2Imx8l38IewJ1BarkA00tQHpkr4a0KPWRKsiG0TwSrecs4vJrUdJ1vjJRUQaNvpRInoaocKSH-TdloVfDriXoflyRq-tKDRE6NUOetvkwShAH9zBdCmnNn30LyD2IToQtrZSNp3EcWO96l-BZsdreYXwl1wno9AZYfl38 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2935e753a36e4a25b0362b13a4c12ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2935e753a36e4a25b0362b13a4c12ebf"}]}] Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 2935e753a36e4a25b0362b13a4c12ebf Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-977698614 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 7d3b3eec24d94748b8b55a52a0e3e422 Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkAdvancedServerOps-977698614-project Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 could not be found. Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '375a6796-9bf3-41c8-9bd4-9fb412064a60'} Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 could not be found. Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 could not be found. Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:56:42.403129 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 could not be found. Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Returning 404 to user: Instance 375a6796-9bf3-41c8-9bd4-9fb412064a60 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b13d05d8-f1e9-4084-98c5-0f013749a50d tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60" status: 404 len: 111 microversion: 2.1 time: 0.033144 Sep 25 01:56:42.407652 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3362/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:56:42 2022] GET /compute/v2.1/servers/375a6796-9bf3-41c8-9bd4-9fb412064a60 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:56:45.363285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51c7f704-f14c-411e-9529-9a9b8ecb9e3e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] Calling method '.version_select at 0x7f7bea6b0790>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:56:45.385711 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51c7f704-f14c-411e-9529-9a9b8ecb9e3e tempest-TestNetworkAdvancedServerOps-977698614 tempest-TestNetworkAdvancedServerOps-977698614-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-861511934" status: 202 len: 0 microversion: 2.1 time: 0.026495 Sep 25 01:56:45.390976 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3338/6700] 10.222.0.16 () {58 vars in 1281 bytes} [Sun Sep 25 01:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-861511934 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:57:07.481127 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:07.481901 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:07.596587 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-939975364", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:07.648832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] validate_networks() for None {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:57:07.950032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:57:07.950470 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:57:07.950987 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:57:07.951410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:57:07.951847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:57:07.960782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:07.961280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:07.961775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:07.962514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:07.962986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:07.963424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:07.980604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Getting quotas for project 26011f6774e24fa3ac59faf52212870d. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:57:07.985854 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Getting quotas for user d632f58cc9544d9296097ce72ef268e0 and project 26011f6774e24fa3ac59faf52212870d. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:57:07.998536 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:57:08.000817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:57:08.045286 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a10b9e0b-6352-4a7d-bb2c-98e02b361c90 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569340 Sep 25 01:57:08.046034 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3363/6701] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:57:08.056889 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:08.057670 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:08.061834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4ef6865-ed85-401f-9703-565f5c3e4053 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:08.062456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4ef6865-ed85-401f-9703-565f5c3e4053 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:08.122634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4ef6865-ed85-401f-9703-565f5c3e4053 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:08.130440 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4ef6865-ed85-401f-9703-565f5c3e4053 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1221 microversion: 2.1 time: 0.075369 Sep 25 01:57:08.131012 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3339/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:08 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:09.155142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:09.156099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:09.163601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:09.164119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:09.164591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:09.165309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:09.165820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:09.166275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:09.228196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:09.236089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cec2061a-34f1-4e77-bf66-b02bac4dcd63 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1273 microversion: 2.1 time: 0.085764 Sep 25 01:57:09.236697 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3364/6703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:09 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:10.260319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:10.260942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:10.267753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:10.269179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:10.269989 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:10.270723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:10.271180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:10.271609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:10.509637 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:10.517288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1a985df-b310-4262-ad9c-a5616264e843 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.261032 Sep 25 01:57:10.517892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3340/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:10 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:10.982724 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c17cbbdf-2a7a-42bf-99b9-1342292d8151 req-52212866-e58c-40be-b155-6e72f053c600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad01985a-9ab1-484a-96bf-f2ad1664cb2a", "tag": "391e5f16-9ec0-4707-90ce-543c822ed9bb"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:10.992442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c17cbbdf-2a7a-42bf-99b9-1342292d8151 req-52212866-e58c-40be-b155-6e72f053c600 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:10.993194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c17cbbdf-2a7a-42bf-99b9-1342292d8151 req-52212866-e58c-40be-b155-6e72f053c600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:10.993681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c17cbbdf-2a7a-42bf-99b9-1342292d8151 req-52212866-e58c-40be-b155-6e72f053c600 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:11.005706 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c17cbbdf-2a7a-42bf-99b9-1342292d8151 req-52212866-e58c-40be-b155-6e72f053c600 service nova] Creating event network-changed:391e5f16-9ec0-4707-90ce-543c822ed9bb for instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a on n-h2-master-1 Sep 25 01:57:11.010723 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c17cbbdf-2a7a-42bf-99b9-1342292d8151 req-52212866-e58c-40be-b155-6e72f053c600 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105327 Sep 25 01:57:11.011324 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3365/6705] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:11.543474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:11.544100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:11.551334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:11.551821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:11.552262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:11.552961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:11.553447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:11.553886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:11.688454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:11.697330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-256d441e-65af-4cbe-9a83-57c9a266dbed tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.157813 Sep 25 01:57:11.697941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3341/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:11 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:12.722379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:12.723007 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:12.729250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:12.729785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:12.730242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:12.730947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:12.731423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:12.731866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:12.861016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:12.868905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ba65624-af62-4154-8bad-14f8c1ccaeb2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.152473 Sep 25 01:57:12.869501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3366/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:12 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:13.891110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:13.891731 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:13.899398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:13.899893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:13.900334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:13.901043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:13.901527 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:13.901959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:14.040724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:14.048546 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e29046ce-d733-4ff6-96f9-61e966e4c150 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.161376 Sep 25 01:57:14.049133 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3342/6708] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:13 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:15.071881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:15.072517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:15.079792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:15.080310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:15.080806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:15.081560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:15.082041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:15.082492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:15.214742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:15.223375 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ffe495e6-7fd3-4786-8ea0-d713ba543363 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.155434 Sep 25 01:57:15.223903 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3367/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:15 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:16.084797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9d04e8d5-e038-4cab-9fdb-36d8a124c9a0 req-c9d8777d-9a3c-4fc1-844b-9a5aa6607757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad01985a-9ab1-484a-96bf-f2ad1664cb2a", "name": "network-vif-plugged", "status": "completed", "tag": "391e5f16-9ec0-4707-90ce-543c822ed9bb"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:16.098766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9d04e8d5-e038-4cab-9fdb-36d8a124c9a0 req-c9d8777d-9a3c-4fc1-844b-9a5aa6607757 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:16.099444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9d04e8d5-e038-4cab-9fdb-36d8a124c9a0 req-c9d8777d-9a3c-4fc1-844b-9a5aa6607757 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:16.100617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9d04e8d5-e038-4cab-9fdb-36d8a124c9a0 req-c9d8777d-9a3c-4fc1-844b-9a5aa6607757 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:16.115617 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9d04e8d5-e038-4cab-9fdb-36d8a124c9a0 req-c9d8777d-9a3c-4fc1-844b-9a5aa6607757 service nova] Creating event network-vif-plugged:391e5f16-9ec0-4707-90ce-543c822ed9bb for instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a on n-h2-master-1 Sep 25 01:57:16.121790 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9d04e8d5-e038-4cab-9fdb-36d8a124c9a0 req-c9d8777d-9a3c-4fc1-844b-9a5aa6607757 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040347 Sep 25 01:57:16.122673 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3343/6710] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:57:16.245618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:16.246293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:16.253315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:16.254186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:16.255018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:16.255376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:16.255854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:16.256304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:16.410745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:16.424104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6feae5ba-6ef2-4c03-854a-020485d7b403 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.182316 Sep 25 01:57:16.429667 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3368/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:16 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:17.448760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:17.449498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:17.456936 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:17.457448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:17.457897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:17.458599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:17.459057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:17.459492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:17.590359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:17.598814 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-858a80fe-6365-45b3-923a-cb8edffddfa2 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1321 microversion: 2.1 time: 0.154360 Sep 25 01:57:17.599387 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3344/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:17 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:18.621738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:18.622376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:18.625192 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:18.626010 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:18.633027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:18.633558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:18.634022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:18.634728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:18.635212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:18.635656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:18.768316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:18.776223 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-37b600b6-ca70-49a1-9970-a03157291899 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1470 microversion: 2.1 time: 0.158575 Sep 25 01:57:18.776795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3369/6713] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:18 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:18.802082 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:18.859621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ca78a5d-2e1d-4237-a926-e6b6babf0510 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Calling method '.version_select at 0x7f7bea92d8b0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:18.925591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ca78a5d-2e1d-4237-a926-e6b6babf0510 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7fc9cc3e48084ed6827c73d740804219" status: 200 len: 371 microversion: 2.1 time: 0.128095 Sep 25 01:57:18.926165 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3345/6714] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:57:18 2022] GET /compute/v2.1/os-quota-sets/7fc9cc3e48084ed6827c73d740804219 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:18.939061 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-474ed824-a728-4e3d-9d58-3c42656403e5 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-294245166", "id": 378677586, "os-flavor-access:is_public": "True"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:18.956577 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-474ed824-a728-4e3d-9d58-3c42656403e5 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021329 Sep 25 01:57:18.957194 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3370/6715] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:57:18 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:18.969642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "378677586"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:18.971906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:18.978613 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:18.979102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:18.979548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:18.980270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:18.980804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:18.981226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.168595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc4a44689d67419f98d18a2dbd8dc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc9cc3e48084ed6827c73d740804219', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:19.175195 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-294245166 {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:57:19.181971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.182482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.182925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.183657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.184111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.184537 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.205737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Getting quotas for project 26011f6774e24fa3ac59faf52212870d. Resources: {'ram', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:57:19.211366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Getting quotas for user d632f58cc9544d9296097ce72ef268e0 and project 26011f6774e24fa3ac59faf52212870d. Resources: {'ram', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:57:19.223343 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] ram quota exceeded for 7fc9cc3e48084ed6827c73d740804219, tried to resize instance. Sep 25 01:57:19.223833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Request method failure captured: Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a/action HTTP/1.1 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 38 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Vz0jFPuJeFEphPWZA6FQ-JaKQxw49Uebcquewm5j6O2_D6Vytbk0l3-6ab-_fWgyBe86Dd6QkG8yu3CV4OROiG7qATb5_dwjG93kw8wfmTsEkRE9xqOMwaBALhZqlfgjooNXV4MAO-TCcfaInA1xX5uXsOQO2js8_nz8Wo99P0gFA Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 7fc9cc3e48084ed6827c73d740804219 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-476640040 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,admin,member Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,admin,member Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7fc9cc3e48084ed6827c73d740804219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7fc9cc3e48084ed6827c73d740804219"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7fc9cc3e48084ed6827c73d740804219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7fc9cc3e48084ed6827c73d740804219"}]}] Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersAdminNegativeTestJSON-476640040 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 7fc9cc3e48084ed6827c73d740804219 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-476640040 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersAdminNegativeTestJSON-476640040-project-admin Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: dc4a44689d67419f98d18a2dbd8dc357 Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersAdminNegativeTestJSON-476640040-project-admin Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: {"resize": {"flavorRef": "378677586"}} Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'ad01985a-9ab1-484a-96bf-f2ad1664cb2a', 'body': {'resize': {'flavorRef': '378677586'}}} Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:57:19.226672 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-03b72876-9382-4509-b741-827e6672da62 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a/action" status: 403 len: 118 microversion: 2.1 time: 0.262682 Sep 25 01:57:19.231190 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3346/6716] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:57:18 2022] POST /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a/action => generated 118 bytes in 264 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:57:19.237591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3b22ffe6-b147-4a17-a26c-06c8ac4dd5d3 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.253970 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3b22ffe6-b147-4a17-a26c-06c8ac4dd5d3 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/378677586" status: 202 len: 0 microversion: 2.1 time: 0.020375 Sep 25 01:57:19.254499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3371/6717] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 25 01:57:19 2022] DELETE /compute/v2.1/flavors/378677586 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:57:19.262373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-84d2568e-6d96-4ffb-bd4a-958e60f455e1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.286177 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-84d2568e-6d96-4ffb-bd4a-958e60f455e1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027444 Sep 25 01:57:19.286735 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3347/6718] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:57:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:57:19.307741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ca78209-ebcc-4316-a4f4-c67a9932dfc7 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Calling method '.version_select at 0x7f7bebd06d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.378521 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ca78209-ebcc-4316-a4f4-c67a9932dfc7 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7fc9cc3e48084ed6827c73d740804219" status: 200 len: 371 microversion: 2.1 time: 0.074730 Sep 25 01:57:19.379100 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3372/6719] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 25 01:57:19 2022] GET /compute/v2.1/os-quota-sets/7fc9cc3e48084ed6827c73d740804219 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:19.391420 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd0da864-7e7f-49e3-b229-29a7a3fabd3c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1802109935", "id": 1165098053, "os-flavor-access:is_public": "True"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:19.409905 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd0da864-7e7f-49e3-b229-29a7a3fabd3c tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022231 Sep 25 01:57:19.410493 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3348/6720] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:57:19 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:19.423367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1165098053"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:19.425773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:19.432655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.433155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.433639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.434608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.435089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.435534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.574672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc4a44689d67419f98d18a2dbd8dc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc9cc3e48084ed6827c73d740804219', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:19.580989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1802109935 {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:57:19.588388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.588895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.589354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.590138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.590620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.591060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.614399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Getting quotas for project 26011f6774e24fa3ac59faf52212870d. Resources: {'ram', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:57:19.619748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Getting quotas for user d632f58cc9544d9296097ce72ef268e0 and project 26011f6774e24fa3ac59faf52212870d. Resources: {'ram', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:57:19.634224 n-d-master-1 devstack@n-api.service[122385]: INFO nova.compute.api [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] cores quota exceeded for 7fc9cc3e48084ed6827c73d740804219, tried to resize instance. Sep 25 01:57:19.634803 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Request method failure captured: Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a/action HTTP/1.1 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 39 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Vz0jFPuJeFEphPWZA6FQ-JaKQxw49Uebcquewm5j6O2_D6Vytbk0l3-6ab-_fWgyBe86Dd6QkG8yu3CV4OROiG7qATb5_dwjG93kw8wfmTsEkRE9xqOMwaBALhZqlfgjooNXV4MAO-TCcfaInA1xX5uXsOQO2js8_nz8Wo99P0gFA Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 7fc9cc3e48084ed6827c73d740804219 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-476640040 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,admin,member Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,admin,member Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7fc9cc3e48084ed6827c73d740804219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7fc9cc3e48084ed6827c73d740804219"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7fc9cc3e48084ed6827c73d740804219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7fc9cc3e48084ed6827c73d740804219"}]}] Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-476640040 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 7fc9cc3e48084ed6827c73d740804219 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-476640040 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-476640040-project-admin Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: dc4a44689d67419f98d18a2dbd8dc357 Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-476640040-project-admin Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: {"resize": {"flavorRef": "1165098053"}} Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ad01985a-9ab1-484a-96bf-f2ad1664cb2a', 'body': {'resize': {'flavorRef': '1165098053'}}} Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:57:19.636858 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e83bf61b-8a8c-49b0-9d7a-f2920bae20c1 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a/action" status: 403 len: 113 microversion: 2.1 time: 0.218871 Sep 25 01:57:19.640958 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3373/6721] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:57:19 2022] POST /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a/action => generated 113 bytes in 220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:57:19.647076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e4e97d21-9a38-4b9c-8672-d9e10d567675 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.664846 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e4e97d21-9a38-4b9c-8672-d9e10d567675 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1165098053" status: 202 len: 0 microversion: 2.1 time: 0.021481 Sep 25 01:57:19.665422 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3349/6722] 10.222.0.16 () {58 vars in 1161 bytes} [Sun Sep 25 01:57:19 2022] DELETE /compute/v2.1/flavors/1165098053 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:57:19.673307 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4ee552d3-e5ee-4a26-ad55-fca0e95ed6e3 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.693053 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4ee552d3-e5ee-4a26-ad55-fca0e95ed6e3 tempest-ServersAdminNegativeTestJSON-476640040 tempest-ServersAdminNegativeTestJSON-476640040-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023355 Sep 25 01:57:19.693659 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3374/6723] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 25 01:57:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:57:19.715246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.715770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:19.721908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.722390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.722830 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.723522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.723974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.724429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.753003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:57:19.827867 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-757a513d-7549-4465-a437-b6edf2953bbc tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 204 len: 0 microversion: 2.1 time: 0.117021 Sep 25 01:57:19.828686 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3350/6724] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:57:19 2022] DELETE /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:57:19.837593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:19.838228 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:19.844121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.844615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.845065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.845822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:19.846311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:19.846774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:19.979722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:19.987890 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0311c029-5621-450d-944e-a722d757e977 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1476 microversion: 2.1 time: 0.154578 Sep 25 01:57:19.988465 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3375/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:19 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1476 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:21.012467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:21.013173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:21.020835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:21.021317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:21.021784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:21.022479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:21.023182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:21.023731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:21.158239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:21.167098 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-db6b970b-6f72-4478-8428-862adce2ea01 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1476 microversion: 2.1 time: 0.159805 Sep 25 01:57:21.167667 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3351/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:21 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:21.878428 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-38bc2601-c46c-4398-8b4f-14dea3298333 req-0a3bf8e2-b77a-4c92-af31-5eda6a301f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad01985a-9ab1-484a-96bf-f2ad1664cb2a", "name": "network-vif-deleted", "tag": "391e5f16-9ec0-4707-90ce-543c822ed9bb"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:21.893676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38bc2601-c46c-4398-8b4f-14dea3298333 req-0a3bf8e2-b77a-4c92-af31-5eda6a301f16 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:21.894095 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38bc2601-c46c-4398-8b4f-14dea3298333 req-0a3bf8e2-b77a-4c92-af31-5eda6a301f16 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:21.894558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-38bc2601-c46c-4398-8b4f-14dea3298333 req-0a3bf8e2-b77a-4c92-af31-5eda6a301f16 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:21.909245 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-38bc2601-c46c-4398-8b4f-14dea3298333 req-0a3bf8e2-b77a-4c92-af31-5eda6a301f16 service nova] Creating event network-vif-deleted:391e5f16-9ec0-4707-90ce-543c822ed9bb for instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a on n-h2-master-1 Sep 25 01:57:21.915912 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-38bc2601-c46c-4398-8b4f-14dea3298333 req-0a3bf8e2-b77a-4c92-af31-5eda6a301f16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041738 Sep 25 01:57:21.916529 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3376/6727] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:57:22.190751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:22.191302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:22.199143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:22.199630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:22.200072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:22.200769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:22.201227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:22.201689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:22.232512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:22.232992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:22.233451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:22.233905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lazy-loading 'fault' on Instance uuid ad01985a-9ab1-484a-96bf-f2ad1664cb2a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:57:22.275153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd632f58cc9544d9296097ce72ef268e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26011f6774e24fa3ac59faf52212870d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:22.283086 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6d923cd2-4665-473b-be93-82309a05470c tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 200 len: 1311 microversion: 2.1 time: 0.096311 Sep 25 01:57:22.283663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3352/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:22 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:23.306869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:23.307594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] [instance: ad01985a-9ab1-484a-96bf-f2ad1664cb2a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:23.314753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:23.315265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:23.315732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:23.316448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:23.316925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:23.317375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:23.331126 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] HTTP exception thrown: Instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a could not be found. Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Request method failure captured: Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a HTTP/1.1 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Vyd_mRxRfDqx14A1xLcDFzRlEvUor_J4wOdEPIDPz1hFqcL4qxgS-BHdtsN6cbHk-nCq5aAAtx3Cbj22EoT_9ZX114mZsrSgU2TEgSoilTwK_kIKDQOsQiOepk0IeIDI9shKAvXBFbBDIXrhYLlOXtn6pPCwNfct2bcz-GrEPec44 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 26011f6774e24fa3ac59faf52212870d Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1700408377 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26011f6774e24fa3ac59faf52212870d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26011f6774e24fa3ac59faf52212870d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26011f6774e24fa3ac59faf52212870d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26011f6774e24fa3ac59faf52212870d"}]}] Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1700408377 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 26011f6774e24fa3ac59faf52212870d Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1700408377 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersAdminNegativeTestJSON-1700408377-project Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: d632f58cc9544d9296097ce72ef268e0 Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1700408377-project Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: exception: Instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a could not be found. Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'ad01985a-9ab1-484a-96bf-f2ad1664cb2a'} Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a could not be found. Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a could not be found. Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:23.332765 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a could not be found. Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] Returning 404 to user: Instance ad01985a-9ab1-484a-96bf-f2ad1664cb2a could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-454d9c76-f968-49c4-9a0a-d7f30d0aa641 tempest-ServersAdminNegativeTestJSON-1700408377 tempest-ServersAdminNegativeTestJSON-1700408377-project] 10.222.0.16 "GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a" status: 404 len: 111 microversion: 2.1 time: 0.031769 Sep 25 01:57:23.337739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3377/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:23 2022] GET /compute/v2.1/servers/ad01985a-9ab1-484a-96bf-f2ad1664cb2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:57:29.604928 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:29.605861 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:29.720756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1997446117", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "1156c8ba-e0e9-4ea0-9944-dd691bc2df71"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:29.773956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] validate_networks() for [('1156c8ba-e0e9-4ea0-9944-dd691bc2df71', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:57:30.154787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:57:30.155222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:57:30.155713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:57:30.156423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:57:30.156845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:57:30.169216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:30.169746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:30.170440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:30.171390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:30.171855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:30.172293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:30.191488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Getting quotas for project 69079674a8234d9d87d2d3c78561b958. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:57:30.196855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Getting quotas for user afb45cff708a4e40a27f57f5900a8442 and project 69079674a8234d9d87d2d3c78561b958. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:57:30.209633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:57:30.212220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:57:30.260364 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [27b0457f-6593-43d4-95eb-c65e040a7e37] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:57:31.268128 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [27b0457f-6593-43d4-95eb-c65e040a7e37] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47210. Sep 25 01:57:31.271997 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-95d57984-b09c-418b-a33e-6a1ddccc42e4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672564 Sep 25 01:57:31.272843 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3353/6730] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:57:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:57:31.283916 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-811b0bc9-234d-4583-98af-af675c3bac62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:31.284547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-811b0bc9-234d-4583-98af-af675c3bac62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:31.288718 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:31.290186 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:31.352559 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-811b0bc9-234d-4583-98af-af675c3bac62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:31.363036 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-811b0bc9-234d-4583-98af-af675c3bac62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1215 microversion: 2.1 time: 0.082227 Sep 25 01:57:31.365905 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3378/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:31 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:32.395969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:32.396617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:32.403046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:32.403543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:32.404306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:32.405184 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:32.406160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:32.406749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:32.484653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:32.492913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77e84cba-9907-4396-a883-2268a5e2ea4d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1267 microversion: 2.1 time: 0.108680 Sep 25 01:57:32.493528 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3354/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:32 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:33.516381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:33.517681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:33.521623 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=57 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:33.527348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:33.528085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:33.529363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:33.530879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:33.531828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:33.532388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:33.670469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:33.678339 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a28fb1d-5c25-4c3b-ba92-439d94329235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.166021 Sep 25 01:57:33.678936 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3379/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:33 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:34.481053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6dddfd58-14b4-4e4c-8f29-f8e8e27ebcf7 req-f228ad29-6fbd-4684-99f0-c47eac2ba028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46dcb668-0ce9-461f-bf1d-ccc634a924e9", "tag": "7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:34.492937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6dddfd58-14b4-4e4c-8f29-f8e8e27ebcf7 req-f228ad29-6fbd-4684-99f0-c47eac2ba028 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:34.493724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6dddfd58-14b4-4e4c-8f29-f8e8e27ebcf7 req-f228ad29-6fbd-4684-99f0-c47eac2ba028 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:34.494312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6dddfd58-14b4-4e4c-8f29-f8e8e27ebcf7 req-f228ad29-6fbd-4684-99f0-c47eac2ba028 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:34.512042 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6dddfd58-14b4-4e4c-8f29-f8e8e27ebcf7 req-f228ad29-6fbd-4684-99f0-c47eac2ba028 service nova] Creating event network-changed:7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf for instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 on n-h1-master-1 Sep 25 01:57:34.518579 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6dddfd58-14b4-4e4c-8f29-f8e8e27ebcf7 req-f228ad29-6fbd-4684-99f0-c47eac2ba028 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040589 Sep 25 01:57:34.520020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3355/6734] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:34.702295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:34.702936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:34.709897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:34.710406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:34.710869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:34.711794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:34.712274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:34.712718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:34.843060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:34.850748 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-898fcc42-1467-42b8-b927-8716583a391d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.152523 Sep 25 01:57:34.851956 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3380/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:34 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:35.874655 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:35.875370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:35.883229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:35.883720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:35.884171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:35.884872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:35.885334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:35.885793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:36.018822 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:36.027131 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f04ef82-7d06-4741-b83d-5e78490f6edb tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.156718 Sep 25 01:57:36.027737 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3356/6736] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:35 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:37.051010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:37.051647 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:37.058640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:37.059144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:37.059600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:37.060307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:37.060777 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:37.061218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:37.189075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:37.197394 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f104ebe4-10df-4dbe-9a0b-1564d28e2b62 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.150368 Sep 25 01:57:37.197983 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3381/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:37 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:38.220123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:38.220786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:38.223699 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:38.229580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:38.230137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:38.230504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:38.231241 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:38.231703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:38.232135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:38.235581 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:38.370584 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:38.378324 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0fa0049f-425d-48f4-92a6-a1f4e753ad8a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.162151 Sep 25 01:57:38.378905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3357/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:38 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:39.402609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:39.403267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:39.405908 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:39.411543 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:39.412040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:39.412498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:39.413200 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:39.414618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:39.415197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:39.547075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:39.555177 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ff57a4a2-4255-467a-aec3-5be551ae59d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.157117 Sep 25 01:57:39.555755 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3382/6739] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:39 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:40.005742 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6cacba4a-8672-4932-91be-e1fb0c3febda req-b5c731f8-a4ec-47be-8c6f-ba7123664756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46dcb668-0ce9-461f-bf1d-ccc634a924e9", "name": "network-vif-plugged", "status": "completed", "tag": "7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:40.018473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6cacba4a-8672-4932-91be-e1fb0c3febda req-b5c731f8-a4ec-47be-8c6f-ba7123664756 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:40.018981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6cacba4a-8672-4932-91be-e1fb0c3febda req-b5c731f8-a4ec-47be-8c6f-ba7123664756 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:40.019416 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6cacba4a-8672-4932-91be-e1fb0c3febda req-b5c731f8-a4ec-47be-8c6f-ba7123664756 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:40.031956 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6cacba4a-8672-4932-91be-e1fb0c3febda req-b5c731f8-a4ec-47be-8c6f-ba7123664756 service nova] Creating event network-vif-plugged:7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf for instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 on n-h1-master-1 Sep 25 01:57:40.037040 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6cacba4a-8672-4932-91be-e1fb0c3febda req-b5c731f8-a4ec-47be-8c6f-ba7123664756 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Sep 25 01:57:40.037673 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3358/6740] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:57:40.578549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:40.579206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:40.586494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:40.586992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:40.587448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:40.588143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:40.588608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:40.589042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:40.718355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:40.726467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d33fc09-a19d-49d8-b5a7-fece3ae9fed8 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1315 microversion: 2.1 time: 0.151298 Sep 25 01:57:40.727383 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3383/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:40 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:41.751243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:41.751867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:41.753850 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:41.754522 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:41.762757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:41.763250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:41.763691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:41.764390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:41.764845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:41.765272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:41.902114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:41.910173 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-366f2454-4d23-4a09-97e6-8ca09338dbc9 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1503 microversion: 2.1 time: 0.163355 Sep 25 01:57:41.910748 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3359/6742] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:41 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:57:41.932765 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:57:41.935069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:41.937020 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:57:41.943043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:41.943545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:41.944023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:41.945362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:41.945869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:41.946314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:42.020137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:42.025867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:57:42.032771 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:57:42.033217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:57:42.033738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:57:42.034172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:57:42.034609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:57:42.145130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38f39043-7717-41be-86ea-71b95d0f77fe tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "POST /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9/action" status: 202 len: 0 microversion: 2.1 time: 0.216813 Sep 25 01:57:42.146065 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3384/6743] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:57:41 2022] POST /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:57:42.154467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:42.155089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:42.162071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:42.162563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:42.163005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:42.164339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:42.164972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:42.165492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:42.337549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:42.346064 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4edc0277-9800-41b7-bb05-b637d15c4e12 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1512 microversion: 2.1 time: 0.195481 Sep 25 01:57:42.346641 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3360/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:42 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:57:43.370065 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:43.370706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:43.377789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:43.378296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:43.378759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:43.379500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:43.380015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:43.380459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:43.518203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:43.526973 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd189796-613a-4ab8-a8e7-17c77f64783c tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1512 microversion: 2.1 time: 0.161838 Sep 25 01:57:43.527570 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3385/6745] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:43 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:44.550397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:44.551015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:44.558988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:44.559468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:44.559905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:44.560591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:44.561042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:44.561494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:44.690549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:44.699020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c3feaa6d-0489-4d49-ade4-ae0b7b3fb0c3 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.152536 Sep 25 01:57:44.699600 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3361/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:44 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:45.721211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:45.721791 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:45.729428 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:45.729935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:45.730395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:45.731102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:45.731572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:45.732016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:45.867161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:45.874912 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-72781c8e-a429-48c7-bbc9-a7bfcc352066 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.157709 Sep 25 01:57:45.875487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3386/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:45 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:46.898371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:46.899031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:46.906300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:46.906791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:46.907238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:46.907937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:46.908399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:46.908835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:47.039900 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:47.047691 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e50e94d4-6a5b-46aa-af63-9d2784724f73 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.153937 Sep 25 01:57:47.048269 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3362/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:46 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:48.071159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:48.071800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:48.078765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:48.079271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:48.079727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:48.080464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:48.080938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:48.081382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:48.213781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:48.221557 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4fdb459a-a96c-4ae5-84b2-1ae4a544f952 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.155093 Sep 25 01:57:48.222128 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3387/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:48 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:49.245452 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:49.246066 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:49.252780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:49.253259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:49.253726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:49.254410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:49.254889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:49.255311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:49.383600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:49.391403 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1443a4d-fb23-4f00-9c0c-103c33d01045 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.150442 Sep 25 01:57:49.391986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3363/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:49 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:50.414873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:50.415537 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:50.422495 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:50.422990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:50.423443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:50.424156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:50.424625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:50.425065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:50.559062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:50.566854 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1c395aef-b21c-4ffe-a823-bb6c3f789103 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.155976 Sep 25 01:57:50.567433 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3388/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:50 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:51.591440 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:51.592070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:51.598943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:51.599436 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:51.599887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:51.601181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:51.601678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:51.602107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:51.731763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:51.739528 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec6b0911-3675-4f27-94bf-d34d11532e0e tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.152045 Sep 25 01:57:51.740111 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3364/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:51 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:52.762701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:52.763340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:52.770437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:52.770937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:52.771395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:52.772106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:52.772784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:52.773225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:52.902364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:52.910522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca6e2ce3-924b-4408-a07a-0d7deac4912a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.151741 Sep 25 01:57:52.911102 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3389/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:52 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:53.934588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:53.935203 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:53.942220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:53.942696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:53.943128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:53.943809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:53.944901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:53.945637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:54.079464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:54.087427 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc0bf682-3945-48ad-bf9d-ef4d93bea0fa tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.156799 Sep 25 01:57:54.088002 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3365/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:53 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:55.111199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:55.111841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:55.118350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:55.118852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:55.119315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:55.120023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:55.120504 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:55.120950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:55.250121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:55.258032 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4cf0d8e9-8912-407d-81ab-3e5951d104ef tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.150903 Sep 25 01:57:55.258621 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3390/6755] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:55 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:56.282011 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:56.282642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:56.289254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:56.289776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:56.290221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:56.290918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:56.291375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:56.291801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:56.422756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:56.430581 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bdd66359-4495-4155-87bf-a14bcae6ee56 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.152959 Sep 25 01:57:56.431159 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3366/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:56 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:57.454646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:57.455267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:57.462700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:57.463207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:57.463665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:57.464376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:57.464853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:57.465297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:57.594615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:57.602955 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-19f2afb5-e38c-485e-89df-aa499faf2235 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.152400 Sep 25 01:57:57.603541 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3391/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:57 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:58.626108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:58.626758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:58.634146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:58.634630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:58.635071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:58.635763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:58.636222 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:58.636649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:58.763937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:58.771654 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-026d916d-07b8-4d6d-9872-701269836989 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.149523 Sep 25 01:57:58.772813 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3367/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:58 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:57:59.795284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:57:59.795925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:57:59.802901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:59.803421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:59.803876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:59.804581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:57:59.805059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:57:59.805529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:57:59.938855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:57:59.946849 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-75d61ec0-de35-417e-8950-f3fe6166583d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.155535 Sep 25 01:57:59.947432 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3392/6759] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:57:59 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:00.970816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:00.971423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:00.979068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:00.979583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:00.980022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:00.980719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:00.981177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:00.981642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:01.112617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:01.121132 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4363033-39a6-42ae-a337-7170a1edb959 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.154319 Sep 25 01:58:01.121749 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3368/6760] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:00 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:02.144073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:02.144717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:02.151659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:02.152165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:02.152623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:02.153335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:02.153839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:02.154288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:02.285444 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:02.293816 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-697ba25a-1af0-4c40-b53a-e2dd4eb3ac6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.153634 Sep 25 01:58:02.294392 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3393/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:02 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:03.317789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:03.318443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:03.326086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:03.326578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:03.327021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:03.327719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:03.328182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:03.328614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:03.459610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:03.467487 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9ba69f2d-727f-4bcc-9cc1-159215626c6d tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.153675 Sep 25 01:58:03.468058 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3369/6762] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:03 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:04.490449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:04.491419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:04.498382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:04.498874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:04.499324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:04.500020 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:04.500485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:04.500921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:04.504791 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:04.638739 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:04.646566 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5dfe47cd-0d63-46e2-aef1-13320f41b544 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.159964 Sep 25 01:58:04.647765 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3394/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:04 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:05.670770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:05.671300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:05.678435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:05.679128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:05.679569 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:05.680288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:05.680740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:05.681166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:05.809235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:05.817080 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-173746a9-95ff-410d-b391-f0286b4ba64b tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.150277 Sep 25 01:58:05.817701 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3370/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:05 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:06.840333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:06.841001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:06.843808 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:58:06.843956 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 01:58:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 (ip 10.222.0.16) !!! Sep 25 01:58:06.851353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:06.851854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:06.852311 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:06.853013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:06.853533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:06.853975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:06.983447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:06.991963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-82c99060-2892-465e-b5dd-d243598f8dff tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.155510 Sep 25 01:58:06.992539 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3395/6765] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:06 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:08.014649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:08.015252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:08.022846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:08.023523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:08.023961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:08.024658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:08.025115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:08.025570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:08.157905 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:08.166465 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-96a63340-ab14-4c13-8a97-5f841e294c96 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.155796 Sep 25 01:58:08.167053 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3371/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:08 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:58:09.190256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:09.190900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:09.197451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:09.197957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:09.198415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:09.199124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:09.199603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:09.200046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:09.327378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:09.335222 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2b38867-ea59-453d-9faf-8024aaecb8d5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.149179 Sep 25 01:58:09.335810 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3396/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:09 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:10.358732 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:10.359346 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:10.361916 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=30 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:10.367608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:10.368093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:10.368530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:10.369217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:10.369694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:10.370118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:10.372839 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=86 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:10.508574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:10.516466 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-696b3e61-5f78-41a2-8879-442a3dd4dede tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1517 microversion: 2.1 time: 0.161693 Sep 25 01:58:10.517060 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3372/6768] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:10 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:11.542413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:11.543238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:11.546147 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=34 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:11.551518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:11.552016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:11.552469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:11.554088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:11.554723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:11.555168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:11.792731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:11.800472 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ae707c65-1906-4694-927f-a79c8a8b593a tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1516 microversion: 2.1 time: 0.262828 Sep 25 01:58:11.801052 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3397/6769] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:11 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:12.140469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46dcb668-0ce9-461f-bf1d-ccc634a924e9", "name": "network-vif-unplugged", "status": "completed", "tag": "7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:12.151932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:12.152429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:12.152875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:12.165224 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] Creating event network-vif-unplugged:7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf for instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 on n-h2-master-1 Sep 25 01:58:12.170737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:58:12.182212 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bc9df1ac-3353-4632-b702-8c0e907e8b69 req-2063c3f8-c7c7-436f-86ab-38582233fa53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045484 Sep 25 01:58:12.182907 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3373/6770] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:58:12.824310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:12.825074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:12.832342 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:12.832854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:12.833318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:12.834070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:12.834711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:12.835258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:13.027182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:13.035384 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-13471a6c-1fd0-45d5-80bc-286348cc1735 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1516 microversion: 2.1 time: 0.215116 Sep 25 01:58:13.035967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3398/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:12 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:14.061235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:14.062004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:14.068150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:14.069228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:14.069696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:14.070401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:14.070855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:14.071281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:14.204938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46dcb668-0ce9-461f-bf1d-ccc634a924e9", "tag": "7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:14.205486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:14.213552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3e7cc533-c862-4a53-b1b9-838edbd09f23 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1514 microversion: 2.1 time: 0.157451 Sep 25 01:58:14.214124 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3374/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:14 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:14.215544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:14.216045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:14.216491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:14.230132 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] Creating event network-changed:7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf for instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 on n-h2-master-1 Sep 25 01:58:14.235474 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:58:14.247051 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d03e8750-4fd8-42dd-9268-f2cb6d8e2168 req-3598b6fb-4f80-41b0-875c-242acde9b8bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045936 Sep 25 01:58:14.247662 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3399/6773] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:58:15.237337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:15.237980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:15.245157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:15.245672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:15.246105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:15.246796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:15.247242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:15.247665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:15.385003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:15.392911 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-03adfb87-5683-4ea8-8fdf-227748f7efc4 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1514 microversion: 2.1 time: 0.159469 Sep 25 01:58:15.393514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3375/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:15 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:16.424658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:16.425372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:16.433549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:16.434055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:16.434508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:16.435230 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:16.435712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:16.436141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:16.574657 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:16.582550 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38b77675-636f-4f72-b36d-06aae95e5894 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1511 microversion: 2.1 time: 0.163624 Sep 25 01:58:16.583176 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3400/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:16 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:16.606891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:16.607429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:16.614707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:16.615384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:16.615901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:16.616805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:16.617340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:16.617887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:16.645014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:58:16.696515 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Found an unconfirmed migration during delete, id: 16, status: finished Sep 25 01:58:18.269794 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2115dae-84c8-4ac2-8601-ee3bc800f40f tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 204 len: 0 microversion: 2.1 time: 1.666565 Sep 25 01:58:18.270476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3376/6776] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:58:16 2022] DELETE /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 0 bytes in 1668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:58:18.279525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:18.280273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:18.287557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:18.288423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:18.288885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:18.289645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:18.290121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:18.290564 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:18.359679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-777dfe83-b2cb-4e83-aeb3-5da9020eb6cd req-2d498591-1342-4c7a-8a93-cb2a0814f86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46dcb668-0ce9-461f-bf1d-ccc634a924e9", "name": "network-vif-plugged", "status": "completed", "tag": "7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:18.371963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-777dfe83-b2cb-4e83-aeb3-5da9020eb6cd req-2d498591-1342-4c7a-8a93-cb2a0814f86b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:18.372457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-777dfe83-b2cb-4e83-aeb3-5da9020eb6cd req-2d498591-1342-4c7a-8a93-cb2a0814f86b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:18.372901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-777dfe83-b2cb-4e83-aeb3-5da9020eb6cd req-2d498591-1342-4c7a-8a93-cb2a0814f86b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:18.390374 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-777dfe83-b2cb-4e83-aeb3-5da9020eb6cd req-2d498591-1342-4c7a-8a93-cb2a0814f86b service nova] Creating event network-vif-plugged:7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf for instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 on n-h2-master-1 Sep 25 01:58:18.396475 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-777dfe83-b2cb-4e83-aeb3-5da9020eb6cd req-2d498591-1342-4c7a-8a93-cb2a0814f86b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041469 Sep 25 01:58:18.397893 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3377/6777] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:58:18.437450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:18.445477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2787613b-3f4e-4ec0-a447-11a3944c6fc5 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1503 microversion: 2.1 time: 0.169976 Sep 25 01:58:18.446059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3401/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:18 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:19.471590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:19.472130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:19.478353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:19.478852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:19.479300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:19.480022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:19.480483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:19.480915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:19.612120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afb45cff708a4e40a27f57f5900a8442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69079674a8234d9d87d2d3c78561b958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:19.620592 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-686b3be3-60cc-4e84-8703-15b5ab570ccd tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 200 len: 1503 microversion: 2.1 time: 0.154786 Sep 25 01:58:19.621182 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3378/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:19 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:20.281635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7d03df55-96fa-4b97-a184-d5002279e0bf req-923c20ea-7aed-4133-97ea-ca04ea5668d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46dcb668-0ce9-461f-bf1d-ccc634a924e9", "name": "network-vif-deleted", "tag": "7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:20.293842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7d03df55-96fa-4b97-a184-d5002279e0bf req-923c20ea-7aed-4133-97ea-ca04ea5668d0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.294349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7d03df55-96fa-4b97-a184-d5002279e0bf req-923c20ea-7aed-4133-97ea-ca04ea5668d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.294814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7d03df55-96fa-4b97-a184-d5002279e0bf req-923c20ea-7aed-4133-97ea-ca04ea5668d0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.308143 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7d03df55-96fa-4b97-a184-d5002279e0bf req-923c20ea-7aed-4133-97ea-ca04ea5668d0 service nova] Creating event network-vif-deleted:7a073c3c-7743-4de5-8ac7-1f4d3f76cbaf for instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 on n-h2-master-1 Sep 25 01:58:20.314072 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7d03df55-96fa-4b97-a184-d5002279e0bf req-923c20ea-7aed-4133-97ea-ca04ea5668d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036411 Sep 25 01:58:20.314697 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3402/6780] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:58:20.643745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:20.644510 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:20.652231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.652799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.653242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.653978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.654445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.654960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.669151 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] HTTP exception thrown: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Request method failure captured: Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 HTTP/1.1 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7WJdklUqFLXsc89hvfOEQtezy9OyMiQEF_CxTmKq_hpXqP2vEbqc7LpLk4mObwhRc-0k-_8GBM_ShAR61tNja7Y9TRYPH7q2w5j0XcoMYBZooJjAx4ZBojYpKQ5Fz2rO8KF1bvHPOlP9BzQCkezJ_yaanIQ6yXqp2UiToWM1zf9Vws Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 69079674a8234d9d87d2d3c78561b958 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69079674a8234d9d87d2d3c78561b958"}]}] Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 69079674a8234d9d87d2d3c78561b958 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-304921579-project Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: afb45cff708a4e40a27f57f5900a8442 Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-304921579-project Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '46dcb668-0ce9-461f-bf1d-ccc634a924e9'} Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:58:20.670845 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Returning 404 to user: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0bc9ee74-cc4a-44d5-89f4-4f9fdce7f9d0 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 404 len: 111 microversion: 2.1 time: 0.032490 Sep 25 01:58:20.675042 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3379/6781] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:20 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:58:20.686218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:20.686833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:20.693133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.693842 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.694411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.695114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.695582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.696018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.709592 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] HTTP exception thrown: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Request method failure captured: Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 HTTP/1.1 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7WJdklUqFLXsc89hvfOEQtezy9OyMiQEF_CxTmKq_hpXqP2vEbqc7LpLk4mObwhRc-0k-_8GBM_ShAR61tNja7Y9TRYPH7q2w5j0XcoMYBZooJjAx4ZBojYpKQ5Fz2rO8KF1bvHPOlP9BzQCkezJ_yaanIQ6yXqp2UiToWM1zf9Vws Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 69079674a8234d9d87d2d3c78561b958 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69079674a8234d9d87d2d3c78561b958"}]}] Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 69079674a8234d9d87d2d3c78561b958 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-DeleteServersTestJSON-304921579-project Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: afb45cff708a4e40a27f57f5900a8442 Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-DeleteServersTestJSON-304921579-project Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '46dcb668-0ce9-461f-bf1d-ccc634a924e9'} Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:58:20.711489 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Returning 404 to user: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c42cb609-4fc1-4079-a9f8-1088feb09c06 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 404 len: 111 microversion: 2.1 time: 0.030979 Sep 25 01:58:20.715687 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3403/6782] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:58:20 2022] DELETE /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:58:20.721710 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:20.722337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] [instance: 46dcb668-0ce9-461f-bf1d-ccc634a924e9] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:20.729506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.730008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.730455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.731157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:20.731620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:20.732054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:20.745509 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] HTTP exception thrown: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Request method failure captured: Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 HTTP/1.1 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7WJdklUqFLXsc89hvfOEQtezy9OyMiQEF_CxTmKq_hpXqP2vEbqc7LpLk4mObwhRc-0k-_8GBM_ShAR61tNja7Y9TRYPH7q2w5j0XcoMYBZooJjAx4ZBojYpKQ5Fz2rO8KF1bvHPOlP9BzQCkezJ_yaanIQ6yXqp2UiToWM1zf9Vws Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 69079674a8234d9d87d2d3c78561b958 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69079674a8234d9d87d2d3c78561b958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69079674a8234d9d87d2d3c78561b958"}]}] Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 69079674a8234d9d87d2d3c78561b958 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-DeleteServersTestJSON-304921579 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-DeleteServersTestJSON-304921579-project Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: afb45cff708a4e40a27f57f5900a8442 Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-DeleteServersTestJSON-304921579-project Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '46dcb668-0ce9-461f-bf1d-ccc634a924e9'} Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:58:20.747085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] Returning 404 to user: Instance 46dcb668-0ce9-461f-bf1d-ccc634a924e9 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b7d7a053-dc73-434c-a6d7-a4f76267e1a6 tempest-DeleteServersTestJSON-304921579 tempest-DeleteServersTestJSON-304921579-project] 10.222.0.16 "GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9" status: 404 len: 111 microversion: 2.1 time: 0.030786 Sep 25 01:58:20.751413 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3380/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:20 2022] GET /compute/v2.1/servers/46dcb668-0ce9-461f-bf1d-ccc634a924e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:58:29.216882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-706227807", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4f87ce72-5543-4556-a6e8-e1f623fb3ed6"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:29.292177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] validate_networks() for [('4f87ce72-5543-4556-a6e8-e1f623fb3ed6', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:58:29.715881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:58:29.716583 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:58:29.717194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:58:29.717813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:58:29.718316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:58:29.734825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:29.735334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:29.735795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:29.737162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:29.737672 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:29.738124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:29.760054 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Getting quotas for project 779611b4d82845a48d34180747a77c16. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:58:29.765698 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Getting quotas for user 1fa684ff6c6c4beca6835a46dc9b7938 and project 779611b4d82845a48d34180747a77c16. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:58:29.779106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:58:29.781756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:58:29.831173 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ffd2702-1889-4faa-a87b-e5f73dd738ee tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751795 Sep 25 01:58:29.831843 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3404/6784] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:58:29.843367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2c27a721-5b38-4b60-8b40-61aa243fb30e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:29.844059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2c27a721-5b38-4b60-8b40-61aa243fb30e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:29.900384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2c27a721-5b38-4b60-8b40-61aa243fb30e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:29.909737 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2c27a721-5b38-4b60-8b40-61aa243fb30e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1217 microversion: 2.1 time: 0.070349 Sep 25 01:58:29.910513 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3381/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:29 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:30.933700 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:30.934341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:30.940638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:30.941205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:30.941694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:30.942418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:30.942894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:30.943340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:31.011994 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:31.019968 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0fd8ae95-b3fc-4864-97e8-a10ec4e7dd61 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1269 microversion: 2.1 time: 0.091039 Sep 25 01:58:31.020595 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3405/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:30 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:32.044207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:32.045508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:32.048642 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:32.056289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:32.057031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:32.057726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:32.058451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:32.058913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:32.059512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:32.304243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:32.314556 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-358d4059-9a46-47a4-9ba5-7ee1022a7d26 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.274144 Sep 25 01:58:32.315925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3382/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:32 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:32.950892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3b33362b-1008-4e70-8291-58b97d522378 req-c655cd6f-55f5-4fc1-b784-5ed30e3bfc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbdb0f4-1c01-424c-abe8-49c65cd21875", "tag": "abd727ab-2257-49ac-8546-92dd6b6aedb1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:32.969899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3b33362b-1008-4e70-8291-58b97d522378 req-c655cd6f-55f5-4fc1-b784-5ed30e3bfc50 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:32.970483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3b33362b-1008-4e70-8291-58b97d522378 req-c655cd6f-55f5-4fc1-b784-5ed30e3bfc50 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:32.970945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3b33362b-1008-4e70-8291-58b97d522378 req-c655cd6f-55f5-4fc1-b784-5ed30e3bfc50 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:32.989572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3b33362b-1008-4e70-8291-58b97d522378 req-c655cd6f-55f5-4fc1-b784-5ed30e3bfc50 service nova] Creating event network-changed:abd727ab-2257-49ac-8546-92dd6b6aedb1 for instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 on n-h1-master-1 Sep 25 01:58:32.996406 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3b33362b-1008-4e70-8291-58b97d522378 req-c655cd6f-55f5-4fc1-b784-5ed30e3bfc50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049219 Sep 25 01:58:32.997026 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3406/6788] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:58:33.338282 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:33.339336 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:33.345865 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:33.346348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:33.346804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:33.347555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:33.348005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:33.348426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:33.498502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:33.506460 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ef776b66-24f1-4859-a79f-ca1519b3698d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.172107 Sep 25 01:58:33.507040 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3383/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:33 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:34.532153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:34.533689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:34.541816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:34.542328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:34.542792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:34.543516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:34.543996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:34.544450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:34.548642 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=60 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:34.674932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:34.683901 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bace8293-29f3-439b-8780-a09125db513f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.157626 Sep 25 01:58:34.684527 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3407/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:34 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:35.706389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:35.706911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:35.713997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:35.714488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:35.714935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:35.715634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:35.716092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:35.716524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:35.904072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:35.912156 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d205466b-33f2-40e9-a4a6-e3e34e65cee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.209897 Sep 25 01:58:35.912818 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3384/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:35 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:36.934858 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:36.935424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:36.942370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:36.942875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:36.943443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:36.944346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:36.944821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:36.945267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:37.112192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:37.120529 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da53a1e8-a96a-46bc-9200-c50f5d6d5482 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.189699 Sep 25 01:58:37.121104 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3408/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:36 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:38.144161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:38.145051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:38.152341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:38.152841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:38.153288 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:38.154025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:38.154489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:38.154925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:38.310506 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-3519b63f-89a1-42cd-9d9e-97b1ee773b6c req-f4f5902e-a57d-4767-8e31-737b02cdd767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbdb0f4-1c01-424c-abe8-49c65cd21875", "name": "network-vif-plugged", "status": "completed", "tag": "abd727ab-2257-49ac-8546-92dd6b6aedb1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:38.331532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3519b63f-89a1-42cd-9d9e-97b1ee773b6c req-f4f5902e-a57d-4767-8e31-737b02cdd767 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:38.332254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3519b63f-89a1-42cd-9d9e-97b1ee773b6c req-f4f5902e-a57d-4767-8e31-737b02cdd767 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:38.332710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-3519b63f-89a1-42cd-9d9e-97b1ee773b6c req-f4f5902e-a57d-4767-8e31-737b02cdd767 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:38.353241 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-3519b63f-89a1-42cd-9d9e-97b1ee773b6c req-f4f5902e-a57d-4767-8e31-737b02cdd767 service nova] Creating event network-vif-plugged:abd727ab-2257-49ac-8546-92dd6b6aedb1 for instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 on n-h1-master-1 Sep 25 01:58:38.363906 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-3519b63f-89a1-42cd-9d9e-97b1ee773b6c req-f4f5902e-a57d-4767-8e31-737b02cdd767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057208 Sep 25 01:58:38.365575 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3409/6793] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:58:38.426455 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:38.435109 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d426925d-74c8-4a12-b807-566c8849f501 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.295491 Sep 25 01:58:38.435704 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3385/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:38 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:39.460689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:39.461370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:39.467997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:39.468502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:39.468963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:39.469712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:39.470193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:39.470639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:39.685078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:39.692844 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88efc13a-4d30-4d98-8baa-8a91c7ba496b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1317 microversion: 2.1 time: 0.238168 Sep 25 01:58:39.694212 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3410/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:39 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:40.716733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:40.717351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:40.720100 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:40.720765 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:40.727157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:40.727645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:40.728083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:40.728779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:40.729231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:40.729691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:40.860649 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:40.869107 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9873d675-5926-4c2a-96a5-44f9a4c31d12 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1506 microversion: 2.1 time: 0.156229 Sep 25 01:58:40.869717 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3386/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:40 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:40.891702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:40.892332 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:40.894311 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:40.894991 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:40.901713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:40.902209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:40.902661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:40.903359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:40.903824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:40.904262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.034592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:41.042357 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-791680e2-d8b6-4857-9117-f3f4ef2fb676 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1506 microversion: 2.1 time: 0.154539 Sep 25 01:58:41.042930 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3411/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:40 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:41.064884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:41.067424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:41.074435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.074920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.075360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.076054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.076512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.076938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.139070 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2dd3ffa-0223-46b9-ac69-10f85e558ee1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "PUT /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1078 microversion: 2.1 time: 0.078036 Sep 25 01:58:41.139628 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3387/6798] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 25 01:58:41 2022] PUT /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:41.158395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:41.159031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:41.165341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.165989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.166444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.167141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.167608 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.168046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.306201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:41.313992 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d983b21-dddf-488e-a62d-2b78ddb0a722 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1504 microversion: 2.1 time: 0.159729 Sep 25 01:58:41.314581 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3412/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:41 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:41.335672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:41.336294 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:41.342476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.342967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.343410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.344111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.344573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.345005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.482706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:41.490684 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-945e307b-dd4e-4bd3-9ab3-e04369c87258 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1504 microversion: 2.1 time: 0.158959 Sep 25 01:58:41.491256 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3388/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:41 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:41.513252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:58:41.515633 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:41.521850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.522353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.523522 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.524263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.524739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.525190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.554094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:41.557145 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:58:41.560102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Old instance type m1.heat2, new instance type m1.heat {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:58:41.567923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:58:41.568364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:58:41.568861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:58:41.569840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:58:41.570454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:58:41.634164 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6438194b-4d67-4346-8503-20e4e3139152 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875/action" status: 202 len: 0 microversion: 2.1 time: 0.124628 Sep 25 01:58:41.634790 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3413/6801] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:58:41 2022] POST /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:58:41.642946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:41.643487 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:41.651572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.652118 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.652786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.653917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:41.654604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:41.655623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:41.817348 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:41.826297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f9cfe660-776a-44a7-a8af-69e28455df0b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1515 microversion: 2.1 time: 0.187329 Sep 25 01:58:41.833925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3389/6802] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:41 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:58:42.849906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:42.850447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:42.858434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:42.858935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:42.859388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:42.860113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:42.860583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:42.861130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:42.992924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:43.003089 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0896689c-2089-4506-b9d4-99e1905d16b8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1515 microversion: 2.1 time: 0.157262 Sep 25 01:58:43.003798 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3414/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:42 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:44.026672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:44.027302 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:44.034289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:44.034774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:44.035216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:44.035915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:44.036374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:44.036806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:44.166466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:44.174271 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8deb9154-daf0-4404-94e1-e9a5a478768a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.152003 Sep 25 01:58:44.174852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3390/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:44 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:45.197976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:45.198651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:45.205595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:45.206102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:45.206576 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:45.207278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:45.207754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:45.208197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:45.341517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:45.349189 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-96f6116c-65cd-4f51-a321-474906401b03 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.155358 Sep 25 01:58:45.349794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3415/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:45 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:46.372725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:46.373345 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:46.380233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:46.380720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:46.381159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:46.381938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:46.382393 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:46.382819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:46.513760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:46.521591 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b6802c2-e63f-41dd-b22b-e0c338ed8359 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.152828 Sep 25 01:58:46.522174 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3391/6806] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:46 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:47.546857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:47.547497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:47.555123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:47.555622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:47.556079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:47.556790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:47.557261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:47.557738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:47.688991 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:47.697540 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d502fa49-84a3-4c92-88bc-3dd1cfad594e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.154627 Sep 25 01:58:47.698125 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3416/6807] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:47 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:48.720112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:48.720737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:48.728320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:48.728810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:48.729258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:48.729988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:48.730452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:48.730885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:48.860493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:48.868340 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4a4a4440-8bef-49a9-b5db-7eaa8856cfd8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.152176 Sep 25 01:58:48.868919 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3392/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:48 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:49.891582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:49.892219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:49.899237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:49.899735 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:49.900194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:49.900907 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:49.901379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:49.901849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:50.031522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:50.039505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-79cd4e42-cdfc-4dff-b7d4-fde08530ce36 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.151724 Sep 25 01:58:50.040072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3417/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:49 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:51.063146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:51.063760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:51.071010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:51.071492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:51.071929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:51.072621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:51.073072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:51.073526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:51.204700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:51.212640 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-924a1db0-f4fc-4949-8b78-72254c8f9fa3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.153562 Sep 25 01:58:51.213209 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3393/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:51 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:52.241279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:52.242921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:52.249655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:52.250156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:52.250642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:52.251346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:52.251816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:52.252257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:52.383482 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:52.391435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-09c0ca67-ffd9-4a5f-9aef-5bec92b81a04 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.154108 Sep 25 01:58:52.392013 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3418/6811] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:52 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:53.415168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:53.415796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:53.422783 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:53.423269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:53.423711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:53.424412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:53.424868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:53.425294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:53.559280 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:53.566980 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a686b558-0ced-412f-8bc6-d6cc45233927 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.155972 Sep 25 01:58:53.567548 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3394/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:53 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:54.591266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:54.591894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:54.598514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:54.599012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:54.599461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:54.600162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:54.600625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:54.601826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:54.729935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:54.738705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf1bfda3-eca3-4a69-b61b-e22d65a6cd33 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.151387 Sep 25 01:58:54.739283 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3419/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:54 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:55.761748 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:55.762295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:55.769127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:55.769643 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:55.770083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:55.770776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:55.771230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:55.771656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:55.905999 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:55.914689 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e4014ebf-c7f5-4fb2-905a-2e0f3aa58c14 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.157044 Sep 25 01:58:55.915288 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3395/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:55 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:56.937697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:56.938341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:56.946122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:56.946627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:56.947091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:56.947808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:56.948283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:56.948740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:57.076200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:57.084043 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f5a0c50-6c46-45c8-b4cf-74a3b830f8e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.150326 Sep 25 01:58:57.084623 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3420/6815] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:56 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:58.106954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:58.107575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:58.114396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:58.114881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:58.115328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:58.116021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:58.117137 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:58.117573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:58.246847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:58.254631 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22e59ff7-a1e0-481f-af09-41ebd4252a62 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.151610 Sep 25 01:58:58.255204 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3396/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:58 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:58:59.280088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:58:59.280721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:58:59.287847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:59.288350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:59.288813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:59.289539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:58:59.290012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:58:59.290454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:58:59.422133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:58:59.430125 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-195dc538-9816-4e2e-9c18-9d2a54fe52c7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.154023 Sep 25 01:58:59.430698 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3421/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:58:59 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:00.454058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:00.454682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:00.463027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:00.463542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:00.463994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:00.464709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:00.465176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:00.465636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:00.597614 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:00.601707 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:00.607001 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b132b4c-a6a6-476f-8662-d784d84245d8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.157001 Sep 25 01:59:00.607583 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3397/6818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:00 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:01.630582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:01.631224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:01.638446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:01.638953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:01.639420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:01.640190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:01.640614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:01.641061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:01.773884 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:01.781859 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e007a2e8-a6fc-4481-ab9e-9b8c29665057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.154927 Sep 25 01:59:01.782443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3422/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:01 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:02.807130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:02.807757 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:02.815421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:02.815918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:02.816362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:02.817065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:02.817574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:02.818008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:02.946509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:02.954296 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4acbd79f-6a19-4572-b4d9-3ea34b4d9f57 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.152509 Sep 25 01:59:02.954878 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3398/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:02 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:03.977460 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:03.978103 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:03.985243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:03.985784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:03.986247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:03.986963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:03.987440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:03.987884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:03.990503 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:04.120346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:04.128164 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f37894c-3a01-474c-808f-2b586d9f8e27 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.154742 Sep 25 01:59:04.128741 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3423/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:03 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:05.152351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:05.152978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:05.160094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:05.160586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:05.161029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:05.161753 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:05.162219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:05.162656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:05.296680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:05.304798 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-46eed759-32b2-4e89-bf6b-20fe328e81a0 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.156946 Sep 25 01:59:05.305380 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3399/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:05 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:06.328805 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:06.329457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:06.337208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:06.337728 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:06.338182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:06.338885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:06.339353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:06.339797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:06.474639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:06.483391 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f26b61f8-2a1b-4ccf-a504-eb3e1eef4081 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.158499 Sep 25 01:59:06.483978 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3424/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:06 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:07.506513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:07.507404 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:07.515563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:07.516047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:07.516491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:07.517490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:07.517956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:07.518394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:07.657238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:07.665737 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-99dccd75-e6a9-4c14-98e9-be58e826a019 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.163143 Sep 25 01:59:07.666324 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3400/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:07 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:08.688486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:08.689120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:08.696764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:08.697263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:08.697760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:08.698470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:08.698939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:08.699382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:08.827473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:08.835459 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6cca0811-70a9-4481-88bb-33b71726fd70 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.150882 Sep 25 01:59:08.836046 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3425/6825] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:08 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:09.858610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:09.859237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:09.865764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:09.866489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:09.866932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:09.867632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:09.868121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:09.868556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:10.003373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:10.011823 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a654244c-9c2f-4f88-9dc0-cc5932af592c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1520 microversion: 2.1 time: 0.157323 Sep 25 01:59:10.012412 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3401/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:09 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:11.036411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:11.037084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:11.044704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:11.045208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:11.045694 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:11.046417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:11.046895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:11.047344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:11.552067 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:11.560513 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1f6824a-7b02-4e8b-b5b9-e7fc0b59a204 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1519 microversion: 2.1 time: 0.528038 Sep 25 01:59:11.561102 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3426/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:11 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1519 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:11.778600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbdb0f4-1c01-424c-abe8-49c65cd21875", "name": "network-vif-unplugged", "status": "completed", "tag": "abd727ab-2257-49ac-8546-92dd6b6aedb1"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:11.783799 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:11.789545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:11.790218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:11.790656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:11.802955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] Creating event network-vif-unplugged:abd727ab-2257-49ac-8546-92dd6b6aedb1 for instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 on n-h2-master-1 Sep 25 01:59:11.808994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:59:11.819791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-9903793c-7277-4e40-ac00-c671b89a390e req-9c7683de-d481-469c-9df6-6afaf7e35433 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101546 Sep 25 01:59:11.821126 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3402/6828] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:59:12.584155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:12.584953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:12.588055 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=30 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:12.593273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:12.593806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:12.594262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:12.594978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:12.595450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:12.595891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:12.727717 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:12.735530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d71c4e6f-bb2a-4794-8dfe-43561896d758 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1517 microversion: 2.1 time: 0.155421 Sep 25 01:59:12.736109 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3427/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:12 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:13.762307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:13.762921 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:13.769332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:13.769850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:13.770286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:13.770970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:13.771420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:13.771846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:13.848416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbdb0f4-1c01-424c-abe8-49c65cd21875", "tag": "abd727ab-2257-49ac-8546-92dd6b6aedb1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:13.859016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:13.859508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:13.859965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:13.872665 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] Creating event network-changed:abd727ab-2257-49ac-8546-92dd6b6aedb1 for instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 on n-h2-master-1 Sep 25 01:59:13.878608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:59:13.890243 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d24a6380-c940-4c51-b494-8d4a794917ee req-c587760d-98f4-4474-a62a-bb3e8993515c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045601 Sep 25 01:59:13.890868 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3428/6830] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:59:13.916979 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:13.924792 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ed3b9e5b-5fc3-434a-a69d-ea5479129de1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1517 microversion: 2.1 time: 0.169008 Sep 25 01:59:13.925364 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3403/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:13 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:14.950725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:14.951448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:14.957804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:14.958313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:14.958799 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:14.959518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:14.959999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:14.960442 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:15.168476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:15.176401 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e8ce805b-36ef-420e-8240-1379e24f7e94 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1517 microversion: 2.1 time: 0.231706 Sep 25 01:59:15.176985 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3429/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:14 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:16.200751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:16.201397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:16.208289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:16.208768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:16.209202 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:16.209922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:16.210377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:16.210943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:16.354563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:16.362463 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-436263a1-5b2d-4514-885a-b35c7a7edba9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1514 microversion: 2.1 time: 0.166000 Sep 25 01:59:16.363045 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3404/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:16 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:16.386655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:16.388013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:16.395264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:16.395845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:16.396376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:16.397166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:16.397745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:16.398464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:16.463032 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e71087a2-ad85-40ab-9c35-2be7912b9c0c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875/action" status: 204 len: 0 microversion: 2.1 time: 0.080915 Sep 25 01:59:16.466976 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3430/6834] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:59:16 2022] POST /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:59:16.475245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:16.476131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:16.483026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:16.483535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:16.483983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:16.484699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:16.485160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:16.485725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:16.625746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:16.636632 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7304c315-f44b-4704-9817-95ed3bb5fdb2 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1514 microversion: 2.1 time: 0.164925 Sep 25 01:59:16.636632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3405/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:16 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:17.147188 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbdb0f4-1c01-424c-abe8-49c65cd21875", "name": "network-vif-plugged", "status": "completed", "tag": "abd727ab-2257-49ac-8546-92dd6b6aedb1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:17.157914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:17.158415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:17.158914 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:17.171636 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] Creating event network-vif-plugged:abd727ab-2257-49ac-8546-92dd6b6aedb1 for instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 on n-h2-master-1 Sep 25 01:59:17.177302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 01:59:17.188627 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a8f748ca-c88b-46df-ae4a-a3fcb8085bce req-cf576fce-b163-4a75-894f-4dce64aaa17d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102128 Sep 25 01:59:17.189348 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3431/6836] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:59:17.657932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:17.658490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:17.665816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:17.666302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:17.666738 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:17.667431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:17.667882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:17.668305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:17.796388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:17.804049 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-964a5659-57c5-404b-abc2-ea8f4a307819 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1514 microversion: 2.1 time: 0.150479 Sep 25 01:59:17.805184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3406/6837] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:17 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:18.829049 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:18.829800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:18.837122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:18.837658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:18.838115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:18.838826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:18.839301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:18.839746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:18.973540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:18.981617 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1705350e-7487-4bfb-82f2-891e12ff2e1f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1506 microversion: 2.1 time: 0.157643 Sep 25 01:59:18.982199 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3432/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:18 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:19.003243 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:19.003867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:19.011921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:19.012410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:19.012864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:19.013598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:19.014064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:19.014497 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:19.142571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:19.151265 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1f056156-3d08-41c0-b940-fca6a2e8d13f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1506 microversion: 2.1 time: 0.151852 Sep 25 01:59:19.151847 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3407/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:18 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:19.177186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d615b4e-57e3-42c5-9424-0500b716d56d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'create', calling method: .version_select at 0x7f7bebb019d0>, body: {"keypair": {"name": "tempest-keypair-772528486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcDX6ktXx5O5Lsmg7mBft4K4pYDEUIro3szpMa5GeSTLxm7HiqAoHHJAZ/blJ2V763AAXdUfrB8Ia2+dVAD1w0kIVcH6aIGCFKA8VPkATRxYSeo4SllvLiM+obWJATboA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:19.193008 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6d615b4e-57e3-42c5-9424-0500b716d56d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Getting quotas for project 779611b4d82845a48d34180747a77c16. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:59:19.198383 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6d615b4e-57e3-42c5-9424-0500b716d56d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Getting quotas for user 1fa684ff6c6c4beca6835a46dc9b7938 and project 779611b4d82845a48d34180747a77c16. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:59:19.226271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d615b4e-57e3-42c5-9424-0500b716d56d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052953 Sep 25 01:59:19.227499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3433/6840] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 01:59:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:59:20.455929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:20.456554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:20.464664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:20.465281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:20.466063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:20.466832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:20.467298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:20.467737 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:20.604033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:20.611768 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b2bdb04a-4808-4544-9669-4a52d5ee1c7e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 200 len: 1506 microversion: 2.1 time: 0.159798 Sep 25 01:59:20.612351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3408/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:20 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:20.635091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:20.635710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:20.642461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:20.642960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:20.643411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:20.644109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:20.644573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:20.645014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:20.671227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:59:20.746865 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e0a590d-ab74-4a61-8b3d-629b520f6eb3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 204 len: 0 microversion: 2.1 time: 0.116729 Sep 25 01:59:20.747503 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3434/6842] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 01:59:20 2022] DELETE /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:59:20.815765 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-761397218", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "4f87ce72-5543-4556-a6e8-e1f623fb3ed6"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:20.869934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] validate_networks() for [('4f87ce72-5543-4556-a6e8-e1f623fb3ed6', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:59:21.242540 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:59:21.242974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:59:21.243459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:59:21.243902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:59:21.244323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:59:21.254140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:21.254620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:21.255055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:21.255775 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:21.256221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:21.256645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:21.273889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Getting quotas for project 779611b4d82845a48d34180747a77c16. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:59:21.279185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Getting quotas for user 1fa684ff6c6c4beca6835a46dc9b7938 and project 779611b4d82845a48d34180747a77c16. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:59:21.292427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:59:21.294730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:59:21.341842 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-617664af-3ef2-4f56-b0bf-985419381057 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529992 Sep 25 01:59:21.342682 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3409/6843] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 01:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:59:21.355245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e606b56-9a6a-4c97-81ef-6b88704a7097 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:21.355969 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e606b56-9a6a-4c97-81ef-6b88704a7097 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:21.410702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e606b56-9a6a-4c97-81ef-6b88704a7097 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:21.418655 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e606b56-9a6a-4c97-81ef-6b88704a7097 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1217 microversion: 2.1 time: 0.068681 Sep 25 01:59:21.424342 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3435/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:21 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:22.442658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:22.443384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:22.450868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:22.451429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:22.451867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:22.452564 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:22.453019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:22.453458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:22.545539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:22.553258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87db3eb5-261d-4cf9-b1dd-ada03d493903 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1269 microversion: 2.1 time: 0.115457 Sep 25 01:59:22.561776 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3410/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:22 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:22.972668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-72dbae35-bc8b-43ef-815a-1dd902dfe0ab req-cf0402c1-991e-4501-b4f9-c595c78617f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbdb0f4-1c01-424c-abe8-49c65cd21875", "name": "network-vif-deleted", "tag": "abd727ab-2257-49ac-8546-92dd6b6aedb1"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:22.986282 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-72dbae35-bc8b-43ef-815a-1dd902dfe0ab req-cf0402c1-991e-4501-b4f9-c595c78617f6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:22.986785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-72dbae35-bc8b-43ef-815a-1dd902dfe0ab req-cf0402c1-991e-4501-b4f9-c595c78617f6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:22.987238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-72dbae35-bc8b-43ef-815a-1dd902dfe0ab req-cf0402c1-991e-4501-b4f9-c595c78617f6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:23.005941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-72dbae35-bc8b-43ef-815a-1dd902dfe0ab req-cf0402c1-991e-4501-b4f9-c595c78617f6 service nova] Creating event network-vif-deleted:abd727ab-2257-49ac-8546-92dd6b6aedb1 for instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 on n-h2-master-1 Sep 25 01:59:23.011871 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-72dbae35-bc8b-43ef-815a-1dd902dfe0ab req-cf0402c1-991e-4501-b4f9-c595c78617f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043542 Sep 25 01:59:23.013147 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3436/6846] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:59:23.577217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:23.577873 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:23.591299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:23.591822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:23.592242 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:23.592958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:23.593630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:23.594249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:23.848599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:23.856550 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7253c6c5-b241-465c-a94d-dab5897297f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.283493 Sep 25 01:59:23.857156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3411/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:23 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:24.880582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:24.881308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:24.888919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:24.889431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:24.889906 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:24.890617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:24.891090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:24.891533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:25.024769 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:25.032353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-5a4a8380-15dd-4f77-8172-15d793b12142 req-bea58c39-a182-4a36-b8bc-9b7bd6fe9a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae", "tag": "4c6528ea-8372-4925-a22c-a798f4647497"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:25.033142 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0be43f9-9c80-4e10-8d46-1a8c961818cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.156807 Sep 25 01:59:25.033758 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3437/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:24 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:25.043386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5a4a8380-15dd-4f77-8172-15d793b12142 req-bea58c39-a182-4a36-b8bc-9b7bd6fe9a30 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:25.043873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5a4a8380-15dd-4f77-8172-15d793b12142 req-bea58c39-a182-4a36-b8bc-9b7bd6fe9a30 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:25.044317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-5a4a8380-15dd-4f77-8172-15d793b12142 req-bea58c39-a182-4a36-b8bc-9b7bd6fe9a30 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:25.056057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-5a4a8380-15dd-4f77-8172-15d793b12142 req-bea58c39-a182-4a36-b8bc-9b7bd6fe9a30 service nova] Creating event network-changed:4c6528ea-8372-4925-a22c-a798f4647497 for instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae on n-h2-master-1 Sep 25 01:59:25.061032 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-5a4a8380-15dd-4f77-8172-15d793b12142 req-bea58c39-a182-4a36-b8bc-9b7bd6fe9a30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032618 Sep 25 01:59:25.061652 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3412/6849] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:59:26.056759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:26.057423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:26.064395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:26.064899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:26.065362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:26.066113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:26.066586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:26.067034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:26.199273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:26.207001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ad74458-30bc-41cd-ba48-10938085b53d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.154813 Sep 25 01:59:26.207580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3438/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:26 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:27.232304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:27.233024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:27.239714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:27.240219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:27.240661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:27.241587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:27.242264 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:27.242704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:27.477829 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:27.486615 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-72137120-6942-46f4-a1b1-783d071635a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.260241 Sep 25 01:59:27.487302 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3413/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:27 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:28.510839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:28.511393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:28.518592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:28.519129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:28.519589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:28.520307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:28.520782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:28.521228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:28.659441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:28.667357 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cf1bd396-d3d6-41c4-a823-6e2de67ab5b9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.161047 Sep 25 01:59:28.667941 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3439/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:28 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:29.689869 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:29.690486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:29.697787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:29.698265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:29.698701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:29.699389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:29.699841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:29.700267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:29.828760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:29.837278 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4dbb5fe-c3e1-4028-9834-bdb09fd7b4a9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.151284 Sep 25 01:59:29.837882 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3414/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:29 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:30.860661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:30.861298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:30.868888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:30.869385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:30.869881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:30.870574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:30.871042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:30.871484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:30.875524 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:31.004681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:31.013363 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eb394b2b-8966-4664-8bf5-8ff0b874dbf6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.156611 Sep 25 01:59:31.013969 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3440/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:30 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:31.096808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-683e4e5b-5e92-4895-aff3-925f57a1be66 req-9972fb0a-1b60-40ec-926e-f13b4a8aa66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae", "name": "network-vif-plugged", "status": "completed", "tag": "4c6528ea-8372-4925-a22c-a798f4647497"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:31.108196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-683e4e5b-5e92-4895-aff3-925f57a1be66 req-9972fb0a-1b60-40ec-926e-f13b4a8aa66c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:31.108677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-683e4e5b-5e92-4895-aff3-925f57a1be66 req-9972fb0a-1b60-40ec-926e-f13b4a8aa66c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:31.109104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-683e4e5b-5e92-4895-aff3-925f57a1be66 req-9972fb0a-1b60-40ec-926e-f13b4a8aa66c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:31.123406 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-683e4e5b-5e92-4895-aff3-925f57a1be66 req-9972fb0a-1b60-40ec-926e-f13b4a8aa66c service nova] Creating event network-vif-plugged:4c6528ea-8372-4925-a22c-a798f4647497 for instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae on n-h2-master-1 Sep 25 01:59:31.128634 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-683e4e5b-5e92-4895-aff3-925f57a1be66 req-9972fb0a-1b60-40ec-926e-f13b4a8aa66c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Sep 25 01:59:31.129259 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3415/6855] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 01:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:59:32.037783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:32.038492 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:32.040486 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:32.046832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:32.047328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:32.047783 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:32.048490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:32.048960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:32.049427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:32.181827 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:32.189568 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f81a83db-0fee-4301-b022-3a2f633170e3 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1317 microversion: 2.1 time: 0.155736 Sep 25 01:59:32.190138 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3441/6856] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:32 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:33.209926 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:33.210943 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:33.216394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:33.217107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:33.224282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.224774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.225214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.226517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.226979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.227410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.231355 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:33.362355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:33.370088 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63262ce0-a61d-4d10-aa42-a9513ef3fe1c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1506 microversion: 2.1 time: 0.161170 Sep 25 01:59:33.370673 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3416/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:33 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:33.392532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:33.393366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:33.401049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.401589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.402075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.402821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.403487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.403937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.537626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:33.545860 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e12381ed-37ca-4c85-923f-d133afaed654 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1506 microversion: 2.1 time: 0.157392 Sep 25 01:59:33.546442 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3442/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:33 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:59:33.567635 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:59:33.570383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:33.576340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.576818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.577253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.577991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.578441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.578864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.607855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:33.613215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Old instance type m1.heat2, new instance type m1.heat {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 01:59:33.620045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:59:33.620468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:59:33.620939 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:59:33.621347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:59:33.621784 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:59:33.686330 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fbcdaf1e-fcbe-4887-b78d-971eaddc7551 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae/action" status: 202 len: 0 microversion: 2.1 time: 0.122622 Sep 25 01:59:33.686952 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3417/6859] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 01:59:33 2022] POST /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:59:33.695902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:33.696576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:33.702648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.703145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.703594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.704332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:33.704798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:33.705232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:33.865663 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:33.874205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f9df190e-b561-43fb-8484-9f6574c8cccf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1513 microversion: 2.1 time: 0.182954 Sep 25 01:59:33.874821 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3443/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:33 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:34.899258 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:34.899930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:34.907397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:34.907893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:34.908321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:34.909021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:34.909503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:34.909953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:35.045819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:35.053588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2f16805-1acc-4b13-bb3c-a3aeb146a913 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1513 microversion: 2.1 time: 0.159358 Sep 25 01:59:35.054361 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3418/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:34 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:36.078046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:36.078693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:36.085858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:36.086361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:36.086822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:36.087541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:36.088019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:36.088467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:36.217956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:36.226284 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76a0550f-c9ac-45c2-b4b3-0410f92327fc tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.151702 Sep 25 01:59:36.226874 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3444/6862] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:36 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:37.250252 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:37.250882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:37.258129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:37.258621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:37.259066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:37.259767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:37.260228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:37.260663 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:37.395347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:37.403204 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c12ee234-9e49-4425-8c77-8043938aeaff tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.156904 Sep 25 01:59:37.403801 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3419/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:37 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:38.427136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:38.427704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:38.434733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:38.435234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:38.435691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:38.436396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:38.436866 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:38.437306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:38.568796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:38.577014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bd4d7f38-3b8c-465a-8a0f-608bf92942b6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.153874 Sep 25 01:59:38.577616 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3445/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:38 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:39.599995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:39.600713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:39.607862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:39.608351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:39.608796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:39.609532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:39.609994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:39.610432 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:39.741879 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:39.749647 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4bf9bf20-357d-4026-b104-518c1185b779 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.153656 Sep 25 01:59:39.750228 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3420/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:39 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:40.773435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:40.774078 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:40.780727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:40.781234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:40.781996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:40.782712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:40.783186 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:40.783641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:40.912593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:40.921154 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15c2524a-e459-4f67-9ee7-dc823e0a5789 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.151872 Sep 25 01:59:40.921750 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3446/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:40 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:41.944365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:41.945271 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:41.947964 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:41.953155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:41.953664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:41.954111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:41.954786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:41.955235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:41.955659 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:42.088299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:42.096019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-98a6ef33-f0ab-4a49-bd5a-b0ac0c6a3151 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.155630 Sep 25 01:59:42.096604 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3421/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:41 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:43.121420 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:43.122055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:43.124901 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:59:43.130189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:43.130693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:43.131151 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:43.132514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:43.132996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:43.133459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:43.266556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:43.274293 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dee2fe9e-805d-4cbb-8d8d-08386e7aa034 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.158384 Sep 25 01:59:43.274868 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3447/6868] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:43 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:44.297517 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:44.298146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:44.305324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:44.305905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:44.306301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:44.307383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:44.307845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:44.308280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:44.438727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:44.447141 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b8171a2-ddfb-45fc-a491-818e8e2f275c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.153645 Sep 25 01:59:44.447733 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3422/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:44 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:45.470190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:45.470821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:45.478019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:45.478512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:45.478969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:45.479668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:45.480134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:45.480569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:45.614147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:45.622499 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c591efe7-03f6-4df4-818e-4e7f63328a87 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.156223 Sep 25 01:59:45.623118 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3448/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:45 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:46.646492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:46.647108 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:46.654933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:46.655411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:46.655846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:46.656814 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:46.657272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:46.657718 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:46.787737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:46.795530 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-177f3cc2-3501-46b8-8b17-2921ea74d966 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.152955 Sep 25 01:59:46.796113 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3423/6871] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:46 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:47.819120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:47.819760 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:47.827500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:47.828013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:47.828459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:47.829175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:47.829675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:47.830149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:47.961177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:47.968973 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ccefc82-5efd-407a-86aa-804e1f637b92 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.153841 Sep 25 01:59:47.969580 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3449/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:47 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:48.993036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:48.993696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:49.000571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:49.001063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:49.001533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:49.002236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:49.002703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:49.003156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:49.135305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:49.143210 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7dd0a1c-7fbb-4855-80c0-e919233d9605 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.154776 Sep 25 01:59:49.143787 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3424/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:48 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:50.166806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:50.167454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:50.174528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:50.175033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:50.175497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:50.176216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:50.176692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:50.177143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:50.306894 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:50.314652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-37ad499a-37ee-48a9-8cb5-944b884c3d49 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.152442 Sep 25 01:59:50.315231 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3450/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:50 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:51.337831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:51.338466 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:51.345319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:51.345842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:51.346290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:51.346990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:51.347453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:51.347885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:51.481094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:51.488843 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ea0ced32-0261-4cb5-bca0-a37fc208416f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.155174 Sep 25 01:59:51.489437 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3425/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:51 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:52.512708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:52.513260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:52.520296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:52.520808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:52.521270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:52.522044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:52.523214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:52.523701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:52.660153 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:52.667945 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc4f40ea-f83f-43c5-b92c-85f4ea561a9d tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.159277 Sep 25 01:59:52.668532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3451/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:52 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:53.691308 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:53.691934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:53.699003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:53.699493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:53.699940 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:53.700644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:53.701104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:53.701575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:53.836511 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:53.844295 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-35fea9ce-6c76-49d3-af6d-d182cb1dc6b7 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.156904 Sep 25 01:59:53.844872 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3426/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:53 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:54.868198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:54.868831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:54.875580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:54.876078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:54.876530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:54.877232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:54.877733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:54.878177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:55.009241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:55.017002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ec609a59-2545-4d2d-b08c-8a8520527da6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.152835 Sep 25 01:59:55.017611 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3452/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:54 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:56.041726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:56.042349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:56.051442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:56.051929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:56.052375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:56.053071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:56.053559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:56.053992 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:56.184506 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:56.192438 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-56d9b7d9-23f8-4708-8d94-eeca4a696da9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.155279 Sep 25 01:59:56.193020 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3427/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:56 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:57.216385 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:57.217021 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:57.226718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:57.227226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:57.227693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:57.228409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:57.228882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:57.229325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:57.362090 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:57.370629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eaae8c75-cf18-4896-bfdd-2d872081060f tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.158199 Sep 25 01:59:57.371210 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3453/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:57 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:58.393561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:58.394182 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:58.397078 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:59:58.398285 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 01:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae (ip 10.222.0.16) !!! Sep 25 01:59:58.404420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:58.404897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:58.405329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:58.406043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:58.406492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:58.407169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:58.537688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:58.545652 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a7d722e8-5971-4d27-b6d2-170ad8cfc62e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.155953 Sep 25 01:59:58.546236 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3428/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:58 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:59:59.569723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:59:59.570543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:59:59.577664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:59.578168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:59.578618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:59.579353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:59:59.579818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:59:59.580280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:59:59.712466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:59:59.720362 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90318031-d1be-4bb8-97d9-8a5961abe28a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.155108 Sep 25 01:59:59.720945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3454/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 01:59:59 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:00.744954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:00.745629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:00.752717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:00.753208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:00.753676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:00.754392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:00.754852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:00.755284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:00.883951 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:00.891705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5dc89213-a3ad-4e51-801a-e8f000b952f9 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.151225 Sep 25 02:00:00.892291 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3429/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:00 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:01.915319 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:01.915953 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:01.923191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:01.923733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:01.924194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:01.924953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:01.925491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:01.925976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:01.930326 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=89 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:02.054790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:02.062559 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51fb84b1-0e4d-4cbb-8476-16d2b68b951b tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1518 microversion: 2.1 time: 0.151210 Sep 25 02:00:02.063141 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3455/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:01 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:03.085806 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:03.086439 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:03.094104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:03.094596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:03.095040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:03.095746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:03.096284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:03.096722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:03.230215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:03.237968 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22c1fc3a-2d98-4c77-b5a8-46cf02c48eb8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1517 microversion: 2.1 time: 0.156448 Sep 25 02:00:03.238565 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3430/6885] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:03 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:03.630480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6528ea-8372-4925-a22c-a798f4647497"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:03.640776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:03.641275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:03.641755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:03.654389 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] Creating event network-vif-unplugged:4c6528ea-8372-4925-a22c-a798f4647497 for instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae on n-h1-master-1 Sep 25 02:00:03.660326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:00:03.671689 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-248dd997-c8b9-438a-a304-03fc678a11df req-5a745094-9197-42bf-8626-609c852f3ada service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097453 Sep 25 02:00:03.672306 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3456/6886] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:00:04.262208 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:04.262730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:04.269480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:04.269963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:04.270401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:04.271095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:04.271546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:04.271969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:04.274974 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:04.416736 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:04.424994 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-39a82c37-4119-4271-bf8d-0ea1ceae83f8 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1517 microversion: 2.1 time: 0.166764 Sep 25 02:00:04.426348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3431/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:04 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:05.451146 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:05.451898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:05.458283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:05.458795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:05.459258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:05.460740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:05.461228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:05.461711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:05.597201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:05.605010 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bccc5ed2-36d0-43ab-9b31-ff754f8d54b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1515 microversion: 2.1 time: 0.159225 Sep 25 02:00:05.605683 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3457/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:05 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:00:05.687371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae", "tag": "4c6528ea-8372-4925-a22c-a798f4647497"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:05.698322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:05.698808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:05.699248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:05.711653 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] Creating event network-changed:4c6528ea-8372-4925-a22c-a798f4647497 for instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae on n-h1-master-1 Sep 25 02:00:05.717018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:00:05.728060 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-dde33151-35fe-4ff3-8215-59ad5c9bf7af req-616d9050-b69a-4bdf-b1f6-175d7d77844d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044430 Sep 25 02:00:05.728656 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3432/6889] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:00:06.628436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:06.629071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:06.636643 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:06.637142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:06.637628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:06.638966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:06.639475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:06.639918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:06.778066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:06.785981 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6c6d65bf-717c-4e7b-a3e9-8b046475e432 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1512 microversion: 2.1 time: 0.161756 Sep 25 02:00:06.786559 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3458/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:06 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:06.810624 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:06.811260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:06.817566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:06.818072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:06.818511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:06.819788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:06.820244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:06.820670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:06.878076 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-25438615-e6a7-412a-9d2c-eafd899b2f2c tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "POST /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae/action" status: 204 len: 0 microversion: 2.1 time: 0.072546 Sep 25 02:00:06.878716 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3433/6891] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:00:06 2022] POST /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 02:00:06.892304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:06.893220 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:06.900331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:06.901083 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:06.901581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:06.902305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:06.902781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:06.903223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:07.141445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:07.149969 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-977d5799-7a23-46b1-9639-4641f1a9be2a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1512 microversion: 2.1 time: 0.266213 Sep 25 02:00:07.151019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3459/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:06 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:08.174323 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:08.175062 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:08.182780 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:08.183269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:08.183713 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:08.184406 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:08.184862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:08.185292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:08.322648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:08.330544 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-22924db3-5a77-4f17-a935-6dd4a80b0114 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1512 microversion: 2.1 time: 0.160480 Sep 25 02:00:08.334065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3434/6893] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:08 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:08.696145 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-138ff42c-99e9-4cc6-92dc-8e65a9ed4bd6 req-a80c6e11-4dd3-4143-b102-f26d911c600e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae", "name": "network-vif-plugged", "status": "completed", "tag": "4c6528ea-8372-4925-a22c-a798f4647497"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:08.706658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-138ff42c-99e9-4cc6-92dc-8e65a9ed4bd6 req-a80c6e11-4dd3-4143-b102-f26d911c600e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:08.707171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-138ff42c-99e9-4cc6-92dc-8e65a9ed4bd6 req-a80c6e11-4dd3-4143-b102-f26d911c600e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:08.707655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-138ff42c-99e9-4cc6-92dc-8e65a9ed4bd6 req-a80c6e11-4dd3-4143-b102-f26d911c600e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:08.720067 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-138ff42c-99e9-4cc6-92dc-8e65a9ed4bd6 req-a80c6e11-4dd3-4143-b102-f26d911c600e service nova] Creating event network-vif-plugged:4c6528ea-8372-4925-a22c-a798f4647497 for instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae on n-h1-master-1 Sep 25 02:00:08.725456 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-138ff42c-99e9-4cc6-92dc-8e65a9ed4bd6 req-a80c6e11-4dd3-4143-b102-f26d911c600e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033495 Sep 25 02:00:08.726072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3460/6894] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:00:09.355504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:09.356126 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:09.362746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.363231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.363667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.364360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.364815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.365245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.494546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:09.502386 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-081274c9-03af-4904-b2ee-f1cf58c220e1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1504 microversion: 2.1 time: 0.150999 Sep 25 02:00:09.502968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3435/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:09 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:09.525641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:09.526368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:09.532971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.533505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.533965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.534673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.535144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.535587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.673706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:09.682096 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8eb7486f-569a-4649-862c-1a7820af7e4a tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1504 microversion: 2.1 time: 0.160737 Sep 25 02:00:09.682670 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3461/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:09 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:09.703796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:09.704422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:09.711105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.711593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.712035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.712739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.713197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.713657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.841111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:09.848773 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8688a5e6-438d-4420-9f70-e62dece1c8b1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1504 microversion: 2.1 time: 0.148857 Sep 25 02:00:09.849349 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3436/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:09 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:09.871316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:09.871833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:09.878208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.878711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.879168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.879875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:09.880350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:09.880794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:09.906023 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:00:09.982026 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-db454099-22ab-4b48-8b7c-fe63bbe0190e tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 204 len: 0 microversion: 2.1 time: 0.114485 Sep 25 02:00:09.982625 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3462/6898] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:00:09 2022] DELETE /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:00:10.000265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:10.000770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:10.007541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:10.008034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:10.008476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:10.009183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:10.009660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:10.010089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:10.035573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:00:10.080220 n-d-master-1 devstack@n-api.service[122384]: INFO nova.compute.api [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Instance is already in deleting state, ignoring this request Sep 25 02:00:10.081047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb14934f-fc04-487f-9232-680295105d13 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 204 len: 0 microversion: 2.1 time: 0.084809 Sep 25 02:00:10.081656 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3437/6899] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:00:09 2022] DELETE /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:00:10.090526 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:10.091256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:10.097180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:10.097711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:10.098175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:10.098887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:10.099364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:10.099813 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:10.235316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:10.243068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af683db0-c24b-4f26-81a0-4a23fbc182cf tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1510 microversion: 2.1 time: 0.156814 Sep 25 02:00:10.243649 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3463/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:10 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:11.266593 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:11.267205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:11.274125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:11.274604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:11.275044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:11.275732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:11.276181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:11.276615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:11.408328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa684ff6c6c4beca6835a46dc9b7938', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779611b4d82845a48d34180747a77c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:11.416978 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-289daa3f-5f0a-4782-9295-fadcdbd6c265 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 200 len: 1510 microversion: 2.1 time: 0.154304 Sep 25 02:00:11.417585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3438/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:11 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:12.064217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-361eea19-77e8-4f7e-9ab2-a858894f3473 req-28706558-0582-49af-b2e9-77a6fd745d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae", "name": "network-vif-deleted", "tag": "4c6528ea-8372-4925-a22c-a798f4647497"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:12.077815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-361eea19-77e8-4f7e-9ab2-a858894f3473 req-28706558-0582-49af-b2e9-77a6fd745d4a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:12.078309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-361eea19-77e8-4f7e-9ab2-a858894f3473 req-28706558-0582-49af-b2e9-77a6fd745d4a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:12.078756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-361eea19-77e8-4f7e-9ab2-a858894f3473 req-28706558-0582-49af-b2e9-77a6fd745d4a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:12.092772 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-361eea19-77e8-4f7e-9ab2-a858894f3473 req-28706558-0582-49af-b2e9-77a6fd745d4a service nova] Creating event network-vif-deleted:4c6528ea-8372-4925-a22c-a798f4647497 for instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae on n-h1-master-1 Sep 25 02:00:12.099740 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-361eea19-77e8-4f7e-9ab2-a858894f3473 req-28706558-0582-49af-b2e9-77a6fd745d4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038897 Sep 25 02:00:12.100631 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3464/6902] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:00:12.439800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:12.440432 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:12.443305 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=36 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:12.449161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:12.449678 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:12.450126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:12.450832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:12.451290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:12.451722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:12.465844 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] HTTP exception thrown: Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae could not be found. Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Request method failure captured: Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae HTTP/1.1 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7XEp_E19DIB0eI9tQSrxpysfcSyeIHNyzU4sFgIDyXR4-cDY3LsaijXlt-t9Lj9tV1zjowpwm-C3NxiUIbUyU1Pc2V0gYcYZAjJfNzLwOGiP-zFfJdIGqtetEjytxOXjSxLcoXOYxtaT9P0nMfqYZY7ra40LcOiUAOdTuwjwrc5-Y0 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 779611b4d82845a48d34180747a77c16 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/779611b4d82845a48d34180747a77c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/779611b4d82845a48d34180747a77c16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/779611b4d82845a48d34180747a77c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_779611b4d82845a48d34180747a77c16"}]}] Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 779611b4d82845a48d34180747a77c16 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerDiskConfigTestJSON-1141086283-project Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1fa684ff6c6c4beca6835a46dc9b7938 Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerDiskConfigTestJSON-1141086283-project Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae could not be found. Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae'} Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae could not be found. Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae could not be found. Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:00:12.467505 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae could not be found. Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Returning 404 to user: Instance 90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-41df3c9b-fcfa-408b-b9a1-91b43dedc773 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae" status: 404 len: 111 microversion: 2.1 time: 0.033160 Sep 25 02:00:12.471763 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3439/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:12 2022] GET /compute/v2.1/servers/90edbf50-f1cc-4d25-b6bd-8bcd90ee2cae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:00:12.478265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e42a34e-ac88-4c79-8799-86b36d0c7dd1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '.version_select at 0x7f7bebc70a60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:12.497495 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e42a34e-ac88-4c79-8799-86b36d0c7dd1 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772528486" status: 202 len: 0 microversion: 2.1 time: 0.023284 Sep 25 02:00:12.497987 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3465/6904] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 25 02:00:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772528486 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:00:13.091138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:13.091668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:13.097724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:13.098223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:13.098667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:13.099401 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:13.099867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:13.100465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:13.114200 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] HTTP exception thrown: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Request method failure captured: Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 HTTP/1.1 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7XEp_E19DIB0eI9tQSrxpysfcSyeIHNyzU4sFgIDyXR4-cDY3LsaijXlt-t9Lj9tV1zjowpwm-C3NxiUIbUyU1Pc2V0gYcYZAjJfNzLwOGiP-zFfJdIGqtetEjytxOXjSxLcoXOYxtaT9P0nMfqYZY7ra40LcOiUAOdTuwjwrc5-Y0 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 779611b4d82845a48d34180747a77c16 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/779611b4d82845a48d34180747a77c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/779611b4d82845a48d34180747a77c16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/779611b4d82845a48d34180747a77c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_779611b4d82845a48d34180747a77c16"}]}] Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 779611b4d82845a48d34180747a77c16 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerDiskConfigTestJSON-1141086283-project Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 1fa684ff6c6c4beca6835a46dc9b7938 Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerDiskConfigTestJSON-1141086283-project Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '9fbdb0f4-1c01-424c-abe8-49c65cd21875'} Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:00:13.115826 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Returning 404 to user: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cbefb464-c8a2-4c09-b3c5-9d9641eb8dc6 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 404 len: 111 microversion: 2.1 time: 0.030029 Sep 25 02:00:13.119961 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3440/6905] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:00:13 2022] DELETE /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:00:13.127702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:13.128464 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] [instance: 9fbdb0f4-1c01-424c-abe8-49c65cd21875] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:13.135786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:13.136291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:13.136752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:13.137544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:13.138022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:13.138469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:13.152191 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] HTTP exception thrown: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Request method failure captured: Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 HTTP/1.1 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7XEp_E19DIB0eI9tQSrxpysfcSyeIHNyzU4sFgIDyXR4-cDY3LsaijXlt-t9Lj9tV1zjowpwm-C3NxiUIbUyU1Pc2V0gYcYZAjJfNzLwOGiP-zFfJdIGqtetEjytxOXjSxLcoXOYxtaT9P0nMfqYZY7ra40LcOiUAOdTuwjwrc5-Y0 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 779611b4d82845a48d34180747a77c16 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/779611b4d82845a48d34180747a77c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/779611b4d82845a48d34180747a77c16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/779611b4d82845a48d34180747a77c16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_779611b4d82845a48d34180747a77c16"}]}] Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 779611b4d82845a48d34180747a77c16 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1141086283 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerDiskConfigTestJSON-1141086283-project Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 1fa684ff6c6c4beca6835a46dc9b7938 Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerDiskConfigTestJSON-1141086283-project Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '9fbdb0f4-1c01-424c-abe8-49c65cd21875'} Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:00:13.153887 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] Returning 404 to user: Instance 9fbdb0f4-1c01-424c-abe8-49c65cd21875 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-91dded87-bc13-4222-9dd5-9e5ab04b1e37 tempest-ServerDiskConfigTestJSON-1141086283 tempest-ServerDiskConfigTestJSON-1141086283-project] 10.222.0.16 "GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875" status: 404 len: 111 microversion: 2.1 time: 0.032472 Sep 25 02:00:13.158443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3466/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:13 2022] GET /compute/v2.1/servers/9fbdb0f4-1c01-424c-abe8-49c65cd21875 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:00:22.000065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e7c26f86-6f90-49c9-ba3d-d544ce7acc0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'create', calling method: .version_select at 0x7f7beba788b0>, body: {"keypair": {"name": "tempest-keypair-1412630501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt9o5JF0oyZQ+iC7a4LBWes58lCfh/zpBzjASE7cMJ4ciVeKG8/lrNSbmIsM7TYDLP6bBTxV197yFAK6n6R4oL6+1mAb2hndfq13Nqr31U3HP7aWOUxwqLT1LqBn0Qn6Q=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:22.020507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e7c26f86-6f90-49c9-ba3d-d544ce7acc0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:00:22.026807 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-e7c26f86-6f90-49c9-ba3d-d544ce7acc0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:00:22.057894 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e7c26f86-6f90-49c9-ba3d-d544ce7acc0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188443 Sep 25 02:00:22.058519 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3441/6907] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:00:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:00:23.354075 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1349357445", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2ec60de-98ee-4ba1-a550-68bee1d2a04f"}], "security_groups": [{"name": "tempest-securitygroup--1808621022"}], "key_name": "tempest-keypair-1412630501", "user_data": "}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:23.363726 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:23.364406 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:23.473322 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] validate_networks() for [('d2ec60de-98ee-4ba1-a550-68bee1d2a04f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:00:23.938990 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:00:23.939434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:00:23.939935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:00:23.940363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:00:23.940796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:00:23.953042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:23.953586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:23.954043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:23.954817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:23.955286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:23.955903 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:23.975558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:00:23.980864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:00:23.993872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:00:23.996274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:00:24.047634 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23edda25-539f-4996-83c7-ea835aa397f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.698769 Sep 25 02:00:24.048495 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3467/6908] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:00:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:00:24.057595 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:24.062546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-66eb8049-c47c-42e8-a6fa-883c92327dd4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:24.063406 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-66eb8049-c47c-42e8-a6fa-883c92327dd4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:24.129069 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66eb8049-c47c-42e8-a6fa-883c92327dd4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:24.137630 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-66eb8049-c47c-42e8-a6fa-883c92327dd4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1239 microversion: 2.1 time: 0.081460 Sep 25 02:00:24.138469 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3442/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:24 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:25.160525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:25.161165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:25.169779 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:25.170294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:25.170753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:25.171476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:25.171956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:25.172399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:25.236692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:25.245328 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1fcce6ca-cd8f-4917-9d12-dac7d2fc031a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1291 microversion: 2.1 time: 0.088955 Sep 25 02:00:25.245952 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3468/6910] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:25 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1291 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:26.269638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:26.270813 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:26.277803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:26.278571 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:26.279190 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:26.280156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:26.280863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:26.281600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:26.451443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:26.464227 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2acf46cd-8d79-4dac-a5e8-10705bcc5318 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.199750 Sep 25 02:00:26.465145 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3443/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:26 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:27.154881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a43d507c-db25-4cf1-b670-0ab295881b2c req-c72892b7-673a-4230-bd01-8111a6c351e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:27.167242 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a43d507c-db25-4cf1-b670-0ab295881b2c req-c72892b7-673a-4230-bd01-8111a6c351e8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:27.167859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a43d507c-db25-4cf1-b670-0ab295881b2c req-c72892b7-673a-4230-bd01-8111a6c351e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:27.168290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a43d507c-db25-4cf1-b670-0ab295881b2c req-c72892b7-673a-4230-bd01-8111a6c351e8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:27.181637 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a43d507c-db25-4cf1-b670-0ab295881b2c req-c72892b7-673a-4230-bd01-8111a6c351e8 service nova] Creating event network-changed:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h1-master-1 Sep 25 02:00:27.186856 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a43d507c-db25-4cf1-b670-0ab295881b2c req-c72892b7-673a-4230-bd01-8111a6c351e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036123 Sep 25 02:00:27.187607 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3469/6912] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:00:27.488222 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:27.488886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:27.496360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:27.497364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:27.497364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:27.498003 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:27.498458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:27.498893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:27.632898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:27.640791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d6a9737-daee-466f-95a9-e142bfa5b198 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.156606 Sep 25 02:00:27.641363 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3444/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:27 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:00:28.665579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:28.666353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:28.672704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:28.673208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:28.673731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:28.674452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:28.674921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:28.675426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:28.815369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:28.824302 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-42cd7256-e86d-4a82-ace1-ebddd307af08 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.164141 Sep 25 02:00:28.824898 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3470/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:28 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:29.847925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:29.848558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:29.855636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:29.856126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:29.856572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:29.857271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:29.857762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:29.858197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:29.991926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:29.999785 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f3ad8da5-1c1c-4841-87eb-c754bd718bda tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.155801 Sep 25 02:00:30.000365 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3445/6915] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:29 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:31.023570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:31.024207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:31.031031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:31.031528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:31.032249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:31.032956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:31.033455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:31.033897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:31.169286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:31.179467 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d48003e-c92f-445c-aa5d-b922df40a583 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.160479 Sep 25 02:00:31.180612 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3471/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:31 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:32.202608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:32.203216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:32.211329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:32.211818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:32.212255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:32.212978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:32.213456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:32.213888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:32.341007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:32.348690 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-93d7d089-d333-4ed7-9e16-d082666cfdbb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.150116 Sep 25 02:00:32.349265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3446/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:32 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:32.755579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-103c5731-09f1-4d05-92d8-3dac6d501b52 req-e82ed242-1597-44c5-a7ff-de6dc4a871e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "name": "network-vif-plugged", "status": "completed", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:32.766017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-103c5731-09f1-4d05-92d8-3dac6d501b52 req-e82ed242-1597-44c5-a7ff-de6dc4a871e4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:32.766589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-103c5731-09f1-4d05-92d8-3dac6d501b52 req-e82ed242-1597-44c5-a7ff-de6dc4a871e4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:32.767195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-103c5731-09f1-4d05-92d8-3dac6d501b52 req-e82ed242-1597-44c5-a7ff-de6dc4a871e4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:32.783591 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-103c5731-09f1-4d05-92d8-3dac6d501b52 req-e82ed242-1597-44c5-a7ff-de6dc4a871e4 service nova] Creating event network-vif-plugged:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h1-master-1 Sep 25 02:00:32.790648 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-103c5731-09f1-4d05-92d8-3dac6d501b52 req-e82ed242-1597-44c5-a7ff-de6dc4a871e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038451 Sep 25 02:00:32.791665 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3472/6918] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:00:33.370479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:33.371097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:33.377958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:33.378442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:33.378887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:33.379579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:33.380036 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:33.380462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:33.510421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:33.518183 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-66121be9-3df2-4c97-9014-2bfb33290ce3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1365 microversion: 2.1 time: 0.151680 Sep 25 02:00:33.518757 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3447/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:33 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:00:34.545634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:34.546365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:34.549251 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:34.549972 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:34.556788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:34.557298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:34.557792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:34.558508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:34.558988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:34.559434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:34.694461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:00:34.702959 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48cff885-e148-4c03-b3d5-78f85de1e7d1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1551 microversion: 2.1 time: 0.162013 Sep 25 02:00:34.703535 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3473/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:00:34 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:00:34.725706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:00:34.726215 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:00:34.728082 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:00:34.734363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:34.734824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:34.735268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:34.736018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:34.736508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:34.736943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:34.813735 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f87d227d-fe93-4304-a2cf-93e339d7097f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091940 Sep 25 02:00:34.814348 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3448/6921] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 02:00:34 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:00:35.866635 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f9329380-9f0d-4ed9-9b3b-a7fe44cbff23 req-b1252aba-7011-4283-8886-a43f83db03be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:00:35.877820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9329380-9f0d-4ed9-9b3b-a7fe44cbff23 req-b1252aba-7011-4283-8886-a43f83db03be service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:00:35.878415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9329380-9f0d-4ed9-9b3b-a7fe44cbff23 req-b1252aba-7011-4283-8886-a43f83db03be service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:00:35.879698 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f9329380-9f0d-4ed9-9b3b-a7fe44cbff23 req-b1252aba-7011-4283-8886-a43f83db03be service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:00:35.893446 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f9329380-9f0d-4ed9-9b3b-a7fe44cbff23 req-b1252aba-7011-4283-8886-a43f83db03be service nova] Creating event network-changed:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h1-master-1 Sep 25 02:00:35.897925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f9329380-9f0d-4ed9-9b3b-a7fe44cbff23 req-b1252aba-7011-4283-8886-a43f83db03be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035238 Sep 25 02:00:35.898945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3474/6922] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:11.820124 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:11.821039 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=34 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:11.826361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:11.826978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:11.834215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:11.834706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:11.835145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:11.835837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:11.836292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:11.836742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:11.977704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:11.986400 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0f5edd77-ffd0-4365-8f49-92c7b11bc65c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1669 microversion: 2.1 time: 0.168324 Sep 25 02:01:11.986997 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3449/6923] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:11 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:12.008900 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:12.009736 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=32 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:12.014240 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:12.015105 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:12.023197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.023704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.024168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.024879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.025357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.025833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.159790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:12.168459 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5dfe893a-6667-49e0-8475-eadec88f260c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1669 microversion: 2.1 time: 0.162027 Sep 25 02:01:12.169049 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3475/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:12 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:12.191188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:12.191809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:12.200657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.201144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.201639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.202340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.202792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.203216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.329357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:12.337113 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0965c30c-a876-4e64-a70d-eb7822914a9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1669 microversion: 2.1 time: 0.149784 Sep 25 02:01:12.337727 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3450/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:12 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:12.360995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:12.363221 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:12.369088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.369621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.370075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.370773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.371240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.371682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.400010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:12.408650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 02:01:12.415198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:01:12.415631 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:01:12.416264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:01:12.416689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:01:12.417114 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:01:12.481943 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0c9dde1-2728-419e-a69a-95153d2bdf62 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0/action" status: 202 len: 0 microversion: 2.1 time: 0.125808 Sep 25 02:01:12.482558 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3476/6926] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:01:12 2022] POST /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:01:12.490895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:12.491522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:12.500503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.500994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.501458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.502174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:12.502631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:12.503061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:12.915929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:12.924119 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7832a7ab-127b-4059-a8e3-934124afa050 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1678 microversion: 2.1 time: 0.437276 Sep 25 02:01:12.924683 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3451/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:12 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1678 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:13.948909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:13.949580 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:13.957626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:13.958145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:13.958689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:13.959410 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:13.959889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:13.960339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:14.097389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:14.105179 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7f8fc138-3797-42f3-8dd9-00d214b20246 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1678 microversion: 2.1 time: 0.161146 Sep 25 02:01:14.105795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3477/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:13 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:15.128459 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:15.129073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:15.138035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:15.138516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:15.138951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:15.139866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:15.140438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:15.140864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:15.270046 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:15.277760 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75de10c4-6408-4788-a42b-3b3f204eb861 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.153232 Sep 25 02:01:15.278329 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3452/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:15 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:16.302729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:16.303373 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:16.310328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:16.310834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:16.312038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:16.312803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:16.313281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:16.313761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:16.450242 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:16.458466 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c7a3a5e-db40-4b5f-a191-aac70ec7da9e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.159630 Sep 25 02:01:16.459050 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3478/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:16 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:17.482415 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:17.483081 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:17.490528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:17.491031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:17.491479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:17.492215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:17.492721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:17.493181 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:17.625430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:17.633195 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd162ae3-2336-4ace-a3bb-ec66ca8680aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.154789 Sep 25 02:01:17.633793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3453/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:17 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:18.656227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:18.656857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:18.663971 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:18.664596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:18.665057 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:18.665794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:18.666268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:18.666718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:18.797793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:18.805656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dcd143b6-2317-466a-9ad3-af8051e9b467 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.153392 Sep 25 02:01:18.806232 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3479/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:18 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:19.829573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:19.830198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:19.837026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:19.837551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:19.837991 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:19.838685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:19.839140 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:19.839567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:19.973320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:19.981039 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1182a04d-e0dd-4fbc-8fd3-efc8fd925846 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.156389 Sep 25 02:01:19.981634 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3454/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:19 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:21.005179 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:21.005863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:21.012667 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:21.013204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:21.013691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:21.014928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:21.015400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:21.015849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:21.145266 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:21.152948 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9a95eb2b-8e90-4c7e-983c-813c51f6fea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.151862 Sep 25 02:01:21.153542 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3480/6934] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:20 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:22.177389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:22.177968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:22.184774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:22.185245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:22.185724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:22.186688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:22.187243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:22.187672 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:22.321107 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:22.329458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-30c5266d-178a-417e-8c91-a4a94e23e871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.156014 Sep 25 02:01:22.330030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3455/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:22 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:23.353353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:23.354020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:23.361715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:23.362222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:23.362689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:23.363746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:23.363880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:23.364305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:23.495424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:23.503342 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b95ff77d-2243-450d-958c-b5a2f290603e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.153912 Sep 25 02:01:23.503918 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3481/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:23 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:24.526778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:24.527407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:24.535890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:24.536465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:24.536899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:24.537625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:24.538086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:24.538507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:24.672186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:24.680050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-362c9deb-4d59-4e8b-802a-771e9120d8f2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.157342 Sep 25 02:01:24.680632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3456/6937] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:24 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:25.704570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:25.705123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:25.711640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:25.712137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:25.712592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:25.713293 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:25.713795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:25.714238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:25.845640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:25.853330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b126dbd6-d085-44ce-b4e8-56c02b21e7d8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.153695 Sep 25 02:01:25.853938 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3482/6938] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:25 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:26.876171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:26.876800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:26.883453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:26.883945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:26.884390 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:26.885086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:26.885574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:26.886007 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:27.017384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:27.025166 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1736ec25-af79-4090-86ba-ae31b7a95b8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.153001 Sep 25 02:01:27.025778 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3457/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:26 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:28.050439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:28.051077 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:28.058279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:28.058778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:28.059232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:28.059939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:28.060413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:28.060858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:28.193454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:28.201246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b0048a87-794e-436c-b207-88a6350c333d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.155503 Sep 25 02:01:28.201852 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3483/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:28 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:29.225445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:29.226071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:29.232861 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:29.233349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:29.234362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:29.235057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:29.235520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:29.235954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:29.366573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:29.374510 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-88e2060e-cb26-407d-a5e7-c8dbfad1e1bc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.152905 Sep 25 02:01:29.375089 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3458/6941] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:29 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:30.398209 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:30.398879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:30.405941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:30.406444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:30.406900 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:30.407890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:30.408358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:30.408801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:30.550923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:30.559305 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f1e78c7-9da6-4fb2-9d36-92e02db5c53a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.165067 Sep 25 02:01:30.559892 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3484/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:30 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:31.583197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:31.583823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:31.590717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:31.591205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:31.591649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:31.592349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:31.592810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:31.593245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:31.725065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:31.732915 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a98eefb5-db6c-472c-a3b8-d1eac792eec7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1683 microversion: 2.1 time: 0.153744 Sep 25 02:01:31.733507 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3459/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:31 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:32.757017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:32.757679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:32.764606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:32.765100 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:32.765597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:32.766526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:32.767000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:32.767440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:32.981835 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:32.990299 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5b80c8f-e3b4-43bf-b4ce-a4a810d1bb6d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1682 microversion: 2.1 time: 0.237222 Sep 25 02:01:32.990962 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3485/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:32 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:33.057082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "name": "network-vif-unplugged", "status": "completed", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:33.067825 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:33.068426 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:33.068895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:33.081344 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] Creating event network-vif-unplugged:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h2-master-1 Sep 25 02:01:33.086929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:01:33.098852 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-93c54d13-b4a4-465f-a3e5-6c5c6b7e1c8d req-f3d080d8-9e15-4eb6-9d1b-e8a3d7cc53c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045497 Sep 25 02:01:33.099679 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3460/6945] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:34.014505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:34.015391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:34.023750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:34.024249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:34.024794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:34.025624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:34.026268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:34.026726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:34.235602 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:34.243454 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e78429df-7007-4794-8324-5f8f014f008b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1682 microversion: 2.1 time: 0.232912 Sep 25 02:01:34.244232 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3486/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:34 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:35.127326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:35.136928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:35.137420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:35.137906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:35.150409 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] Creating event network-changed:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h2-master-1 Sep 25 02:01:35.155727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:01:35.167475 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7edd953a-0ae0-451c-8cd1-b6e98c182ed1 req-059da192-b127-4a74-9c81-ca53f6aa92dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045147 Sep 25 02:01:35.168002 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3461/6947] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:35.268130 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:35.268770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:35.275748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:35.276257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:35.276723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:35.277470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:35.277955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:35.278429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:35.414495 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:35.423450 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-896c748b-7231-4344-b250-becc6d6d5e6c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1680 microversion: 2.1 time: 0.159591 Sep 25 02:01:35.424082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3487/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:35 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:36.449780 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:36.450501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:36.457147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:36.457664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:36.458106 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:36.458802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:36.459257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:36.459688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:36.591008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:36.599701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-edb6d78e-bc78-4398-9d94-8350d5547a48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1680 microversion: 2.1 time: 0.155150 Sep 25 02:01:36.600292 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3462/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:36 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:01:37.623248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:37.623920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:37.631605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:37.632121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:37.632582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:37.633303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:37.633810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:37.634260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:37.764687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:37.773065 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9fc31825-4058-453f-9617-551ecad2d3ac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1677 microversion: 2.1 time: 0.153762 Sep 25 02:01:37.773682 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3488/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:37 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:01:37.796189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:37.796737 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:37.803860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:37.804355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:37.804817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:37.805606 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:37.806074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:37.806509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:37.868758 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-569c16e3-26f0-433a-8787-084f17f20ec3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0/action" status: 204 len: 0 microversion: 2.1 time: 0.076450 Sep 25 02:01:37.869358 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3463/6951] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:01:37 2022] POST /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:01:37.878570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:37.879222 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:37.885244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:37.885993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:37.886466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:37.887333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:37.887648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:37.888546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:38.021320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:38.029151 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8db64ac6-94cf-4bcb-b69a-3f9a1fec2686 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1677 microversion: 2.1 time: 0.155646 Sep 25 02:01:38.029754 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3489/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:37 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:39.055960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:39.056596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:39.064209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:39.064701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:39.065138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:39.065850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:39.066301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:39.066729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:39.211792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:39.221175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5eea6adc-95aa-4ba4-b4e9-edcea888eb48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1677 microversion: 2.1 time: 0.171019 Sep 25 02:01:39.233863 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3464/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:39 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:39.778568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b6dd95b2-db41-42f1-bc1e-d1a7e0f3173b req-1b40e5c5-f37a-48b4-9a02-e441c0c1244f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "name": "network-vif-plugged", "status": "completed", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:39.789108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b6dd95b2-db41-42f1-bc1e-d1a7e0f3173b req-1b40e5c5-f37a-48b4-9a02-e441c0c1244f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:39.789872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b6dd95b2-db41-42f1-bc1e-d1a7e0f3173b req-1b40e5c5-f37a-48b4-9a02-e441c0c1244f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:39.790338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b6dd95b2-db41-42f1-bc1e-d1a7e0f3173b req-1b40e5c5-f37a-48b4-9a02-e441c0c1244f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:39.794439 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:39.804109 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b6dd95b2-db41-42f1-bc1e-d1a7e0f3173b req-1b40e5c5-f37a-48b4-9a02-e441c0c1244f service nova] Creating event network-vif-plugged:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h2-master-1 Sep 25 02:01:39.809235 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b6dd95b2-db41-42f1-bc1e-d1a7e0f3173b req-1b40e5c5-f37a-48b4-9a02-e441c0c1244f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035662 Sep 25 02:01:39.809874 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3490/6954] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:40.246357 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:40.246983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:40.254538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.255024 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.255465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.256167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.257008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.257134 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.259815 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:40.388165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:40.396348 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-287a6cc4-2e7b-42f1-83b3-0f6189457219 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1669 microversion: 2.1 time: 0.153925 Sep 25 02:01:40.396924 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3465/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:40 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:40.419753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:40.420479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:40.428000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.428507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.428973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.429718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.430198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.430646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.567183 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:40.574956 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-266d793f-e9a2-4c6b-8e54-f0bf7f0194e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1669 microversion: 2.1 time: 0.159748 Sep 25 02:01:40.575539 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3491/6956] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:40 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:40.597695 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:40.598316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:40.604220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.604705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.605152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.605868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.606324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.606750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.734620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:40.742920 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-71b9229f-2f58-4e40-836b-9232bb74bf47 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1669 microversion: 2.1 time: 0.149722 Sep 25 02:01:40.743515 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3466/6957] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:40 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:40.765109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:40.765699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:40.771931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.772440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.772901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.773653 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.774131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.774579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.802045 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:01:40.876596 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23ccc318-be4f-4c7c-aadb-54aac80f5756 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 204 len: 0 microversion: 2.1 time: 0.115059 Sep 25 02:01:40.877309 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3492/6958] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:01:40 2022] DELETE /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:01:40.885977 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:40.886648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:40.892796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.893286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.893755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:40.894452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:40.894912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:40.895341 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:41.023498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:41.032074 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a65a3cbf-5e7d-4c0a-8f25-481cf5b15796 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1675 microversion: 2.1 time: 0.149311 Sep 25 02:01:41.032917 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3467/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:40 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:42.056746 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:42.057509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:42.060294 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:42.067421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:42.067927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:42.068386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:42.069098 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:42.069616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:42.070061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:42.205528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:42.213603 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07f63439-9949-4e51-be8c-ea4f56eda2bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1675 microversion: 2.1 time: 0.161072 Sep 25 02:01:42.214188 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3493/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:42 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:43.238322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:43.238964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:43.241918 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=39 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:43.247422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:43.247923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:43.248365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:43.249080 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:43.249631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:43.250707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:43.415880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:43.424561 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2402bfeb-d196-4d07-a5fd-e9f6fe71d02f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 200 len: 1607 microversion: 2.1 time: 0.191006 Sep 25 02:01:43.425156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3468/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:43 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 1607 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:43.593038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-60bc475f-398a-41cf-9e0b-ca2f324b6286 req-43820adf-fe02-44e8-a074-02c7dc3c5ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3892fb7c-d41d-4f41-bd33-c5d70befaee0", "name": "network-vif-deleted", "tag": "9e574450-3e36-44f6-93a9-90a3873be0c0"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:43.606329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-60bc475f-398a-41cf-9e0b-ca2f324b6286 req-43820adf-fe02-44e8-a074-02c7dc3c5ab8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:43.606840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-60bc475f-398a-41cf-9e0b-ca2f324b6286 req-43820adf-fe02-44e8-a074-02c7dc3c5ab8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:43.607295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-60bc475f-398a-41cf-9e0b-ca2f324b6286 req-43820adf-fe02-44e8-a074-02c7dc3c5ab8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:43.620753 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-60bc475f-398a-41cf-9e0b-ca2f324b6286 req-43820adf-fe02-44e8-a074-02c7dc3c5ab8 service nova] Creating event network-vif-deleted:9e574450-3e36-44f6-93a9-90a3873be0c0 for instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 on n-h2-master-1 Sep 25 02:01:43.626458 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-60bc475f-398a-41cf-9e0b-ca2f324b6286 req-43820adf-fe02-44e8-a074-02c7dc3c5ab8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037356 Sep 25 02:01:43.627077 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3494/6962] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:44.448423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:44.449189 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:44.456984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:44.457519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:44.458586 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:44.459449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:44.459920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:44.460364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:44.475791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 HTTP/1.1 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3892fb7c-d41d-4f41-bd33-c5d70befaee0'} Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:01:44.477503 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-15e17f0a-9d8c-4517-a765-86e2f36beb93 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 404 len: 111 microversion: 2.1 time: 0.034639 Sep 25 02:01:44.482014 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3469/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:44 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:01:44.493516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:44.494270 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:44.501338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:44.501916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:44.502378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:44.503111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:44.503609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:44.504246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:44.519146 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 HTTP/1.1 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3892fb7c-d41d-4f41-bd33-c5d70befaee0'} Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:01:44.520857 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:01:44.525246 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca15f437-428a-4c86-8141-0233256160ca tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 404 len: 111 microversion: 2.1 time: 0.033916 Sep 25 02:01:44.531340 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3495/6964] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:44 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:01:44.572183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1894305211", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "d2ec60de-98ee-4ba1-a550-68bee1d2a04f"}], "security_groups": [{"name": "tempest-securitygroup--1808621022"}], "key_name": "tempest-keypair-1412630501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:44.682376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] validate_networks() for [('d2ec60de-98ee-4ba1-a550-68bee1d2a04f', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:01:45.140498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:01:45.141007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:01:45.141517 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:01:45.141933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:01:45.142352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:01:45.151235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:45.151721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:45.152192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:45.152924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:45.153381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:45.153836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:45.174600 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:01:45.179924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:01:45.192401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:01:45.194769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:01:45.241795 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4b9d5739-01b0-4ab7-bb00-f412a0d4365d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673498 Sep 25 02:01:45.242445 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3470/6965] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:01:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:01:45.254232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-37e4b6b0-ea97-47b0-bf5d-ebb3401afa86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:45.254878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-37e4b6b0-ea97-47b0-bf5d-ebb3401afa86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:45.315984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-37e4b6b0-ea97-47b0-bf5d-ebb3401afa86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:45.325105 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-37e4b6b0-ea97-47b0-bf5d-ebb3401afa86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1239 microversion: 2.1 time: 0.075035 Sep 25 02:01:45.325719 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3496/6966] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:45 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:46.349130 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:46.349866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:46.357924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:46.358434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:46.358879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:46.359636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:46.360094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:46.360519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:46.456010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:46.464693 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e025fcf-981a-4a04-b374-d7bfc11908a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1309 microversion: 2.1 time: 0.119687 Sep 25 02:01:46.465280 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3471/6967] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:46 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:47.490461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:47.491097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:47.498924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:47.499434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:47.499920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:47.500818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:47.501488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:47.501958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:47.708417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:47.716525 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f4cb5eb-18e5-432d-a0a1-a1cc9dcf77d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.230150 Sep 25 02:01:47.717182 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3497/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:47 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:47.831699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3cea5cf4-8550-45ef-9c75-12a83470e2fe req-5bf741ef-15af-434f-b11a-e4942578939b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:47.843141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3cea5cf4-8550-45ef-9c75-12a83470e2fe req-5bf741ef-15af-434f-b11a-e4942578939b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:47.844476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3cea5cf4-8550-45ef-9c75-12a83470e2fe req-5bf741ef-15af-434f-b11a-e4942578939b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:47.845290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3cea5cf4-8550-45ef-9c75-12a83470e2fe req-5bf741ef-15af-434f-b11a-e4942578939b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:47.857389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3cea5cf4-8550-45ef-9c75-12a83470e2fe req-5bf741ef-15af-434f-b11a-e4942578939b service nova] Creating event network-changed:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h2-master-1 Sep 25 02:01:47.862910 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3cea5cf4-8550-45ef-9c75-12a83470e2fe req-5bf741ef-15af-434f-b11a-e4942578939b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047169 Sep 25 02:01:47.863519 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3472/6969] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:48.740579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:48.741219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:48.748124 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:48.748626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:48.749082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:48.749824 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:48.750306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:48.750945 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:48.887882 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:48.896251 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d784d7b3-b1d6-45cb-af48-aae7853d45da tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.159621 Sep 25 02:01:48.896841 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3498/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:48 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:49.920507 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:49.921246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:49.929067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:49.929596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:49.930038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:49.930735 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:49.931200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:49.931633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:50.060575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:50.068552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de2c5e44-4220-4384-9767-77db733d9632 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.152326 Sep 25 02:01:50.069118 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3473/6971] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:49 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:51.092656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:51.093287 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:51.100993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:51.101518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:51.101975 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:51.102669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:51.103137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:51.103575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:51.231899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:51.240536 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4eacf2c-e5e9-492e-a03c-c26b5de91898 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.151802 Sep 25 02:01:51.241108 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3499/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:51 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:52.263843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:52.264468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:52.271716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:52.272204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:52.272649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:52.273350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:52.273842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:52.274304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:52.412334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:52.420049 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d32dfa2-46bc-4129-9fb7-32d154a71ef5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.160147 Sep 25 02:01:52.420618 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3474/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:52 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:53.444547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:53.445176 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:53.452024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:53.452519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:53.453626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:53.454661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:53.455133 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:53.455575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:53.586123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:53.593915 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ed64c44-60a9-403c-98c4-cb5120ce53b7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.153254 Sep 25 02:01:53.594571 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3500/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:53 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:01:53.885146 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-cc25926a-24a6-467b-aaf2-4be1ac493145 req-c8fbfed5-c9b4-47a0-bb42-603fe2970a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "name": "network-vif-plugged", "status": "completed", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:53.897750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cc25926a-24a6-467b-aaf2-4be1ac493145 req-c8fbfed5-c9b4-47a0-bb42-603fe2970a4e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:53.898244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cc25926a-24a6-467b-aaf2-4be1ac493145 req-c8fbfed5-c9b4-47a0-bb42-603fe2970a4e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:53.898683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-cc25926a-24a6-467b-aaf2-4be1ac493145 req-c8fbfed5-c9b4-47a0-bb42-603fe2970a4e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:53.910545 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-cc25926a-24a6-467b-aaf2-4be1ac493145 req-c8fbfed5-c9b4-47a0-bb42-603fe2970a4e service nova] Creating event network-vif-plugged:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h2-master-1 Sep 25 02:01:53.915830 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-cc25926a-24a6-467b-aaf2-4be1ac493145 req-c8fbfed5-c9b4-47a0-bb42-603fe2970a4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Sep 25 02:01:53.916980 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3475/6975] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:54.617509 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:54.618148 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:54.624626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:54.625158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:54.625641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:54.626350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:54.626820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:54.627263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:54.756938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:54.764587 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cace8b57-8697-482e-ae87-255742ab7f0e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1365 microversion: 2.1 time: 0.151220 Sep 25 02:01:54.765158 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3501/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:54 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:55.788983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:55.789725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:55.792717 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:55.793384 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:55.800100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:55.800593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:55.801037 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:55.801773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:55.802231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:55.802658 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:55.935599 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:01:55.944230 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0fa99384-421f-4a2f-b19d-7f65b4d30457 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1552 microversion: 2.1 time: 0.159544 Sep 25 02:01:55.944811 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3476/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:01:55 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:01:55.968149 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:01:55.969260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:01:55.971495 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:01:55.980121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:55.980624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:55.981081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:55.981820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:55.982296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:55.982741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:56.059870 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-167d3445-fcc3-4d02-9e3f-d268660c38f7 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095612 Sep 25 02:01:56.060512 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3502/6978] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 02:01:55 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:01:56.983132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-34f0865c-5853-4b2d-891c-38137feb2a4a req-48b367ed-f2d6-4378-ba18-451184c9610c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:01:56.994320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-34f0865c-5853-4b2d-891c-38137feb2a4a req-48b367ed-f2d6-4378-ba18-451184c9610c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:01:56.994880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-34f0865c-5853-4b2d-891c-38137feb2a4a req-48b367ed-f2d6-4378-ba18-451184c9610c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:01:56.995386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-34f0865c-5853-4b2d-891c-38137feb2a4a req-48b367ed-f2d6-4378-ba18-451184c9610c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:01:57.007268 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-34f0865c-5853-4b2d-891c-38137feb2a4a req-48b367ed-f2d6-4378-ba18-451184c9610c service nova] Creating event network-changed:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h2-master-1 Sep 25 02:01:57.012576 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-34f0865c-5853-4b2d-891c-38137feb2a4a req-48b367ed-f2d6-4378-ba18-451184c9610c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Sep 25 02:01:57.013272 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3477/6979] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:02:58.767622 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=21 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:02:58.768776 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:02:58.774089 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1c8b1e10-6f2e-4a06-9655-18f28ae2c706 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:02:58.782961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c8b1e10-6f2e-4a06-9655-18f28ae2c706 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:02:58.783498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c8b1e10-6f2e-4a06-9655-18f28ae2c706 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:02:58.783960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1c8b1e10-6f2e-4a06-9655-18f28ae2c706 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:02:58.806782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1c8b1e10-6f2e-4a06-9655-18f28ae2c706 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 02:02:58.848670 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1c8b1e10-6f2e-4a06-9655-18f28ae2c706 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.084149 Sep 25 02:02:58.849286 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3503/6980] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:02:58 2022] POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:02:58.856484 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:02:58.857676 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=57 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:02:58.863553 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:02:58.864456 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:02:58.872508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:02:58.872998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:02:58.873459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:02:58.874161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:02:58.874641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:02:58.875682 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:02:59.006797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:02:59.014679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4bb0a1a-9781-4c6a-8078-2b0b9313c0e4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.160946 Sep 25 02:02:59.015296 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3478/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:02:58 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:00.038741 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:00.039471 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:00.047158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:00.047712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:00.048170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:00.048879 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:00.049355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:00.049853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:00.183488 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:00.192294 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8df3d958-b591-4f81-bfcc-74e1ecdf20bf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.157881 Sep 25 02:03:00.192868 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3504/6982] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:00 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:01.216161 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:01.216776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:01.224331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:01.224815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:01.225253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:01.225973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:01.226428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:01.226854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:01.357661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:01.365454 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5eec59fd-8334-4119-89ec-48ca62dab2f8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.153262 Sep 25 02:03:01.366044 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3479/6983] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:01 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:02.390038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:02.391606 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:02.398347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:02.398844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:02.399296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:02.399994 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:02.400459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:02.400894 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:02.531265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:02.539306 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8d36cba-c62a-461c-bfc2-52f8a8ac8021 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.153198 Sep 25 02:03:02.539835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3505/6984] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:02 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:03.563265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:03.563888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:03.570723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:03.571213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:03.571656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:03.572358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:03.573457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:03.573898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:03.706762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:03.714580 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-260116dc-49d1-43ad-8ba7-52c1b78e1ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.155553 Sep 25 02:03:03.715156 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3480/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:03 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:04.739036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:04.739624 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:04.746465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:04.746970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:04.747433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:04.748145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:04.748620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:04.749067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:04.877727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:04.885593 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-53aa46aa-cbc5-494d-b83f-2f801a37f9d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.151325 Sep 25 02:03:04.886169 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3506/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:04 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:05.910319 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:05.910948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:05.917970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:05.918466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:05.919047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:05.919786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:05.920299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:05.920733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:06.057468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:06.065982 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce335680-30e9-4117-a0b8-99d8585ddf73 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.160226 Sep 25 02:03:06.066579 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3481/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:05 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:07.089561 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:07.090217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:07.097248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:07.097780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:07.098240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:07.098947 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:07.099420 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:07.099863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:07.227697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:07.236958 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e854d78b-2366-4509-8011-341fa08e8ad0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.151394 Sep 25 02:03:07.237563 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3507/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:07 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:08.261234 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:08.261882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:08.269314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:08.269877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:08.270379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:08.271085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:08.271545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:08.272010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:08.408760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:08.416625 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9930207f-b671-4e69-bad7-2201e5372911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.159274 Sep 25 02:03:08.417208 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3482/6989] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:08 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:09.440574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:09.441212 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:09.443728 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:03:09.443881 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c (ip 10.222.0.16) !!! Sep 25 02:03:09.450590 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:09.451091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:09.451547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:09.452258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:09.453336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:09.453817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:09.582965 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:09.590724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-365113a2-fa0b-4050-9d79-048c1ef1c200 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1657 microversion: 2.1 time: 0.154385 Sep 25 02:03:09.591297 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3508/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:09 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:09.614101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:09.616358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:09.622873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:09.623349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:09.623779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:09.625100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:09.625816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:09.626247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:09.653855 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:09.660369 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 02:03:09.666756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:03:09.667179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:03:09.667648 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:03:09.668053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:03:09.668461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:03:09.731533 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e4bab11f-e261-48c1-a9b5-0cb2204e72ab tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.122398 Sep 25 02:03:09.732331 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3483/6991] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:03:09 2022] POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:03:09.740946 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:09.741623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:09.747467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:09.747964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:09.748418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:09.749118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:09.750707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:09.751243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:09.924441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:09.932571 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dc90b9de-1fc8-4e2b-9bef-de7de19d348c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.195385 Sep 25 02:03:09.933157 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3509/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:09 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:10.958602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:10.959226 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:10.966031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:10.966516 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:10.966960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:10.967654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:10.968185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:10.968835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:11.103789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:11.112358 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1cefc1d7-5547-4d1b-8875-29136af7cea9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.158505 Sep 25 02:03:11.112939 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3484/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:10 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:12.136198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:12.136843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:12.144671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:12.145176 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:12.145678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:12.146401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:12.146881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:12.147330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:12.284341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:12.292166 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-492e92c6-f845-4722-b075-a73b16cbcac9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1685 microversion: 2.1 time: 0.159946 Sep 25 02:03:12.292750 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3510/6994] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:12 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:13.316110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:13.316727 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:13.323547 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:13.324029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:13.324466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:13.325153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:13.325641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:13.326067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:13.456412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:13.464228 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-113f5fa6-911d-4249-ac21-eea00fdaf1d3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1685 microversion: 2.1 time: 0.152048 Sep 25 02:03:13.464798 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3485/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:13 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:14.313297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "name": "network-vif-unplugged", "status": "completed", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:14.324206 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:14.324708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:14.325185 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:14.340530 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] Creating event network-vif-unplugged:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h1-master-1 Sep 25 02:03:14.346529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:03:14.357998 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-46bedbcf-0fb5-4d5f-a930-038c44b5cc27 req-ad2c4b81-140d-47c1-a7dc-9f420d69b926 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048622 Sep 25 02:03:14.358607 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3511/6996] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:03:14.488546 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:14.489176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:14.496176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:14.496661 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:14.497095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:14.497821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:14.498270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:14.498688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:14.640680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:14.648745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-551fb25e-322a-41a3-89ff-29b29dc428cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1684 microversion: 2.1 time: 0.164619 Sep 25 02:03:14.649319 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3486/6997] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:14 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:15.674135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:15.674863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:15.681135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:15.681669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:15.682134 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:15.682870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:15.683372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:15.683818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:15.816159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:15.824128 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d3c1be7-6d98-4e38-8fbe-a23b6a531504 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1682 microversion: 2.1 time: 0.155610 Sep 25 02:03:15.824708 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3512/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:15 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:03:16.397587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:16.408257 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:16.408733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:16.409164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:16.421808 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] Creating event network-changed:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h1-master-1 Sep 25 02:03:16.427443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:03:16.438867 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bc9ffc31-85e1-4047-b791-03ddc5540e4c req-b6fa3dbd-9f4e-43b4-a658-f27855fbfd75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045023 Sep 25 02:03:16.439480 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3487/6999] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:03:16.850803 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:16.851645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:16.858215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:16.859565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:16.860459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:16.861388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:16.861904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:16.862352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:17.082293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:17.090896 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-047c6179-f9d9-4909-9f59-54e8212c52cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1682 microversion: 2.1 time: 0.245313 Sep 25 02:03:17.091657 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3513/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:16 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:18.116129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:18.116770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:18.122960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:18.123434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:18.123869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:18.125087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:18.125638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:18.126061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:18.255121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:18.262926 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-79d467ee-977b-473e-be81-90d7d1cb9b86 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1678 microversion: 2.1 time: 0.151973 Sep 25 02:03:18.263502 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3488/7001] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:18 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:18.286018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:18.286586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:18.293460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:18.293967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:18.294446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:18.295145 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:18.295621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:18.296102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:18.353524 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24e31637-345d-4715-b8ff-470dd6c22168 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action" status: 204 len: 0 microversion: 2.1 time: 0.071521 Sep 25 02:03:18.354174 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3514/7002] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:03:18 2022] POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:03:18.363089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:18.363711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:18.369759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:18.370179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:18.370630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:18.371312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:18.371768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:18.372193 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:18.588016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:18.595817 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e1363ffc-8546-444d-8462-0ef4d447ba4c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1678 microversion: 2.1 time: 0.237359 Sep 25 02:03:18.596397 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3489/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:18 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:19.561504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "name": "network-vif-plugged", "status": "completed", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:19.572527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:19.573182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:19.573865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:19.588232 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] Creating event network-vif-plugged:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h1-master-1 Sep 25 02:03:19.594083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:03:19.604991 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a0b8d123-0abf-4de5-b993-9edce38ad67f req-cd8a6f3c-4feb-4bb9-a5ea-e6478059efa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054150 Sep 25 02:03:19.605990 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3515/7004] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:03:19.619972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:19.621115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:19.626251 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:03:19.626424 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c (ip 10.222.0.16) !!! Sep 25 02:03:19.638755 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:19.639316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:19.639817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:19.641174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:19.641730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:19.642293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:19.791532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:19.804611 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dae48992-8274-4d16-b30f-02f47a24f44c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1657 microversion: 2.1 time: 0.188439 Sep 25 02:03:19.805217 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3490/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:19 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1657 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:19.829650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:19.830431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:19.836797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:19.837304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:19.837795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:19.838512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:19.838999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:19.839448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:19.975197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:19.983056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a66fbdef-67d9-4ead-a605-24e75ef77a80 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1657 microversion: 2.1 time: 0.158669 Sep 25 02:03:19.983627 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3516/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:19 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:20.006987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c95fdca1-2b5d-4c7b-aa79-76be45631a6e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:20.012525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c95fdca1-2b5d-4c7b-aa79-76be45631a6e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:20.013010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c95fdca1-2b5d-4c7b-aa79-76be45631a6e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:20.013468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c95fdca1-2b5d-4c7b-aa79-76be45631a6e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:20.038659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c95fdca1-2b5d-4c7b-aa79-76be45631a6e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Going to try to start instance {{(pid=122384) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 02:03:20.081062 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c95fdca1-2b5d-4c7b-aa79-76be45631a6e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.078234 Sep 25 02:03:20.081713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3491/7007] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:03:20 2022] POST /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:03:20.090783 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:20.091415 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:20.097963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:20.098460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:20.098913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:20.099621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:20.100091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:20.100525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:20.234598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:20.242584 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f044c718-2831-4eaf-b7a9-db0414b850fb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1666 microversion: 2.1 time: 0.156523 Sep 25 02:03:20.243173 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3517/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:20 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:21.268702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:21.269480 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:21.275634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:21.276121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:21.276563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:21.277255 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:21.277741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:21.278175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:21.296887 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:21.414325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:21.422845 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-40c1f219-6b4e-4d37-95a1-98a751144f0a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1670 microversion: 2.1 time: 0.159891 Sep 25 02:03:21.423433 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3492/7009] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:21 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:21.445535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:21.446006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:21.452831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:21.453497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:21.454335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:21.455055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:21.455529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:21.455973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:21.458652 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:21.486646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:03:21.559837 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d788aac8-9695-4293-b0a6-348ca0f5ca39 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 204 len: 0 microversion: 2.1 time: 0.117886 Sep 25 02:03:21.560463 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3518/7010] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:03:21 2022] DELETE /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:03:21.569935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:21.570548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:21.576396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:21.576873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:21.577304 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:21.578284 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:21.578924 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:21.579357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:21.706907 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:21.714758 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e86eeb11-ee56-4922-a42f-7bd362aaf629 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1676 microversion: 2.1 time: 0.148792 Sep 25 02:03:21.715335 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3493/7011] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:21 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:22.739360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:22.740040 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:22.746922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:22.747429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:22.747890 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:22.748602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:22.749074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:22.750066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:22.885201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:22.893317 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e91c0ec3-f209-48ef-bba1-e2ec3291675e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1676 microversion: 2.1 time: 0.158355 Sep 25 02:03:22.893925 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3519/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:22 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:23.916435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:23.917221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:23.925082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:23.925712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:23.926173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:23.927384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:23.928163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:23.928607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:23.931652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-159e7eb5-6eb0-49af-a3e7-eba17a8fd0a4 req-8a975210-5767-4254-91cb-5e4f1aed5029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ea5849-886a-4184-9987-bfae0c1d2a0c", "name": "network-vif-deleted", "tag": "5bfcca91-2667-4c6e-8fda-03f6d72ec2e5"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:23.943028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-159e7eb5-6eb0-49af-a3e7-eba17a8fd0a4 req-8a975210-5767-4254-91cb-5e4f1aed5029 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:23.943526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-159e7eb5-6eb0-49af-a3e7-eba17a8fd0a4 req-8a975210-5767-4254-91cb-5e4f1aed5029 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:23.944243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-159e7eb5-6eb0-49af-a3e7-eba17a8fd0a4 req-8a975210-5767-4254-91cb-5e4f1aed5029 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:23.957522 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-159e7eb5-6eb0-49af-a3e7-eba17a8fd0a4 req-8a975210-5767-4254-91cb-5e4f1aed5029 service nova] Creating event network-vif-deleted:5bfcca91-2667-4c6e-8fda-03f6d72ec2e5 for instance 92ea5849-886a-4184-9987-bfae0c1d2a0c on n-h1-master-1 Sep 25 02:03:23.962342 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-159e7eb5-6eb0-49af-a3e7-eba17a8fd0a4 req-8a975210-5767-4254-91cb-5e4f1aed5029 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034383 Sep 25 02:03:23.964770 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3520/7013] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:03:24.005674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:24.014308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d76143e6-84a6-48d2-8780-553db6241f1a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 200 len: 1608 microversion: 2.1 time: 0.101744 Sep 25 02:03:24.015298 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3494/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:23 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 1608 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:25.040318 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:25.041055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:25.047801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:25.048312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:25.048759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:25.049497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:25.049970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:25.050414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:25.063774 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c HTTP/1.1 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '92ea5849-886a-4184-9987-bfae0c1d2a0c'} Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:03:25.065414 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-34be324a-5238-42a7-a5d3-0e721af1c10d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 404 len: 111 microversion: 2.1 time: 0.031825 Sep 25 02:03:25.070088 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3521/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:25 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:03:25.083674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:25.084299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:25.091220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:25.091705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:25.092144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:25.092840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:25.093301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:25.093758 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:25.112997 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c HTTP/1.1 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '92ea5849-886a-4184-9987-bfae0c1d2a0c'} Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:03:25.114738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd0cf2da-81c9-4e6e-9c7b-e7d8fcc79e33 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 404 len: 111 microversion: 2.1 time: 0.036467 Sep 25 02:03:25.119019 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3495/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:25 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:03:25.166251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1566139856", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "d2ec60de-98ee-4ba1-a550-68bee1d2a04f"}], "security_groups": [{"name": "tempest-securitygroup--1808621022"}], "key_name": "tempest-keypair-1412630501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:25.272092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] validate_networks() for [('d2ec60de-98ee-4ba1-a550-68bee1d2a04f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:03:25.649456 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:03:25.649911 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:03:25.650408 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:03:25.650836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:03:25.651267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:03:25.660557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:25.661054 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:25.661537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:25.662309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:25.662762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:25.663209 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:25.679962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:03:25.685180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:03:25.698083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:03:25.700397 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:03:25.747262 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f837d218-e47a-4019-838f-1e56db570285 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.584921 Sep 25 02:03:25.747919 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3522/7017] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:03:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:03:25.760025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c6136d96-8934-4baa-a5eb-e018f68af287 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:25.760651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c6136d96-8934-4baa-a5eb-e018f68af287 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:25.817543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c6136d96-8934-4baa-a5eb-e018f68af287 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:25.824565 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c6136d96-8934-4baa-a5eb-e018f68af287 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1239 microversion: 2.1 time: 0.068446 Sep 25 02:03:25.825237 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3496/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:25 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:26.849642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:26.850290 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:26.858376 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:26.858884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:26.859346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:26.860082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:26.860562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:26.861011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:26.941573 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:26.949567 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-05bd5e53-7ad4-4c82-a0be-96b46efc2505 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1299 microversion: 2.1 time: 0.103956 Sep 25 02:03:26.950160 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3523/7019] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:26 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:27.974375 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:27.974922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:27.983204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:27.983700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:27.984143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:27.984885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:27.985329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:27.985790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:28.294588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:28.304342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d213717f-c4e1-4ba2-ada2-dfc04d4450f6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.333995 Sep 25 02:03:28.304923 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3497/7020] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:27 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:03:28.753940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-41e360a6-1b61-45dc-bb41-d630759e5f02 req-fbd4097d-9cf0-4230-b324-5a9703943d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:28.766581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-41e360a6-1b61-45dc-bb41-d630759e5f02 req-fbd4097d-9cf0-4230-b324-5a9703943d32 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:28.767139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-41e360a6-1b61-45dc-bb41-d630759e5f02 req-fbd4097d-9cf0-4230-b324-5a9703943d32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:28.767597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-41e360a6-1b61-45dc-bb41-d630759e5f02 req-fbd4097d-9cf0-4230-b324-5a9703943d32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:28.781980 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-41e360a6-1b61-45dc-bb41-d630759e5f02 req-fbd4097d-9cf0-4230-b324-5a9703943d32 service nova] Creating event network-changed:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:03:28.788544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-41e360a6-1b61-45dc-bb41-d630759e5f02 req-fbd4097d-9cf0-4230-b324-5a9703943d32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038713 Sep 25 02:03:28.789447 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3524/7021] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:03:29.328233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:29.329397 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:29.332052 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=47 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:29.337802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:29.338292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:29.338731 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:29.339424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:29.339877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:29.340300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:29.477538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:29.485468 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2cf0dcf5-b327-47db-9803-359507e0628f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.161018 Sep 25 02:03:29.486049 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3498/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:29 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:03:30.509752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:30.510483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:30.512455 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:30.518999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:30.519499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:30.519957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:30.520670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:30.521139 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:30.521611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:30.650641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:30.659366 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c837b4af-8182-4ff2-9e12-1a32ec5ce751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.154752 Sep 25 02:03:30.659947 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3525/7023] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:30 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:31.683165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:31.684003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:31.691597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:31.692083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:31.692523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:31.693218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:31.693717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:31.694143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:31.826138 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:31.834378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b5a5b499-3222-464f-986c-16363117c491 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.155216 Sep 25 02:03:31.834946 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3499/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:31 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:32.857575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:32.858211 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:32.865260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:32.865791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:32.866246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:32.866955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:32.867425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:32.867871 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:33.001136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:33.008929 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ad969224-bcc1-4eca-ad23-b81003383510 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.155333 Sep 25 02:03:33.009536 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3526/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:32 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:34.032110 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:34.032730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:34.039942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:34.040529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:34.041029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:34.041905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:34.042363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:34.042793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:34.174993 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:34.182832 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8a4dbf37-afe7-4d42-8384-f325c0261c67 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.154647 Sep 25 02:03:34.183416 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3500/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:34 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:03:35.207826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:35.208738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:35.215610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:35.216110 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:35.216565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:35.217268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:35.217760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:35.218202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:35.351165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:35.358864 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8c638267-28fa-47f7-96b2-aac9bb510da5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.155363 Sep 25 02:03:35.360092 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3527/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:35 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:36.340802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0b8a6962-3e50-4689-8640-e8d2c4461831 req-45bb560b-9e4e-49a2-a1b7-d5295da1f5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "name": "network-vif-plugged", "status": "completed", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:36.347340 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:36.353810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0b8a6962-3e50-4689-8640-e8d2c4461831 req-45bb560b-9e4e-49a2-a1b7-d5295da1f5f7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:36.355350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0b8a6962-3e50-4689-8640-e8d2c4461831 req-45bb560b-9e4e-49a2-a1b7-d5295da1f5f7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:36.355350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0b8a6962-3e50-4689-8640-e8d2c4461831 req-45bb560b-9e4e-49a2-a1b7-d5295da1f5f7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:36.366367 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0b8a6962-3e50-4689-8640-e8d2c4461831 req-45bb560b-9e4e-49a2-a1b7-d5295da1f5f7 service nova] Creating event network-vif-plugged:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:03:36.371860 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0b8a6962-3e50-4689-8640-e8d2c4461831 req-45bb560b-9e4e-49a2-a1b7-d5295da1f5f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Sep 25 02:03:36.372632 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3501/7028] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:03:36.382722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:36.383353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:36.385220 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:36.386122 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:03:36.395012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:36.395459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:36.395901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:36.396611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:36.397078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:36.397562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:36.589113 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:36.597451 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ea5e1ae-b904-4a2e-a421-54aa18320476 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.218592 Sep 25 02:03:36.598033 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3528/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:36 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:37.623285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:37.623992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:37.631574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:37.632058 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:37.632493 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:37.633183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:37.633669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:37.634093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:37.762838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:37.771202 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5b1aef9-d7fb-42a3-8b2c-da8b0b3ac6bb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1365 microversion: 2.1 time: 0.152401 Sep 25 02:03:37.771778 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3502/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:37 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:03:38.794908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:38.795579 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:38.803042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:38.803547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:38.804006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:38.804725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:38.805199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:38.805670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:38.939806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:03:38.947514 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6bbbc95-fac7-4388-a572-6e7e348a6545 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1551 microversion: 2.1 time: 0.156554 Sep 25 02:03:38.948239 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3529/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:03:38 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:03:38.970889 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:03:38.971379 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:03:38.977782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:38.978263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:38.978702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:38.979392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:38.979848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:38.980275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:39.120005 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3396babd-0f75-4ad5-8894-bd74d8b38954 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153712 Sep 25 02:03:39.120599 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3503/7032] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 02:03:38 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:03:40.059681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-11075db2-e186-42fc-bc4b-95a706b49eb5 req-af7bfd0b-2aad-4b7c-aef1-488170bc4ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:03:40.070573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11075db2-e186-42fc-bc4b-95a706b49eb5 req-af7bfd0b-2aad-4b7c-aef1-488170bc4ea6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:03:40.071180 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11075db2-e186-42fc-bc4b-95a706b49eb5 req-af7bfd0b-2aad-4b7c-aef1-488170bc4ea6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:03:40.071642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11075db2-e186-42fc-bc4b-95a706b49eb5 req-af7bfd0b-2aad-4b7c-aef1-488170bc4ea6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:03:40.083502 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-11075db2-e186-42fc-bc4b-95a706b49eb5 req-af7bfd0b-2aad-4b7c-aef1-488170bc4ea6 service nova] Creating event network-changed:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:03:40.088950 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-11075db2-e186-42fc-bc4b-95a706b49eb5 req-af7bfd0b-2aad-4b7c-aef1-488170bc4ea6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032961 Sep 25 02:03:40.089666 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3530/7033] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:04:41.759517 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=11 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:41.760182 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=52 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:41.764851 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:04:41.767112 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:41.774268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:41.774746 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:41.775177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:41.775856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:41.776301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:41.776723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:41.805881 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:41.811275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Old instance type m1.heat2, new instance type m1.heat {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 02:04:41.818798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:04:41.819217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:04:41.819687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:04:41.820093 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:04:41.820501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:04:41.884116 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1343fda8-6576-4603-bb72-564d2a7d508e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.127154 Sep 25 02:04:41.884734 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3504/7034] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:04:41 2022] POST /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:04:41.892153 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=11 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:41.893019 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:04:41.898639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:41.899376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:41.907433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:41.908074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:41.909553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:41.910673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:41.911278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:41.911734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:42.114998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:42.122917 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2c83c1bf-7658-4599-906d-999d3d5f67d4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1678 microversion: 2.1 time: 0.233726 Sep 25 02:04:42.123513 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3531/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:41 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:43.148642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:43.149253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:43.156130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:43.156609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:43.157041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:43.157749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:43.158199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:43.159803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:43.296315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:43.304158 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f32f471d-4fe6-4cb1-ae3d-d45d05cb959c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1678 microversion: 2.1 time: 0.161041 Sep 25 02:04:43.304739 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3505/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:43 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:44.327468 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:44.328298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:44.335210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:44.335776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:44.336437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:44.337158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:44.337658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:44.338531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:44.488705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:44.496551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b312c71e-35f5-4592-8b51-125593749e51 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1678 microversion: 2.1 time: 0.173140 Sep 25 02:04:44.497120 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3532/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:44 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:45.520651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:45.521272 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:45.528178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:45.528662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:45.529099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:45.529816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:45.530273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:45.530698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:45.665034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:45.672918 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c4d005a4-4407-4c3e-90ec-8fa1c0469b49 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.157300 Sep 25 02:04:45.673521 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3506/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:45 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:46.696410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:46.697080 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:46.704044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:46.704549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:46.705019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:46.706362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:46.706840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:46.707294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:46.836818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:46.844705 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f462e181-b792-4d4b-ba73-1f2e6a5f8a8b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.152269 Sep 25 02:04:46.845215 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3533/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:46 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:47.868944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:47.869605 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:47.876664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:47.877226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:47.877868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:47.878573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:47.879032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:47.879457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:48.011441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:48.019261 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11594154-650f-4f5d-b609-e7ac3a722029 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.154337 Sep 25 02:04:48.019834 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3507/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:47 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:49.042831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:49.043497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:49.050967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:49.051471 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:49.051940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:49.052650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:49.053127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:49.053614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:49.183034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:49.191532 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9566a584-bfb7-40b2-ae34-74b9ffc76f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.152654 Sep 25 02:04:49.192139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3534/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:49 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:50.214201 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:50.214827 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:50.222197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:50.222677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:50.223122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:50.223816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:50.224277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:50.224704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:50.352576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:50.360353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6a7644e2-ca7e-4335-b168-2c1042dc3fdc tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.150113 Sep 25 02:04:50.360933 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3508/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:50 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:51.384022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:51.384661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:51.392246 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:51.392791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:51.393240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:51.393981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:51.394448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:51.394885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:51.528964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:51.537394 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7040acc4-bfc0-4c4d-b397-6ea94ee5eaac tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.157280 Sep 25 02:04:51.537994 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3535/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:51 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:52.561622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:52.562183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:52.569876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:52.570365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:52.570807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:52.571508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:52.571968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:52.572428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:52.706893 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:52.714888 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77051d1a-c341-4532-b08e-595b464a5b9b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.157410 Sep 25 02:04:52.715456 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3509/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:52 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:53.740533 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:53.741094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:53.748132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:53.748642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:53.749107 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:53.749855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:53.750333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:53.750780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:53.884527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:53.892290 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74fb2968-b7da-4df9-8766-21246d764202 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.156000 Sep 25 02:04:53.893706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3536/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:53 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:54.916891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:54.917450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:54.924425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:54.924905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:54.925343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:54.926059 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:54.926517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:54.926948 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:55.062058 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:55.070710 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bfe8a191-43e9-4326-83c8-898a9a1d449f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.157803 Sep 25 02:04:55.071302 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3510/7046] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:54 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:56.094306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:56.094943 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:56.102010 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:56.102516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:56.102977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:56.103691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:56.104166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:56.104617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:56.236259 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:56.244072 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-216f3fd6-8c03-4b8e-b789-00622f9ee933 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.153906 Sep 25 02:04:56.244653 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3537/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:56 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:56.972192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:04:56.983305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:56.983793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:56.984229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:56.997044 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] Creating event network-vif-unplugged:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h1-master-1 Sep 25 02:04:57.002763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:04:57.014216 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6fc42d40-121b-446e-9a45-1fbeb728e11d req-ab874e77-3857-40e8-8ee3-1dc9115d8f54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046489 Sep 25 02:04:57.014836 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3511/7048] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:04:57.271730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:57.272384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:57.279144 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:57.279656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:57.280115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:57.280828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:57.281301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:57.281773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:57.421939 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:57.430235 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-da654cba-88da-44a2-9cb3-b5bf321b006d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1682 microversion: 2.1 time: 0.165334 Sep 25 02:04:57.430850 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3538/7049] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:57 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:58.454423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:58.455320 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:58.462342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:58.462821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:58.463249 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:58.463929 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:58.464379 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:58.464799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:58.602424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:58.610170 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-496994c1-4384-46e4-8ba1-75b111be2e3e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1680 microversion: 2.1 time: 0.159997 Sep 25 02:04:58.610762 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3512/7050] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:58 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:04:59.051787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:04:59.061910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:59.062404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:59.062855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:59.074394 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] Creating event network-changed:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h1-master-1 Sep 25 02:04:59.079641 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:04:59.090938 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-980023ae-8f6b-4338-82a4-24313ea56f9d req-2012ed77-0cf0-483d-a722-6430ea6838cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042926 Sep 25 02:04:59.091526 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3539/7051] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:04:59.634183 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:04:59.634841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:04:59.642205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:59.643250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:59.643926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:59.644851 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:04:59.645585 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:04:59.646130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:04:59.777350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:04:59.786106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0c2619c-1730-4da7-80ca-92b3961fb8de tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1680 microversion: 2.1 time: 0.155787 Sep 25 02:04:59.786687 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3513/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:04:59 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:00.810275 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:00.810999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:00.817174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:00.817715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:00.818229 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:00.818877 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:00.819351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:00.819796 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:00.951607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:00.959905 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9606e843-449a-4660-a344-df407bcc3833 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1677 microversion: 2.1 time: 0.154783 Sep 25 02:05:00.960480 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3540/7053] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:00 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:00.983147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:00.983690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:00.990593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:00.991079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:00.991520 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:00.992212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:00.992667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:00.993094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:01.030367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:01.030846 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:01.031279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:01.032004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:01.032457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:01.033728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:01.053903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:05:01.059023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:05:01.157745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0276fe7e-08ff-456b-be03-62d2d5061152 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe/action" status: 202 len: 0 microversion: 2.1 time: 0.178175 Sep 25 02:05:01.159383 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3514/7054] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:05:00 2022] POST /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:05:01.167415 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:01.168047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:01.174326 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:01.174732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:01.175191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:01.175901 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:01.176385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:01.176862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:01.310411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:01.318348 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f88ee85-fc47-4751-9b76-3bc7f42afb03 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.154865 Sep 25 02:05:01.318917 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3541/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:01 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:02.343880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:02.344641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:02.353365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:02.353899 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:02.354868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:02.355838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:02.356185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:02.356615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:02.486772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:02.494523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3676bb52-d87d-4f0d-944f-75dd7ce687aa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.155878 Sep 25 02:05:02.495099 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3515/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:02 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:03.517395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:03.518059 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:03.524812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:03.525308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:03.525797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:03.526506 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:03.526976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:03.527418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:03.663018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:03.671025 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c75c806e-646c-4a6f-8033-c9ec1d1e52ed tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.157724 Sep 25 02:05:03.671609 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3542/7057] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:03 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:03.959756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "name": "network-vif-plugged", "status": "completed", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:03.969647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:03.970154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:03.970631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:03.982845 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] Creating event network-vif-plugged:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:05:03.985478 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:03.990754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:05:04.003810 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f3f446c2-c829-4023-9096-1e24feb94af9 req-3f2df6eb-dc08-403f-98c7-5fb22ef748c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115156 Sep 25 02:05:04.004814 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3516/7058] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:04.604350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:04.615092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:04.615718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:04.616238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:04.628175 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] Creating event network-vif-unplugged:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:05:04.633693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:05:04.644656 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-004e90d8-bcf7-454c-afa9-804b7f1c10b9 req-0e27b607-c15b-45d2-bb01-55ee53b123df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106723 Sep 25 02:05:04.645286 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3543/7059] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:04.696571 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:04.698032 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:04.708565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:04.709070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:04.709584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:04.710233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:04.710683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:04.711103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:04.934049 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:04.942353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-10834abd-1f0c-4ae2-b3e7-ef859185a857 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.250847 Sep 25 02:05:04.942933 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3517/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:04 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:05.968142 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:05.968855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:05.976582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:05.977079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:05.977558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:05.978272 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:05.978765 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:05.979203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:06.116900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:06.124895 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1ab28a06-09fc-4d1b-8ec8-d86e1e00dc4b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.161881 Sep 25 02:05:06.125491 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3544/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:05 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:06.662036 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:06.675842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:06.676327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:06.676769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:06.687741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] Creating event network-changed:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:05:06.693824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:05:06.704309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-998c6f43-48d9-41b2-bf29-86de6bf7142e req-af400eb1-0d74-4a4c-8200-9df7f7eb0bb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046229 Sep 25 02:05:06.705492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3518/7062] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:07.149019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:07.149711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:07.156528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:07.157030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:07.157538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:07.159447 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:07.159949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:07.160392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:07.303948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:07.311834 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5e6610a9-dfd9-4f81-bd4e-eb56874fd672 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.166730 Sep 25 02:05:07.312423 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3545/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:07 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:08.336810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:08.337543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:08.343789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:08.344273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:08.344714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:08.346173 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:08.346728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:08.347161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:08.590710 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:08.600610 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5d98b6e8-7f72-4c74-94e5-5b4d79f9535e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1676 microversion: 2.1 time: 0.269034 Sep 25 02:05:08.601201 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3519/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:08 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:09.623983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:09.624616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:09.631691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:09.632190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:09.632646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:09.633349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:09.633843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:09.634285 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:09.765954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:09.774382 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f4567b4-1ccf-483b-a84c-4bd329507658 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1669 microversion: 2.1 time: 0.154464 Sep 25 02:05:09.774961 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3546/7065] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:09 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:09.797304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:09.797954 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:09.805001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:09.805512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:09.805951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:09.806639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:09.807098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:09.807562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:09.934857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:09.943229 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0cdda145-535b-45b5-adbb-abc10682f465 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1669 microversion: 2.1 time: 0.149731 Sep 25 02:05:09.943807 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3520/7066] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:09 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:09.966629 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:09.967198 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:09.973503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:09.974006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:09.974465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:09.975179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:09.975652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:09.976094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:10.107099 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:10.115575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-51eccd6d-3ecc-4bd8-9ca7-b07ecb3d275f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1669 microversion: 2.1 time: 0.153582 Sep 25 02:05:10.116147 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3547/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:09 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:10.138204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:10.138712 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:10.144657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:10.145151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:10.145634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:10.146329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:10.146791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:10.147219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:10.172563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:05:10.246740 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-863da58e-9780-4c56-9f04-8af7beed6d02 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 204 len: 0 microversion: 2.1 time: 0.111987 Sep 25 02:05:10.247242 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3521/7068] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:05:10 2022] DELETE /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:05:10.257247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:10.257912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:10.263841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:10.264336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:10.264812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:10.265542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:10.266037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:10.266473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:10.270952 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=100 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:10.394423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:10.402121 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2717cc27-03d6-45a8-bc70-a791989111c5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1675 microversion: 2.1 time: 0.148825 Sep 25 02:05:10.402696 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3548/7069] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:10 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:11.427136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:11.427848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:11.431659 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:11.435680 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:11.436166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:11.436608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:11.437305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:11.437787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:11.438217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:11.572085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:11.579797 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ddc731a8-7987-4e9d-8a2d-091effd1ce70 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1675 microversion: 2.1 time: 0.157091 Sep 25 02:05:11.580461 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3522/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:11 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:12.603557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:12.604098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:12.607046 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=37 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:12.613597 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:12.614216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:12.615077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:12.615693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:12.616267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:12.616790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:12.711181 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:12.719068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e99f4cb8-1873-4f29-9578-d7c81d12138b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 200 len: 1607 microversion: 2.1 time: 0.119903 Sep 25 02:05:12.719653 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3549/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:12 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 1607 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:12.828537 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e3e1a87d-9728-4165-bf29-59c1f43a48e2 req-e2553713-ca42-40ec-b3e0-2aa10f7ae5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d41e3dc-0387-4262-8bda-5b9c05db3ffe", "name": "network-vif-deleted", "tag": "89a6433c-58b6-4d35-b9e3-33c6c86c9119"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:12.837734 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:12.840018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e3e1a87d-9728-4165-bf29-59c1f43a48e2 req-e2553713-ca42-40ec-b3e0-2aa10f7ae5ca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:12.840506 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e3e1a87d-9728-4165-bf29-59c1f43a48e2 req-e2553713-ca42-40ec-b3e0-2aa10f7ae5ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:12.840938 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e3e1a87d-9728-4165-bf29-59c1f43a48e2 req-e2553713-ca42-40ec-b3e0-2aa10f7ae5ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:12.854947 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e3e1a87d-9728-4165-bf29-59c1f43a48e2 req-e2553713-ca42-40ec-b3e0-2aa10f7ae5ca service nova] Creating event network-vif-deleted:89a6433c-58b6-4d35-b9e3-33c6c86c9119 for instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe on n-h2-master-1 Sep 25 02:05:12.860360 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e3e1a87d-9728-4165-bf29-59c1f43a48e2 req-e2553713-ca42-40ec-b3e0-2aa10f7ae5ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035462 Sep 25 02:05:12.861808 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3523/7072] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:13.743615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:13.744267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:13.751291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:13.751891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:13.752389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:13.753109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:13.753636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:13.754135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:13.768654 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe HTTP/1.1 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4d41e3dc-0387-4262-8bda-5b9c05db3ffe'} Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:05:13.770391 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:05:13.775133 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3634636-1f32-4da6-aab4-ee2fb7d8b133 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 404 len: 111 microversion: 2.1 time: 0.032733 Sep 25 02:05:13.776178 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3550/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:13 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:05:13.791206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:13.791917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:13.802702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:13.803201 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:13.803906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:13.804639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:13.805102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:13.805827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:13.820178 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe HTTP/1.1 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4d41e3dc-0387-4262-8bda-5b9c05db3ffe'} Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:05:13.822367 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-049ce1cc-6865-4558-8e7b-6e07bd021717 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 404 len: 111 microversion: 2.1 time: 0.036869 Sep 25 02:05:13.826802 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3524/7074] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:13 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:05:13.873333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1951405565", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "d2ec60de-98ee-4ba1-a550-68bee1d2a04f"}], "security_groups": [{"name": "tempest-securitygroup--1808621022"}], "key_name": "tempest-keypair-1412630501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:13.977671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] validate_networks() for [('d2ec60de-98ee-4ba1-a550-68bee1d2a04f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:05:14.344662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:05:14.345675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:05:14.346177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:05:14.346615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:05:14.347053 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:05:14.355980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:14.356489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:14.356955 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:14.357738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:14.358214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:14.358706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:14.376548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:05:14.381978 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:05:14.394675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:05:14.397013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:05:14.445838 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab863828-2385-4d3d-bb6a-14478392aca2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.576169 Sep 25 02:05:14.446402 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3551/7075] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:05:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:05:14.458301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-65f5236f-6688-49d9-89be-28b020789dcb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:14.458938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-65f5236f-6688-49d9-89be-28b020789dcb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:14.514497 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-65f5236f-6688-49d9-89be-28b020789dcb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:14.526020 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-65f5236f-6688-49d9-89be-28b020789dcb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1239 microversion: 2.1 time: 0.072148 Sep 25 02:05:14.526592 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3525/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:14 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:15.550954 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:15.551597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:15.559267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:15.559795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:15.560238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:15.560956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:15.561461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:15.561982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:15.627356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:15.635561 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c6c68dd7-be6b-4902-b146-bfbc827868cf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1299 microversion: 2.1 time: 0.089122 Sep 25 02:05:15.636366 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3552/7077] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:15 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:16.660528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:16.661867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:16.669391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:16.669996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:16.670508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:16.671279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:16.671810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:16.672322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:16.815329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:16.824232 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e60a7d77-4e90-445f-b534-1aa57e0a5bd3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.168517 Sep 25 02:05:16.825132 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3526/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:16 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:17.181869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-cdfea480-5511-48dc-ba45-8d692cdfb695 req-f6542c51-c166-488c-bc11-33864059dac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:17.192478 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdfea480-5511-48dc-ba45-8d692cdfb695 req-f6542c51-c166-488c-bc11-33864059dac4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:17.192895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdfea480-5511-48dc-ba45-8d692cdfb695 req-f6542c51-c166-488c-bc11-33864059dac4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:17.193343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-cdfea480-5511-48dc-ba45-8d692cdfb695 req-f6542c51-c166-488c-bc11-33864059dac4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:17.208863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-cdfea480-5511-48dc-ba45-8d692cdfb695 req-f6542c51-c166-488c-bc11-33864059dac4 service nova] Creating event network-changed:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h1-master-1 Sep 25 02:05:17.214097 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-cdfea480-5511-48dc-ba45-8d692cdfb695 req-f6542c51-c166-488c-bc11-33864059dac4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097214 Sep 25 02:05:17.214800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3553/7079] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:17.849117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:17.849689 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:17.856486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:17.856974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:17.857472 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:17.858172 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:17.858635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:17.859070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:17.986564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:17.995294 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2db2bb04-acc4-446c-be00-7877c52e89bd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.150999 Sep 25 02:05:17.995870 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3527/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:17 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:19.019558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:19.020315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:19.027498 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:19.028002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:19.028464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:19.029178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:19.029681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:19.030126 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:19.164515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:19.172335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-55f7c314-81e5-404e-ac6a-8676fd7bb0ba tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.157384 Sep 25 02:05:19.173397 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3554/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:19 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:20.196386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:20.197033 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:20.204001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:20.205149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:20.205630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:20.206332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:20.206790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:20.207223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:20.335485 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:20.343165 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-192d81a0-80f4-43e4-89b1-abbbe876d249 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.150759 Sep 25 02:05:20.343737 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3528/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:20 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:05:21.366243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:21.366876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:21.373710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:21.374205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:21.374659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:21.375359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:21.375828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:21.376831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:21.506141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:21.514167 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-97b9ec0d-4354-4d22-af33-2f8fcb3c92c6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.151800 Sep 25 02:05:21.514740 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3555/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:21 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:22.587502 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:22.588160 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:22.594297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:22.594856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:22.595306 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:22.596194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:22.596656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:22.597087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:22.741515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:22.749244 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37288aaf-afbe-4ed4-b0cc-69c521292c77 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.215527 Sep 25 02:05:22.749853 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3529/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:22 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:23.772889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:23.773549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:23.780275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:23.780775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:23.781227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:23.781963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:23.783031 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:23.783712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:23.918395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:23.926377 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0dcff138-d017-4159-b6e5-15b4feffe03e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.157394 Sep 25 02:05:23.927171 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3556/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:23 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:24.003957 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-76746328-492b-463a-b3b4-7cab9fa482c5 req-9e3466e9-2564-4a11-ae71-1891b6148fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "name": "network-vif-plugged", "status": "completed", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:24.014701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-76746328-492b-463a-b3b4-7cab9fa482c5 req-9e3466e9-2564-4a11-ae71-1891b6148fc8 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:24.015194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-76746328-492b-463a-b3b4-7cab9fa482c5 req-9e3466e9-2564-4a11-ae71-1891b6148fc8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:24.015622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-76746328-492b-463a-b3b4-7cab9fa482c5 req-9e3466e9-2564-4a11-ae71-1891b6148fc8 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:24.027832 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-76746328-492b-463a-b3b4-7cab9fa482c5 req-9e3466e9-2564-4a11-ae71-1891b6148fc8 service nova] Creating event network-vif-plugged:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h1-master-1 Sep 25 02:05:24.033021 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-76746328-492b-463a-b3b4-7cab9fa482c5 req-9e3466e9-2564-4a11-ae71-1891b6148fc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Sep 25 02:05:24.033995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3530/7086] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:24.950668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:24.951279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:24.953294 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:24.954638 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:24.960898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:24.961998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:24.962490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:24.963199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:24.963671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:24.964112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:25.099575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:25.108149 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4de9eeb-4088-4557-b75b-47859267c086 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1365 microversion: 2.1 time: 0.161511 Sep 25 02:05:25.108754 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3557/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:24 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:26.128491 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:05:26.133787 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:26.134491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:26.140910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:26.141389 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:26.141848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:26.142769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:26.143221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:26.143673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:26.271901 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:05:26.279684 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3655517b-b504-427c-8a2a-0dd306e5f71e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1551 microversion: 2.1 time: 0.152155 Sep 25 02:05:26.280254 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3531/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:05:26 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:05:26.304653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:05:26.305175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:05:26.312014 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:26.312521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:26.312984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:26.313733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:26.314567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:26.315021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:26.392039 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3e062533-3f1f-41ff-a4d3-453926869f1c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091254 Sep 25 02:05:26.392736 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3558/7089] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 25 02:05:26 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:05:27.322102 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c02fdf12-1b4e-4027-95b2-a3d0fa059d0c req-0a53bf3a-d448-4d68-a43d-58684e25fd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:05:27.332747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c02fdf12-1b4e-4027-95b2-a3d0fa059d0c req-0a53bf3a-d448-4d68-a43d-58684e25fd59 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:05:27.333223 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c02fdf12-1b4e-4027-95b2-a3d0fa059d0c req-0a53bf3a-d448-4d68-a43d-58684e25fd59 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:05:27.333684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c02fdf12-1b4e-4027-95b2-a3d0fa059d0c req-0a53bf3a-d448-4d68-a43d-58684e25fd59 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:05:27.347781 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c02fdf12-1b4e-4027-95b2-a3d0fa059d0c req-0a53bf3a-d448-4d68-a43d-58684e25fd59 service nova] Creating event network-changed:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h1-master-1 Sep 25 02:05:27.352849 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c02fdf12-1b4e-4027-95b2-a3d0fa059d0c req-0a53bf3a-d448-4d68-a43d-58684e25fd59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034465 Sep 25 02:05:27.353476 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3532/7090] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:01.872451 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:01.873292 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=50 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:01.877208 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:01.878723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:01.885746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:01.886258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:01.886713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:01.887418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:01.887931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:01.888339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:02.021171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:02.029030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74b5c5c4-6ac6-4cf5-a6a3-d3552099df7d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1669 microversion: 2.1 time: 0.158642 Sep 25 02:06:02.029735 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3559/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:01 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:02.052088 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=21 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:02.052829 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:02.057162 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b00d7fb8-b10c-4857-9fe6-30f98ff95e73"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:02.059594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:02.067512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:02.067997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:02.068442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:02.069150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:02.069636 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:02.070066 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:02.338774 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-51e7f502-d0c2-4fa0-ab67-611d74904280 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289285 Sep 25 02:06:02.339668 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3533/7092] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 02:06:02 2022] POST /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:13.068977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:13.071301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:13.073753 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:13.074644 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:13.080171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:13.080677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:13.081141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:13.082409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:13.082888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:13.083336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:13.112191 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:13.117789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Old instance type m1.heat2, new instance type m1.heat {{(pid=122385) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 02:06:13.124838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:06:13.125302 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:06:13.125813 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:06:13.126244 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:06:13.126677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:06:13.189313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d294e5fe-a4a2-47c4-83d5-820360b0314f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/action" status: 202 len: 0 microversion: 2.1 time: 0.124430 Sep 25 02:06:13.189967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3560/7093] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:06:13 2022] POST /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:06:13.198589 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:13.199310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:13.202215 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:13.202881 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:13.210290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:13.210788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:13.211233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:13.212215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:13.212926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:13.213377 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:13.372198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:13.381588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-844118ce-1cb5-4b2e-891b-7871fcc5b561 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1724 microversion: 2.1 time: 0.187114 Sep 25 02:06:13.382163 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3534/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:13 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:14.406487 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:14.407133 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:14.415197 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:14.415709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:14.416169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:14.416887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:14.417365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:14.417848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:14.554676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:14.563510 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-798c9af4-d9dc-4a8a-8ccc-6acc3d341214 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1724 microversion: 2.1 time: 0.161838 Sep 25 02:06:14.564101 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3561/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:14 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:15.586681 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:15.587298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:15.594048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:15.594531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:15.594970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:15.595657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:15.596115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:15.596544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:15.733249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:15.742799 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18b60386-25bf-4f22-ab3b-422d33b20970 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.160057 Sep 25 02:06:15.743376 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3535/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:15 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:16.766678 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:16.767311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:16.774940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:16.775444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:16.775896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:16.776614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:16.777076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:16.777535 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:16.907846 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:16.916341 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5889389-fa20-4f59-85da-3279dda1cd00 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.153962 Sep 25 02:06:16.916912 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3562/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:16 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:17.940101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:17.941435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:17.948375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:17.948859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:17.949299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:17.950041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:17.950488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:17.950918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:18.082831 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:18.091191 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-497eb962-4646-47f6-a5b2-32f39c4a6aa4 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.155022 Sep 25 02:06:18.091767 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3536/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:17 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:19.114744 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:19.115378 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:19.122256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:19.122757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:19.123218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:19.123923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:19.124395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:19.124841 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:19.253777 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:19.262261 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9de66b23-a0bd-42aa-a3ea-8f7830980693 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.151555 Sep 25 02:06:19.262869 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3563/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:19 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:20.287072 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:20.287699 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:20.294629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:20.295121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:20.295565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:20.296261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:20.296820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:20.297250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:20.426035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:20.434307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b4e73c70-86b8-4b2e-b52c-d7068aa4d1e6 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.152115 Sep 25 02:06:20.434884 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3537/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:20 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:21.458020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:21.458586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:21.465330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:21.465856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:21.466320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:21.467000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:21.467464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:21.467898 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:21.601055 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:21.609305 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8436f05e-1aff-492c-a98b-a16bd2ac0917 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.155550 Sep 25 02:06:21.609902 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3564/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:21 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:22.633906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:22.634523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:22.641570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:22.641996 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:22.642434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:22.643123 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:22.643576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:22.644000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:22.775468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:22.783740 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-09fa3e06-4702-40bb-a446-773ab91d3793 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.153840 Sep 25 02:06:22.784646 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3538/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:22 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:23.808461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:23.809091 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:23.816919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:23.817429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:23.817895 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:23.818601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:23.819068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:23.819510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:23.954642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:23.963194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f7acbe4-566e-4288-bf40-e90da0223394 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.158740 Sep 25 02:06:23.963784 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3565/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:23 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:24.986891 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:24.988076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:24.994937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:24.995423 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:24.995864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:24.996559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:24.997013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:24.997469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:25.138231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:25.146590 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9edb7632-c6a1-40ec-80d3-5fa7399531b8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.163764 Sep 25 02:06:25.147161 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3539/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:24 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:26.169365 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:26.169964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:26.177264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:26.177816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:26.178277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:26.178983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:26.179463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:26.179916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:26.312826 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:26.322075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8fa251a0-2ccc-4e5d-b936-e14321438d29 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.156667 Sep 25 02:06:26.322633 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3566/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:26 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:27.344402 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:27.345029 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:27.352782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:27.353270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:27.353742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:27.354437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:27.354894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:27.355331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:27.484558 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:27.493368 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-98fa43a0-1f58-4124-892b-6e74174c678c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.152905 Sep 25 02:06:27.493968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3540/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:27 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:28.517522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:28.518217 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:28.525882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:28.526384 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:28.526845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:28.527555 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:28.528032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:28.528479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:28.658071 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:28.667007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8d79d25c-c18d-4e9b-843d-0384573a4095 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.153431 Sep 25 02:06:28.667592 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3567/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:28 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:29.691002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:29.691669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:29.698600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:29.699091 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:29.699534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:29.700232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:29.700698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:29.701130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:29.833550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:29.841789 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e93a1e70-3a8b-4095-8071-7a7a2d7f1db5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.155464 Sep 25 02:06:29.842365 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3541/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:29 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:30.866195 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:30.866831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:30.873705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:30.874216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:30.874676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:30.875388 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:30.875863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:30.876341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:31.005056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:31.013426 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-42a5f1c5-b454-4e2f-910a-ef578b99d85c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.151799 Sep 25 02:06:31.014019 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3568/7109] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:30 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:32.038435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:32.039061 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:32.045941 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:32.046430 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:32.046872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:32.047568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:32.048029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:32.048461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:32.181370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:32.189711 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6586711c-33e6-45d8-ae34-79809441084a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.156012 Sep 25 02:06:32.190389 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3542/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:32 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:33.213832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:33.214411 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:33.216546 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:06:33.216741 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 (ip 10.222.0.16) !!! Sep 25 02:06:33.225818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:33.226986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:33.227450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:33.228238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:33.228713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:33.229231 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:33.386786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:33.396192 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfe0a24e-ee68-46f4-b9d2-50a4b81b642b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.186051 Sep 25 02:06:33.396975 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3569/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:33 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:34.420875 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:34.421551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:34.429048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:34.429598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:34.430052 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:34.430773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:34.431230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:34.431667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:34.569955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:34.578480 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a4d996c4-a49d-4b86-a1cf-4a5bd3a32881 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1729 microversion: 2.1 time: 0.161620 Sep 25 02:06:34.579071 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3543/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:34 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:35.222284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "name": "network-vif-unplugged", "status": "completed", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:35.233378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:35.233917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:35.234365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:35.247148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] Creating event network-vif-unplugged:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h2-master-1 Sep 25 02:06:35.252596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:06:35.263469 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-18a7278d-9834-4a24-bab4-b774d0ad2019 req-7c2d1f17-2dac-47b6-bba3-516d9d217284 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044932 Sep 25 02:06:35.264304 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3570/7113] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:35.602937 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:35.603586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:35.610809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:35.611299 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:35.611730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:35.612433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:35.612882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:35.613303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:35.828964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:35.840013 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2567f895-577d-4615-bdeb-c3e6f1cfe123 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1728 microversion: 2.1 time: 0.241455 Sep 25 02:06:35.840601 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3544/7114] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:35 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:36.866424 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:36.867096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:36.873319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:36.873854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:36.874310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:36.875017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:36.875485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:36.875925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:37.011679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:37.020022 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7e66ec7-2daf-4a10-b28d-8f147cbb1751 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.159537 Sep 25 02:06:37.020926 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3571/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:36 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:37.305513 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:37.316084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:37.316655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:37.317317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:37.330041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] Creating event network-changed:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h2-master-1 Sep 25 02:06:37.335769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:06:37.348670 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b1aa70a8-b7cd-42c5-8db8-874746e25e3e req-c3d90a60-119c-49d4-82c7-c403720737ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047072 Sep 25 02:06:37.349341 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3545/7116] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:38.044388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:38.045722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:38.053198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:38.053724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:38.054179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:38.054896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:38.055363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:38.055802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:38.192849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:38.201359 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c2051b14-1bf5-46e1-950c-b6fea510ca79 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.160980 Sep 25 02:06:38.201994 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3572/7117] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:38 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:39.226286 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:39.226898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:39.233039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:39.233561 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:39.234001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:39.234698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:39.235154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:39.235578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:39.375198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:39.384459 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e56cbc18-85a0-4587-91c1-a1bb5c00b283 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.163560 Sep 25 02:06:39.385269 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3546/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:39 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:40.408299 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:40.409223 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:40.423757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:40.424275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:40.424740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:40.426270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:40.426782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:40.427973 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:40.577824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:40.588712 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-80059787-8534-45a4-9281-6c445ecc7cdb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.184239 Sep 25 02:06:40.589572 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3573/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:40 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:41.612197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:41.612707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:41.615806 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:06:41.615952 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 (ip 10.222.0.16) !!! Sep 25 02:06:41.622903 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:41.623382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:41.623820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:41.624514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:41.624970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:41.625422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:41.759381 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:41.768599 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a16afe67-5b5d-4672-a452-b68017f4d42d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.160318 Sep 25 02:06:41.769310 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3547/7120] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:41 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:42.792625 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:42.793267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:42.800218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:42.800731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:42.801222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:42.802073 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:42.802547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:42.802995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:42.937646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:42.946697 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-98baceb4-7e06-49f8-a08b-f2c56c0effeb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.158019 Sep 25 02:06:42.947279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3574/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:42 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:43.969662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:43.970285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:43.973672 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=29 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:43.979178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:43.979665 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:43.980108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:43.980806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:43.981261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:43.981721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:43.985993 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=83 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:44.118883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:44.127221 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd778080-728f-41c4-971b-c18790fdb2e9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.161661 Sep 25 02:06:44.127798 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3548/7122] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:43 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:45.151180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:45.151821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:45.154688 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=35 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:45.161645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:45.162234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:45.162691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:45.163398 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:45.163868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:45.164309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:45.166976 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:06:45.296727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:45.305419 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e42ee15a-f6b9-48a8-868c-822e6f9adc01 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.158179 Sep 25 02:06:45.306000 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3575/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:45 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:46.329122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:46.329766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:46.337469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:46.337953 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:46.338392 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:46.339078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:46.339534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:46.339959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:46.474563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:46.483741 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1103d5e7-0fbd-451d-a41c-2bb9c0912919 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.158350 Sep 25 02:06:46.484325 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3549/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:46 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:47.508479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:47.509121 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:47.516021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:47.516524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:47.516990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:47.517741 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:47.518216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:47.518660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:47.653481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:47.662572 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f94a479c-86d1-4880-b6c1-06e210bff3e1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.158344 Sep 25 02:06:47.663173 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3576/7125] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:47 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:48.686393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:48.686936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:48.694200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:48.694690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:48.695128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:48.695820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:48.696273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:48.696700 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:48.825948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:48.835050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92f231dd-101f-4669-a72b-dcc3c379d31f tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.152337 Sep 25 02:06:48.835620 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3550/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:48 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:49.858962 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:49.859599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:49.867052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:49.867574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:49.868032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:49.868737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:49.869214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:49.869681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:50.007134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:50.015773 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5975047a-12fd-489a-9c5b-be5e524e8726 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1726 microversion: 2.1 time: 0.160643 Sep 25 02:06:50.016298 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3577/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:49 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:51.039677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:51.040331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:51.047053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.047534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.047966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.048644 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.049093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.049545 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.183488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:51.192174 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5bb7d58f-8184-47f2-a54d-3247d40c08db tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1723 microversion: 2.1 time: 0.156851 Sep 25 02:06:51.192769 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3551/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:51 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:51.216934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:51.217527 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:51.224453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.224951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.225427 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.226172 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.226644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.227089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.265213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.265744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.266199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.266978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.267433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.267881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.291747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:06:51.296887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Getting quotas for user 8edfad57c63f4b89ace3e8fcab4a680b and project 33f8acaa10da4a938d2677f9d91ad6a6. Resources: {'ram', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:06:51.401277 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9888ac2d-1080-4004-a47e-6a6a4225b4fa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "POST /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/action" status: 202 len: 0 microversion: 2.1 time: 0.188047 Sep 25 02:06:51.401980 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3578/7129] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:06:51 2022] POST /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:06:51.410724 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:51.411355 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:51.418378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.418878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.419324 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.420032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:51.420488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:51.420917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:51.619760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:51.628145 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4400979-c65e-4b3d-adcd-3f8a28029fa3 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.221675 Sep 25 02:06:51.628726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3552/7130] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:51 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:52.652861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:52.653712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:52.661187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:52.661696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:52.662370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:52.663094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:52.663572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:52.664022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:52.797425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:52.806526 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22c1bc6e-e511-4231-bc6d-643baa0c0a0d tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.158800 Sep 25 02:06:52.807147 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3579/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:52 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:06:53.250810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "name": "network-vif-plugged", "status": "completed", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:53.261560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:53.262693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:53.262693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:53.274910 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] Creating event network-vif-plugged:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h2-master-1 Sep 25 02:06:53.280340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:06:53.292249 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-78c27685-44ce-4060-b1a7-3863afe531ee req-6363f765-8534-4142-8be4-efc91629b2e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045205 Sep 25 02:06:53.292873 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3553/7132] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:53.830530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:53.831162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:53.838936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:53.839430 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:53.839887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:53.840583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:53.841050 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:53.841514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:53.970522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:53.979203 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-43124360-7d83-420f-ae23-cd272991ac0b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.152544 Sep 25 02:06:53.979979 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3580/7133] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:53 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:55.003809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:55.004514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:55.026778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:55.027270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:55.027704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:55.028536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:55.028990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:55.029442 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:55.164926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:55.173332 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6fc5cda-f112-4d84-acba-2da83d5ebac1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.174614 Sep 25 02:06:55.173936 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3554/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:54 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:56.198423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:56.199092 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:56.205605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:56.206116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:56.206577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:56.207291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:56.207768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:56.208216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:56.349260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:56.358525 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-840c1710-c139-4624-ab3c-654b0a965ff8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.164467 Sep 25 02:06:56.359103 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3581/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:56 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:56.987932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "name": "network-vif-unplugged", "status": "completed", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:56.999008 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:56.999509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:57.000042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:57.012488 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] Creating event network-vif-unplugged:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h1-master-1 Sep 25 02:06:57.017967 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:06:57.029536 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-6690f2ef-31bc-4014-bcef-69d5c27af5e9 req-33f20df6-3254-4ded-8003-410912d1bbaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045283 Sep 25 02:06:57.030207 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3555/7136] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:57.382279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:57.383486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:57.391422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:57.391422 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:57.391731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:57.392439 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:57.392909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:57.393349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:57.536748 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:57.545439 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9164285-7a28-44de-89ff-d3d4de546871 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.167103 Sep 25 02:06:57.546025 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3582/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:57 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:58.569628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:58.570969 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:58.579487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:58.579990 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:58.580435 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:58.581142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:58.581635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:58.582072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:58.721688 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:58.730013 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c690a334-2bc1-471d-b23a-2aa32a6ef56e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.165570 Sep 25 02:06:58.730597 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3556/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:58 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:06:59.071584 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:06:59.081764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:59.082251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:59.082696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:59.097634 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] Creating event network-changed:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h1-master-1 Sep 25 02:06:59.103853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:06:59.114899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-11eb993c-08df-410c-86d7-68adfa639e1b req-81378198-daac-4e91-b346-e9b4e377026e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047409 Sep 25 02:06:59.115684 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3583/7139] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:06:59.753751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:06:59.754371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:06:59.761856 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:59.762351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:59.762795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:59.763492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:06:59.763945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:06:59.764371 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:06:59.898435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:06:59.906857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e82df254-84e9-45a9-b882-8e53f61f1a44 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.157284 Sep 25 02:06:59.907436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3557/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:06:59 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:07:00.934236 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:00.934867 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:00.941023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:00.941626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:00.942077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:00.942778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:00.943247 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:00.943689 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:01.076576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:01.084931 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af6c6ddf-fd9c-434a-9c87-adb7a3196ea0 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.156784 Sep 25 02:07:01.085680 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3584/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:00 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:02.108372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:02.109073 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:02.116198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:02.116774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:02.117438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:02.118144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:02.118601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:02.119031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:02.262053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:02.270387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c715fa3-883d-4122-bbb9-ec2baf51cf13 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.165940 Sep 25 02:07:02.270973 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3558/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:02 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:03.294718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:03.295347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:03.297334 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:03.303572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:03.304084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:03.304868 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:03.305625 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:03.306092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:03.306532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:03.437781 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:03.447240 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22b191eb-f08f-446a-ae94-affe2b36c458 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.156486 Sep 25 02:07:03.447830 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3585/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:03 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:04.470735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:04.471356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:04.478297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:04.478782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:04.479224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:04.479918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:04.480384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:04.480813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:04.613268 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:04.622309 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55ea6d31-0eff-415d-bfb1-0a270307635b tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.155528 Sep 25 02:07:04.622902 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3559/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:04 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:05.646233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:05.646792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:05.654334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:05.654837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:05.655292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:05.655997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:05.656467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:05.656912 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:05.785924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:05.794818 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23a6c23c-f018-47af-b1d4-6a00b998c911 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.152604 Sep 25 02:07:05.795407 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3586/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:05 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:06.817938 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:06.818587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:06.825701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:06.826192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:06.826632 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:06.827326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:06.827784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:06.828219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:06.962433 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:06.970665 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b791c221-6313-48f9-aa4c-231ba7286efa tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.156730 Sep 25 02:07:06.971244 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3560/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:06 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:07.995451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:07.996085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:08.003266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:08.003781 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:08.004239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:08.004954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:08.005488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:08.005936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:08.134855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:08.143395 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64cab193-0b6b-4cbe-b796-6309efcdc232 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.152518 Sep 25 02:07:08.143986 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3587/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:07 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:09.167163 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:09.167777 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:09.174409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:09.174888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:09.175321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:09.176009 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:09.176456 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:09.176876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:09.307031 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:09.315300 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-57a06373-bc75-4913-860b-fd2ad2c99498 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.152597 Sep 25 02:07:09.316115 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3561/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:09 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:10.341032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:10.341709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:10.348965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:10.349489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:10.349944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:10.350640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:10.351113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:10.351832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:10.492807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:10.501161 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fe10119e-e594-4aae-9c8b-44700cc36683 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1722 microversion: 2.1 time: 0.164072 Sep 25 02:07:10.501754 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3588/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:10 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:11.526797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:11.527417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:11.534550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:11.535032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:11.535469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:11.536152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:11.536604 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:11.537028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:11.665288 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:11.673683 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-12daf232-d636-4e20-8e10-576b036f8e5a tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1715 microversion: 2.1 time: 0.152181 Sep 25 02:07:11.674255 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3562/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:11 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:11.696857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:11.697512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:11.704212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:11.704705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:11.705154 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:11.705876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:11.706345 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:11.706786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:11.709308 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:11.842818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:11.851276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2428b800-4f77-4166-b861-523f1aa68508 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1715 microversion: 2.1 time: 0.158978 Sep 25 02:07:11.851893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3589/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:11 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:11.873701 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:11.874327 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:11.880326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:11.880817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:11.881260 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:11.881986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:11.883069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:11.883507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:12.011016 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:12.019695 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7201da5f-cf0f-49ed-89ca-f6b2e2315799 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1715 microversion: 2.1 time: 0.150039 Sep 25 02:07:12.020279 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3563/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:11 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:12.042548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:12.043068 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:12.049170 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:12.049729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:12.050212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:12.050990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:12.051467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:12.051970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:12.080430 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:07:12.157323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2d83a309-7db2-4a65-8084-affc673d5159 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 204 len: 0 microversion: 2.1 time: 0.118364 Sep 25 02:07:12.157973 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3590/7153] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:07:12 2022] DELETE /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:07:12.168080 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:12.168696 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:12.174776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:12.175269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:12.175701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:12.176387 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:12.176837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:12.177262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:12.307776 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:12.316060 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e101a93-047c-4964-96e7-f21d59e5985c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1721 microversion: 2.1 time: 0.153168 Sep 25 02:07:12.316645 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3564/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:12 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:13.340719 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:13.341473 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:13.348624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:13.349127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:13.349620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:13.350338 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:13.350815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:13.351330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:13.488454 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:13.498396 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50c35c40-d6bf-40d5-a445-4fc949080cbf tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1721 microversion: 2.1 time: 0.162625 Sep 25 02:07:13.499026 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3591/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:13 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:14.523449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:14.524277 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:14.531253 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=34 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:14.532706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:14.533544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:14.533983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:14.534958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:14.535417 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:14.535842 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:14.540278 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:14.679122 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:14.687914 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-955b6174-679c-4730-a3fc-6da794f8b0c1 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1721 microversion: 2.1 time: 0.168917 Sep 25 02:07:14.689460 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3565/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:14 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:14.943264 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-54a371a2-3bde-4c73-9a19-2af538aa117d req-fde30e71-e9ea-4688-888d-d3b8d2f9ab18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7be5dc-ef10-4a75-9846-c5755bc1ed27", "name": "network-vif-deleted", "tag": "aef5ef9d-5836-4de5-9969-fae7f72cb5e2"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:14.962070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-54a371a2-3bde-4c73-9a19-2af538aa117d req-fde30e71-e9ea-4688-888d-d3b8d2f9ab18 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:14.962631 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-54a371a2-3bde-4c73-9a19-2af538aa117d req-fde30e71-e9ea-4688-888d-d3b8d2f9ab18 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:14.963086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-54a371a2-3bde-4c73-9a19-2af538aa117d req-fde30e71-e9ea-4688-888d-d3b8d2f9ab18 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:14.975264 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-54a371a2-3bde-4c73-9a19-2af538aa117d req-fde30e71-e9ea-4688-888d-d3b8d2f9ab18 service nova] Creating event network-vif-deleted:aef5ef9d-5836-4de5-9969-fae7f72cb5e2 for instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 on n-h1-master-1 Sep 25 02:07:14.981574 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-54a371a2-3bde-4c73-9a19-2af538aa117d req-fde30e71-e9ea-4688-888d-d3b8d2f9ab18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041929 Sep 25 02:07:14.982451 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3592/7157] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:07:15.712211 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:15.713001 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:15.720170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:15.720655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:15.721097 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:15.722002 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:15.722482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:15.723022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:15.802120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:15.811269 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4e751168-86d3-48fd-9dd3-8335607e51a5 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1370 microversion: 2.1 time: 0.103417 Sep 25 02:07:15.821892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3566/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:15 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:16.897174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:16.897966 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:16.900663 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:16.906390 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:16.906897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:16.907357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:16.908066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:16.908541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:16.908980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:16.982555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:16.990903 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4411db76-0937-465d-9dfc-8cbd85c492d2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1370 microversion: 2.1 time: 0.099011 Sep 25 02:07:16.991494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3593/7159] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:16 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:18.014563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:18.015260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:18.022799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:18.023797 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:18.024280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:18.024994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:18.025485 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:18.025922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:18.089531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:18.098252 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-62913966-b9d7-4120-8262-c4387dc33ddd tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1370 microversion: 2.1 time: 0.087626 Sep 25 02:07:18.098833 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3567/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:18 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:19.121375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:19.122022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:19.128733 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:19.129237 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:19.129716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:19.130414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:19.130880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:19.131316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:19.195768 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8edfad57c63f4b89ace3e8fcab4a680b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f8acaa10da4a938d2677f9d91ad6a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:19.204156 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7114245f-c6e3-4b76-b985-62502701e8a2 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 200 len: 1370 microversion: 2.1 time: 0.086933 Sep 25 02:07:19.204728 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3594/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:19 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:20.229843 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:20.230527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:20.237495 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:20.237982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:20.238431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:20.239128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:20.239584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:20.240022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:20.253900 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 HTTP/1.1 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '6c7be5dc-ef10-4a75-9846-c5755bc1ed27'} Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:20.255551 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-17b0a370-0214-49d9-b8a6-6aa347c9f613 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 404 len: 111 microversion: 2.1 time: 0.031814 Sep 25 02:07:20.260014 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3568/7162] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:20 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:20.320009 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:20.322232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:20.329048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:20.329615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:20.330074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:20.330809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:20.331281 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:20.331725 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:20.344774 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-volume_attachments HTTP/1.1 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': '6c7be5dc-ef10-4a75-9846-c5755bc1ed27'} Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:20.346616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfc7cdce-20e1-4e29-a5ab-b2318433dd48 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032204 Sep 25 02:07:20.350551 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3595/7163] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:07:20 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.681267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.681834 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.689638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.690131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.690574 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.691317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.691772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.692204 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.706134 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 HTTP/1.1 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '6c7be5dc-ef10-4a75-9846-c5755bc1ed27'} Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.707706 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7ec0ffb0-9770-4f75-bd1f-db95dff9c1af tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 404 len: 111 microversion: 2.1 time: 0.032611 Sep 25 02:07:23.711960 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3569/7164] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:07:23 2022] DELETE /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.717797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.718601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 6c7be5dc-ef10-4a75-9846-c5755bc1ed27] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.725551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.726840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.727365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.728066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.728565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.729003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.743808 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 HTTP/1.1 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '6c7be5dc-ef10-4a75-9846-c5755bc1ed27'} Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.745433 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 6c7be5dc-ef10-4a75-9846-c5755bc1ed27 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-76a7514b-81ba-4417-ad55-0e12076a07be tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27" status: 404 len: 111 microversion: 2.1 time: 0.033126 Sep 25 02:07:23.749840 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3596/7165] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:23 2022] GET /compute/v2.1/servers/6c7be5dc-ef10-4a75-9846-c5755bc1ed27 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 02:07:23.756083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.756602 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.763408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.763901 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.764342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.765056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.765549 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.765978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.780645 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe HTTP/1.1 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4d41e3dc-0387-4262-8bda-5b9c05db3ffe'} Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.782460 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e783da8a-7a30-43ce-837e-4d7eb24bf2f9 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 404 len: 111 microversion: 2.1 time: 0.031904 Sep 25 02:07:23.786588 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3570/7166] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:07:23 2022] DELETE /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.794863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.795640 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 4d41e3dc-0387-4262-8bda-5b9c05db3ffe] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.802069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.802637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.803191 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.804583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.805395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.805865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.823373 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe HTTP/1.1 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '4d41e3dc-0387-4262-8bda-5b9c05db3ffe'} Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.824908 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 4d41e3dc-0387-4262-8bda-5b9c05db3ffe could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4f58381c-3516-44eb-b1b6-fe341c80d0cb tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe" status: 404 len: 111 microversion: 2.1 time: 0.035601 Sep 25 02:07:23.829070 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3597/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:23 2022] GET /compute/v2.1/servers/4d41e3dc-0387-4262-8bda-5b9c05db3ffe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.835119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.835621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.841689 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.842182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.842627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.843332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.843788 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.844216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.858437 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c HTTP/1.1 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '92ea5849-886a-4184-9987-bfae0c1d2a0c'} Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.860042 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7e163583-f070-42cf-aa6d-a3f1d80ae34c tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 404 len: 111 microversion: 2.1 time: 0.030314 Sep 25 02:07:23.863746 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3571/7168] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:07:23 2022] DELETE /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.869917 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.870554 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 92ea5849-886a-4184-9987-bfae0c1d2a0c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.876579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.877081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.877605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.878319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.878793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.879239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.893253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c HTTP/1.1 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '92ea5849-886a-4184-9987-bfae0c1d2a0c'} Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.894831 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 92ea5849-886a-4184-9987-bfae0c1d2a0c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2ae21b0-2a07-4f3b-a94f-9da8141c5408 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c" status: 404 len: 111 microversion: 2.1 time: 0.030107 Sep 25 02:07:23.899616 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3598/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:23 2022] GET /compute/v2.1/servers/92ea5849-886a-4184-9987-bfae0c1d2a0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.905700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.906155 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.912479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.912961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.913533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.914510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.914958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.915381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.929017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 HTTP/1.1 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '3892fb7c-d41d-4f41-bd33-c5d70befaee0'} Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.930863 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-021fe53c-ee2d-45b7-87c7-d3e62e2668e8 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 404 len: 111 microversion: 2.1 time: 0.030546 Sep 25 02:07:23.935054 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3572/7170] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:07:23 2022] DELETE /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.941016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:23.941896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] [instance: 3892fb7c-d41d-4f41-bd33-c5d70befaee0] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:23.948764 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.949271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.949767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.950491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:23.950968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:23.951445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:23.965945 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] HTTP exception thrown: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Request method failure captured: Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 HTTP/1.1 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7Y1am5M74kmoI375-F8fWQJwgIPsHrKMnGQN9O4lkFBXRF3mlcpyAdGVk2L14cHzK56GGDRTcsXMWlU1IVCbG6XMwQLPRFmsGmiQc8jHO8ORjz0t_U8IycLgBqcuysnLQ6x4rJOmvMaS_q5ukMIeLMIQ4J5bx0GZ8PNGQocGMjjxJM Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33f8acaa10da4a938d2677f9d91ad6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33f8acaa10da4a938d2677f9d91ad6a6"}]}] Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 33f8acaa10da4a938d2677f9d91ad6a6 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServerActionsTestJSON-1284997866 Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 8edfad57c63f4b89ace3e8fcab4a680b Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServerActionsTestJSON-1284997866-project Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '3892fb7c-d41d-4f41-bd33-c5d70befaee0'} Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:07:23.967548 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Returning 404 to user: Instance 3892fb7c-d41d-4f41-bd33-c5d70befaee0 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce8eb2ca-c107-425d-b5bc-4a1b43fc873e tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0" status: 404 len: 111 microversion: 2.1 time: 0.032103 Sep 25 02:07:23.971556 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3599/7171] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:23 2022] GET /compute/v2.1/servers/3892fb7c-d41d-4f41-bd33-c5d70befaee0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:07:23.978071 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c34501c-cde0-401f-91e9-0769329cc288 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] Calling method '.version_select at 0x7f7beab1fe50>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:24.001888 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c34501c-cde0-401f-91e9-0769329cc288 tempest-ServerActionsTestJSON-1284997866 tempest-ServerActionsTestJSON-1284997866-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412630501" status: 202 len: 0 microversion: 2.1 time: 0.027832 Sep 25 02:07:24.002690 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3573/7172] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 25 02:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412630501 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:07:33.332562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1341421943", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "dc45e4c1-2ae1-4ce5-bf00-c5bbdfb245f6"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:33.395189 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] validate_networks() for [('dc45e4c1-2ae1-4ce5-bf00-c5bbdfb245f6', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:07:33.828718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:07:33.829195 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:07:33.829740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:07:33.830174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:07:33.830617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:07:33.840099 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:33.840600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:33.841062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:33.841846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:33.842324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:33.842771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:33.860041 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Getting quotas for project db37cf1c523e4b3d80845b512bfa4045. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:07:33.865310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Getting quotas for user 9d822638f4cd4770905d6551e669d4c3 and project db37cf1c523e4b3d80845b512bfa4045. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:07:33.878628 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:07:33.880975 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:07:33.931102 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93597f95-a1c2-48af-b306-8df11acac64f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737103 Sep 25 02:07:33.931678 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3600/7173] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:07:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:07:33.940709 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=27 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:33.945728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6088d125-627c-460a-80f4-6f39ddf58da4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:33.946359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6088d125-627c-460a-80f4-6f39ddf58da4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:34.011802 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6088d125-627c-460a-80f4-6f39ddf58da4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:34.018920 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6088d125-627c-460a-80f4-6f39ddf58da4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1217 microversion: 2.1 time: 0.080047 Sep 25 02:07:34.019514 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3574/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:33 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:35.043767 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:35.045703 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:35.053223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:35.054334 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:35.054792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:35.055748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:35.056770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:35.057250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:35.121608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:35.131274 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bc735190-3291-48a9-8af1-70923e339c92 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1269 microversion: 2.1 time: 0.093102 Sep 25 02:07:35.132714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3601/7175] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:35 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:36.158095 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:36.158729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:36.168838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:36.169383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:36.169862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:36.170570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:36.171020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:36.171570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:36.442679 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:36.455215 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d5f0365f-8d4b-4834-8dfa-258abe149945 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.303195 Sep 25 02:07:36.470881 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3575/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:36 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:36.887034 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-bb458ec9-11b0-4350-b16e-21015d447c73 req-c3e83a55-c9bc-4089-b723-e2cce87642f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e1e550-1a61-4161-a547-7e636fd689e1", "tag": "6ff3a0f4-0baf-41d2-8a19-fba44dc1e24d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:36.903834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb458ec9-11b0-4350-b16e-21015d447c73 req-c3e83a55-c9bc-4089-b723-e2cce87642f6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:36.904389 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb458ec9-11b0-4350-b16e-21015d447c73 req-c3e83a55-c9bc-4089-b723-e2cce87642f6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:36.904834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-bb458ec9-11b0-4350-b16e-21015d447c73 req-c3e83a55-c9bc-4089-b723-e2cce87642f6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:36.919754 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-bb458ec9-11b0-4350-b16e-21015d447c73 req-c3e83a55-c9bc-4089-b723-e2cce87642f6 service nova] Creating event network-changed:6ff3a0f4-0baf-41d2-8a19-fba44dc1e24d for instance 13e1e550-1a61-4161-a547-7e636fd689e1 on n-h2-master-1 Sep 25 02:07:36.934335 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-bb458ec9-11b0-4350-b16e-21015d447c73 req-c3e83a55-c9bc-4089-b723-e2cce87642f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051094 Sep 25 02:07:36.936316 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3602/7177] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:07:37.484331 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:37.484992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:37.492662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:37.493141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:37.493609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:37.494292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:37.494740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:37.495162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:37.629316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:37.638023 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5e57d380-4abe-4b52-8e9c-145cef8cba14 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.157661 Sep 25 02:07:37.638602 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3576/7178] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:37 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:38.660731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:38.661374 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:38.668950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:38.669491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:38.669951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:38.670673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:38.671136 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:38.671582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:38.800279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:38.808802 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0748e3e7-75eb-473b-b1ef-6f797f2e6453 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.152721 Sep 25 02:07:38.809373 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3603/7179] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:38 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:39.831574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:39.832198 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:39.839178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:39.839667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:39.840110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:39.840807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:39.841267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:39.841730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:39.975471 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:39.983224 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-85bb62c0-33a8-4953-9061-a7f51e51c270 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.155555 Sep 25 02:07:39.983807 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3577/7180] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:39 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:41.007547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:41.008187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:41.014763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:41.015265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:41.015726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:41.016433 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:41.016909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:41.017354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:41.148016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:41.155746 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9b36987-a15d-4774-b784-b592ae4ce23d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.152991 Sep 25 02:07:41.156320 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3604/7181] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:41 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:42.180293 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:42.181817 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:42.189523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:42.190013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:42.190457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:42.191161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:42.191621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:42.192056 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:42.320556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:42.328262 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-533e478c-70b6-4d8a-b054-3ac7c279a44e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.153637 Sep 25 02:07:42.328834 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3578/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:42 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:43.352780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:43.353463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:43.360562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:43.361079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:43.361566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:43.362558 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:43.362761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:43.363205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:43.368648 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:43.502646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b10c50dc-70cc-480e-bbdd-77d5882e4b87 req-1dad6db7-e4e9-4c3d-bbd0-167405f2c873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e1e550-1a61-4161-a547-7e636fd689e1", "name": "network-vif-plugged", "status": "completed", "tag": "6ff3a0f4-0baf-41d2-8a19-fba44dc1e24d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:43.517579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b10c50dc-70cc-480e-bbdd-77d5882e4b87 req-1dad6db7-e4e9-4c3d-bbd0-167405f2c873 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:43.518070 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b10c50dc-70cc-480e-bbdd-77d5882e4b87 req-1dad6db7-e4e9-4c3d-bbd0-167405f2c873 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:43.518675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b10c50dc-70cc-480e-bbdd-77d5882e4b87 req-1dad6db7-e4e9-4c3d-bbd0-167405f2c873 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:43.530205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:43.536096 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b7dfc04d-5c9e-40e1-bcab-2634b5a50e3e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.187366 Sep 25 02:07:43.537279 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3605/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:43 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:43.545221 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b10c50dc-70cc-480e-bbdd-77d5882e4b87 req-1dad6db7-e4e9-4c3d-bbd0-167405f2c873 service nova] Creating event network-vif-plugged:6ff3a0f4-0baf-41d2-8a19-fba44dc1e24d for instance 13e1e550-1a61-4161-a547-7e636fd689e1 on n-h2-master-1 Sep 25 02:07:43.552537 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b10c50dc-70cc-480e-bbdd-77d5882e4b87 req-1dad6db7-e4e9-4c3d-bbd0-167405f2c873 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052983 Sep 25 02:07:43.554176 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3579/7184] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:07:44.564285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:44.564951 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:44.566870 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:44.567549 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:44.575378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:44.576149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:44.576924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:44.577801 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:44.578363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:44.579052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:44.716696 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:44.724718 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93876d6e-8253-4c77-981e-4ba956a7b80d tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1317 microversion: 2.1 time: 0.164380 Sep 25 02:07:44.725831 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3606/7185] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:44 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:45.748856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:45.749494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:45.751544 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:45.753436 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:45.761272 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:45.761957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:45.762428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:45.763145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:45.763609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:45.764039 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:45.895116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:45.903024 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2180fc7f-edfc-410e-bfdd-8b79af49839c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.158507 Sep 25 02:07:45.903606 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3580/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:45 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:45.965524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-967878922", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "dc45e4c1-2ae1-4ce5-bf00-c5bbdfb245f6"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:46.019694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] validate_networks() for [('dc45e4c1-2ae1-4ce5-bf00-c5bbdfb245f6', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:07:46.400096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:07:46.400615 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:07:46.401119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:07:46.401588 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:07:46.402306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:07:46.411582 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:46.412088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:46.413106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:46.414207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:46.414686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:46.415131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:46.433224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Getting quotas for project db37cf1c523e4b3d80845b512bfa4045. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:07:46.438751 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Getting quotas for user 9d822638f4cd4770905d6551e669d4c3 and project db37cf1c523e4b3d80845b512bfa4045. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:07:46.452328 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:07:46.454681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:07:46.501367 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a79fad83-477f-47fc-ab89-913a394fed70 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539797 Sep 25 02:07:46.502066 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3607/7187] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:07:46.516188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0c9b12cd-ed2f-4947-be99-b586b520258c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:46.517751 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0c9b12cd-ed2f-4947-be99-b586b520258c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:46.574389 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0c9b12cd-ed2f-4947-be99-b586b520258c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:46.581824 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0c9b12cd-ed2f-4947-be99-b586b520258c tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1216 microversion: 2.1 time: 0.069593 Sep 25 02:07:46.582405 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3581/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:46 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:47.614248 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:47.614934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:47.618507 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:47.624318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:47.630213 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:47.631329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:47.632227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:47.632718 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:47.633164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:47.707812 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:47.716358 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ccee2a81-d982-4db0-9961-6a0c4ddc5455 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1276 microversion: 2.1 time: 0.115178 Sep 25 02:07:47.716946 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3608/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:47 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:48.741976 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:48.743140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:48.753434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:48.753944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:48.754388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:48.755133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:48.755589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:48.756013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:48.891872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:48.900759 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cc010139-6bc3-45bd-8cb0-713933cae354 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.164287 Sep 25 02:07:48.901361 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3582/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:48 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:49.546810 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a839d8af-3a8b-4e77-bc62-9ebcdfb4fe71 req-09a33276-dd3c-449a-bb2a-2252f0c50d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b535e689-52ef-484f-8811-b9957eed68df", "tag": "378f31de-ee44-406c-88bb-9eba25f9bbf4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:49.560623 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a839d8af-3a8b-4e77-bc62-9ebcdfb4fe71 req-09a33276-dd3c-449a-bb2a-2252f0c50d80 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:49.561438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a839d8af-3a8b-4e77-bc62-9ebcdfb4fe71 req-09a33276-dd3c-449a-bb2a-2252f0c50d80 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:49.562409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a839d8af-3a8b-4e77-bc62-9ebcdfb4fe71 req-09a33276-dd3c-449a-bb2a-2252f0c50d80 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:49.575440 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a839d8af-3a8b-4e77-bc62-9ebcdfb4fe71 req-09a33276-dd3c-449a-bb2a-2252f0c50d80 service nova] Creating event network-changed:378f31de-ee44-406c-88bb-9eba25f9bbf4 for instance b535e689-52ef-484f-8811-b9957eed68df on n-h1-master-1 Sep 25 02:07:49.581756 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a839d8af-3a8b-4e77-bc62-9ebcdfb4fe71 req-09a33276-dd3c-449a-bb2a-2252f0c50d80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038661 Sep 25 02:07:49.582368 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3609/7191] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:07:49.924443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:49.925064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:49.932418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:49.932909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:49.933354 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:49.934094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:49.934554 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:49.934985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:50.068411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:50.076850 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-80431489-c260-4083-9ec2-6c76b4166385 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.156414 Sep 25 02:07:50.077452 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3583/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:49 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:51.101672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:51.102399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:51.109670 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:51.110178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:51.110636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:51.111362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:51.111834 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:51.112274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:51.250369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:51.258484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2fd1d596-b344-4171-9d01-d1d2699b782b tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.161957 Sep 25 02:07:51.259072 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3610/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:51 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:52.281989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:52.282607 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:52.290244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:52.290723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:52.291160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:52.291854 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:52.292308 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:52.292733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:52.423615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:52.431818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-587dd091-9e52-45da-a577-b8de567fcecc tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.153718 Sep 25 02:07:52.432404 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3584/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:52 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:53.455384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:53.456081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:53.463589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:53.464088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:53.464546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:53.465258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:53.465767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:53.466215 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:53.600431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:53.608312 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0f0db8fc-eba4-4a10-9f35-f9f2fc592884 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.156951 Sep 25 02:07:53.608900 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3611/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:53 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:54.631786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:54.632410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:54.639720 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:54.640220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:54.640723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:54.641383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:54.641958 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:54.642408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:54.778250 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:54.786833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8c3605f3-ee34-4b80-9a83-b5422d14204e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.159067 Sep 25 02:07:54.788257 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3585/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:54 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:54.790528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-246442f8-4bac-43bc-a176-7b7fe69f3c06 req-6cfbe6a4-89ba-4cd0-bcc3-059b52c44868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b535e689-52ef-484f-8811-b9957eed68df", "name": "network-vif-plugged", "status": "completed", "tag": "378f31de-ee44-406c-88bb-9eba25f9bbf4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:54.801727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-246442f8-4bac-43bc-a176-7b7fe69f3c06 req-6cfbe6a4-89ba-4cd0-bcc3-059b52c44868 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:54.802306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-246442f8-4bac-43bc-a176-7b7fe69f3c06 req-6cfbe6a4-89ba-4cd0-bcc3-059b52c44868 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:54.803036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-246442f8-4bac-43bc-a176-7b7fe69f3c06 req-6cfbe6a4-89ba-4cd0-bcc3-059b52c44868 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:54.814424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-246442f8-4bac-43bc-a176-7b7fe69f3c06 req-6cfbe6a4-89ba-4cd0-bcc3-059b52c44868 service nova] Creating event network-vif-plugged:378f31de-ee44-406c-88bb-9eba25f9bbf4 for instance b535e689-52ef-484f-8811-b9957eed68df on n-h1-master-1 Sep 25 02:07:54.819644 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-246442f8-4bac-43bc-a176-7b7fe69f3c06 req-6cfbe6a4-89ba-4cd0-bcc3-059b52c44868 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034098 Sep 25 02:07:54.820263 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3612/7197] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:07:55.812430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:55.813056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:55.820337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:55.820831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:55.821276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:55.822025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:55.822486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:55.822915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:55.954007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:55.962588 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9f926529-0fde-4df6-a4f0-ccc05a04e9d8 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1316 microversion: 2.1 time: 0.154320 Sep 25 02:07:55.963163 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3586/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:55 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:56.983708 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:56.984498 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:56.988999 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:56.989754 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:56.997375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:56.997905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:56.998362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:56.999072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:56.999544 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:56.999987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:57.138681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:57.146720 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-000bf663-e6cc-4e9f-a28d-0b35a26d7b59 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1505 microversion: 2.1 time: 0.164780 Sep 25 02:07:57.147336 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3613/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:56 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:57.169332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:57.169895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:57.171690 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:07:57.178598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:57.179187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:57.179621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:57.180326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:57.180782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:57.181214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:57.207429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:07:57.289605 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a7ec980-6c1b-48e7-9044-0501dac847be tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 204 len: 0 microversion: 2.1 time: 0.124015 Sep 25 02:07:57.290257 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3587/7200] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:07:57 2022] DELETE /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:07:57.298764 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:57.299780 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:57.306658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:57.307155 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:57.307804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:57.308584 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:57.309062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:57.309546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:57.445787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:57.453836 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f6354ec1-d111-4966-90aa-f96396934d1a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1511 microversion: 2.1 time: 0.159173 Sep 25 02:07:57.454449 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3614/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:57 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:07:58.479296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:58.479994 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:58.486782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:58.487258 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:58.487693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:58.488374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:58.488822 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:58.489244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:58.625684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:58.633797 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2f3e08c-ef2c-4a70-8614-c30f82df445f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1511 microversion: 2.1 time: 0.159514 Sep 25 02:07:58.634378 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3588/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:58 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:07:59.331401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-25bba3a5-3073-48ab-b62b-6283615ce5e0 req-c25c74cd-0b4c-4655-ab82-5bf6f3ceb9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b535e689-52ef-484f-8811-b9957eed68df", "name": "network-vif-deleted", "tag": "378f31de-ee44-406c-88bb-9eba25f9bbf4"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:07:59.348940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-25bba3a5-3073-48ab-b62b-6283615ce5e0 req-c25c74cd-0b4c-4655-ab82-5bf6f3ceb9fd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:59.349832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-25bba3a5-3073-48ab-b62b-6283615ce5e0 req-c25c74cd-0b4c-4655-ab82-5bf6f3ceb9fd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:59.350847 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-25bba3a5-3073-48ab-b62b-6283615ce5e0 req-c25c74cd-0b4c-4655-ab82-5bf6f3ceb9fd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:59.368662 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-25bba3a5-3073-48ab-b62b-6283615ce5e0 req-c25c74cd-0b4c-4655-ab82-5bf6f3ceb9fd service nova] Creating event network-vif-deleted:378f31de-ee44-406c-88bb-9eba25f9bbf4 for instance b535e689-52ef-484f-8811-b9957eed68df on n-h1-master-1 Sep 25 02:07:59.378209 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-25bba3a5-3073-48ab-b62b-6283615ce5e0 req-c25c74cd-0b4c-4655-ab82-5bf6f3ceb9fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048649 Sep 25 02:07:59.379741 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3615/7203] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:07:59.657169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:07:59.657812 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:07:59.665580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:59.666071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:59.666515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:59.667213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:59.667667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:59.668095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:59.700433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:07:59.700918 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:07:59.701358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:07:59.701839 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lazy-loading 'fault' on Instance uuid b535e689-52ef-484f-8811-b9957eed68df {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:07:59.743326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:07:59.751143 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-18517e34-66b6-45b7-803e-016a301f9f0e tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 200 len: 1306 microversion: 2.1 time: 0.097850 Sep 25 02:07:59.751718 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3589/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:07:59 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:00.774862 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:00.775585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:00.782697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:00.783194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:00.783644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:00.784346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:00.785068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:00.785526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:00.799955 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] HTTP exception thrown: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df HTTP/1.1 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b535e689-52ef-484f-8811-b9957eed68df'} Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:00.801689 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 404 to user: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22091a41-eb48-4e3d-b6ab-a3c8cba261cb tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 404 len: 111 microversion: 2.1 time: 0.033495 Sep 25 02:08:00.806528 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3616/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:00 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:08:00.812849 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:00.813508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:00.820886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:00.821373 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:00.821853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:00.822884 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:00.823340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:00.823771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:00.956391 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:00.964410 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2b435bb-cc39-409e-a803-44e6478ea941 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.155506 Sep 25 02:08:00.964999 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3590/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:00 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:00.987110 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1164c95b-45ee-456e-bbfa-d9c0dcd4e227 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:00.989386 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1164c95b-45ee-456e-bbfa-d9c0dcd4e227 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 29a30fbb-aa21-4669-be64-bac0409c7596] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:00.995678 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-1164c95b-45ee-456e-bbfa-d9c0dcd4e227 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] HTTP exception thrown: Instance 29a30fbb-aa21-4669-be64-bac0409c7596 could not be found. Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1164c95b-45ee-456e-bbfa-d9c0dcd4e227 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/29a30fbb-aa21-4669-be64-bac0409c7596/action HTTP/1.1 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 32 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: {"resize": {"flavorRef": "452"}} Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 29a30fbb-aa21-4669-be64-bac0409c7596 could not be found. Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '29a30fbb-aa21-4669-be64-bac0409c7596', 'body': {'resize': {'flavorRef': '452'}}} Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a30fbb-aa21-4669-be64-bac0409c7596 could not be found. Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:08:00.997502 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a30fbb-aa21-4669-be64-bac0409c7596 could not be found. Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a30fbb-aa21-4669-be64-bac0409c7596 could not be found. Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1164c95b-45ee-456e-bbfa-d9c0dcd4e227 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 404 to user: Instance 29a30fbb-aa21-4669-be64-bac0409c7596 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1164c95b-45ee-456e-bbfa-d9c0dcd4e227 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "POST /compute/v2.1/servers/29a30fbb-aa21-4669-be64-bac0409c7596/action" status: 404 len: 111 microversion: 2.1 time: 0.015944 Sep 25 02:08:01.001948 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3617/7207] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:08:00 2022] POST /compute/v2.1/servers/29a30fbb-aa21-4669-be64-bac0409c7596/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:08:01.008462 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:01.009083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:01.015088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.015575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.016019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.016714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.017196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.017651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.021917 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:01.430944 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:01.438744 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f86d0eb6-6750-403a-818d-8e49d4a90342 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.434901 Sep 25 02:08:01.439322 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3591/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:01 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:01.462535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:01.463162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:01.470001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.470499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.470951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.471654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.472192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.472636 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.611413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:01.619678 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6bc7de56-95b4-4fcc-836f-d054e4cf582a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.161226 Sep 25 02:08:01.620257 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3618/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:01 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:01.642586 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "6f0ce260-162d-4ee3-a313-1fba61f546a6"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:01.644759 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:01.651620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.652098 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.652530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.653216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.653695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.654117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.745946 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:01.751371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] HTTP exception thrown: Flavor 6f0ce260-162d-4ee3-a313-1fba61f546a6 could not be found. Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: request: POST /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1/action HTTP/1.1 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 65 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: {"resize": {"flavorRef": "6f0ce260-162d-4ee3-a313-1fba61f546a6"}} Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: exception: Flavor 6f0ce260-162d-4ee3-a313-1fba61f546a6 could not be found. Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '13e1e550-1a61-4161-a547-7e636fd689e1', 'body': {'resize': {'flavorRef': '6f0ce260-162d-4ee3-a313-1fba61f546a6'}}} Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:01.753361 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 6f0ce260-162d-4ee3-a313-1fba61f546a6 could not be found. Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 6f0ce260-162d-4ee3-a313-1fba61f546a6 could not be found. Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 6f0ce260-162d-4ee3-a313-1fba61f546a6 could not be found. Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 400 to user: Flavor 6f0ce260-162d-4ee3-a313-1fba61f546a6 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ac2bdc1b-535f-4c1b-809e-0afacfa49614 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "POST /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1/action" status: 400 len: 107 microversion: 2.1 time: 0.116285 Sep 25 02:08:01.758948 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3592/7210] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:08:01 2022] POST /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1/action => generated 107 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 02:08:01.763642 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:01.764286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:01.770278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.770776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.771228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.772518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.772981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.773514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.907292 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:01.916304 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-56573f11-1350-4ea1-beb4-01bccbf1c10a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.156474 Sep 25 02:08:01.916895 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3619/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:01 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:08:01.941086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:01.941747 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:01.949326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.949852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.950293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:01.950997 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:01.951455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:01.951887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.084216 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:02.092110 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1b9ba3f1-68e6-4978-96a8-7ecb890d130a tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.155783 Sep 25 02:08:02.092697 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3593/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:01 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:02.116476 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a218dfbf-60ef-49a5-87f8-a91244f5fc6f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a218dfbf-60ef-49a5-87f8-a91244f5fc6f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: request: POST /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1/action HTTP/1.1 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 29 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: {"resize": {"flavorRef": ""}} Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '13e1e550-1a61-4161-a547-7e636fd689e1', 'body': {'resize': {'flavorRef': ''}}} Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise error Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi '' Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.120151 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a218dfbf-60ef-49a5-87f8-a91244f5fc6f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a218dfbf-60ef-49a5-87f8-a91244f5fc6f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "POST /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1/action" status: 400 len: 113 microversion: 2.1 time: 0.010319 Sep 25 02:08:02.125422 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3620/7213] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:08:02 2022] POST /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 25 02:08:02.130175 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:02.131394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:02.137591 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.138083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.138524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.139221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.139674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.140101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.274717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:02.282645 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e88e1df6-b892-4ddc-9bc8-d275a4290150 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1506 microversion: 2.1 time: 0.156392 Sep 25 02:08:02.283221 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3594/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:02 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:02.308824 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:02.309349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:02.316239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.316748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.317212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.317965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.319075 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.319600 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.332961 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] HTTP exception thrown: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df HTTP/1.1 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b535e689-52ef-484f-8811-b9957eed68df'} Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:08:02.335017 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 404 to user: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb723885-8d1c-496b-ae44-53eb9b59327f tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 404 len: 111 microversion: 2.1 time: 0.031534 Sep 25 02:08:02.339047 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3621/7215] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:08:02 2022] DELETE /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:08:02.345199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:02.345846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: b535e689-52ef-484f-8811-b9957eed68df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:02.352049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.352531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.352968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.353693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.354148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.354575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.369051 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] HTTP exception thrown: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df HTTP/1.1 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: exception: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': 'b535e689-52ef-484f-8811-b9957eed68df'} Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:02.370633 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 404 to user: Instance b535e689-52ef-484f-8811-b9957eed68df could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-44ccef1d-1f8f-4f4e-82c6-fd413a0182a0 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df" status: 404 len: 111 microversion: 2.1 time: 0.030807 Sep 25 02:08:02.375316 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3595/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:02 2022] GET /compute/v2.1/servers/b535e689-52ef-484f-8811-b9957eed68df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:08:02.381467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:02.382006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:02.388159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.388671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.389132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.389880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.390357 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.391040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.421660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:08:02.499008 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b41f0944-59c1-4a1c-846d-d5910beda6c4 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 204 len: 0 microversion: 2.1 time: 0.121662 Sep 25 02:08:02.499519 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3622/7217] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:08:02 2022] DELETE /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:08:02.508847 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:02.509490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:02.515481 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.515968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.516408 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.517101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:02.517593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:02.518023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:02.652850 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:02.661191 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7caefcf0-57d8-48e1-84e2-c580c27e5494 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1512 microversion: 2.1 time: 0.157259 Sep 25 02:08:02.665453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3596/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:02 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:03.686043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:03.686677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:03.695374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:03.695888 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:03.696400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:03.697152 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:03.697652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:03.698101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:03.832675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:03.840928 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b8af5699-18a9-4159-837b-b46027ca05ef tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1512 microversion: 2.1 time: 0.159451 Sep 25 02:08:03.841540 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3623/7219] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:03 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:04.636165 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b4d75d09-335a-4dc9-82f5-ad623fc0a976 req-a11e6112-3b5f-488c-bb0b-e46bb726a162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e1e550-1a61-4161-a547-7e636fd689e1", "name": "network-vif-deleted", "tag": "6ff3a0f4-0baf-41d2-8a19-fba44dc1e24d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:04.648187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b4d75d09-335a-4dc9-82f5-ad623fc0a976 req-a11e6112-3b5f-488c-bb0b-e46bb726a162 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:04.649099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b4d75d09-335a-4dc9-82f5-ad623fc0a976 req-a11e6112-3b5f-488c-bb0b-e46bb726a162 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:04.649796 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b4d75d09-335a-4dc9-82f5-ad623fc0a976 req-a11e6112-3b5f-488c-bb0b-e46bb726a162 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:04.665803 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b4d75d09-335a-4dc9-82f5-ad623fc0a976 req-a11e6112-3b5f-488c-bb0b-e46bb726a162 service nova] Creating event network-vif-deleted:6ff3a0f4-0baf-41d2-8a19-fba44dc1e24d for instance 13e1e550-1a61-4161-a547-7e636fd689e1 on n-h2-master-1 Sep 25 02:08:04.671288 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b4d75d09-335a-4dc9-82f5-ad623fc0a976 req-a11e6112-3b5f-488c-bb0b-e46bb726a162 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039562 Sep 25 02:08:04.671907 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3597/7220] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:08:04.864381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:04.865086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:04.872008 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:04.872515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:04.872977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:04.873736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:04.874217 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:04.874663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:04.906436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:04.906937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:04.907397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:04.907865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lazy-loading 'fault' on Instance uuid 13e1e550-1a61-4161-a547-7e636fd689e1 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:08:04.949317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d822638f4cd4770905d6551e669d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db37cf1c523e4b3d80845b512bfa4045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:04.957071 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6f5b2411-43bb-44f9-a776-51abbeabaa81 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 200 len: 1307 microversion: 2.1 time: 0.096904 Sep 25 02:08:04.957675 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3624/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:04 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:05.982185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:05.982892 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] [instance: 13e1e550-1a61-4161-a547-7e636fd689e1] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:05.989981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:05.991374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:05.991878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:05.992565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:05.993013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:05.993464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:06.006776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] HTTP exception thrown: Instance 13e1e550-1a61-4161-a547-7e636fd689e1 could not be found. Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Request method failure captured: Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 HTTP/1.1 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7flKrax_6pu_nM-S1veyOodnSTOO785RGwdtCffA4WV4OaruOeV03tBu59xkGkWHv2XjEaxUXYwydbxT49Cy_FX0lWGT0INFUFatYC_RnlGnT2C36nDZyE-LJ3Ui_k-ICEkwOw3I_cCliyqYhCazRm7RafARn0ZDZRCx8fdWAB5Ljc Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db37cf1c523e4b3d80845b512bfa4045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db37cf1c523e4b3d80845b512bfa4045"}]}] Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: db37cf1c523e4b3d80845b512bfa4045 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-ServersNegativeTestJSON-449937384 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 9d822638f4cd4770905d6551e669d4c3 Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-ServersNegativeTestJSON-449937384-project Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 13e1e550-1a61-4161-a547-7e636fd689e1 could not be found. Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '13e1e550-1a61-4161-a547-7e636fd689e1'} Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e1e550-1a61-4161-a547-7e636fd689e1 could not be found. Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e1e550-1a61-4161-a547-7e636fd689e1 could not be found. Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:08:06.008384 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e1e550-1a61-4161-a547-7e636fd689e1 could not be found. Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] Returning 404 to user: Instance 13e1e550-1a61-4161-a547-7e636fd689e1 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f499415d-a902-4bdb-8d23-cb69072e8f35 tempest-ServersNegativeTestJSON-449937384 tempest-ServersNegativeTestJSON-449937384-project] 10.222.0.16 "GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1" status: 404 len: 111 microversion: 2.1 time: 0.031877 Sep 25 02:08:06.012925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3598/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:05 2022] GET /compute/v2.1/servers/13e1e550-1a61-4161-a547-7e636fd689e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:08:37.578463 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:37.579225 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:37.760507 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30b14b82-fd28-4105-8ee5-a06d4248a438 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: .version_select at 0x7f7beabbc5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1034189493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdw20LjN189f59zFVUJkFUEZkLOkg+vyFuW1fTy/aglFE/LaE121+MkKDvT/ZrX4UG1vPxCFwJ1MwokCeIXhPr/umKZYIjQXQFbYRmV2jLhNgpGZacSrRo9lxaLcgk15A=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:37.776458 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-30b14b82-fd28-4105-8ee5-a06d4248a438 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for project bd7e342e28b54ef283747d50e865f50a. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:08:37.781656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-30b14b82-fd28-4105-8ee5-a06d4248a438 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for user 4dff958dd34144d89a23f45762e76e8d and project bd7e342e28b54ef283747d50e865f50a. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:08:37.812786 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30b14b82-fd28-4105-8ee5-a06d4248a438 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.240116 Sep 25 02:08:37.813393 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3625/7223] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:08:37 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:08:37.869746 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-19923915", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1034189493", "networks": [{"uuid": "44c5e8e1-21f2-40c0-88c4-984e56a49d61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:37.880749 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:37.881625 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:37.934051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] validate_networks() for [('44c5e8e1-21f2-40c0-88c4-984e56a49d61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:08:38.314543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:08:38.314973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:08:38.315447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:08:38.315880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:08:38.316289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:08:38.325730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:38.326211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:38.326641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:38.327360 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:38.327806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:38.328228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:38.345995 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for project bd7e342e28b54ef283747d50e865f50a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:08:38.352094 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for user 4dff958dd34144d89a23f45762e76e8d and project bd7e342e28b54ef283747d50e865f50a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:08:38.364514 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:08:38.367090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:08:38.419311 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a32c9b5-abb1-441c-a3f5-6f75797dec80 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553859 Sep 25 02:08:38.420167 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3599/7224] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:08:38.432524 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2589ab8e-34ae-4af7-a034-2ca07be657d1 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:38.433419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2589ab8e-34ae-4af7-a034-2ca07be657d1 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:38.492922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2589ab8e-34ae-4af7-a034-2ca07be657d1 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:38.502220 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2589ab8e-34ae-4af7-a034-2ca07be657d1 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1261 microversion: 2.1 time: 0.074389 Sep 25 02:08:38.502868 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3626/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:38 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1261 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:08:39.527588 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:39.528245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:39.535807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:39.536305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:39.536951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:39.537694 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:39.538160 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:39.538595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:39.709354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:39.718113 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1bc98df2-68c0-4ee2-bb41-c9c0aabd30b0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1313 microversion: 2.1 time: 0.195838 Sep 25 02:08:39.718795 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3600/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:39 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:40.743357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:40.746604 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:40.757990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:40.759093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:40.760536 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:40.761957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:40.762674 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:40.763355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:41.085516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:41.094794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b1fb729-a827-49cb-ab05-910197f69e40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.356692 Sep 25 02:08:41.109940 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3627/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:40 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:41.916971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-943c4cc9-222c-4ab9-b212-14cc1b67b6db req-5f6213d4-51d2-4d3d-ac82-11ba19c72dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e527015-85c5-48e2-81eb-b360da72e86c", "tag": "4cf7b94e-d95e-4ba6-9d03-ba793315139d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:41.928804 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-943c4cc9-222c-4ab9-b212-14cc1b67b6db req-5f6213d4-51d2-4d3d-ac82-11ba19c72dfe service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:41.929289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-943c4cc9-222c-4ab9-b212-14cc1b67b6db req-5f6213d4-51d2-4d3d-ac82-11ba19c72dfe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:41.929995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-943c4cc9-222c-4ab9-b212-14cc1b67b6db req-5f6213d4-51d2-4d3d-ac82-11ba19c72dfe service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:41.941701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-943c4cc9-222c-4ab9-b212-14cc1b67b6db req-5f6213d4-51d2-4d3d-ac82-11ba19c72dfe service nova] Creating event network-changed:4cf7b94e-d95e-4ba6-9d03-ba793315139d for instance 2e527015-85c5-48e2-81eb-b360da72e86c on n-h1-master-1 Sep 25 02:08:41.947134 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-943c4cc9-222c-4ab9-b212-14cc1b67b6db req-5f6213d4-51d2-4d3d-ac82-11ba19c72dfe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033924 Sep 25 02:08:41.947745 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3601/7228] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:08:42.119815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:42.120486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:42.127896 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:42.128397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:42.128857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:42.129615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:42.130085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:42.130532 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:42.261165 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:42.268979 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c41e5d77-ab6c-4555-af7a-60bb76a91af6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.153275 Sep 25 02:08:42.269601 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3628/7229] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:42 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:43.293823 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:43.294532 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:43.300779 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:43.301263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:43.302005 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:43.302736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:43.303194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:43.303626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:43.445693 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:43.453644 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e04d0ebe-5796-4892-82b4-c595b4d77176 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.164963 Sep 25 02:08:43.454553 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3602/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:43 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:44.478295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:44.478934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:44.485849 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:44.486353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:44.486812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:44.487525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:44.487999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:44.488445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:44.622993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:44.631406 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b97a4fd0-9120-4a15-8a95-f2de732e485b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.157079 Sep 25 02:08:44.631979 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3629/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:44 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:45.654435 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:45.654958 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:45.662326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:45.662806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:45.663267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:45.663971 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:45.664441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:45.664859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:45.797826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:45.806464 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fe89acba-4db4-41e2-ae27-63d4baf4c060 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.156049 Sep 25 02:08:45.807029 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3603/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:45 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:46.830324 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:46.830995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:46.837850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:46.838354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:46.838814 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:46.839527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:46.840005 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:46.840452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:46.978016 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:46.985805 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c891bb6d-1bf5-482f-9a2f-fc1af0904afc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.159359 Sep 25 02:08:46.986390 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3630/7233] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:46 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:47.015961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a368f961-a3c3-42bb-81bb-05c78e8215d6 req-94cdc3b1-3993-43e9-a783-280edbb27fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e527015-85c5-48e2-81eb-b360da72e86c", "name": "network-vif-plugged", "status": "completed", "tag": "4cf7b94e-d95e-4ba6-9d03-ba793315139d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:47.026025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a368f961-a3c3-42bb-81bb-05c78e8215d6 req-94cdc3b1-3993-43e9-a783-280edbb27fe5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:47.026512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a368f961-a3c3-42bb-81bb-05c78e8215d6 req-94cdc3b1-3993-43e9-a783-280edbb27fe5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:47.026946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a368f961-a3c3-42bb-81bb-05c78e8215d6 req-94cdc3b1-3993-43e9-a783-280edbb27fe5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:47.039363 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a368f961-a3c3-42bb-81bb-05c78e8215d6 req-94cdc3b1-3993-43e9-a783-280edbb27fe5 service nova] Creating event network-vif-plugged:4cf7b94e-d95e-4ba6-9d03-ba793315139d for instance 2e527015-85c5-48e2-81eb-b360da72e86c on n-h1-master-1 Sep 25 02:08:47.044230 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a368f961-a3c3-42bb-81bb-05c78e8215d6 req-94cdc3b1-3993-43e9-a783-280edbb27fe5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Sep 25 02:08:47.044836 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3604/7234] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:08:48.010725 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:48.011369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:48.018369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:48.018873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:48.019336 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:48.020048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:48.020526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:48.020976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:48.149727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:48.157393 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2bbadc96-e045-4d86-aa44-9f54225fa732 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1361 microversion: 2.1 time: 0.150651 Sep 25 02:08:48.158015 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3631/7235] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:48 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:49.178434 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:49.179203 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:49.183767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:49.184481 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:49.191509 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:49.192513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:49.193149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:49.193888 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:49.194347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:49.194781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:49.327105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:49.335565 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f58753e5-c9e7-49bd-ad86-58ebcef7d6dc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1554 microversion: 2.1 time: 0.159162 Sep 25 02:08:49.336191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3605/7236] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:49 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:49.357661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:08:49.358301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:49.360150 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:08:49.366661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:49.367168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:49.367630 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:49.368341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:49.368818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:49.369264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:49.499898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:08:49.508647 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-73d6f13a-87d2-4027-9373-a4baac724d7f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1554 microversion: 2.1 time: 0.155038 Sep 25 02:08:49.509221 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3632/7237] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:08:49 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:08:51.178576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8501fe7d-47b8-4187-b2bf-88495b45b6d3"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:08:51.181067 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:08:51.187962 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:51.188450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:51.188889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:51.189621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:08:51.190081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:08:51.190508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:08:51.452558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6e25d7d-c572-4efe-be75-0ffd11c9cb3e tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278297 Sep 25 02:08:51.453385 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3606/7238] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 02:08:51 2022] POST /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:02.167074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:02.167596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:02.170282 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:02.171014 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=36 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:02.177517 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:02.178027 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:02.178491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:02.179205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:02.179682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:02.180159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:02.261192 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lazy-loading 'services' on Instance uuid 2e527015-85c5-48e2-81eb-b360da72e86c {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:09:02.332756 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5cf1475-28f4-4704-a7a7-f199142cf5f5 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments/8501fe7d-47b8-4187-b2bf-88495b45b6d3" status: 202 len: 0 microversion: 2.1 time: 0.169385 Sep 25 02:09:02.333459 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3633/7239] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:09:02 2022] DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments/8501fe7d-47b8-4187-b2bf-88495b45b6d3 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:09:02.343197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:02.345738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:02.348637 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:02.349648 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:02.357552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:02.358026 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:02.358458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:02.359158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:02.359618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:02.360044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:02.394385 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-567ec54b-b7f8-4760-9de3-4d21168a19ce tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055598 Sep 25 02:09:02.395737 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3607/7240] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:02 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:03.408572 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:03.412315 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:03.418880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:03.419380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:03.419837 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:03.420560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:03.421032 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:03.421500 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:03.453330 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cd90f12c-ca90-488b-ac23-439fb770701b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049110 Sep 25 02:09:03.453932 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3634/7241] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:03 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:09:04.466158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:04.468386 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:04.475859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:04.476359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:04.476805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:04.477548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:04.478010 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:04.478439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:04.512408 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fb901377-f5d6-4fb6-8421-483840398eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050363 Sep 25 02:09:04.513002 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3608/7242] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:04 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:05.524461 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:05.526963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:05.533862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:05.534366 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:05.534820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:05.535832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:05.536359 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:05.536805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:05.571491 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-df045457-3fcb-4880-b2e3-4e87ad966755 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051037 Sep 25 02:09:05.572069 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3635/7243] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:05 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:06.584465 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:06.587365 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:06.594462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:06.594947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:06.595388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:06.596148 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:06.596589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:06.597019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:06.632297 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc363fee-1976-4bb3-a946-2b9e54243b48 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052274 Sep 25 02:09:06.633253 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3609/7244] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:06 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:07.644401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:07.646792 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:07.653570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:07.654071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:07.654556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:07.655263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:07.655738 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:07.656188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:07.686110 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d184d7fe-b472-4d04-a70f-322c94f34eb7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045825 Sep 25 02:09:07.686674 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3636/7245] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:07 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 02:09:07.698190 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:07.698680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:07.705357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:07.705864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:07.706297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:07.706981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:07.707433 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:07.707849 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:07.784757 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] HTTP exception thrown: Instance 2e527015-85c5-48e2-81eb-b360da72e86c is not attached to volume 8501fe7d-47b8-4187-b2bf-88495b45b6d3 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Request method failure captured: Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments/8501fe7d-47b8-4187-b2bf-88495b45b6d3 HTTP/1.1 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7gg00iODzWDbgBlQdkKP7MHO8EgDUo0h0PoHxGYxaE23iOGyDvrVvfX0j5d7Li8JlR8G1Dd361TkFwN6CQjdwlkF9dkjuvB9JqQNOTpXNrrwOXbpXXxCy2YpnDmWQ4k9bFl13-x-TQk1kA2FuZgChqrfbSMdyWz_wKacm8nIGJtIFU Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd7e342e28b54ef283747d50e865f50a"}]}] Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4dff958dd34144d89a23f45762e76e8d Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 2e527015-85c5-48e2-81eb-b360da72e86c is not attached to volume 8501fe7d-47b8-4187-b2bf-88495b45b6d3 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': '2e527015-85c5-48e2-81eb-b360da72e86c', 'id': '8501fe7d-47b8-4187-b2bf-88495b45b6d3'} Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8501fe7d-47b8-4187-b2bf-88495b45b6d3. Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e527015-85c5-48e2-81eb-b360da72e86c is not attached to volume 8501fe7d-47b8-4187-b2bf-88495b45b6d3 Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:07.791401 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e527015-85c5-48e2-81eb-b360da72e86c is not attached to volume 8501fe7d-47b8-4187-b2bf-88495b45b6d3 Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Returning 404 to user: Instance 2e527015-85c5-48e2-81eb-b360da72e86c is not attached to volume 8501fe7d-47b8-4187-b2bf-88495b45b6d3 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dd6ba34b-5ba0-466a-bf94-444ee8d21ff9 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments/8501fe7d-47b8-4187-b2bf-88495b45b6d3" status: 404 len: 154 microversion: 2.1 time: 0.098638 Sep 25 02:09:07.795708 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3610/7246] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:09:07 2022] DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c/os-volume_attachments/8501fe7d-47b8-4187-b2bf-88495b45b6d3 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:09:11.143083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:11.143732 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:11.151646 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:11.152153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:11.152615 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:11.153341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:11.153848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:11.154299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:11.181505 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:09:11.260975 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d5d4dece-9552-4374-bd45-ec02fd49d79c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 204 len: 0 microversion: 2.1 time: 0.121720 Sep 25 02:09:11.262021 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3637/7247] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:09:11 2022] DELETE /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:09:11.270919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:11.271542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:11.279170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:11.279602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:11.280042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:11.280744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:11.281200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:11.281656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:11.417998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:11.426794 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ddfe828f-4be6-4855-859b-fa45e0b968c0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1560 microversion: 2.1 time: 0.160007 Sep 25 02:09:11.427471 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3611/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:11 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:12.451398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:12.452122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:12.459768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:12.460268 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:12.460724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:12.461448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:12.461928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:12.462367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:12.592174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:12.600053 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bc13d65-3f25-40b6-94d6-6b8394bf8353 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1560 microversion: 2.1 time: 0.152963 Sep 25 02:09:12.600628 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3638/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:12 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:13.623299 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:13.623922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:13.631969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:13.632478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:13.632920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:13.633654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:13.634110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:13.634538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:13.650190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-642e49ee-bbbf-47ef-b969-e37c96a208a5 req-219684d8-e5c8-43e9-b63c-aeeb8d06898f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e527015-85c5-48e2-81eb-b360da72e86c", "name": "network-vif-deleted", "tag": "4cf7b94e-d95e-4ba6-9d03-ba793315139d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:13.662033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-642e49ee-bbbf-47ef-b969-e37c96a208a5 req-219684d8-e5c8-43e9-b63c-aeeb8d06898f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:13.662530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-642e49ee-bbbf-47ef-b969-e37c96a208a5 req-219684d8-e5c8-43e9-b63c-aeeb8d06898f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:13.662983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-642e49ee-bbbf-47ef-b969-e37c96a208a5 req-219684d8-e5c8-43e9-b63c-aeeb8d06898f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:13.685652 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-642e49ee-bbbf-47ef-b969-e37c96a208a5 req-219684d8-e5c8-43e9-b63c-aeeb8d06898f service nova] Creating event network-vif-deleted:4cf7b94e-d95e-4ba6-9d03-ba793315139d for instance 2e527015-85c5-48e2-81eb-b360da72e86c on n-h1-master-1 Sep 25 02:09:13.694635 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-642e49ee-bbbf-47ef-b969-e37c96a208a5 req-219684d8-e5c8-43e9-b63c-aeeb8d06898f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050329 Sep 25 02:09:13.695779 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3639/7250] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:13.708738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:13.718736 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ed01d4a8-8872-4f8f-a0fb-8546ec5c7381 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 200 len: 1518 microversion: 2.1 time: 0.099316 Sep 25 02:09:13.719335 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3612/7251] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:13 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 1518 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:14.747662 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:14.748387 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 2e527015-85c5-48e2-81eb-b360da72e86c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:14.755541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:14.756048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:14.756552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:14.757216 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:14.757721 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:14.758171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:14.771617 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] HTTP exception thrown: Instance 2e527015-85c5-48e2-81eb-b360da72e86c could not be found. Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Request method failure captured: Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c HTTP/1.1 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7gg00iODzWDbgBlQdkKP7MHO8EgDUo0h0PoHxGYxaE23iOGyDvrVvfX0j5d7Li8JlR8G1Dd361TkFwN6CQjdwlkF9dkjuvB9JqQNOTpXNrrwOXbpXXxCy2YpnDmWQ4k9bFl13-x-TQk1kA2FuZgChqrfbSMdyWz_wKacm8nIGJtIFU Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd7e342e28b54ef283747d50e865f50a"}]}] Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4dff958dd34144d89a23f45762e76e8d Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 2e527015-85c5-48e2-81eb-b360da72e86c could not be found. Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '2e527015-85c5-48e2-81eb-b360da72e86c'} Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e527015-85c5-48e2-81eb-b360da72e86c could not be found. Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e527015-85c5-48e2-81eb-b360da72e86c could not be found. Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:14.773246 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e527015-85c5-48e2-81eb-b360da72e86c could not be found. Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Returning 404 to user: Instance 2e527015-85c5-48e2-81eb-b360da72e86c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e47a73e1-705a-4330-a4b7-088b3203ec3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c" status: 404 len: 111 microversion: 2.1 time: 0.031308 Sep 25 02:09:14.778137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3640/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:14 2022] GET /compute/v2.1/servers/2e527015-85c5-48e2-81eb-b360da72e86c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:09:14.783429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61ae151a-4f32-4e74-9580-0afba8920b18 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '.version_select at 0x7f7bea70f940>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:14.805084 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61ae151a-4f32-4e74-9580-0afba8920b18 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1034189493" status: 202 len: 0 microversion: 2.1 time: 0.025510 Sep 25 02:09:14.805713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3613/7253] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 02:09:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1034189493 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:09:14.823002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-124a8fef-1cd7-44c3-9e8a-08dadfb8656b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: .version_select at 0x7f7beaaa33a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1279516232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7p+dFNSp1cAfdsLxk+MOesHknsUrQ4IBhWQ8X4eveUHCctRDQ8BKkm2ibGLSm5Jz/cAUcyers/boXnxHiQ2G2N8D+BN9JiPqskALrGBaDZzUZBpsWDvqzIz4F3051NyA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:14.838125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-124a8fef-1cd7-44c3-9e8a-08dadfb8656b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for project bd7e342e28b54ef283747d50e865f50a. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:09:14.843967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-124a8fef-1cd7-44c3-9e8a-08dadfb8656b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for user 4dff958dd34144d89a23f45762e76e8d and project bd7e342e28b54ef283747d50e865f50a. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:09:14.867582 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-124a8fef-1cd7-44c3-9e8a-08dadfb8656b tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048547 Sep 25 02:09:14.868174 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3641/7254] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:09:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:14.917340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1456188165", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1279516232", "networks": [{"uuid": "44c5e8e1-21f2-40c0-88c4-984e56a49d61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:14.970310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] validate_networks() for [('44c5e8e1-21f2-40c0-88c4-984e56a49d61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:09:15.341505 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:09:15.341933 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:09:15.342437 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:09:15.342848 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:09:15.343262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:09:15.352803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:15.353286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:15.353749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:15.354473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:15.354932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:15.355356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:15.372371 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for project bd7e342e28b54ef283747d50e865f50a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:09:15.377574 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for user 4dff958dd34144d89a23f45762e76e8d and project bd7e342e28b54ef283747d50e865f50a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:09:15.390563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:09:15.392924 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:09:15.439987 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0eda676c-c26a-4053-9742-69f30627b09d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526530 Sep 25 02:09:15.440636 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3614/7255] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:09:15.452645 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22c778ab-2261-4b1d-8aa7-ec563a3fcb31 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:15.453283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22c778ab-2261-4b1d-8aa7-ec563a3fcb31 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:15.515721 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22c778ab-2261-4b1d-8aa7-ec563a3fcb31 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:15.524425 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22c778ab-2261-4b1d-8aa7-ec563a3fcb31 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1263 microversion: 2.1 time: 0.075645 Sep 25 02:09:15.524995 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3642/7256] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:15 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1263 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:16.549775 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:16.550385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:16.558649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:16.559486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:16.560108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:16.560921 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:16.561487 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:16.561986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:16.636113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:16.649726 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9d2e648-924a-4bd1-a6ca-cd3d8a40ce2a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1323 microversion: 2.1 time: 0.105393 Sep 25 02:09:16.662228 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3615/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:16 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1323 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:17.676873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:17.677598 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:17.684313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:17.684811 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:17.685352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:17.686298 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:17.686553 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:17.686989 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:17.820119 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:17.827912 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b349d2c-dd9f-48c3-a45d-f66880b5a616 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1363 microversion: 2.1 time: 0.155591 Sep 25 02:09:17.828490 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3643/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:17 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:18.026076 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-14ab8b89-bf20-4ed2-ab9c-90cd4b953d32 req-9adb5a32-7b78-44ac-b80c-712c7ee9b1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a044b00-1ec8-4468-800f-823f38914cd3", "tag": "0c024e29-3153-4603-806b-1c3a37cb1b57"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:18.036844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-14ab8b89-bf20-4ed2-ab9c-90cd4b953d32 req-9adb5a32-7b78-44ac-b80c-712c7ee9b1d7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:18.037329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-14ab8b89-bf20-4ed2-ab9c-90cd4b953d32 req-9adb5a32-7b78-44ac-b80c-712c7ee9b1d7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:18.037896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-14ab8b89-bf20-4ed2-ab9c-90cd4b953d32 req-9adb5a32-7b78-44ac-b80c-712c7ee9b1d7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:18.052594 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-14ab8b89-bf20-4ed2-ab9c-90cd4b953d32 req-9adb5a32-7b78-44ac-b80c-712c7ee9b1d7 service nova] Creating event network-changed:0c024e29-3153-4603-806b-1c3a37cb1b57 for instance 5a044b00-1ec8-4468-800f-823f38914cd3 on n-h1-master-1 Sep 25 02:09:18.057418 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-14ab8b89-bf20-4ed2-ab9c-90cd4b953d32 req-9adb5a32-7b78-44ac-b80c-712c7ee9b1d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037172 Sep 25 02:09:18.058042 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3616/7259] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:18.852098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:18.852762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:18.859523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:18.860016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:18.860469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:18.861167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:18.861782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:18.862227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:18.994960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:19.002681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9127b3d-2937-4500-ae80-0e4078357036 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1363 microversion: 2.1 time: 0.155347 Sep 25 02:09:19.003261 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3644/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:18 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:20.027520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:20.028262 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:20.034492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:20.035751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:20.036226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:20.036898 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:20.037355 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:20.037810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:20.165844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:20.173563 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3fa6e3f0-1581-4aaf-a050-4166f10dbb43 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1363 microversion: 2.1 time: 0.151191 Sep 25 02:09:20.174144 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3617/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:20 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:21.196887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:21.197545 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:21.204063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:21.204563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:21.205018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:21.205788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:21.206261 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:21.206700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:21.340902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:21.348923 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4db788e5-f84f-4dce-a4a4-a225887af31a tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1363 microversion: 2.1 time: 0.156712 Sep 25 02:09:21.349516 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3645/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:21 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:22.371666 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:22.372285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:22.379128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:22.379611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:22.380055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:22.380793 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:22.381246 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:22.381706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:22.512606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:22.520448 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-037e4b35-77e9-4bc3-b9e0-700953f03212 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1363 microversion: 2.1 time: 0.152744 Sep 25 02:09:22.521700 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3618/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:22 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:23.228518 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-05fa63ee-ea63-4f5b-90fc-a18478147ddd req-3955ed8c-69b1-4ea9-9593-5ae7f5a0bfd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a044b00-1ec8-4468-800f-823f38914cd3", "name": "network-vif-plugged", "status": "completed", "tag": "0c024e29-3153-4603-806b-1c3a37cb1b57"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:23.240062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-05fa63ee-ea63-4f5b-90fc-a18478147ddd req-3955ed8c-69b1-4ea9-9593-5ae7f5a0bfd1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:23.240570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-05fa63ee-ea63-4f5b-90fc-a18478147ddd req-3955ed8c-69b1-4ea9-9593-5ae7f5a0bfd1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:23.241224 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-05fa63ee-ea63-4f5b-90fc-a18478147ddd req-3955ed8c-69b1-4ea9-9593-5ae7f5a0bfd1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:23.252624 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-05fa63ee-ea63-4f5b-90fc-a18478147ddd req-3955ed8c-69b1-4ea9-9593-5ae7f5a0bfd1 service nova] Creating event network-vif-plugged:0c024e29-3153-4603-806b-1c3a37cb1b57 for instance 5a044b00-1ec8-4468-800f-823f38914cd3 on n-h1-master-1 Sep 25 02:09:23.258488 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-05fa63ee-ea63-4f5b-90fc-a18478147ddd req-3955ed8c-69b1-4ea9-9593-5ae7f5a0bfd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Sep 25 02:09:23.259139 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3646/7264] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:23.544089 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:23.544702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:23.551534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:23.552697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:23.553211 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:23.553966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:23.554439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:23.554896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:23.684315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:23.692177 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d2097c44-610a-4cbd-a9be-5a3657a24649 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1363 microversion: 2.1 time: 0.151982 Sep 25 02:09:23.692770 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3619/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:23 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:24.716510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:24.717341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:24.723807 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:24.724349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:24.724806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:24.725562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:24.726038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:24.726485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:24.862047 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:24.870666 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d82823d8-d025-4240-a60e-a5dbe8326a44 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1555 microversion: 2.1 time: 0.159387 Sep 25 02:09:24.871245 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3647/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:24 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:24.894187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:24.895205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:24.902187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:24.902673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:24.903112 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:24.903808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:24.904266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:24.904696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:25.033056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:25.041924 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5cde2a72-10df-4433-9167-9968676494e7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1555 microversion: 2.1 time: 0.151666 Sep 25 02:09:25.042504 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3620/7267] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:24 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:26.544856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:26.547256 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:26.549227 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:26.556040 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:26.556541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:26.557000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:26.557745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:26.558236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:26.558668 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:26.818743 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f2f5be7b-1545-4616-874b-ef012930dd40 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277450 Sep 25 02:09:26.819342 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3648/7268] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 02:09:26 2022] POST /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:37.541322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:37.541872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:37.543963 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:37.544619 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:37.545870 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:37.546480 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=70 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:37.554235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:37.554712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:37.555149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:37.555840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:37.556286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:37.556707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:37.640631 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lazy-loading 'services' on Instance uuid 5a044b00-1ec8-4468-800f-823f38914cd3 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:09:37.711085 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3986d324-4650-4f95-8ce1-51ae0c3b76d6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments/fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4" status: 202 len: 0 microversion: 2.1 time: 0.173460 Sep 25 02:09:37.711692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3621/7269] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:09:37 2022] DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments/fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:09:37.719228 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:37.720155 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:09:37.725100 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:37.727513 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:37.737081 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:37.737617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:37.738076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:37.738793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:37.739804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:37.740252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:37.775529 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54a119a9-20f0-4855-847d-ba534a4eb6bf tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058923 Sep 25 02:09:37.776102 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3649/7270] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:37 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:38.789659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:38.792010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:38.798977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:38.799469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:38.799915 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:38.800618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:38.801074 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:38.801699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:38.835150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0b821246-56a7-4f7b-9f29-3619795a544f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050668 Sep 25 02:09:38.835949 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3622/7271] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:38 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:39.847231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:39.849674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:39.857052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:39.857591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:39.858076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:39.858836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:39.859307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:39.859759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:39.896371 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-aa2f25e8-cbed-4fef-9315-f6cd29d85a8c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053072 Sep 25 02:09:39.897212 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3650/7272] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:39 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:40.908354 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:40.910735 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:40.917969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:40.918458 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:40.918892 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:40.919583 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:40.920031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:40.920453 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:40.951657 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-91c6f5c3-8924-4139-9a07-345303587419 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Sep 25 02:09:40.952273 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3623/7273] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:40 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:41.965037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:41.967204 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:41.974990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:41.975489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:41.975941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:41.976655 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:41.977119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:41.977583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:42.007837 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0e7c5b9b-f609-4334-8f2c-36e287d6c0a6 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046919 Sep 25 02:09:42.008409 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3651/7274] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:41 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:43.020339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:43.022810 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:43.029771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:43.030253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:43.030683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:43.031368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:43.031818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:43.032240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:43.062033 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9457beae-ff6b-4fb3-8115-760ee9217292 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045762 Sep 25 02:09:43.062589 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3624/7275] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:09:43 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 02:09:43.073960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:43.074483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:43.081421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:43.081924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:43.082383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:43.083277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:43.083753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:43.084199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:43.296223 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] HTTP exception thrown: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 is not attached to volume fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Request method failure captured: Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments/fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 HTTP/1.1 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7gg00iODzWDbgBlQdkKP7MHO8EgDUo0h0PoHxGYxaE23iOGyDvrVvfX0j5d7Li8JlR8G1Dd361TkFwN6CQjdwlkF9dkjuvB9JqQNOTpXNrrwOXbpXXxCy2YpnDmWQ4k9bFl13-x-TQk1kA2FuZgChqrfbSMdyWz_wKacm8nIGJtIFU Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd7e342e28b54ef283747d50e865f50a"}]}] Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4dff958dd34144d89a23f45762e76e8d Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 is not attached to volume fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': '5a044b00-1ec8-4468-800f-823f38914cd3', 'id': 'fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4'} Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4. Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 is not attached to volume fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:43.298202 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 is not attached to volume fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Returning 404 to user: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 is not attached to volume fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6786a610-b081-412f-94c9-0a73c51da8a7 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments/fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4" status: 404 len: 154 microversion: 2.1 time: 0.229906 Sep 25 02:09:43.302605 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3652/7276] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:09:43 2022] DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3/os-volume_attachments/fbd7c5b4-3dbc-4be8-b3a2-42b8866976a4 => generated 154 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:09:46.660547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:46.662399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:46.669853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:46.670440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:46.670950 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:46.671909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:46.672947 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:46.673620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:46.700421 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:09:46.778934 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-08af2b62-abc0-4628-a072-40629030452c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 204 len: 0 microversion: 2.1 time: 0.122146 Sep 25 02:09:46.779866 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3625/7277] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:09:46 2022] DELETE /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 02:09:46.789701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:46.790336 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:46.798024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:46.798529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:46.798982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:46.799673 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:46.800138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:46.800571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:46.935892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:46.944555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d92f9c8c-d1ed-439d-8ad8-cd542bacf804 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1561 microversion: 2.1 time: 0.160061 Sep 25 02:09:46.945123 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3653/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:46 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:47.968774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:47.969516 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:47.976673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:47.977156 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:47.977625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:47.978320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:47.978774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:47.979203 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:48.107410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:48.115915 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-11790a25-1d32-41c2-a62b-485f8cdd624d tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1561 microversion: 2.1 time: 0.151445 Sep 25 02:09:48.116484 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3626/7279] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:47 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:49.092109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d28d5ad5-eb16-406c-ab34-2fab626ab3e9 req-968869ec-e5ce-449d-a177-86f2c6ebfb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a044b00-1ec8-4468-800f-823f38914cd3", "name": "network-vif-deleted", "tag": "0c024e29-3153-4603-806b-1c3a37cb1b57"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:49.104117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d28d5ad5-eb16-406c-ab34-2fab626ab3e9 req-968869ec-e5ce-449d-a177-86f2c6ebfb35 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:49.104617 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d28d5ad5-eb16-406c-ab34-2fab626ab3e9 req-968869ec-e5ce-449d-a177-86f2c6ebfb35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:49.105074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d28d5ad5-eb16-406c-ab34-2fab626ab3e9 req-968869ec-e5ce-449d-a177-86f2c6ebfb35 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:49.118092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d28d5ad5-eb16-406c-ab34-2fab626ab3e9 req-968869ec-e5ce-449d-a177-86f2c6ebfb35 service nova] Creating event network-vif-deleted:0c024e29-3153-4603-806b-1c3a37cb1b57 for instance 5a044b00-1ec8-4468-800f-823f38914cd3 on n-h1-master-1 Sep 25 02:09:49.123355 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d28d5ad5-eb16-406c-ab34-2fab626ab3e9 req-968869ec-e5ce-449d-a177-86f2c6ebfb35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Sep 25 02:09:49.123928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3654/7280] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:49.139096 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:49.139794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:49.147449 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:49.148063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:49.148559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:49.149334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:49.149900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:49.150544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:49.222528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:49.232117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bdd67009-ff36-4dda-8fc2-184c813a30da tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 200 len: 1348 microversion: 2.1 time: 0.096913 Sep 25 02:09:49.232793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3627/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:49 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:50.257528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:50.258252 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: 5a044b00-1ec8-4468-800f-823f38914cd3] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:50.264480 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:50.264981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:50.265464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:50.266174 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:50.266644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:50.267088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:50.281007 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] HTTP exception thrown: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 could not be found. Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Request method failure captured: Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 HTTP/1.1 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7gg00iODzWDbgBlQdkKP7MHO8EgDUo0h0PoHxGYxaE23iOGyDvrVvfX0j5d7Li8JlR8G1Dd361TkFwN6CQjdwlkF9dkjuvB9JqQNOTpXNrrwOXbpXXxCy2YpnDmWQ4k9bFl13-x-TQk1kA2FuZgChqrfbSMdyWz_wKacm8nIGJtIFU Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd7e342e28b54ef283747d50e865f50a"}]}] Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4dff958dd34144d89a23f45762e76e8d Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 could not be found. Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '5a044b00-1ec8-4468-800f-823f38914cd3'} Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 could not be found. Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 could not be found. Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:09:50.282697 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 could not be found. Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Returning 404 to user: Instance 5a044b00-1ec8-4468-800f-823f38914cd3 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9401be2f-1054-4f34-82db-51c4308369dd tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3" status: 404 len: 111 microversion: 2.1 time: 0.031969 Sep 25 02:09:50.288687 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3655/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:50 2022] GET /compute/v2.1/servers/5a044b00-1ec8-4468-800f-823f38914cd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:09:50.293886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f31bf3b2-69e6-43ac-a343-147c6858dabb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '.version_select at 0x7f7bea60d3a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:50.314071 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f31bf3b2-69e6-43ac-a343-147c6858dabb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1279516232" status: 202 len: 0 microversion: 2.1 time: 0.024007 Sep 25 02:09:50.314663 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3628/7283] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 02:09:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1279516232 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:09:50.331586 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dfdc6a15-1948-49b4-a5a3-44fb6adbd924 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: .version_select at 0x7f7be8125280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1777869457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHgIHxwvC2EFiVFMLgvOOysKoAbKMgyRb9GV1QmidvQmPHWvSTHV7oGOc7lP6qLcCBAsPYKSWFXHZpmbnGZJzFgGHNxkaiWaANSfjEMRwj2ZEHLAPYBhAdEOVGsbrNcAA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:50.347305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-dfdc6a15-1948-49b4-a5a3-44fb6adbd924 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for project bd7e342e28b54ef283747d50e865f50a. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:09:50.353799 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-dfdc6a15-1948-49b4-a5a3-44fb6adbd924 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for user 4dff958dd34144d89a23f45762e76e8d and project bd7e342e28b54ef283747d50e865f50a. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:09:50.376691 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dfdc6a15-1948-49b4-a5a3-44fb6adbd924 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049061 Sep 25 02:09:50.377277 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3656/7284] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:09:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:50.428399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1068928689", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1777869457", "networks": [{"uuid": "44c5e8e1-21f2-40c0-88c4-984e56a49d61"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:50.483596 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] validate_networks() for [('44c5e8e1-21f2-40c0-88c4-984e56a49d61', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:09:50.851766 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:09:50.852193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:09:50.852672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:09:50.853084 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:09:50.853560 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:09:50.862229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:50.862707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:50.863144 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:50.864093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:50.864552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:50.864983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:50.882642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for project bd7e342e28b54ef283747d50e865f50a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:09:50.887973 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Getting quotas for user 4dff958dd34144d89a23f45762e76e8d and project bd7e342e28b54ef283747d50e865f50a. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:09:50.900867 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:09:50.903240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:09:50.950136 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-110b45c9-1bea-41c8-8b8e-466a26489444 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525574 Sep 25 02:09:50.950810 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3629/7285] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:09:50.961941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f07bd92-aa97-427a-a0b0-726d43c1222f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:50.962585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f07bd92-aa97-427a-a0b0-726d43c1222f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:51.022202 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f07bd92-aa97-427a-a0b0-726d43c1222f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:51.029266 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f07bd92-aa97-427a-a0b0-726d43c1222f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1263 microversion: 2.1 time: 0.071204 Sep 25 02:09:51.029880 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3657/7286] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:50 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:52.053255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:52.053926 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:52.062496 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:52.063343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:52.063852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:52.064662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:52.065186 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:52.065730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:52.147896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:52.156493 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82d7d426-f5bc-436e-a881-692a34f261eb tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1323 microversion: 2.1 time: 0.107832 Sep 25 02:09:52.158531 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3630/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:52 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:53.181004 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:53.181787 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:53.189166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:53.189705 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:53.190184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:53.191035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:53.191515 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:53.191992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:53.410135 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:53.419734 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10b9526c-1ac9-4a52-a913-d6da67f0f702 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.243434 Sep 25 02:09:53.420414 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3658/7288] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:53 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:53.515520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fcb4c1de-be07-4458-acf8-6e92f29fa55c req-f6cba4fd-7718-4619-bb21-6705b778e45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e48ceb-af47-4b45-98ea-ba3a0719bc72", "tag": "2b0416b9-6f43-436a-8b3f-199e90bb07b6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:09:53.534981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fcb4c1de-be07-4458-acf8-6e92f29fa55c req-f6cba4fd-7718-4619-bb21-6705b778e45f service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:53.536126 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fcb4c1de-be07-4458-acf8-6e92f29fa55c req-f6cba4fd-7718-4619-bb21-6705b778e45f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:53.536907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fcb4c1de-be07-4458-acf8-6e92f29fa55c req-f6cba4fd-7718-4619-bb21-6705b778e45f service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:53.558709 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fcb4c1de-be07-4458-acf8-6e92f29fa55c req-f6cba4fd-7718-4619-bb21-6705b778e45f service nova] Creating event network-changed:2b0416b9-6f43-436a-8b3f-199e90bb07b6 for instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 on n-h2-master-1 Sep 25 02:09:53.567804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fcb4c1de-be07-4458-acf8-6e92f29fa55c req-f6cba4fd-7718-4619-bb21-6705b778e45f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058681 Sep 25 02:09:53.568926 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3631/7289] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:09:54.443759 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:54.444398 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:54.450872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:54.451358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:54.451818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:54.452526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:54.453000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:54.453476 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:54.584937 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:54.594293 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-071b82da-3ccb-4e93-8761-842e7efb55ca tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.154823 Sep 25 02:09:54.594875 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3659/7290] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:54 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:55.619809 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:55.620542 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:55.626767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:55.627247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:55.627683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:55.628364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:55.628815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:55.629845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:55.760285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:55.767936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2e95f1f-6bc4-4b70-b2d8-75810e786714 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.153286 Sep 25 02:09:55.768508 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3632/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:55 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:56.791032 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:56.791672 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:56.798750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:56.799251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:56.799753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:56.800446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:56.800920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:56.801424 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:56.929738 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:56.937583 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2989ee3e-5ccf-4827-951c-693fadfd5ffc tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.150463 Sep 25 02:09:56.938153 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3660/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:56 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:57.961349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:57.961970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:57.968398 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:57.968880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:57.969316 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:57.970029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:57.970483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:57.970909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:58.101562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:58.109660 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-47d26b23-b512-442e-b38d-56088b5508c4 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.152887 Sep 25 02:09:58.110456 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3633/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:57 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:09:59.132774 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:09:59.133434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:09:59.140385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:59.140889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:59.141348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:59.142087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:09:59.142567 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:09:59.143011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:09:59.274141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:09:59.281840 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b3f10a0e-f215-4edb-af42-532087423a88 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.153044 Sep 25 02:09:59.282420 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3661/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:09:59 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:00.210650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-7d6557ce-4cbb-4336-a3af-ff8b00d5997f req-18a3ce48-2338-43cc-8377-092fea991c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e48ceb-af47-4b45-98ea-ba3a0719bc72", "name": "network-vif-plugged", "status": "completed", "tag": "2b0416b9-6f43-436a-8b3f-199e90bb07b6"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:10:00.221528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7d6557ce-4cbb-4336-a3af-ff8b00d5997f req-18a3ce48-2338-43cc-8377-092fea991c06 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:00.222018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7d6557ce-4cbb-4336-a3af-ff8b00d5997f req-18a3ce48-2338-43cc-8377-092fea991c06 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:00.222450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-7d6557ce-4cbb-4336-a3af-ff8b00d5997f req-18a3ce48-2338-43cc-8377-092fea991c06 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:00.233627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-7d6557ce-4cbb-4336-a3af-ff8b00d5997f req-18a3ce48-2338-43cc-8377-092fea991c06 service nova] Creating event network-vif-plugged:2b0416b9-6f43-436a-8b3f-199e90bb07b6 for instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 on n-h2-master-1 Sep 25 02:10:00.239124 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-7d6557ce-4cbb-4336-a3af-ff8b00d5997f req-18a3ce48-2338-43cc-8377-092fea991c06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031791 Sep 25 02:10:00.239753 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3634/7295] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:00.306097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:00.306660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:00.314026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:00.314526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:00.314977 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:00.315702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:00.316169 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:00.316644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:00.498022 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:00.505806 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9c5ac1c7-1a73-4099-b1c2-35b45d73e49c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.204765 Sep 25 02:10:00.506376 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3662/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:00 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:01.525826 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:01.526603 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:01.531914 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:01.532619 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:01.539719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:01.540206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:01.540639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:01.541332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:01.541809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:01.542232 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:01.674838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:01.682885 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0204e435-c7e3-4ff6-9c09-c2263effe7a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1363 microversion: 2.1 time: 0.158028 Sep 25 02:10:01.683464 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3635/7297] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:01 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:02.705921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:02.706475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:02.708454 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:02.714432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:02.714931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:02.715392 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:02.716094 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:02.716566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:02.717007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:02.845392 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:02.853684 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9f4cd94f-86e6-471c-87ac-288536683361 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1556 microversion: 2.1 time: 0.151799 Sep 25 02:10:02.854271 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3663/7298] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:02 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:02.876351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:02.876974 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:02.884025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:02.884514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:02.884955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:02.885683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:02.886139 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:02.886565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:03.021964 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:03.029753 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6c310a60-4cf8-4afa-b0f6-c3162d1fa930 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1556 microversion: 2.1 time: 0.157265 Sep 25 02:10:03.030336 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3636/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:02 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:04.537478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d91e1fcc-808c-4e3b-afdf-12d8bdebc577"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:10:04.539849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:04.546640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:04.547131 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:04.547578 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:04.548276 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:04.548736 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:04.549171 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:04.806618 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-96ee75b5-21a3-4881-b7c9-f294894884e8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "POST /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274176 Sep 25 02:10:04.807235 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3664/7300] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 02:10:04 2022] POST /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:15.515717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:15.516227 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:15.518823 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:15.519482 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:15.525838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:15.526320 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:15.526757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:15.527452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:15.527902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:15.528326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:15.610906 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lazy-loading 'services' on Instance uuid f9e48ceb-af47-4b45-98ea-ba3a0719bc72 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:10:15.685177 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77958662-e8d5-47a3-ae18-ce7f4bb34bb0 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments/d91e1fcc-808c-4e3b-afdf-12d8bdebc577" status: 202 len: 0 microversion: 2.1 time: 0.173115 Sep 25 02:10:15.685993 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3637/7301] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:10:15 2022] DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments/d91e1fcc-808c-4e3b-afdf-12d8bdebc577 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:10:15.693897 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:15.694628 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:15.699684 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:15.702104 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:15.713419 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:15.713943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:15.714404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:15.715125 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:15.715601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:15.716045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:15.750558 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-50cf66cc-e18f-4c51-bc4a-0c36d2612f2f tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059201 Sep 25 02:10:15.751132 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3665/7302] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:10:15 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:16.764963 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:16.767488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:16.776042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:16.776543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:16.776984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:16.777732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:16.778194 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:16.778627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:16.815419 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5ce657fa-707c-4c14-bbbd-843b7a2eb23c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055040 Sep 25 02:10:16.816008 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3638/7303] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:10:16 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:10:17.828651 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:17.830949 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:17.840021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:17.840527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:17.840986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:17.841768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:17.842244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:17.842686 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:17.875192 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e8a60561-cbc2-4101-a663-ab465eba5caa tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050672 Sep 25 02:10:17.875779 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3666/7304] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:10:17 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:18.888351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:18.890554 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:18.898158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:18.898590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:18.899027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:18.899708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:18.900157 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:18.900575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:18.931378 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-48e31fd3-5b09-4ce3-a28c-aaacaa35bd1c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047080 Sep 25 02:10:18.931943 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3639/7305] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:10:18 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:19.944713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:19.946843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:19.953703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:19.954210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:19.954669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:19.955381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:19.955854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:19.956302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:19.987219 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-74b1ff52-b327-46aa-b0c8-f529a334ac3c tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047273 Sep 25 02:10:19.987803 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3667/7306] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:10:19 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:20.999310 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:21.001364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:21.008163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:21.008649 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:21.009082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:21.009834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:21.010289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:21.010712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:21.041375 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-72d8162a-e45f-4bfe-bcde-b12bf0ccf9a8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046159 Sep 25 02:10:21.041971 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3640/7307] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:10:20 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 02:10:21.053207 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:21.053727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:21.060469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:21.060969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:21.061450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:21.062164 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:21.062638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:21.063082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:21.138892 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] HTTP exception thrown: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 is not attached to volume d91e1fcc-808c-4e3b-afdf-12d8bdebc577 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Request method failure captured: Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments/d91e1fcc-808c-4e3b-afdf-12d8bdebc577 HTTP/1.1 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7gg00iODzWDbgBlQdkKP7MHO8EgDUo0h0PoHxGYxaE23iOGyDvrVvfX0j5d7Li8JlR8G1Dd361TkFwN6CQjdwlkF9dkjuvB9JqQNOTpXNrrwOXbpXXxCy2YpnDmWQ4k9bFl13-x-TQk1kA2FuZgChqrfbSMdyWz_wKacm8nIGJtIFU Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd7e342e28b54ef283747d50e865f50a"}]}] Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4dff958dd34144d89a23f45762e76e8d Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 is not attached to volume d91e1fcc-808c-4e3b-afdf-12d8bdebc577 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': 'f9e48ceb-af47-4b45-98ea-ba3a0719bc72', 'id': 'd91e1fcc-808c-4e3b-afdf-12d8bdebc577'} Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d91e1fcc-808c-4e3b-afdf-12d8bdebc577. Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 is not attached to volume d91e1fcc-808c-4e3b-afdf-12d8bdebc577 Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:10:21.140547 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 is not attached to volume d91e1fcc-808c-4e3b-afdf-12d8bdebc577 Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Returning 404 to user: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 is not attached to volume d91e1fcc-808c-4e3b-afdf-12d8bdebc577 {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-239c0def-5c2d-4f60-a6b4-565d6fbf2ff8 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments/d91e1fcc-808c-4e3b-afdf-12d8bdebc577" status: 404 len: 154 microversion: 2.1 time: 0.093060 Sep 25 02:10:21.145922 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3668/7308] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:10:21 2022] DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72/os-volume_attachments/d91e1fcc-808c-4e3b-afdf-12d8bdebc577 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:10:24.489915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:24.490476 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:24.497429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:24.497937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:24.498381 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:24.499088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:24.499546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:24.499987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:24.528575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:10:24.607783 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8f3c13f8-e2c8-44be-b9cf-9b421055f169 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 204 len: 0 microversion: 2.1 time: 0.121762 Sep 25 02:10:24.608557 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3641/7309] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:10:24 2022] DELETE /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:10:24.617577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:24.618116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:24.624696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:24.625189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:24.625661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:24.626363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:24.626827 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:24.627263 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:24.764832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:24.772889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a07b84a-ba8e-4822-a321-d390809d48ac tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1562 microversion: 2.1 time: 0.159648 Sep 25 02:10:24.773487 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3669/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:24 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:25.796911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:25.797652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:25.805332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:25.805862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:25.806286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:25.806979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:25.807440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:25.807880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:25.947750 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:25.955679 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-23740444-0bf6-43fe-88a4-d1e24722ad53 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1562 microversion: 2.1 time: 0.163023 Sep 25 02:10:25.956259 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3642/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:25 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:26.862117 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a7b91db5-6e09-4cc6-8320-2ded8fc61052 req-e8cb66bb-7447-4c44-8f15-81ac969402bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e48ceb-af47-4b45-98ea-ba3a0719bc72", "name": "network-vif-deleted", "tag": "2b0416b9-6f43-436a-8b3f-199e90bb07b6"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:10:26.872568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a7b91db5-6e09-4cc6-8320-2ded8fc61052 req-e8cb66bb-7447-4c44-8f15-81ac969402bf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:26.873058 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a7b91db5-6e09-4cc6-8320-2ded8fc61052 req-e8cb66bb-7447-4c44-8f15-81ac969402bf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:26.873554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a7b91db5-6e09-4cc6-8320-2ded8fc61052 req-e8cb66bb-7447-4c44-8f15-81ac969402bf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:26.890121 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a7b91db5-6e09-4cc6-8320-2ded8fc61052 req-e8cb66bb-7447-4c44-8f15-81ac969402bf service nova] Creating event network-vif-deleted:2b0416b9-6f43-436a-8b3f-199e90bb07b6 for instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 on n-h2-master-1 Sep 25 02:10:26.895820 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a7b91db5-6e09-4cc6-8320-2ded8fc61052 req-e8cb66bb-7447-4c44-8f15-81ac969402bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105896 Sep 25 02:10:26.896443 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3670/7312] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:26.978922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:26.979545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:26.986707 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:26.987195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:26.987637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:26.989120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:26.989616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:26.990050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:27.022192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:27.022681 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:27.023122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:27.023575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lazy-loading 'fault' on Instance uuid f9e48ceb-af47-4b45-98ea-ba3a0719bc72 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:10:27.069101 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dff958dd34144d89a23f45762e76e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7e342e28b54ef283747d50e865f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:27.076886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8249878b-38aa-4394-8039-fe3cdd52b5db tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 200 len: 1353 microversion: 2.1 time: 0.101888 Sep 25 02:10:27.077490 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3643/7313] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:26 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:28.101431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:28.102161 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] [instance: f9e48ceb-af47-4b45-98ea-ba3a0719bc72] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:28.108325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:28.108830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:28.109287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:28.110024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:28.110499 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:28.110970 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:28.124279 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] HTTP exception thrown: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 could not be found. Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Request method failure captured: Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 HTTP/1.1 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7gg00iODzWDbgBlQdkKP7MHO8EgDUo0h0PoHxGYxaE23iOGyDvrVvfX0j5d7Li8JlR8G1Dd361TkFwN6CQjdwlkF9dkjuvB9JqQNOTpXNrrwOXbpXXxCy2YpnDmWQ4k9bFl13-x-TQk1kA2FuZgChqrfbSMdyWz_wKacm8nIGJtIFU Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd7e342e28b54ef283747d50e865f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd7e342e28b54ef283747d50e865f50a"}]}] Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: bd7e342e28b54ef283747d50e865f50a Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-252083486 Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4dff958dd34144d89a23f45762e76e8d Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestEncryptedCinderVolumes-252083486-project Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: exception: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 could not be found. Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'f9e48ceb-af47-4b45-98ea-ba3a0719bc72'} Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 could not be found. Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 could not be found. Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:10:28.125959 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 could not be found. Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Returning 404 to user: Instance f9e48ceb-af47-4b45-98ea-ba3a0719bc72 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e9fc870a-ca8f-4753-b772-0ad1f6daae10 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72" status: 404 len: 111 microversion: 2.1 time: 0.031162 Sep 25 02:10:28.131106 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3671/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:28 2022] GET /compute/v2.1/servers/f9e48ceb-af47-4b45-98ea-ba3a0719bc72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:10:28.136860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-375793ad-a482-42ba-b931-ae74b43465c3 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] Calling method '.version_select at 0x7f7bea6b7d30>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:28.157282 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-375793ad-a482-42ba-b931-ae74b43465c3 tempest-TestEncryptedCinderVolumes-252083486 tempest-TestEncryptedCinderVolumes-252083486-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1777869457" status: 202 len: 0 microversion: 2.1 time: 0.024180 Sep 25 02:10:28.157910 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3644/7315] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 25 02:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1777869457 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:10:55.393196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fddb1c22-1d72-4965-a0b6-0052ee464d78 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'create', calling method: .version_select at 0x7f7be80e5670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1829499200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDszH4uc0VUJxreG5x3pHTkmNyjUMiOG8NuMBOXZcudxav8r5XBQh8bgd77mtDfaiAHvT5m0prGZZxAoiyCAoS5BP6ET3pRV2/BnqrArRsdc5tvp1m7acKd08MBDCwUBRA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:10:55.399166 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=14 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:55.399828 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=34 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:55.413175 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-fddb1c22-1d72-4965-a0b6-0052ee464d78 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:10:55.421785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-fddb1c22-1d72-4965-a0b6-0052ee464d78 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for user 4e4a721ce8234a698ef43644a8d96a53 and project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:10:55.446802 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fddb1c22-1d72-4965-a0b6-0052ee464d78 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057504 Sep 25 02:10:55.447461 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3672/7316] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:10:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:10:55.498639 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-419772173", "imageRef": "1f8239dc-10a7-42e3-bd15-0a37a7ac9f51", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1829499200", "networks": [{"uuid": "55117f72-f643-418a-acb2-a78ff3daacf3"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:10:55.508931 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:55.509624 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:10:55.556561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] validate_networks() for [('55117f72-f643-418a-acb2-a78ff3daacf3', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:10:55.933729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:10:55.934164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:10:55.934672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:10:55.935217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:10:55.935640 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:10:55.944908 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:55.945397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:55.945873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:55.946635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:55.947095 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:55.947529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:55.964739 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:10:55.970177 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for user 4e4a721ce8234a698ef43644a8d96a53 and project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:10:55.982577 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:10:55.984803 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1f8239dc-10a7-42e3-bd15-0a37a7ac9f51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:10:56.031552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-dc35fc8c-72c8-4552-b03f-35103c1e2b0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536777 Sep 25 02:10:56.032212 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3645/7317] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:10:56.043439 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9b912ec1-00f7-4afd-909c-eb20e0517084 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:56.044076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9b912ec1-00f7-4afd-909c-eb20e0517084 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:56.101466 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9b912ec1-00f7-4afd-909c-eb20e0517084 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:56.108591 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9b912ec1-00f7-4afd-909c-eb20e0517084 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1258 microversion: 2.1 time: 0.069038 Sep 25 02:10:56.109254 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3673/7318] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:56 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:57.132241 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:57.133781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:57.139810 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:57.140301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:57.140741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:57.142101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:57.142575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:57.143185 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:57.205726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:57.214160 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-738e8903-4ce0-4ba1-8d41-e3b0bbd2dcc9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1310 microversion: 2.1 time: 0.086918 Sep 25 02:10:57.214735 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3646/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:57 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:58.242297 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:58.244347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:58.257278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:58.258445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:58.259267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:58.260362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:58.261194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:58.261969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:58.413596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:58.427461 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-65cc46e4-d2cb-4ec7-b7e0-4ef8edb68233 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.192149 Sep 25 02:10:58.429467 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3674/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:58 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:10:59.453429 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:10:59.455741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:10:59.463966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:59.464769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:59.465728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:59.466723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:10:59.467375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:10:59.467993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:10:59.614024 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:10:59.626185 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82314ec0-7903-4432-9eb4-f55a45f8406b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.176805 Sep 25 02:10:59.639756 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3647/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:10:59 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:00.654262 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:00.654920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:00.662657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:00.663165 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:00.663629 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:00.664351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:00.664831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:00.665289 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:00.805339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:00.814432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-88cf424c-5ef3-4a65-b335-6c98cd7e0dcd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.163174 Sep 25 02:11:00.815604 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3675/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:00 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:01.836911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:01.837620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:01.844394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:01.844882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:01.845322 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:01.846082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:01.846541 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:01.846972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:01.990983 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:01.998641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-319b1586-284e-4535-bfd7-72b5d4547cf5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.165649 Sep 25 02:11:01.999215 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3648/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:01 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:03.022800 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:03.023869 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:03.031770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:03.032277 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:03.032985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:03.033742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:03.034212 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:03.034660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:03.193039 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:03.201247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb5dabf6-942c-4d9d-b154-fc0b02ce9ce9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.183958 Sep 25 02:11:03.202088 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3676/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:03 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:04.233422 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:04.234917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:04.242519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:04.243273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:04.243715 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:04.244616 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:04.245084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:04.245717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:04.393659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:04.403046 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3a24ffc2-c20d-415e-81d4-0c73af04a1e5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.178309 Sep 25 02:11:04.403941 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3649/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:04 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:05.426868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:05.427618 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:05.435760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:05.437619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:05.438121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:05.438940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:05.439519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:05.440024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:05.588925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:05.596825 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-308c4cb5-8a5f-4870-a0e4-a6afc7655335 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.175062 Sep 25 02:11:05.597947 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3677/7326] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:05 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:06.620363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:06.620980 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:06.623676 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:06.624343 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:06.630714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:06.631200 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:06.631641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:06.632334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:06.632789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:06.633219 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:06.766064 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:06.774601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f830248c-ca34-422b-97b6-cdec3b19d965 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.158146 Sep 25 02:11:06.775478 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3650/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:06 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:07.557773 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:07.693797 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a26ed3d6-e1fd-4986-a05f-ed4bb7fb5333 req-b496f3e2-0172-48c1-b276-1f45b2550c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:11:07.703460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a26ed3d6-e1fd-4986-a05f-ed4bb7fb5333 req-b496f3e2-0172-48c1-b276-1f45b2550c5a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:07.703953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a26ed3d6-e1fd-4986-a05f-ed4bb7fb5333 req-b496f3e2-0172-48c1-b276-1f45b2550c5a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:07.704405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a26ed3d6-e1fd-4986-a05f-ed4bb7fb5333 req-b496f3e2-0172-48c1-b276-1f45b2550c5a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:07.715692 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a26ed3d6-e1fd-4986-a05f-ed4bb7fb5333 req-b496f3e2-0172-48c1-b276-1f45b2550c5a service nova] Creating event network-changed:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:11:07.720681 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a26ed3d6-e1fd-4986-a05f-ed4bb7fb5333 req-b496f3e2-0172-48c1-b276-1f45b2550c5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167326 Sep 25 02:11:07.721283 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3678/7328] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:11:07.798725 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:07.799338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:07.806409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:07.806896 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:07.807330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:07.808021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:07.808483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:07.808875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:07.944658 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:07.952434 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7da3e746-ac2c-4b52-993c-2acab64e8af7 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.157731 Sep 25 02:11:07.953006 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3651/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:07 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:08.976348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:08.977073 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:08.983485 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:08.983990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:08.984450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:08.985161 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:08.985665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:08.986113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:09.119308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:09.127075 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85c73399-e92f-4833-aea4-bd0709523765 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.156490 Sep 25 02:11:09.127651 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3679/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:08 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:10.151018 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:10.153078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:10.158434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:10.158923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:10.159367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:10.160640 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:10.161368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:10.161823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:10.295218 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:10.305207 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5bd842c6-d7ac-4196-8dd9-cec72c1c83e4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.158129 Sep 25 02:11:10.305836 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3652/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:10 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:11.328124 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:11.328756 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:11.335586 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:11.336080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:11.336539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:11.337238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:11.337737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:11.338178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:11.725982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:11.733941 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-70dff06f-1800-487d-a55d-ed0029507700 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.409642 Sep 25 02:11:11.734528 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3680/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:11 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:12.757860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:12.758482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:12.765321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:12.765838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:12.766279 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:12.766972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:12.767437 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:12.767866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:12.894529 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:12.902147 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-64087f11-c527-4965-b58e-13f82680adb1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.148642 Sep 25 02:11:12.902728 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3653/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:12 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:13.836478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-900919cf-5633-4962-8140-ef3ca8abff2e req-9c4f21a0-74cc-4e35-9780-14a1b9891ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "name": "network-vif-plugged", "status": "completed", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:11:13.846367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-900919cf-5633-4962-8140-ef3ca8abff2e req-9c4f21a0-74cc-4e35-9780-14a1b9891ed6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:13.846943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-900919cf-5633-4962-8140-ef3ca8abff2e req-9c4f21a0-74cc-4e35-9780-14a1b9891ed6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:13.847472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-900919cf-5633-4962-8140-ef3ca8abff2e req-9c4f21a0-74cc-4e35-9780-14a1b9891ed6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:13.858826 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-900919cf-5633-4962-8140-ef3ca8abff2e req-9c4f21a0-74cc-4e35-9780-14a1b9891ed6 service nova] Creating event network-vif-plugged:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:11:13.863850 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-900919cf-5633-4962-8140-ef3ca8abff2e req-9c4f21a0-74cc-4e35-9780-14a1b9891ed6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089611 Sep 25 02:11:13.864502 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3681/7334] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:11:13.925482 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:13.926121 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:13.932909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:13.933397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:13.933885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:13.934584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:13.935048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:13.935480 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:14.070055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:14.078399 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9eeb52d3-2311-433d-8c3b-0a8a159e0c0c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.156881 Sep 25 02:11:14.078993 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3654/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:13 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:15.102793 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:15.103519 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:15.109747 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:15.110249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:15.110709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:15.111417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:15.111893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:15.112337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:15.241944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:15.249869 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-27b64c18-c4db-425e-b1c2-ff20ac206a0f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1358 microversion: 2.1 time: 0.152191 Sep 25 02:11:15.250437 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3682/7336] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:15 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:16.273952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:16.274566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:16.281597 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.282411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.282548 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.283330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.283610 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.284034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.423741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:16.431900 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d2debf5-7018-46b0-89f1-87fb3e93fa07 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1548 microversion: 2.1 time: 0.162194 Sep 25 02:11:16.432494 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3655/7337] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:16 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:16.454293 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:16.454925 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:16.462701 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.463204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.463656 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.464364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.464831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.465269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.598227 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:16.606879 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-93761390-0502-428a-9864-3d88b10df3c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1548 microversion: 2.1 time: 0.156453 Sep 25 02:11:16.607450 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3683/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:16 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:16.629477 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:16.634857 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:16.635661 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Searching by: {'deleted': False, 'project_id': '3e4dde63604a418d8ff919f35e5928d7'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 02:11:16.641170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.641654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.642412 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.643321 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.643823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.644431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.671213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 02:11:16.699412 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a58ca50f-9600-4593-bb7b-8c2500a40d81 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073707 Sep 25 02:11:16.700191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3656/7339] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 02:11:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:11:16.712280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:16.712945 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:16.719173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.719682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.720148 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.720869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:16.721346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:16.721836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:16.859343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:16.867960 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3889f688-a64c-49d5-97a5-eaeeed68cb03 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1548 microversion: 2.1 time: 0.160127 Sep 25 02:11:16.877532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3684/7340] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:16 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:18.410212 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d9a74b5-9e2b-4a31-9a6f-12f314924a82"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:11:18.413687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:18.420670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:18.421161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:18.421641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:18.422347 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:18.422802 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:18.423233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:18.683807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a8f4e9fe-b3e1-4af7-840e-43a3503aa5f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277404 Sep 25 02:11:18.684426 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3657/7341] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 02:11:18 2022] POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:11:31.739677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:31.740963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:31.743757 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:31.744635 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=58 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:31.750873 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:31.751375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:31.751828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:31.752548 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:31.753022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:31.753494 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:31.882035 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:31.890247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-01a1ef59-eb93-4e40-9d57-a83f963558e2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1594 microversion: 2.1 time: 0.154485 Sep 25 02:11:31.890820 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3685/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:31 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:33.783740 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b56d2c6b-4136-4e7e-af25-976bb27b570c req-90a0c8a9-2580-4987-a9ec-67362aa47fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:11:33.797438 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:33.798480 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:33.799201 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:11:33.801490 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b56d2c6b-4136-4e7e-af25-976bb27b570c req-90a0c8a9-2580-4987-a9ec-67362aa47fd7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:33.802014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b56d2c6b-4136-4e7e-af25-976bb27b570c req-90a0c8a9-2580-4987-a9ec-67362aa47fd7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:33.802543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b56d2c6b-4136-4e7e-af25-976bb27b570c req-90a0c8a9-2580-4987-a9ec-67362aa47fd7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:33.817776 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b56d2c6b-4136-4e7e-af25-976bb27b570c req-90a0c8a9-2580-4987-a9ec-67362aa47fd7 service nova] Creating event network-changed:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:11:33.823866 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b56d2c6b-4136-4e7e-af25-976bb27b570c req-90a0c8a9-2580-4987-a9ec-67362aa47fd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044506 Sep 25 02:11:33.824664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3658/7343] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:11:34.828144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1558060831"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:11:34.828711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:34.836770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:34.837310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:34.837789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:34.838556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:34.838965 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:34.839405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:34.976076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Adding security group 997d5c7b-3835-4c7c-980c-ab295a555b07 to port 9b34f547-6b5f-431e-8fa9-f8b83776cea7 Sep 25 02:11:35.299036 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb40ecb8-5af9-4498-9859-759437463ec5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action" status: 202 len: 0 microversion: 2.1 time: 0.475067 Sep 25 02:11:35.299662 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3686/7344] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:11:34 2022] POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:11:35.310270 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:11:35.310984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:11:35.317614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:35.318741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:35.319188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:35.320000 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:35.320457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:35.320889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:35.478674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:11:35.487059 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87c841a4-b79d-4409-957d-5c5469718f74 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1759 microversion: 2.1 time: 0.182301 Sep 25 02:11:35.487637 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3659/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:11:35 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:11:35.840912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a6033ec3-0729-4c77-9962-e897e38e8014 req-d87cdf45-83f1-4b97-8d22-7b4926d49722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:11:35.851002 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a6033ec3-0729-4c77-9962-e897e38e8014 req-d87cdf45-83f1-4b97-8d22-7b4926d49722 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:11:35.851503 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a6033ec3-0729-4c77-9962-e897e38e8014 req-d87cdf45-83f1-4b97-8d22-7b4926d49722 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:11:35.851961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a6033ec3-0729-4c77-9962-e897e38e8014 req-d87cdf45-83f1-4b97-8d22-7b4926d49722 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:11:35.866912 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a6033ec3-0729-4c77-9962-e897e38e8014 req-d87cdf45-83f1-4b97-8d22-7b4926d49722 service nova] Creating event network-changed:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:11:35.871904 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a6033ec3-0729-4c77-9962-e897e38e8014 req-d87cdf45-83f1-4b97-8d22-7b4926d49722 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035971 Sep 25 02:11:35.872585 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3687/7346] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:13:13.919685 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71316119-ca8d-457e-a845-7566a7d0a6aa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:13:13.920186 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:13:13.920906 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:13:13.922638 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:13:13.922915 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:13:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action (ip 10.222.0.16) !!! Sep 25 02:13:13.927922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:13:13.930240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:13:13.942656 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:13.943153 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:13.943615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:13.944296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:13.944741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:13.945164 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:14.017120 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-003023b0-0b0e-482b-97b3-df8126cc97f8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action" status: 202 len: 0 microversion: 2.1 time: 0.099652 Sep 25 02:13:14.017793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3660/7347] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:13:13 2022] POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:13:14.024472 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:13:14.025070 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:13:14.026485 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:13:14.028174 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:13:14.028305 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a (ip 10.222.0.16) !!! Sep 25 02:13:14.035419 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:13:14.036098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:13:14.045387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:14.045917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:14.046369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:14.047071 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:14.047539 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:14.047976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:14.194607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:13:14.203095 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-30c047c9-7f0f-426a-ad12-13cdc0196e6d tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1761 microversion: 2.1 time: 0.180965 Sep 25 02:13:14.203764 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3688/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:13:14 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:13:15.230307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:13:15.231014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:13:15.237820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:15.238312 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:15.238750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:15.239440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:15.239893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:15.240346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:15.250002 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] [71316119-ca8d-457e-a845-7566a7d0a6aa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50096. Sep 25 02:13:15.398412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:13:15.407308 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5eb72d10-0fc3-4193-a9fc-1fb2f0c53fde tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1766 microversion: 2.1 time: 0.183700 Sep 25 02:13:15.407883 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3661/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:13:15 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1766 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:13:16.432230 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:13:16.432940 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:13:16.443876 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50100. Sep 25 02:13:16.447831 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:16.448346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:16.448812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:16.449552 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:13:16.450029 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:13:16.450475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:13:16.596001 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:13:16.604651 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b8beabd-ce72-44e6-a91a-f98ad3bd9771 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1759 microversion: 2.1 time: 0.176752 Sep 25 02:13:16.605275 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3689/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:13:16 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:30.554044 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:30.554788 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:30.558793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1558060831"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:14:30.559322 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:30.566762 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:30.567243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:30.567676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:30.568367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:30.568812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:30.569230 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:30.766628 n-d-master-1 devstack@n-api.service[122384]: INFO nova.network.security_group_api [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Removing security group 997d5c7b-3835-4c7c-980c-ab295a555b07 from port 9b34f547-6b5f-431e-8fa9-f8b83776cea7 Sep 25 02:14:31.066268 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6fe7833-5721-476a-9fd2-1966f523d786 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action" status: 202 len: 0 microversion: 2.1 time: 0.513640 Sep 25 02:14:31.067040 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3662/7351] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:14:30 2022] POST /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:14:31.076161 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:31.076942 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:31.081677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:14:31.092195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:31.092697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:31.093153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:31.105788 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] Creating event network-changed:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:14:31.108956 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] [37e8c059-29c2-4f75-b760-85a25e703565] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:14:32.117922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:32.118441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:32.125051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:32.125216 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] [37e8c059-29c2-4f75-b760-85a25e703565] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50154. Sep 25 02:14:32.125684 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:32.125998 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:32.126881 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:32.127697 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:32.128314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:32.129313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-5161352c-38b8-493e-a30a-29571efb3383 req-efb3c62d-2596-4cea-ad96-61fd2a16e978 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.055184 Sep 25 02:14:32.130391 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3690/7352] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:14:32.217769 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lazy-loading 'services' on Instance uuid 4f2b78b9-0192-4b0b-892e-906e90f2732a {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:14:32.294446 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-247aa3b8-8047-4c1c-b02d-46483aade182 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments/7d9a74b5-9e2b-4a31-9a6f-12f314924a82" status: 202 len: 0 microversion: 2.1 time: 0.181613 Sep 25 02:14:32.299577 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3663/7353] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:14:32 2022] DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments/7d9a74b5-9e2b-4a31-9a6f-12f314924a82 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:14:32.305944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:32.308614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:32.315856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:32.316766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:32.317254 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:32.318287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:32.318865 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:32.319570 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:32.352221 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-84cb34f1-357b-4abb-8192-93bee46a672f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051165 Sep 25 02:14:32.353214 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3691/7354] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:14:32 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:14:33.366449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:33.369141 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:33.376293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:33.376781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:33.377954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:33.378651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:33.379108 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:33.379534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:33.411050 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b5b114b-f0b2-47a6-93ee-d8717c2951df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049514 Sep 25 02:14:33.416083 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3664/7355] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:14:33 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:14:34.144930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7478166e-9df8-40c9-89c2-7b58f3ef3263 req-7a5e213d-1039-4f88-bbbf-a6918f9f78a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:14:34.155275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7478166e-9df8-40c9-89c2-7b58f3ef3263 req-7a5e213d-1039-4f88-bbbf-a6918f9f78a1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:34.155789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7478166e-9df8-40c9-89c2-7b58f3ef3263 req-7a5e213d-1039-4f88-bbbf-a6918f9f78a1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:34.156218 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7478166e-9df8-40c9-89c2-7b58f3ef3263 req-7a5e213d-1039-4f88-bbbf-a6918f9f78a1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:34.168066 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7478166e-9df8-40c9-89c2-7b58f3ef3263 req-7a5e213d-1039-4f88-bbbf-a6918f9f78a1 service nova] Creating event network-changed:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:14:34.173056 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7478166e-9df8-40c9-89c2-7b58f3ef3263 req-7a5e213d-1039-4f88-bbbf-a6918f9f78a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032534 Sep 25 02:14:34.173689 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3692/7356] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:14:34.425034 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:34.427264 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:34.434533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:34.435015 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:34.435706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:34.436576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:34.437191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:34.437844 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:34.469633 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c27b35d-b57d-44c4-ab10-2866f4554c7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Sep 25 02:14:34.470516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3665/7357] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:14:34 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:14:35.484086 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:35.486876 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:35.493239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:35.493785 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:35.494274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:35.494993 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:35.495465 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:35.495909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:35.526374 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-20d43472-7090-47ba-8e67-a751556a1d77 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Sep 25 02:14:35.526945 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3693/7358] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:14:35 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:14:36.540051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:36.542283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:36.549725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:36.550283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:36.550725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:36.551422 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:36.551873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:36.552302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:36.582226 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf546a0b-9a49-4707-b0c0-564df2553496 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046424 Sep 25 02:14:36.582793 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3666/7359] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:14:36 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:14:37.594941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:37.597833 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:37.604691 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:37.605196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:37.605688 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:37.606401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:37.606880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:37.607331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:37.639839 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b68055b2-bebd-46fb-b9e5-8c8c55ec1b0a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048901 Sep 25 02:14:37.640313 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3694/7360] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:14:37 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 02:14:37.650935 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:37.651450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:37.658889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:37.659372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:37.659808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:37.660492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:37.660942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:37.661367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:37.741372 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] HTTP exception thrown: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a is not attached to volume 7d9a74b5-9e2b-4a31-9a6f-12f314924a82 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Request method failure captured: Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: request: DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments/7d9a74b5-9e2b-4a31-9a6f-12f314924a82 HTTP/1.1 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7igihW1vYgq269ne-G-Y8bvkPD84iwAZx-Vc8Iuys4x_pvngRTCRXdQUXcnpeG9leh6WQfcNSQS9nvnV1N-QBw1-X1JkCztrtZOThQu95sIQWhdee3Mx0yC4v5fSAjH9OnLotNK6RSlLxKBfMYFAdmXWzhFc1X9eKUovSeM4jG62Lw Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e4dde63604a418d8ff919f35e5928d7"}]}] Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4e4a721ce8234a698ef43644a8d96a53 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a is not attached to volume 7d9a74b5-9e2b-4a31-9a6f-12f314924a82 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: action_args: {'server_id': '4f2b78b9-0192-4b0b-892e-906e90f2732a', 'id': '7d9a74b5-9e2b-4a31-9a6f-12f314924a82'} Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7d9a74b5-9e2b-4a31-9a6f-12f314924a82. Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a is not attached to volume 7d9a74b5-9e2b-4a31-9a6f-12f314924a82 Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:14:37.743065 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a is not attached to volume 7d9a74b5-9e2b-4a31-9a6f-12f314924a82 Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Returning 404 to user: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a is not attached to volume 7d9a74b5-9e2b-4a31-9a6f-12f314924a82 {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5795dc6d-b6f4-4914-b7ec-5615497fd7f6 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments/7d9a74b5-9e2b-4a31-9a6f-12f314924a82" status: 404 len: 154 microversion: 2.1 time: 0.097633 Sep 25 02:14:37.747580 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3667/7361] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:14:37 2022] DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a/os-volume_attachments/7d9a74b5-9e2b-4a31-9a6f-12f314924a82 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:14:41.002320 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:41.002973 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:41.010156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:41.010669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:41.011437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:41.012167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:41.012647 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:41.013127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:41.039881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:14:41.116407 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0f5e36d-0c31-44f2-8d57-aa3f27fc47df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 204 len: 0 microversion: 2.1 time: 0.117594 Sep 25 02:14:41.117063 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3695/7362] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:14:40 2022] DELETE /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 02:14:41.128919 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:41.129575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:41.136297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:41.136787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:41.137226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:41.137981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:41.138438 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:41.138866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:41.280575 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:41.289057 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cdfecc73-163c-4a7f-a461-7f7acbacc564 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1554 microversion: 2.1 time: 0.166441 Sep 25 02:14:41.289659 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3668/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:41 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:42.312983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:42.313747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:42.321395 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:42.321921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:42.322386 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:42.323103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:42.323579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:42.324034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:42.502950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:42.510826 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f180da54-ac5f-40f5-aab0-db4bc7b8d43e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1554 microversion: 2.1 time: 0.202204 Sep 25 02:14:42.511406 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3696/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:42 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:43.535301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:43.535959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:43.543208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:43.543698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:43.544141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:43.544839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:43.545302 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:43.545773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:43.681910 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:43.689882 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77583f69-7a94-4751-9461-6f1cb828fea2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 200 len: 1554 microversion: 2.1 time: 0.159231 Sep 25 02:14:43.690815 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3669/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:43 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:43.838789 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-145a78cb-6231-4cc7-ac64-27a4283464c4 req-99009c9d-0510-4595-ae77-af06df13b2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f2b78b9-0192-4b0b-892e-906e90f2732a", "name": "network-vif-deleted", "tag": "9b34f547-6b5f-431e-8fa9-f8b83776cea7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:14:43.851006 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-145a78cb-6231-4cc7-ac64-27a4283464c4 req-99009c9d-0510-4595-ae77-af06df13b2c0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:43.851502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-145a78cb-6231-4cc7-ac64-27a4283464c4 req-99009c9d-0510-4595-ae77-af06df13b2c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:43.851956 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-145a78cb-6231-4cc7-ac64-27a4283464c4 req-99009c9d-0510-4595-ae77-af06df13b2c0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:43.866239 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-145a78cb-6231-4cc7-ac64-27a4283464c4 req-99009c9d-0510-4595-ae77-af06df13b2c0 service nova] Creating event network-vif-deleted:9b34f547-6b5f-431e-8fa9-f8b83776cea7 for instance 4f2b78b9-0192-4b0b-892e-906e90f2732a on n-h1-master-1 Sep 25 02:14:43.871942 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-145a78cb-6231-4cc7-ac64-27a4283464c4 req-99009c9d-0510-4595-ae77-af06df13b2c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037592 Sep 25 02:14:43.872568 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3697/7366] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:14:44.714026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:44.714645 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: 4f2b78b9-0192-4b0b-892e-906e90f2732a] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:44.721464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:44.721975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:44.722431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:44.723151 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:44.723605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:44.724029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:44.737745 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] HTTP exception thrown: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a could not be found. Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Request method failure captured: Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a HTTP/1.1 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7igihW1vYgq269ne-G-Y8bvkPD84iwAZx-Vc8Iuys4x_pvngRTCRXdQUXcnpeG9leh6WQfcNSQS9nvnV1N-QBw1-X1JkCztrtZOThQu95sIQWhdee3Mx0yC4v5fSAjH9OnLotNK6RSlLxKBfMYFAdmXWzhFc1X9eKUovSeM4jG62Lw Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e4dde63604a418d8ff919f35e5928d7"}]}] Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 4e4a721ce8234a698ef43644a8d96a53 Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a could not be found. Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '4f2b78b9-0192-4b0b-892e-906e90f2732a'} Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a could not be found. Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a could not be found. Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:14:44.739380 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a could not be found. Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Returning 404 to user: Instance 4f2b78b9-0192-4b0b-892e-906e90f2732a could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-53e185eb-ecf6-443c-9fec-f7b0f2d3ca39 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a" status: 404 len: 111 microversion: 2.1 time: 0.030622 Sep 25 02:14:44.744399 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3670/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:44 2022] GET /compute/v2.1/servers/4f2b78b9-0192-4b0b-892e-906e90f2732a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:14:44.751354 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-be36c1fc-2f23-475f-ac52-5f026bc2894c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '.version_select at 0x7f7bf163ba60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:44.756361 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be36c1fc-2f23-475f-ac52-5f026bc2894c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:14:45.763139 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [None req-be36c1fc-2f23-475f-ac52-5f026bc2894c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50206. Sep 25 02:14:45.782292 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-be36c1fc-2f23-475f-ac52-5f026bc2894c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1829499200" status: 202 len: 0 microversion: 2.1 time: 1.035181 Sep 25 02:14:45.782889 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3698/7368] 10.222.0.16 () {58 vars in 1272 bytes} [Sun Sep 25 02:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1829499200 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:14:55.012961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-864e87fa-7c32-49ff-a3d1-085c8a644fc5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'create', calling method: .version_select at 0x7f7bea7721f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-221078495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIdQDqNFbh7k+LMaC91BCuVrR3FlqwQ2kHtxWDTsB3tByZUey3tZRTljhDM7/7oVMXPaGPdOEKryd18P/cH/Mpscwkd8ujwxs9rCaEDEVUMDqfaJWaBPS9IarzHGngs+g=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:14:55.019367 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:14:55.019515 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:14:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Sep 25 02:14:55.020804 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=18 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:55.021493 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:55.037771 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-864e87fa-7c32-49ff-a3d1-085c8a644fc5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:14:55.046035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-864e87fa-7c32-49ff-a3d1-085c8a644fc5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for user 4e4a721ce8234a698ef43644a8d96a53 and project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:14:55.075311 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-864e87fa-7c32-49ff-a3d1-085c8a644fc5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.066151 Sep 25 02:14:55.075994 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3671/7369] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:14:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:14:55.124933 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:14:55.131333 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-505082744", "imageRef": "058c5b59-6c90-419f-971c-6c98d56498e5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-221078495", "networks": [{"uuid": "55117f72-f643-418a-acb2-a78ff3daacf3"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:14:55.185921 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] validate_networks() for [('55117f72-f643-418a-acb2-a78ff3daacf3', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:14:55.625655 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:14:55.626108 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:14:55.626607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:14:55.627044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:14:55.627478 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:14:55.637308 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:55.637853 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:55.638313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:55.639067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:55.639554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:55.640003 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:55.657247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:14:55.663742 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Getting quotas for user 4e4a721ce8234a698ef43644a8d96a53 and project 3e4dde63604a418d8ff919f35e5928d7. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:14:55.676057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:14:55.678418 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='058c5b59-6c90-419f-971c-6c98d56498e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:14:55.725658 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9dfbdc7c-c58f-464a-8ae2-243d627cd284 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602517 Sep 25 02:14:55.726315 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3699/7370] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:14:55.737595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f0cde0c3-6628-47ed-ac5e-3c28a2c82aa4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:55.738385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f0cde0c3-6628-47ed-ac5e-3c28a2c82aa4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:55.797123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f0cde0c3-6628-47ed-ac5e-3c28a2c82aa4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:55.804514 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f0cde0c3-6628-47ed-ac5e-3c28a2c82aa4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1257 microversion: 2.1 time: 0.071023 Sep 25 02:14:55.805090 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3672/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:55 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:56.828713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-020c4bdd-57f2-4879-9e69-7f1af9832693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:56.829359 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-020c4bdd-57f2-4879-9e69-7f1af9832693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:56.883166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-020c4bdd-57f2-4879-9e69-7f1af9832693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:56.890130 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-020c4bdd-57f2-4879-9e69-7f1af9832693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1257 microversion: 2.1 time: 0.066278 Sep 25 02:14:56.890705 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3700/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:56 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:57.913545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4045a07f-2cb9-404a-a454-a3aa22df37c5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:57.914167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4045a07f-2cb9-404a-a454-a3aa22df37c5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:57.966615 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4045a07f-2cb9-404a-a454-a3aa22df37c5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:57.975382 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4045a07f-2cb9-404a-a454-a3aa22df37c5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1257 microversion: 2.1 time: 0.066738 Sep 25 02:14:57.975953 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3673/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:57 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:14:58.999166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:14:59.000434 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:14:59.008997 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:59.009542 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:59.010007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:59.010740 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:14:59.011403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:14:59.011859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:14:59.083988 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:14:59.093800 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-68be9242-eb28-4b9e-980d-47ca8dbbf40f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1317 microversion: 2.1 time: 0.099104 Sep 25 02:14:59.094595 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3701/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:14:58 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:00.119105 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:00.120844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:00.130675 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:00.131182 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:00.131626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:00.132570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:00.133030 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:00.133601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:00.276342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:00.284572 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-85e15fcc-92d1-4e91-aaba-586056d62ff1 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.169995 Sep 25 02:15:00.285822 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3674/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:00 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:01.308232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:01.308924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:01.311630 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:01.324001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:01.324927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:01.325533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:01.326484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:01.327069 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:01.327650 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:01.472593 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:01.481799 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a390687c-7bf9-4c59-9531-fad711e5e5a8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.177263 Sep 25 02:15:01.495424 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3702/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:01 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:02.507952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:02.508490 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:02.515413 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:02.515893 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:02.516327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:02.517293 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:02.519283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:02.519729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:02.668054 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:02.676298 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ba3e8da1-4f6d-4738-9bb0-02213df36ee3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.172715 Sep 25 02:15:02.677096 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3675/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:02 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:03.699814 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:03.700343 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:03.708559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:03.708766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:03.709194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:03.709920 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:03.710407 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:03.710829 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:03.874289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:03.883338 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-92626e52-432a-480e-a3e4-d09d5d0a5271 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.187450 Sep 25 02:15:03.884109 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3703/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:03 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:04.911248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:04.911975 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:04.919588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:04.920078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:04.920517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:04.921221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:04.921704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:04.922133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:05.104968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:05.115369 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0baed561-09f5-44e8-9e80-0f498b419b7b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.209028 Sep 25 02:15:05.125455 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3676/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:04 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:06.141375 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:06.144486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:06.147705 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:06.154066 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:06.154679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:06.155143 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:06.156102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:06.156589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:06.157096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:06.300674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:06.309148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bce32b06-7c87-4ad7-92ab-dbd9dc5a73e8 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.172600 Sep 25 02:15:06.310004 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3704/7380] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:06 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:07.332301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:07.332998 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:07.339824 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:07.340300 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:07.340733 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:07.341431 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:07.341883 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:07.342303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:07.481981 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:07.490883 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f08c7fed-b0db-4e14-8e94-69892951dd02 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.162809 Sep 25 02:15:07.491554 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3677/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:07 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:07.616304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ff59d9a0-f3b2-4661-a01b-2143a9ae08b9 req-6234060e-a5be-4e4e-a47e-88b01a4c427b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:07.621538 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:07.629680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ff59d9a0-f3b2-4661-a01b-2143a9ae08b9 req-6234060e-a5be-4e4e-a47e-88b01a4c427b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:07.630455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ff59d9a0-f3b2-4661-a01b-2143a9ae08b9 req-6234060e-a5be-4e4e-a47e-88b01a4c427b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:07.630919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ff59d9a0-f3b2-4661-a01b-2143a9ae08b9 req-6234060e-a5be-4e4e-a47e-88b01a4c427b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:07.642640 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ff59d9a0-f3b2-4661-a01b-2143a9ae08b9 req-6234060e-a5be-4e4e-a47e-88b01a4c427b service nova] Creating event network-changed:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:15:07.648466 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ff59d9a0-f3b2-4661-a01b-2143a9ae08b9 req-6234060e-a5be-4e4e-a47e-88b01a4c427b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Sep 25 02:15:07.649073 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3705/7382] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:15:08.514872 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:08.515501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:08.517330 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:08.523807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:08.524286 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:08.524722 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:08.525484 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:08.526042 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:08.526513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:08.661300 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:08.669160 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2cd897f-33a5-4985-a480-9dcdd4b9b4d4 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.158241 Sep 25 02:15:08.669772 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3678/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:08 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:09.694834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:09.695563 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:09.701789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:09.702294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:09.702755 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:09.703470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:09.703951 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:09.704403 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:09.833368 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:09.841129 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2f923281-0d3a-4250-a8c6-d7a68deb639f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.152076 Sep 25 02:15:09.841736 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3706/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:09 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:10.865232 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:10.865911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:10.873801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:10.874282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:10.874712 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:10.875405 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:10.875850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:10.876271 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:11.008383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:11.016243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-403ec16c-6f97-4aa9-b31b-8783a41ba112 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.156070 Sep 25 02:15:11.016825 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3679/7385] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:10 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:12.040870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:12.041539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:12.048423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:12.048980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:12.049640 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:12.050364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:12.050848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:12.051300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:12.177310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:12.185076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e2bd8547-4994-4584-bfc6-acf28e8e4b14 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.148406 Sep 25 02:15:12.185679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3707/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:12 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:12.803169 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b9db5ea3-49cc-483a-b9cf-ac4954148061 req-12c02f91-9063-46ab-a8a7-74b71070d961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "name": "network-vif-plugged", "status": "completed", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:12.813885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b9db5ea3-49cc-483a-b9cf-ac4954148061 req-12c02f91-9063-46ab-a8a7-74b71070d961 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:12.815582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b9db5ea3-49cc-483a-b9cf-ac4954148061 req-12c02f91-9063-46ab-a8a7-74b71070d961 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:12.816127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b9db5ea3-49cc-483a-b9cf-ac4954148061 req-12c02f91-9063-46ab-a8a7-74b71070d961 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:12.827818 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b9db5ea3-49cc-483a-b9cf-ac4954148061 req-12c02f91-9063-46ab-a8a7-74b71070d961 service nova] Creating event network-vif-plugged:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:15:12.832879 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b9db5ea3-49cc-483a-b9cf-ac4954148061 req-12c02f91-9063-46ab-a8a7-74b71070d961 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033982 Sep 25 02:15:12.833492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3680/7387] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:15:13.208431 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:13.209098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:13.216047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:13.216550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:13.217036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:13.217790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:13.218262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:13.218707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:13.353094 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:13.360758 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d7d850f0-2a3d-4fab-b8b0-3fd6b4f1dd33 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1357 microversion: 2.1 time: 0.156604 Sep 25 02:15:13.361350 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3708/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:13 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:14.384255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:14.384956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:14.392087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.392592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.393225 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.394085 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.394540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.394963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.523334 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:14.531087 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3f741094-60d3-4f58-b042-c7430866c85b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1548 microversion: 2.1 time: 0.151165 Sep 25 02:15:14.531664 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3681/7389] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:14 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:14.554269 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:14.554939 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:14.561739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.562236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.562692 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.563401 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.563872 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.564316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.691639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:14.699532 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e99ff3a1-5578-4e65-942c-32c147b17d4c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1548 microversion: 2.1 time: 0.149098 Sep 25 02:15:14.700373 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3709/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:14 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:14.721634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:14.726467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:14.727244 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Searching by: {'deleted': False, 'project_id': '3e4dde63604a418d8ff919f35e5928d7'} {{(pid=122384) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 02:15:14.732615 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.733099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.733584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.734311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.734773 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.735205 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.758798 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.multi_cell_list [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122384) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 02:15:14.788572 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-626772e6-88aa-4c81-9911-91f790fc3689 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071296 Sep 25 02:15:14.789160 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3682/7391] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 25 02:15:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:15:14.801677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:14.802311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:14.808303 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.808806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.809264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.810007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:14.810482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:14.810929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:14.941218 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:14.948963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0d2fbef6-820d-4505-90dd-23c18fd243ce tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1548 microversion: 2.1 time: 0.151799 Sep 25 02:15:14.949565 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3710/7392] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:14 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:16.474520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "290eb713-0f2e-4fc7-8723-813285f36e8a"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:16.476846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:16.483525 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:16.484016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:16.484459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:16.485161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:16.485650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:16.486084 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:16.753148 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-323315de-9b70-4ceb-b6b9-c8d3fe7723c2 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282166 Sep 25 02:15:16.753838 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3683/7393] 10.222.0.16 () {60 vars in 1323 bytes} [Sun Sep 25 02:15:16 2022] POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:15:27.531286 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:27.531928 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:27.534754 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=17 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:27.535427 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=58 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:27.541642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:27.542156 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:27.542616 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:27.543340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:27.543818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:27.544270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:27.673311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:27.682194 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-38fec000-478b-4dca-a8ce-7d1bcf591a3c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1594 microversion: 2.1 time: 0.155072 Sep 25 02:15:27.682775 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3711/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:27 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:29.525069 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:29.525947 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:29.526665 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:29.605824 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fdbf5f73-6963-4546-93cc-c891aad86cea req-b7c3bd45-4ea3-4fdf-9ad0-7c300156f6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:29.616476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fdbf5f73-6963-4546-93cc-c891aad86cea req-b7c3bd45-4ea3-4fdf-9ad0-7c300156f6bf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:29.616961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fdbf5f73-6963-4546-93cc-c891aad86cea req-b7c3bd45-4ea3-4fdf-9ad0-7c300156f6bf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:29.617397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fdbf5f73-6963-4546-93cc-c891aad86cea req-b7c3bd45-4ea3-4fdf-9ad0-7c300156f6bf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:29.630136 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fdbf5f73-6963-4546-93cc-c891aad86cea req-b7c3bd45-4ea3-4fdf-9ad0-7c300156f6bf service nova] Creating event network-changed:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:15:29.635323 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fdbf5f73-6963-4546-93cc-c891aad86cea req-b7c3bd45-4ea3-4fdf-9ad0-7c300156f6bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112213 Sep 25 02:15:29.636253 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3684/7395] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:15:30.784710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-299978134"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:30.785276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:30.792621 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:30.793135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:30.793644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:30.794368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:30.794846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:30.795294 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:30.921492 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Adding security group 52d67522-9f0c-490f-bc89-a2c5990d6f2e to port c33fb44d-0f80-4642-bdde-8ef79d16a9c9 Sep 25 02:15:31.238220 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ee283a8-fcfc-487a-b23b-6087525e37dd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/action" status: 202 len: 0 microversion: 2.1 time: 0.457790 Sep 25 02:15:31.238967 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3712/7396] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:15:30 2022] POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:15:31.248463 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:31.249172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:31.255739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:31.256228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:31.256666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:31.257368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:31.257848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:31.258268 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:31.420508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:31.428982 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2a47e098-61fc-4836-87cf-1051a8c0b59b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1759 microversion: 2.1 time: 0.185587 Sep 25 02:15:31.429585 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3685/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:31 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:15:31.651982 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-40b744ce-2e70-494c-b42c-0d0275747174 req-3694e8af-a5d1-47f3-a45d-dac7c8a3acb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:31.662748 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-40b744ce-2e70-494c-b42c-0d0275747174 req-3694e8af-a5d1-47f3-a45d-dac7c8a3acb2 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:31.663258 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-40b744ce-2e70-494c-b42c-0d0275747174 req-3694e8af-a5d1-47f3-a45d-dac7c8a3acb2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:31.663715 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-40b744ce-2e70-494c-b42c-0d0275747174 req-3694e8af-a5d1-47f3-a45d-dac7c8a3acb2 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:31.675349 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-40b744ce-2e70-494c-b42c-0d0275747174 req-3694e8af-a5d1-47f3-a45d-dac7c8a3acb2 service nova] Creating event network-changed:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:15:31.680574 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-40b744ce-2e70-494c-b42c-0d0275747174 req-3694e8af-a5d1-47f3-a45d-dac7c8a3acb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032415 Sep 25 02:15:31.681416 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3713/7398] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:15:48.453592 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:48.454330 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=8 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:48.500360 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:15:48.502710 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:48.509374 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:48.509909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:48.510352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:48.511045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:48.511505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:48.511933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:48.584896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f2117e65-e379-497c-8c61-5f8cddb0763e tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/action" status: 202 len: 0 microversion: 2.1 time: 0.136455 Sep 25 02:15:48.585732 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3686/7399] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:15:48 2022] POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:15:48.594532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:48.595263 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:48.598393 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:48.599185 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:15:48.605812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:48.606549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:48.606788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:48.607538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:48.608017 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:48.608481 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:48.759197 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:48.767560 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3c15ef5a-f64e-4e57-ac98-59ad2ef33895 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1751 microversion: 2.1 time: 0.177349 Sep 25 02:15:48.768152 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3714/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:48 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:49.792007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:49.792710 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:49.799945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:49.800823 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:49.801206 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:49.802040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:49.802503 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:49.802937 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:49.946970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:49.955276 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-37b2c6bc-0d34-4f60-99c3-264e319febda tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.167860 Sep 25 02:15:49.955844 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3687/7401] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:49 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:50.979873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:50.980447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:50.987443 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:50.988012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:50.988568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:50.989279 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:50.989803 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:50.990239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:51.134050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:51.142434 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-14708f57-4c8e-4369-a6a3-4d0f3ffdfd5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.166624 Sep 25 02:15:51.143008 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3715/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:50 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:52.165662 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:52.166285 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:52.173132 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:52.173725 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:52.174165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:52.174867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:52.175329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:52.175875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:52.323424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:52.331668 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-097387d1-3b41-4949-8687-ded4c84c59df tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.170164 Sep 25 02:15:52.332350 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3688/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:52 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:53.354732 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:53.355379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:53.362305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:53.362862 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:53.363541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:53.364262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:53.364745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:53.365198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:53.515031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:53.524102 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-539db6c0-fa7b-45ca-a070-e2f82df6ee1c tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.173292 Sep 25 02:15:53.524680 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3716/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:53 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:54.547668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:54.548398 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:54.555934 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:54.556424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:54.556866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:54.557600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:54.558064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:54.558498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:54.700430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:54.709189 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8eab3166-9f78-491d-8948-52dc0461ff69 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.165434 Sep 25 02:15:54.709794 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3689/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:54 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:55.732277 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:55.732853 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:55.740257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:55.740753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:55.741204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:55.741940 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:55.742409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:55.742850 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:55.883556 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:55.891889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-733a6e58-0805-4b5a-817f-16246669bd55 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.163652 Sep 25 02:15:55.892552 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3717/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:55 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:56.915987 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:56.916604 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:56.923627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:56.924102 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:56.924535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:56.925751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:56.926576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:56.927027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:57.071922 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:57.080257 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5b8ece1c-50d7-48f9-baa7-daf51f4209f5 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.168456 Sep 25 02:15:57.080848 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3690/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:56 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:58.103716 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:58.104357 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:58.111202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:58.111708 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:58.112173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:58.113149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:58.113632 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:58.114091 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:58.257257 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:58.265607 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4d4e6fdd-b852-4271-901d-b9698e289542 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.165850 Sep 25 02:15:58.266184 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3718/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:58 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:15:59.289488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:15:59.290117 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:15:59.297159 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:59.297676 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:59.298117 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:59.298818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:15:59.299273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:15:59.299702 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:15:59.448791 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:15:59.457201 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d53050f8-375c-4e4c-a1b6-5985c8ce140f tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.172515 Sep 25 02:15:59.457823 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3691/7409] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:15:59 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:16:00.481136 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:00.481804 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:00.489922 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:00.490437 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:00.490899 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:00.491627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:00.492102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:00.492550 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:00.640848 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:16:00.649549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3bd978e3-0df0-403c-8656-a7f94de43ac9 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1756 microversion: 2.1 time: 0.172404 Sep 25 02:16:00.650134 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3719/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:16:00 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:16:01.672205 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:01.672774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:01.679837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:01.680327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:01.680768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:01.681492 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:01.681949 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:01.682378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:01.825866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:16:01.835003 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-2ea7d413-24eb-424b-a60f-0ea800bd9ea3 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1759 microversion: 2.1 time: 0.166813 Sep 25 02:16:01.835574 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3692/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:16:01 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:16:34.168960 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-299978134"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:16:34.169627 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:34.171875 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:34.172619 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=36 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:34.179077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:34.179588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:34.180059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:34.180780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:34.181257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:34.181739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:34.312092 n-d-master-1 devstack@n-api.service[122385]: INFO nova.network.security_group_api [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Removing security group 52d67522-9f0c-490f-bc89-a2c5990d6f2e from port c33fb44d-0f80-4642-bdde-8ef79d16a9c9 Sep 25 02:16:34.616966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-24ec4f4e-83ef-4e72-909b-15754fffa44b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/action" status: 202 len: 0 microversion: 2.1 time: 0.452288 Sep 25 02:16:34.618197 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3720/7412] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:16:34 2022] POST /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:16:34.624645 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=14 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:34.625422 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:16:34.637634 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d71d73c6-9876-4ea3-bbb6-924b617e6541 req-7db27249-f9ae-43dc-8d3c-ad450235a11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:16:34.649980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d71d73c6-9876-4ea3-bbb6-924b617e6541 req-7db27249-f9ae-43dc-8d3c-ad450235a11e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:34.650464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d71d73c6-9876-4ea3-bbb6-924b617e6541 req-7db27249-f9ae-43dc-8d3c-ad450235a11e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:34.650895 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d71d73c6-9876-4ea3-bbb6-924b617e6541 req-7db27249-f9ae-43dc-8d3c-ad450235a11e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:34.664614 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d71d73c6-9876-4ea3-bbb6-924b617e6541 req-7db27249-f9ae-43dc-8d3c-ad450235a11e service nova] Creating event network-changed:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:16:34.671762 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d71d73c6-9876-4ea3-bbb6-924b617e6541 req-7db27249-f9ae-43dc-8d3c-ad450235a11e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048415 Sep 25 02:16:34.673126 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3693/7413] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:35.745301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:35.745879 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:35.752121 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:35.752620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:35.753074 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:35.753802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:35.754274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:35.755337 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:35.839126 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lazy-loading 'services' on Instance uuid b6a17a38-bfc3-4a26-8741-12a5b88ac58f {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:16:35.915282 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-778aa64b-7cde-4630-a58a-d7d79943dffb tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments/290eb713-0f2e-4fc7-8723-813285f36e8a" status: 202 len: 0 microversion: 2.1 time: 0.176161 Sep 25 02:16:35.915901 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3721/7414] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:16:35 2022] DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments/290eb713-0f2e-4fc7-8723-813285f36e8a => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:16:35.928356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:35.930643 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:35.940276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:35.940986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:35.941396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:35.942922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:35.943380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:35.943812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:35.976553 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c39a150a-527b-4f39-9d6b-b240a5b1e4de tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055599 Sep 25 02:16:35.977133 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3694/7415] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:16:35 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:36.701447 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-27b0b9c6-a330-40cc-b5cf-776f47a0504e req-e7174e96-26e5-4805-91d0-b1c714ad6972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:16:36.714166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-27b0b9c6-a330-40cc-b5cf-776f47a0504e req-e7174e96-26e5-4805-91d0-b1c714ad6972 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:36.714661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-27b0b9c6-a330-40cc-b5cf-776f47a0504e req-e7174e96-26e5-4805-91d0-b1c714ad6972 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:36.715232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-27b0b9c6-a330-40cc-b5cf-776f47a0504e req-e7174e96-26e5-4805-91d0-b1c714ad6972 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:36.728505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-27b0b9c6-a330-40cc-b5cf-776f47a0504e req-e7174e96-26e5-4805-91d0-b1c714ad6972 service nova] Creating event network-changed:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:16:36.735259 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-27b0b9c6-a330-40cc-b5cf-776f47a0504e req-e7174e96-26e5-4805-91d0-b1c714ad6972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038195 Sep 25 02:16:36.736466 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3722/7416] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:16:36.990275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:36.992523 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:36.999253 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:36.999741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:37.000170 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:37.000926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:37.001311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:37.001759 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:37.034969 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e46cb39b-c00b-454e-addf-e3cd92bbc26a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049802 Sep 25 02:16:37.035542 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3695/7417] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:16:36 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:38.049908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:38.052391 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:38.058753 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:38.059269 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:38.059732 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:38.060461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:38.060944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:38.061397 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:38.095009 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a2545010-52d1-474e-8b4d-4bfdd8ce6414 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Sep 25 02:16:38.095601 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3723/7418] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:16:38 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:39.108968 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:39.111217 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:39.119346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:39.119868 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:39.120313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:39.121245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:39.122141 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:39.122674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:39.157523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ae34d1b1-d025-4cd1-aa39-f2fa70cfe5db tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053082 Sep 25 02:16:39.158113 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3696/7419] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:16:39 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:40.170344 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:40.172490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:40.180193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:40.180695 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:40.181150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:40.181892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:40.182362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:40.182805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:40.212649 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7ce85aad-3caf-4ab1-9b6a-a7a7eb0f8563 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046384 Sep 25 02:16:40.213215 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3724/7420] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:16:40 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:41.225008 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:41.227276 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:41.235161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:41.235647 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:41.236088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:41.236781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:41.237237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:41.237696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:41.266896 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d1a66069-3349-42b3-b99a-a18769a89958 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046626 Sep 25 02:16:41.267463 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3697/7421] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 25 02:16:41 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 02:16:41.278900 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:41.279405 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:41.287101 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:41.287611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:41.288329 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:41.289043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:41.289546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:41.289999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:41.364841 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] HTTP exception thrown: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f is not attached to volume 290eb713-0f2e-4fc7-8723-813285f36e8a Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Request method failure captured: Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: request: DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments/290eb713-0f2e-4fc7-8723-813285f36e8a HTTP/1.1 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7igihW1vYgq269ne-G-Y8bvkPD84iwAZx-Vc8Iuys4x_pvngRTCRXdQUXcnpeG9leh6WQfcNSQS9nvnV1N-QBw1-X1JkCztrtZOThQu95sIQWhdee3Mx0yC4v5fSAjH9OnLotNK6RSlLxKBfMYFAdmXWzhFc1X9eKUovSeM4jG62Lw Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e4dde63604a418d8ff919f35e5928d7"}]}] Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4e4a721ce8234a698ef43644a8d96a53 Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f is not attached to volume 290eb713-0f2e-4fc7-8723-813285f36e8a Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: action_args: {'server_id': 'b6a17a38-bfc3-4a26-8741-12a5b88ac58f', 'id': '290eb713-0f2e-4fc7-8723-813285f36e8a'} Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 290eb713-0f2e-4fc7-8723-813285f36e8a. Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f is not attached to volume 290eb713-0f2e-4fc7-8723-813285f36e8a Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:16:41.366517 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f is not attached to volume 290eb713-0f2e-4fc7-8723-813285f36e8a Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Returning 404 to user: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f is not attached to volume 290eb713-0f2e-4fc7-8723-813285f36e8a {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f464d25-535c-4e99-a5c5-8fdb6b4f3693 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments/290eb713-0f2e-4fc7-8723-813285f36e8a" status: 404 len: 154 microversion: 2.1 time: 0.093132 Sep 25 02:16:41.370710 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3725/7422] 10.222.0.16 () {58 vars in 1416 bytes} [Sun Sep 25 02:16:41 2022] DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f/os-volume_attachments/290eb713-0f2e-4fc7-8723-813285f36e8a => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:16:44.623512 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:44.624015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:44.631192 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:44.631724 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:44.632168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:44.633150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:44.633639 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:44.634072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:44.659539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:16:44.742290 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b1d0b83c-1b2a-4cd6-a4b5-c00afb0cab87 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 204 len: 0 microversion: 2.1 time: 0.123264 Sep 25 02:16:44.746091 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3698/7423] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:16:44 2022] DELETE /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:16:44.755515 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:44.756448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:44.768084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:44.768802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:44.769585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:44.772680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:44.773349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:44.774037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:44.910106 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:16:44.919034 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6a43927f-eb8b-4f02-a8ab-3361dc55c5ea tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1554 microversion: 2.1 time: 0.171483 Sep 25 02:16:44.919604 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3726/7424] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:16:44 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:16:45.942934 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:45.943760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:45.950446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:45.950931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:45.951369 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:45.952054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:45.952507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:45.952933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:46.084340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:16:46.092162 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-083bba75-cff3-410d-950b-f25896c57e11 tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1554 microversion: 2.1 time: 0.153521 Sep 25 02:16:46.092722 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3699/7425] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:16:45 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:16:47.116305 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:47.116983 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:47.123666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:47.124175 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:47.124642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:47.125369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:47.125874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:47.126325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:47.201665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4a721ce8234a698ef43644a8d96a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4dde63604a418d8ff919f35e5928d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:16:47.219851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fceb7bfd-5483-49b4-bb2e-e5cc8ef0f18a tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 200 len: 1512 microversion: 2.1 time: 0.108305 Sep 25 02:16:47.220456 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3727/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:16:47 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:16:47.303832 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fdee80f8-2c15-4919-929d-0494b68361e6 req-f166c0e8-a0ba-48b3-bee0-50008ccdface service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a17a38-bfc3-4a26-8741-12a5b88ac58f", "name": "network-vif-deleted", "tag": "c33fb44d-0f80-4642-bdde-8ef79d16a9c9"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:16:47.313558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fdee80f8-2c15-4919-929d-0494b68361e6 req-f166c0e8-a0ba-48b3-bee0-50008ccdface service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:47.314041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fdee80f8-2c15-4919-929d-0494b68361e6 req-f166c0e8-a0ba-48b3-bee0-50008ccdface service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:47.314469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fdee80f8-2c15-4919-929d-0494b68361e6 req-f166c0e8-a0ba-48b3-bee0-50008ccdface service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:47.325725 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fdee80f8-2c15-4919-929d-0494b68361e6 req-f166c0e8-a0ba-48b3-bee0-50008ccdface service nova] Creating event network-vif-deleted:c33fb44d-0f80-4642-bdde-8ef79d16a9c9 for instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f on n-h1-master-1 Sep 25 02:16:47.330589 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fdee80f8-2c15-4919-929d-0494b68361e6 req-f166c0e8-a0ba-48b3-bee0-50008ccdface service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082681 Sep 25 02:16:47.331192 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3700/7427] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:16:48.244740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:48.245443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] [instance: b6a17a38-bfc3-4a26-8741-12a5b88ac58f] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:16:48.252832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:48.253347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:48.253832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:48.254583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:16:48.255065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:16:48.256147 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:16:48.272664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] HTTP exception thrown: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f could not be found. Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Request method failure captured: Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f HTTP/1.1 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7igihW1vYgq269ne-G-Y8bvkPD84iwAZx-Vc8Iuys4x_pvngRTCRXdQUXcnpeG9leh6WQfcNSQS9nvnV1N-QBw1-X1JkCztrtZOThQu95sIQWhdee3Mx0yC4v5fSAjH9OnLotNK6RSlLxKBfMYFAdmXWzhFc1X9eKUovSeM4jG62Lw Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e4dde63604a418d8ff919f35e5928d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e4dde63604a418d8ff919f35e5928d7"}]}] Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 3e4dde63604a418d8ff919f35e5928d7 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1147754617 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 4e4a721ce8234a698ef43644a8d96a53 Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestMinimumBasicScenario-1147754617-project Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: exception: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f could not be found. Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'b6a17a38-bfc3-4a26-8741-12a5b88ac58f'} Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f could not be found. Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f could not be found. Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:16:48.274334 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f could not be found. Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Returning 404 to user: Instance b6a17a38-bfc3-4a26-8741-12a5b88ac58f could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af9857fd-cacd-4cb8-b0c1-311b2fd207fd tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f" status: 404 len: 111 microversion: 2.1 time: 0.035840 Sep 25 02:16:48.278650 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3728/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:16:48 2022] GET /compute/v2.1/servers/b6a17a38-bfc3-4a26-8741-12a5b88ac58f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:16:48.285561 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7eb62474-307c-43e3-aba9-2435e20dee5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] Calling method '.version_select at 0x7f7bea6689d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:16:48.307400 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7eb62474-307c-43e3-aba9-2435e20dee5b tempest-TestMinimumBasicScenario-1147754617 tempest-TestMinimumBasicScenario-1147754617-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-221078495" status: 202 len: 0 microversion: 2.1 time: 0.026178 Sep 25 02:16:48.308088 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3701/7429] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 25 02:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-221078495 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:16:57.501138 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f63f08dd-b5fc-43fb-bc6f-ec8815d1b556 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: .version_select at 0x7f7be80dfdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-275151060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8bZZ2wYWq/FyViwJkA5haG14Boe+Pb+dO8YkW08t11LTuWmt6xP7Mjs3a1uCzDQbyZMHUsiGzqNf0clf1WkQJX0F8kErhRlOHde1mb4RltRK3ZoTDBXQdhTkbxtd/PeA=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:16:57.517102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f63f08dd-b5fc-43fb-bc6f-ec8815d1b556 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:16:57.523282 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-f63f08dd-b5fc-43fb-bc6f-ec8815d1b556 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:16:57.548150 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f63f08dd-b5fc-43fb-bc6f-ec8815d1b556 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.212232 Sep 25 02:16:57.548756 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3729/7430] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:16:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:17:03.708819 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:03.709733 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:03.714525 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1553870184", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "aa8617d4-df53-4a6a-b409-6b5125039f54"}], "key_name": "tempest-TestNetworkAdvancedServerOps-275151060", "security_groups": [{"name": "tempest-secgroup-smoke-1129902225"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:17:03.844314 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] validate_networks() for [('aa8617d4-df53-4a6a-b409-6b5125039f54', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:17:04.275453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:17:04.276075 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:17:04.276551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:17:04.276961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:17:04.277377 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:17:04.287292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:04.288135 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:04.288767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:04.289605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:04.290162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:04.290666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:04.310090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:17:04.315704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:17:04.328468 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:17:04.331164 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:17:04.393762 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-aef08244-0a20-4296-8578-7f45220e18c0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.686983 Sep 25 02:17:04.394781 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3702/7431] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:17:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:17:04.403840 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:04.408938 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2d0b6e6-b842-4f1d-a006-fac3e0eddfb6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:04.409705 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2d0b6e6-b842-4f1d-a006-fac3e0eddfb6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:04.413348 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:04.484870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2d0b6e6-b842-4f1d-a006-fac3e0eddfb6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:04.492957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2d0b6e6-b842-4f1d-a006-fac3e0eddfb6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1266 microversion: 2.1 time: 0.089831 Sep 25 02:17:04.493573 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3730/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:04 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:05.518202 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-969dd876-cfc1-46e4-9fb4-0ea8708a7d15 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:05.519549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-969dd876-cfc1-46e4-9fb4-0ea8708a7d15 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:05.586641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-969dd876-cfc1-46e4-9fb4-0ea8708a7d15 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:05.594064 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-969dd876-cfc1-46e4-9fb4-0ea8708a7d15 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1266 microversion: 2.1 time: 0.081711 Sep 25 02:17:05.594698 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3703/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:05 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:06.617441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a980318e-41a8-4123-9e25-fd67122f2717 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:06.618082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a980318e-41a8-4123-9e25-fd67122f2717 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:06.672169 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a980318e-41a8-4123-9e25-fd67122f2717 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:06.679888 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a980318e-41a8-4123-9e25-fd67122f2717 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1266 microversion: 2.1 time: 0.067038 Sep 25 02:17:06.680454 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3731/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:06 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:07.703171 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-00564728-b395-446d-8ebe-008c9fc4c8d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:07.703788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-00564728-b395-446d-8ebe-008c9fc4c8d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:07.758056 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-00564728-b395-446d-8ebe-008c9fc4c8d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:07.765226 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-00564728-b395-446d-8ebe-008c9fc4c8d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1266 microversion: 2.1 time: 0.065976 Sep 25 02:17:07.765905 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3704/7435] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:07 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:08.789364 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:08.790030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:08.797055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:08.797604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:08.798068 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:08.798809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:08.799287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:08.799730 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:08.863817 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:08.871702 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-991fc594-e0f7-44bd-9eb8-00f32b6dede8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1270 microversion: 2.1 time: 0.087508 Sep 25 02:17:08.872271 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3732/7436] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:08 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:09.894738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:09.895347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:09.905038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:09.905553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:09.905986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:09.906674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:09.907124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:09.907551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:09.992705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:10.000494 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-817c2fce-ac86-41a8-ab6d-d3a88a529bbf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1324 microversion: 2.1 time: 0.109706 Sep 25 02:17:10.001108 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3705/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:09 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1324 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:11.024261 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:11.024909 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:11.031828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:11.032341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:11.032808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:11.033563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:11.034053 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:11.034519 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:11.243158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:11.251463 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-443d3947-798f-4be5-beb2-aeb285eb2023 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.231194 Sep 25 02:17:11.252344 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3733/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:11 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:11.296690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-0dd1ad74-902f-407a-8737-ad167583aaaf req-08161489-ad3a-4803-a5fd-cab76592ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34febd89-bdd9-40d0-a2af-331a47f54aba", "tag": "2a3909a2-a31c-412c-afd5-e10751792e32"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:17:11.309979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0dd1ad74-902f-407a-8737-ad167583aaaf req-08161489-ad3a-4803-a5fd-cab76592ef4d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:11.310471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0dd1ad74-902f-407a-8737-ad167583aaaf req-08161489-ad3a-4803-a5fd-cab76592ef4d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:11.310909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-0dd1ad74-902f-407a-8737-ad167583aaaf req-08161489-ad3a-4803-a5fd-cab76592ef4d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:11.323225 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-0dd1ad74-902f-407a-8737-ad167583aaaf req-08161489-ad3a-4803-a5fd-cab76592ef4d service nova] Creating event network-changed:2a3909a2-a31c-412c-afd5-e10751792e32 for instance 34febd89-bdd9-40d0-a2af-331a47f54aba on n-h2-master-1 Sep 25 02:17:11.330456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-0dd1ad74-902f-407a-8737-ad167583aaaf req-08161489-ad3a-4803-a5fd-cab76592ef4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038423 Sep 25 02:17:11.331726 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3706/7439] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:17:12.275729 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:12.276371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:12.283358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:12.283869 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:12.284333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:12.285052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:12.285559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:12.286015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:12.418890 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:12.426781 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d9b3e884-e9b2-4ba4-b729-781563e6c029 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.155061 Sep 25 02:17:12.427862 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3734/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:12 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:13.450733 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:13.451436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:13.459463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:13.459955 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:13.460395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:13.461113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:13.461598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:13.462028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:13.598384 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:13.606258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-82733ae5-669d-4825-a091-c4bc91f2edaf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.159783 Sep 25 02:17:13.606852 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3707/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:13 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:14.629435 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:14.630893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:14.637816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:14.638325 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:14.638789 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:14.639505 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:14.639985 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:14.640436 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:14.776481 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:14.784276 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-335ac5da-ea52-42f1-8486-2af52576e7ce tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.158847 Sep 25 02:17:14.784856 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3735/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:14 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:17:15.808446 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:15.809090 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:15.811295 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:15.817531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:15.818022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:15.818469 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:15.819839 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:15.820311 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:15.820741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:15.959237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:15.967998 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-92e33c0c-e939-4e2b-9d07-45f427219773 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.163601 Sep 25 02:17:15.968817 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3708/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:15 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:16.991697 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:16.992340 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:16.994719 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=8 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:17.000350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:17.000859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:17.001321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:17.002061 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:17.002547 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:17.002996 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:17.423815 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:17.431781 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a475d7d-88ac-444b-beec-79ed39a54151 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.444247 Sep 25 02:17:17.432361 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3736/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:16 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:18.108843 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=10 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:18.168971 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bf9cfd82-b3c2-4bf3-a160-3e9b881b5a77 req-5d34a4ab-5584-4604-b0d7-59c0f0e9589b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34febd89-bdd9-40d0-a2af-331a47f54aba", "name": "network-vif-plugged", "status": "completed", "tag": "2a3909a2-a31c-412c-afd5-e10751792e32"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:17:18.179313 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bf9cfd82-b3c2-4bf3-a160-3e9b881b5a77 req-5d34a4ab-5584-4604-b0d7-59c0f0e9589b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:18.179951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bf9cfd82-b3c2-4bf3-a160-3e9b881b5a77 req-5d34a4ab-5584-4604-b0d7-59c0f0e9589b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:18.180386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bf9cfd82-b3c2-4bf3-a160-3e9b881b5a77 req-5d34a4ab-5584-4604-b0d7-59c0f0e9589b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:18.191552 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bf9cfd82-b3c2-4bf3-a160-3e9b881b5a77 req-5d34a4ab-5584-4604-b0d7-59c0f0e9589b service nova] Creating event network-vif-plugged:2a3909a2-a31c-412c-afd5-e10751792e32 for instance 34febd89-bdd9-40d0-a2af-331a47f54aba on n-h2-master-1 Sep 25 02:17:18.196565 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bf9cfd82-b3c2-4bf3-a160-3e9b881b5a77 req-5d34a4ab-5584-4604-b0d7-59c0f0e9589b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093165 Sep 25 02:17:18.197144 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3709/7445] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:17:18.454758 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:18.455399 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:18.462379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:18.462892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:18.463358 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:18.464076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:18.464557 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:18.465009 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:18.596436 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:18.604181 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3fb61d71-19d0-4067-a3cc-dbbd56a2a97f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.153354 Sep 25 02:17:18.604762 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3737/7446] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:18 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:19.630192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:19.630828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:19.637600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:19.638089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:19.638532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:19.639226 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:19.639683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:19.640110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:19.777204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:19.785047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6dc836a3-b967-4fd0-b579-0d09c2f14741 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1392 microversion: 2.1 time: 0.160768 Sep 25 02:17:19.785685 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3710/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:19 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:20.809517 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:20.810171 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:20.817127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:20.817665 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:20.818123 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:20.819510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:20.820232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:20.820682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:20.950866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:20.958714 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-35bc3c6d-e289-4a50-aecc-2f498152c119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1564 microversion: 2.1 time: 0.153170 Sep 25 02:17:20.959296 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3738/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:20 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:20.981352 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:20.981996 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:20.988741 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:20.989221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:20.989699 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:20.990385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:20.991427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:20.991848 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:21.124326 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:21.132001 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4d9dc089-9ae6-4b97-9342-bbddd07bbe82 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1564 microversion: 2.1 time: 0.154487 Sep 25 02:17:21.132584 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3711/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:20 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:22.704986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:17:22.705665 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:22.707341 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8f971d1f-6d06-4620-b5dd-9fff104de860 req-14a017f0-9591-4d6b-bd2e-cb50e8507cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34febd89-bdd9-40d0-a2af-331a47f54aba", "tag": "2a3909a2-a31c-412c-afd5-e10751792e32"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:17:22.714248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:22.714954 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:22.715758 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:22.716502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:22.717046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:22.717528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:22.719532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8f971d1f-6d06-4620-b5dd-9fff104de860 req-14a017f0-9591-4d6b-bd2e-cb50e8507cdc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:22.720077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8f971d1f-6d06-4620-b5dd-9fff104de860 req-14a017f0-9591-4d6b-bd2e-cb50e8507cdc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:22.720799 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8f971d1f-6d06-4620-b5dd-9fff104de860 req-14a017f0-9591-4d6b-bd2e-cb50e8507cdc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:22.736079 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8f971d1f-6d06-4620-b5dd-9fff104de860 req-14a017f0-9591-4d6b-bd2e-cb50e8507cdc service nova] Creating event network-changed:2a3909a2-a31c-412c-afd5-e10751792e32 for instance 34febd89-bdd9-40d0-a2af-331a47f54aba on n-h2-master-1 Sep 25 02:17:22.742243 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8f971d1f-6d06-4620-b5dd-9fff104de860 req-14a017f0-9591-4d6b-bd2e-cb50e8507cdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038732 Sep 25 02:17:22.742950 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3712/7450] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:17:22.941442 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:17:22.949966 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e8047a08-fca0-4e05-b3d5-260c62da38c8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1564 microversion: 2.1 time: 0.249112 Sep 25 02:17:22.950726 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3739/7451] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:17:22 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:17:54.235768 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:54.236512 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=38 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:17:54.240669 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:17:54.242978 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:17:54.250142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:54.250566 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:54.251004 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:54.251692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:17:54.252146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:17:54.252573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:17:54.408413 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86853173-fc6e-4be4-bf92-e379c2ccca37 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action" status: 200 len: 24570 microversion: 2.1 time: 0.174481 Sep 25 02:17:54.409100 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3713/7452] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:17:54 2022] POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action => generated 24570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 02:18:24.608621 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=23 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:24.609394 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=48 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:24.611410 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:18:24.611573 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action (ip 10.222.0.16) !!! Sep 25 02:18:24.616341 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:24.616896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:24.625203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:24.625724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:24.626179 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:24.626904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:24.627414 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:24.627867 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:24.694984 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-66f8b7a9-bba8-4068-840e-8bd9864b8c89 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action" status: 202 len: 0 microversion: 2.1 time: 0.087911 Sep 25 02:18:24.695574 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3740/7453] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:18:24 2022] POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:18:24.704888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:24.705749 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:24.708399 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:24.709107 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:24.716650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:24.717125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:24.717595 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:24.718290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:24.718739 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:24.719161 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:24.857621 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:24.865422 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-014ebe3c-9646-4083-bf38-811adb9b3f08 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1688 microversion: 2.1 time: 0.164804 Sep 25 02:18:24.865995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3714/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:24 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:25.892551 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:25.893566 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:25.902301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:25.902806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:25.903271 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:25.903990 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:25.904468 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:25.904913 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:26.037600 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:26.046346 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8bcc13a0-2179-48b5-9410-12aa7106b463 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1668 microversion: 2.1 time: 0.159296 Sep 25 02:18:26.046918 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3741/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:25 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:27.140972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:27.143106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:27.151047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:27.151533 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:27.151974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:27.152669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:27.153128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:27.153584 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:27.219678 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7a3b20d9-b0f5-486b-bc61-18f9f0016991 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action" status: 200 len: 32642 microversion: 2.1 time: 0.082546 Sep 25 02:18:27.220633 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3715/7456] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:18:27 2022] POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action => generated 32642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:18:27.234676 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:27.235249 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:27.242103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:27.242605 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:27.243798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:27.244508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:27.244984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:27.245451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:27.312951 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-912225ae-7b6f-4bee-a323-fe4a620d98c4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action" status: 202 len: 0 microversion: 2.1 time: 0.082350 Sep 25 02:18:27.313624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3742/7457] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:18:27 2022] POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:18:27.323193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:27.323897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:27.331208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:27.331765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:27.332275 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:27.333045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:27.333622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:27.334049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:27.467413 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:27.475065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4fa1280-cd58-4d3e-911c-252a82c26b0f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1675 microversion: 2.1 time: 0.156960 Sep 25 02:18:27.475635 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3716/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:27 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:28.501648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:28.502371 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:28.508711 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:28.509355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:28.509844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:28.510551 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:28.511021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:28.511464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:28.646463 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:28.655000 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29991dec-bab7-45b6-b56a-3a167bddb5c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1683 microversion: 2.1 time: 0.158596 Sep 25 02:18:28.655568 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3743/7459] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:28 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:28.748826 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:28.751044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:28.759498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:28.760061 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:28.760494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:28.761179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:28.761653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:28.762073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:28.822606 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ca0bd65-e874-4aea-8674-899a7c714560 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action" status: 200 len: 38439 microversion: 2.1 time: 0.077592 Sep 25 02:18:28.823271 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3717/7460] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:18:28 2022] POST /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba/action => generated 38439 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:18:29.798650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2ea6b80f-e722-4b4e-99c7-a43a954f5bab req-1bff09f5-2abf-45cf-8802-0cbe776eca1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34febd89-bdd9-40d0-a2af-331a47f54aba", "tag": "2a3909a2-a31c-412c-afd5-e10751792e32"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:29.808689 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:29.809284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:29.810245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2ea6b80f-e722-4b4e-99c7-a43a954f5bab req-1bff09f5-2abf-45cf-8802-0cbe776eca1b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:29.811092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2ea6b80f-e722-4b4e-99c7-a43a954f5bab req-1bff09f5-2abf-45cf-8802-0cbe776eca1b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:29.811637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2ea6b80f-e722-4b4e-99c7-a43a954f5bab req-1bff09f5-2abf-45cf-8802-0cbe776eca1b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:29.816467 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:29.816983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:29.817482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:29.818477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:29.818960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:29.819409 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:29.825558 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2ea6b80f-e722-4b4e-99c7-a43a954f5bab req-1bff09f5-2abf-45cf-8802-0cbe776eca1b service nova] Creating event network-changed:2a3909a2-a31c-412c-afd5-e10751792e32 for instance 34febd89-bdd9-40d0-a2af-331a47f54aba on n-h2-master-1 Sep 25 02:18:29.830749 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2ea6b80f-e722-4b4e-99c7-a43a954f5bab req-1bff09f5-2abf-45cf-8802-0cbe776eca1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036057 Sep 25 02:18:29.831799 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3718/7461] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:18:29.849601 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:18:29.946507 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f6ef7e5-9b87-4394-bcd6-131e86f93d72 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 204 len: 0 microversion: 2.1 time: 0.153585 Sep 25 02:18:29.947155 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3744/7462] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:18:29 2022] DELETE /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:18:29.956475 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:29.957187 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:29.965805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:29.966692 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:29.967138 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:29.968089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:29.968666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:29.969532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:30.130249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:30.138886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e32d4fcd-3474-4d8b-a16e-319fd48ed8f4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1689 microversion: 2.1 time: 0.186674 Sep 25 02:18:30.139468 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3719/7463] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:29 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:31.164300 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:31.165056 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:31.172122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:31.172626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:31.173087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:31.173828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:31.174307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:31.174749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:31.623855 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:31.632468 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-416e2486-c397-4f47-9952-a5afe7ba5a22 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1689 microversion: 2.1 time: 0.472780 Sep 25 02:18:31.633051 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3745/7464] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:31 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1689 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:32.208509 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3e7c73cb-860a-40cd-8f0e-75e3359a51dd req-827683e4-3d80-4a39-a689-84bb6dc11fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34febd89-bdd9-40d0-a2af-331a47f54aba", "name": "network-vif-deleted", "tag": "2a3909a2-a31c-412c-afd5-e10751792e32"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:32.218870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3e7c73cb-860a-40cd-8f0e-75e3359a51dd req-827683e4-3d80-4a39-a689-84bb6dc11fb6 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:32.219359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3e7c73cb-860a-40cd-8f0e-75e3359a51dd req-827683e4-3d80-4a39-a689-84bb6dc11fb6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:32.219794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3e7c73cb-860a-40cd-8f0e-75e3359a51dd req-827683e4-3d80-4a39-a689-84bb6dc11fb6 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:32.232337 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3e7c73cb-860a-40cd-8f0e-75e3359a51dd req-827683e4-3d80-4a39-a689-84bb6dc11fb6 service nova] Creating event network-vif-deleted:2a3909a2-a31c-412c-afd5-e10751792e32 for instance 34febd89-bdd9-40d0-a2af-331a47f54aba on n-h2-master-1 Sep 25 02:18:32.237771 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3e7c73cb-860a-40cd-8f0e-75e3359a51dd req-827683e4-3d80-4a39-a689-84bb6dc11fb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032900 Sep 25 02:18:32.238459 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3720/7465] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:18:32.657577 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:32.658213 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:32.666316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:32.666817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:32.667275 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:32.668201 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:32.668682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:32.669182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:32.704451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:32.704870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:32.705330 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:32.705832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lazy-loading 'fault' on Instance uuid 34febd89-bdd9-40d0-a2af-331a47f54aba {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:18:32.748285 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:32.756399 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3f4c78f4-07eb-4f61-be0e-e5b62f4746f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 200 len: 1356 microversion: 2.1 time: 0.102652 Sep 25 02:18:32.757080 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3746/7466] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:32 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:33.781590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:33.782296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 34febd89-bdd9-40d0-a2af-331a47f54aba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:33.788772 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:33.789832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:33.790376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:33.791154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:33.791614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:33.792046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:33.806093 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] HTTP exception thrown: Instance 34febd89-bdd9-40d0-a2af-331a47f54aba could not be found. Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Request method failure captured: Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba HTTP/1.1 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7oYOH5DvFC4Dd32o4-wMglRI5eEbLLMNRysTmR7OTDp_cMWRFFQPmJbSJTg9bEPKRXQG4oARq0tpDjqvaZUjKack-_Qfp1bg7wB8FN34ludiMlpJ534dsxgmAZoSXiVvRvMNzjAG650dGBDTznitA15rql5J_BkAmji6Nlram_aAUA Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c81a9610beb448de86effadb691910a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c81a9610beb448de86effadb691910a8"}]}] Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: fda050fca295403c8695da4b37062cd7 Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 34febd89-bdd9-40d0-a2af-331a47f54aba could not be found. Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '34febd89-bdd9-40d0-a2af-331a47f54aba'} Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34febd89-bdd9-40d0-a2af-331a47f54aba could not be found. Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34febd89-bdd9-40d0-a2af-331a47f54aba could not be found. Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:18:33.807738 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34febd89-bdd9-40d0-a2af-331a47f54aba could not be found. Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Returning 404 to user: Instance 34febd89-bdd9-40d0-a2af-331a47f54aba could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-73a88e05-e87f-4bee-aef5-c46da778dc3f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba" status: 404 len: 111 microversion: 2.1 time: 0.032751 Sep 25 02:18:33.813129 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3721/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:33 2022] GET /compute/v2.1/servers/34febd89-bdd9-40d0-a2af-331a47f54aba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 02:18:37.069936 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ae7e23d-9c32-40fb-9c1d-b7aebf6a04b9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '.version_select at 0x7f7beaf58dc0>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:37.097587 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ae7e23d-9c32-40fb-9c1d-b7aebf6a04b9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-275151060" status: 202 len: 0 microversion: 2.1 time: 0.031309 Sep 25 02:18:37.098102 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3747/7468] 10.222.0.16 () {58 vars in 1281 bytes} [Sun Sep 25 02:18:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-275151060 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:18:37.127051 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f6fdf5e5-984f-4b75-a0a0-1b44a6ac1719 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: .version_select at 0x7f7bea69f310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1708933762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPb78atE1tHAkGJ/KDTApe0pDjhzWze6jhEEqrtjyTQBdqUQi9X2KnUPN5cw5W3l+88onVYo1Up4uY+76OgHMJH19afnl3LIlnPT+pc4imaPOW1tNCNzk/v7ElK+XjxssQ=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:37.153880 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f6fdf5e5-984f-4b75-a0a0-1b44a6ac1719 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:18:37.165363 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-f6fdf5e5-984f-4b75-a0a0-1b44a6ac1719 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:18:37.190189 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f6fdf5e5-984f-4b75-a0a0-1b44a6ac1719 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066912 Sep 25 02:18:37.190851 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3722/7469] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:18:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:18:42.745363 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-669946668", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "b884d781-a704-4f88-a8d3-6bec30667b0f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1708933762", "security_groups": [{"name": "tempest-secgroup-smoke-1653846317"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:42.756069 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:42.873150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] validate_networks() for [('b884d781-a704-4f88-a8d3-6bec30667b0f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:18:43.333660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:18:43.334323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:18:43.335005 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:18:43.335612 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:18:43.336334 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:18:43.347935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:43.356952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:43.357479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:43.358344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:43.358833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:43.359287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:43.402295 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:18:43.409636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:18:43.432977 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:18:43.435591 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:18:43.497816 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1a476381-8d5a-4d64-b06f-762de159a4bf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756860 Sep 25 02:18:43.507480 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3748/7470] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:18:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:18:43.514496 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5fef3166-fc95-4cbf-b66b-e466a7a9bcd6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:43.515863 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5fef3166-fc95-4cbf-b66b-e466a7a9bcd6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:43.630606 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5fef3166-fc95-4cbf-b66b-e466a7a9bcd6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:43.640939 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5fef3166-fc95-4cbf-b66b-e466a7a9bcd6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1266 microversion: 2.1 time: 0.134466 Sep 25 02:18:43.644191 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3723/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:43 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:18:44.672569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:44.673382 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:44.681581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:44.682235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:44.682851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:44.684012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:44.684568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:44.685432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:44.751622 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:44.760506 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ce872864-ebd6-4830-8997-7435217cd568 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1318 microversion: 2.1 time: 0.091888 Sep 25 02:18:44.761243 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3749/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:44 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:45.785966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:45.788043 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:45.791926 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:45.801289 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:45.802150 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:45.802763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:45.803662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:45.804307 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:45.805655 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:45.968816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:45.978426 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-01a1edda-4c61-418c-839c-94eefc3376eb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.197588 Sep 25 02:18:45.979351 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3724/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:45 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:46.484807 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0d033cf1-84e5-4641-b394-30987738bf51 req-142475eb-b63a-4b6b-acfa-2f69759a0059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb77b780-781a-4f10-b648-5f07def26b1c", "tag": "efe54a5e-767c-4f8b-af52-739c360c8867"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:46.498462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0d033cf1-84e5-4641-b394-30987738bf51 req-142475eb-b63a-4b6b-acfa-2f69759a0059 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:46.499310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0d033cf1-84e5-4641-b394-30987738bf51 req-142475eb-b63a-4b6b-acfa-2f69759a0059 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:46.499776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0d033cf1-84e5-4641-b394-30987738bf51 req-142475eb-b63a-4b6b-acfa-2f69759a0059 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:46.513437 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0d033cf1-84e5-4641-b394-30987738bf51 req-142475eb-b63a-4b6b-acfa-2f69759a0059 service nova] Creating event network-changed:efe54a5e-767c-4f8b-af52-739c360c8867 for instance fb77b780-781a-4f10-b648-5f07def26b1c on n-h1-master-1 Sep 25 02:18:46.518529 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0d033cf1-84e5-4641-b394-30987738bf51 req-142475eb-b63a-4b6b-acfa-2f69759a0059 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037492 Sep 25 02:18:46.519137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3750/7474] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:18:47.002683 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:47.003304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:47.011317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:47.011813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:47.012256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:47.012979 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:47.013448 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:47.013885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:47.146445 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:47.154689 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-13e184f9-87bf-49cb-898f-5994e02e0b4a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.155967 Sep 25 02:18:47.155251 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3725/7475] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:46 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:48.179084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:48.179976 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:48.187957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:48.188466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:48.188936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:48.189745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:48.190248 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:48.190699 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:48.326031 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:48.333957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1cd30a87-7955-4485-a018-264ef4d5c066 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.159181 Sep 25 02:18:48.334543 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3751/7476] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:48 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:49.356720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:49.357340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:49.364109 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:49.364590 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:49.365027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:49.365744 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:49.366197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:49.366627 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:49.504091 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:49.512792 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c1fad807-597d-465d-a49b-75cfe59b3ca4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.159829 Sep 25 02:18:49.517459 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3726/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:49 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:50.536284 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:50.536947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:50.544413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:50.544919 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:50.545378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:50.546122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:50.546596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:50.547046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:50.684062 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:50.692205 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f5a7c1c5-7e1d-41ed-9140-7fb563d18c9e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.159961 Sep 25 02:18:50.692794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3752/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:50 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:51.662498 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-b1e97d25-f9e5-4222-ae44-f76ff164d258 req-df36168e-82c6-42a1-9823-d5c16dbd1eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb77b780-781a-4f10-b648-5f07def26b1c", "name": "network-vif-plugged", "status": "completed", "tag": "efe54a5e-767c-4f8b-af52-739c360c8867"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:51.673747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1e97d25-f9e5-4222-ae44-f76ff164d258 req-df36168e-82c6-42a1-9823-d5c16dbd1eef service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:51.674236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1e97d25-f9e5-4222-ae44-f76ff164d258 req-df36168e-82c6-42a1-9823-d5c16dbd1eef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:51.674674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-b1e97d25-f9e5-4222-ae44-f76ff164d258 req-df36168e-82c6-42a1-9823-d5c16dbd1eef service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:51.686429 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-b1e97d25-f9e5-4222-ae44-f76ff164d258 req-df36168e-82c6-42a1-9823-d5c16dbd1eef service nova] Creating event network-vif-plugged:efe54a5e-767c-4f8b-af52-739c360c8867 for instance fb77b780-781a-4f10-b648-5f07def26b1c on n-h1-master-1 Sep 25 02:18:51.691902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-b1e97d25-f9e5-4222-ae44-f76ff164d258 req-df36168e-82c6-42a1-9823-d5c16dbd1eef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Sep 25 02:18:51.692505 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3727/7479] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:18:51.716425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:51.717159 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:51.724111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:51.724681 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:51.725221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:51.726044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:51.726882 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:51.727554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:51.864030 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:51.872222 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6d0666e3-6a90-4326-8c37-e1ec4d89441b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.159735 Sep 25 02:18:51.872905 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3753/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:51 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:52.896388 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:52.897097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:52.903975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:52.904450 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:52.904890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:52.905622 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:52.906087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:52.906515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:53.045239 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:53.053017 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c9601655-b0fe-4683-a0ef-077c3ff9c352 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1392 microversion: 2.1 time: 0.161762 Sep 25 02:18:53.053639 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3728/7481] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:52 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:54.076906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:54.077574 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:54.080412 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:54.081093 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:54.087493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:54.088001 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:54.088463 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:54.089184 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:54.089682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:54.090127 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:54.224935 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:54.232953 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f3e592e5-30af-4e7e-a51f-e1a89da11008 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1564 microversion: 2.1 time: 0.160082 Sep 25 02:18:54.233563 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3754/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:54 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:54.257185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:54.257896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:54.259752 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:54.266428 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:54.266932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:54.267362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:54.268064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:54.268519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:54.268945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:54.415214 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:54.423164 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a21861c4-b970-46a2-941a-501fe1eb0df4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1564 microversion: 2.1 time: 0.170100 Sep 25 02:18:54.423734 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3729/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:54 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:18:56.383033 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:18:56.383899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-8fb7228a-b2d5-44b1-8a1e-3834fa592e7f req-33a7d3c7-580c-46b9-b28f-513926b1a64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb77b780-781a-4f10-b648-5f07def26b1c", "tag": "efe54a5e-767c-4f8b-af52-739c360c8867"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:18:56.388246 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:18:56.395505 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:56.398225 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:18:56.401679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:56.402382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:56.403116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:56.404119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:56.404791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:56.405152 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8fb7228a-b2d5-44b1-8a1e-3834fa592e7f req-33a7d3c7-580c-46b9-b28f-513926b1a64e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:18:56.405716 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:56.405834 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8fb7228a-b2d5-44b1-8a1e-3834fa592e7f req-33a7d3c7-580c-46b9-b28f-513926b1a64e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:18:56.406175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-8fb7228a-b2d5-44b1-8a1e-3834fa592e7f req-33a7d3c7-580c-46b9-b28f-513926b1a64e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:18:56.420713 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-8fb7228a-b2d5-44b1-8a1e-3834fa592e7f req-33a7d3c7-580c-46b9-b28f-513926b1a64e service nova] Creating event network-changed:efe54a5e-767c-4f8b-af52-739c360c8867 for instance fb77b780-781a-4f10-b648-5f07def26b1c on n-h1-master-1 Sep 25 02:18:56.425813 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-8fb7228a-b2d5-44b1-8a1e-3834fa592e7f req-33a7d3c7-580c-46b9-b28f-513926b1a64e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049353 Sep 25 02:18:56.426427 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3730/7484] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:18:56.561376 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:18:56.570736 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9fbea4b2-256f-4288-ae65-2e6c07087632 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1564 microversion: 2.1 time: 0.196573 Sep 25 02:18:56.571471 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3755/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:18:56 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1564 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:19.830994 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=34 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:19.831732 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:19.835913 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:19:19.838192 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:19.845086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:19.845602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:19.846040 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:19.846727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:19.847178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:19.847601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:19.917282 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-19ba990a-6fe6-4a29-b851-c696ad0d1932 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c/action" status: 200 len: 24571 microversion: 2.1 time: 0.087863 Sep 25 02:19:19.917832 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3731/7486] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:19:19 2022] POST /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:19:31.012594 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:19:31.015610 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:31.017992 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:31.018662 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=40 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:31.024749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:31.025270 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:31.025761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:31.026482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:31.026962 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:31.027418 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:31.101724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9748b1f3-7c43-458c-adfc-ad20df494505 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c/action" status: 202 len: 0 microversion: 2.1 time: 0.093520 Sep 25 02:19:31.102297 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3756/7487] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:19:31 2022] POST /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:19:31.111508 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:31.112238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:31.115257 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:31.115963 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:19:31.123021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:31.123505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:31.123956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:31.124635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:31.125094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:31.125565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:31.336349 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:31.344765 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8310f90d-fe12-4687-af55-386ef7e0e780 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1675 microversion: 2.1 time: 0.237576 Sep 25 02:19:31.345605 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3732/7488] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:31 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:19:32.374321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:32.375069 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:32.381227 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:32.381768 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:32.382226 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:32.382931 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:32.383406 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:32.383851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:32.515369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:32.523237 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c820c085-9668-4ca1-9cb9-41ecf052b8a6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.156380 Sep 25 02:19:32.523815 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3757/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:32 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:33.547991 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:33.548609 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:33.556235 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:33.556711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:33.557146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:33.557863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:33.558315 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:33.558863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:33.691948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:33.700351 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3447c5a0-b023-456d-b426-0356ebcd1810 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.155782 Sep 25 02:19:33.700914 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3733/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:33 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:34.724064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:34.724637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:34.732365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:34.732891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:34.733385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:34.734166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:34.734648 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:34.735183 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:34.868043 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:34.876136 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2a1e393c-e553-454c-8845-891426e2bfc9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.156082 Sep 25 02:19:34.876714 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3758/7491] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:34 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:35.899657 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:35.900284 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:35.907874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:35.908363 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:35.908805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:35.909534 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:35.909995 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:35.910425 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:36.044306 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:36.052085 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ebe4f1d-20ee-453e-b7e7-8d17908d0119 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.156382 Sep 25 02:19:36.052654 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3734/7492] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:35 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:37.075849 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:37.076483 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:37.083353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:37.083856 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:37.084315 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:37.085026 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:37.085538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:37.085981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:37.215656 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:37.223534 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c4fe9f41-4096-49cb-87c8-437b6b3ca5e7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.151768 Sep 25 02:19:37.224113 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3759/7493] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:37 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:38.248007 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:38.248646 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:38.255444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:38.255923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:38.256351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:38.257027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:38.257499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:38.257919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:38.389804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:38.397544 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4a7bf5c-68da-4330-996f-3693dc25b9e9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.153714 Sep 25 02:19:38.398128 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3735/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:38 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:39.422690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:39.423393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:39.430360 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:39.430875 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:39.431340 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:39.432084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:39.432562 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:39.433013 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:39.565828 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:39.573604 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a650636e-d2a5-4f0b-b8ee-93ece0b3e4f6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.155643 Sep 25 02:19:39.574704 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3760/7495] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:39 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:40.598841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:40.599457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:40.606478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:40.606957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:40.607397 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:40.608083 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:40.608542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:40.608963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:40.741687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:40.750453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b75b9d8-6427-4f9b-b88f-d0699db130d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.155207 Sep 25 02:19:40.751030 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3736/7496] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:40 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:41.776042 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:41.776785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:41.784470 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:41.784978 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:41.785459 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:41.786188 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:41.786663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:41.787113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:41.953832 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:41.961965 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-624a0efa-ca57-4003-98cb-6ad358c789e6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.190639 Sep 25 02:19:41.962563 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3761/7497] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:41 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:42.987608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:42.988228 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:42.995208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:42.995730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:42.996178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:42.996875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:42.997330 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:42.997784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:43.127680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:43.135525 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5bc27ce0-6b93-4b58-8976-b5698cadccba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.151853 Sep 25 02:19:43.136087 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3737/7498] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:42 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:44.159187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:44.159831 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:44.166986 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:44.167496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:44.168521 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:44.169441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:44.169928 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:44.170381 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:44.400576 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:44.409544 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5d0586de-5b99-4bc2-8233-4a461022cebd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.254256 Sep 25 02:19:44.410137 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3762/7499] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:44 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:45.434650 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:45.435275 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:45.442276 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:45.442835 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:45.443277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:45.443976 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:45.444429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:45.444850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:45.578099 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:45.586009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-90e21a09-548f-4d9d-be49-d6a7010bd531 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.155863 Sep 25 02:19:45.586576 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3738/7500] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:45 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:46.610565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:46.611199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:46.617809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:46.618304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:46.618756 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:46.619458 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:46.619929 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:46.620372 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:46.754413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:46.762432 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64d02296-0776-4fdc-9565-2dda3818503d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1680 microversion: 2.1 time: 0.155982 Sep 25 02:19:46.763007 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3763/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:46 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:19:47.786328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:19:47.786949 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:19:47.794451 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:47.794963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:47.795383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:47.796096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:19:47.796531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:19:47.796960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:19:47.932332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:19:47.940336 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-67653769-851e-4fae-8c3c-f96f75c06240 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1683 microversion: 2.1 time: 0.157953 Sep 25 02:19:47.940896 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3739/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:19:47 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:14.130822 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:14.133074 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:14.135737 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=16 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:14.136540 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:14.143950 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:14.144486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:14.144957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:14.145757 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:14.146239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:14.146690 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:14.225850 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85911a56-96a0-4c14-87c5-fd62940d428a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c/action" status: 200 len: 68998 microversion: 2.1 time: 0.098939 Sep 25 02:20:14.226540 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3764/7503] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:20:14 2022] POST /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c/action => generated 68998 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:20:21.640652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:21.641193 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:21.643353 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=16 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:21.643490 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-91ca158c-5a53-4cb3-b4e9-a80614bdbe4c req-bf93fb42-fd27-4c4c-af7f-24c259452256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb77b780-781a-4f10-b648-5f07def26b1c", "tag": "efe54a5e-767c-4f8b-af52-739c360c8867"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:21.643994 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=48 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:21.645936 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:20:21.646248 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:20:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c (ip 10.222.0.16) !!! Sep 25 02:20:21.655644 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-91ca158c-5a53-4cb3-b4e9-a80614bdbe4c req-bf93fb42-fd27-4c4c-af7f-24c259452256 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:21.656493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-91ca158c-5a53-4cb3-b4e9-a80614bdbe4c req-bf93fb42-fd27-4c4c-af7f-24c259452256 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:21.657106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-91ca158c-5a53-4cb3-b4e9-a80614bdbe4c req-bf93fb42-fd27-4c4c-af7f-24c259452256 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:21.658113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:21.658685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:21.659187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:21.659957 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:21.660477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:21.660974 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:21.670894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-91ca158c-5a53-4cb3-b4e9-a80614bdbe4c req-bf93fb42-fd27-4c4c-af7f-24c259452256 service nova] Creating event network-changed:efe54a5e-767c-4f8b-af52-739c360c8867 for instance fb77b780-781a-4f10-b648-5f07def26b1c on n-h1-master-1 Sep 25 02:20:21.676435 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-91ca158c-5a53-4cb3-b4e9-a80614bdbe4c req-bf93fb42-fd27-4c4c-af7f-24c259452256 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037104 Sep 25 02:20:21.677671 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3765/7504] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:20:21.691149 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:20:21.779372 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-16f09d40-4067-42c4-8626-7d4d99cb9108 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 204 len: 0 microversion: 2.1 time: 0.143399 Sep 25 02:20:21.780402 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3740/7505] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:20:21 2022] DELETE /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:20:21.790841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:21.791690 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:21.798560 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:21.799079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:21.799554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:21.800283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:21.800760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:21.801208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:21.939956 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:21.948002 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1543b303-f561-4f42-bf7b-39d8998925c3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1689 microversion: 2.1 time: 0.162863 Sep 25 02:20:21.948589 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3766/7506] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:21 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:22.972767 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:22.973503 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:22.980488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:22.980986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:22.981475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:22.982175 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:22.982633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:22.983063 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:23.113438 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:23.121444 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-724fe6c2-5984-4290-8a41-a1c9b49513cc tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1689 microversion: 2.1 time: 0.152680 Sep 25 02:20:23.122106 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3741/7507] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:22 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:24.044050 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-9f067790-091a-4d93-8718-2c57ef6d0e3b req-44ec0eb5-422c-434c-8cfc-2ee8b207e374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb77b780-781a-4f10-b648-5f07def26b1c", "name": "network-vif-deleted", "tag": "efe54a5e-767c-4f8b-af52-739c360c8867"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:24.056022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9f067790-091a-4d93-8718-2c57ef6d0e3b req-44ec0eb5-422c-434c-8cfc-2ee8b207e374 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:24.056516 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9f067790-091a-4d93-8718-2c57ef6d0e3b req-44ec0eb5-422c-434c-8cfc-2ee8b207e374 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:24.056966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-9f067790-091a-4d93-8718-2c57ef6d0e3b req-44ec0eb5-422c-434c-8cfc-2ee8b207e374 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:24.070218 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-9f067790-091a-4d93-8718-2c57ef6d0e3b req-44ec0eb5-422c-434c-8cfc-2ee8b207e374 service nova] Creating event network-vif-deleted:efe54a5e-767c-4f8b-af52-739c360c8867 for instance fb77b780-781a-4f10-b648-5f07def26b1c on n-h1-master-1 Sep 25 02:20:24.076344 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-9f067790-091a-4d93-8718-2c57ef6d0e3b req-44ec0eb5-422c-434c-8cfc-2ee8b207e374 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036776 Sep 25 02:20:24.076951 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3767/7508] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:20:24.145841 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:24.146458 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:24.154826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:24.155314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:24.155765 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:24.156445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:24.156900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:24.157326 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:24.191575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:24.192069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:24.192508 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:24.192965 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lazy-loading 'fault' on Instance uuid fb77b780-781a-4f10-b648-5f07def26b1c {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:20:24.234548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:24.242479 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-051aba75-b5ec-4249-9565-ae3fabab339b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 200 len: 1356 microversion: 2.1 time: 0.101136 Sep 25 02:20:24.243247 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3742/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:24 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:25.267232 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:25.267967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: fb77b780-781a-4f10-b648-5f07def26b1c] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:25.274944 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:25.275440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:25.275893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:25.276603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:25.277096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:25.277812 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:25.291550 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] HTTP exception thrown: Instance fb77b780-781a-4f10-b648-5f07def26b1c could not be found. Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Request method failure captured: Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c HTTP/1.1 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7oYOH5DvFC4Dd32o4-wMglRI5eEbLLMNRysTmR7OTDp_cMWRFFQPmJbSJTg9bEPKRXQG4oARq0tpDjqvaZUjKack-_Qfp1bg7wB8FN34ludiMlpJ534dsxgmAZoSXiVvRvMNzjAG650dGBDTznitA15rql5J_BkAmji6Nlram_aAUA Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c81a9610beb448de86effadb691910a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c81a9610beb448de86effadb691910a8"}]}] Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: fda050fca295403c8695da4b37062cd7 Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: exception: Instance fb77b780-781a-4f10-b648-5f07def26b1c could not be found. Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': 'fb77b780-781a-4f10-b648-5f07def26b1c'} Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb77b780-781a-4f10-b648-5f07def26b1c could not be found. Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb77b780-781a-4f10-b648-5f07def26b1c could not be found. Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:20:25.294412 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb77b780-781a-4f10-b648-5f07def26b1c could not be found. Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Returning 404 to user: Instance fb77b780-781a-4f10-b648-5f07def26b1c could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c35a012-0cd6-476d-8be0-b3f5c41560f1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c" status: 404 len: 111 microversion: 2.1 time: 0.033252 Sep 25 02:20:25.302863 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3768/7510] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:25 2022] GET /compute/v2.1/servers/fb77b780-781a-4f10-b648-5f07def26b1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:20:28.296770 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3ca0ea5c-2648-4974-8dfe-29cd69fb74f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '.version_select at 0x7f7bea62f0d0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:28.326094 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3ca0ea5c-2648-4974-8dfe-29cd69fb74f7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1708933762" status: 202 len: 0 microversion: 2.1 time: 0.037283 Sep 25 02:20:28.327729 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3743/7511] 10.222.0.16 () {58 vars in 1284 bytes} [Sun Sep 25 02:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1708933762 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:20:28.359173 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3685e20e-6918-4cd3-b0ab-7c3a3a55c0f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: .version_select at 0x7f7bf3fb2f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1289118938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYdNoc2NlZII74Y+9p2rJllyYjhyW5UxUGz98Dh4AHUHST9rAVDvJkA7qP4cxsdbIXJPW/4UWqwuiJpQXC2whxVMhEJ/5cZfDlqmsVMWjDq+AsNRyZ9LGc55ziuXGtTHQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:28.377755 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3685e20e-6918-4cd3-b0ab-7c3a3a55c0f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:20:28.383372 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3685e20e-6918-4cd3-b0ab-7c3a3a55c0f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:20:28.408963 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3685e20e-6918-4cd3-b0ab-7c3a3a55c0f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055241 Sep 25 02:20:28.409595 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3769/7512] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:20:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:20:33.896026 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-151522846", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "75359814-9e72-4646-8ee8-985d76cb5c3e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1289118938", "security_groups": [{"name": "tempest-secgroup-smoke-363342719"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:34.012119 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] validate_networks() for [('75359814-9e72-4646-8ee8-985d76cb5c3e', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:20:34.239245 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:34.482680 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:20:34.483116 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:20:34.483595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:20:34.484014 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:20:34.484464 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:20:34.493382 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:34.493894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:34.494338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:34.495079 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:34.495538 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:34.495969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:34.514774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:20:34.520111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:20:34.532838 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:20:34.535197 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:20:34.584627 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d39d83af-b936-4e5f-98cd-17419d9f0d30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.693623 Sep 25 02:20:34.585374 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3744/7513] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:20:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:20:34.599930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cb928fda-abcc-48b7-93ee-4a4d23b8ae4b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:34.600582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cb928fda-abcc-48b7-93ee-4a4d23b8ae4b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:34.675467 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cb928fda-abcc-48b7-93ee-4a4d23b8ae4b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:34.683821 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cb928fda-abcc-48b7-93ee-4a4d23b8ae4b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1266 microversion: 2.1 time: 0.090086 Sep 25 02:20:34.684740 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3770/7514] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:34 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:35.707860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:35.708479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:35.716756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:35.717535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:35.718178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:35.719072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:35.719696 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:35.720294 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:35.825125 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:35.834081 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c381b11-da4c-4fef-8541-372ad8abf822 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1326 microversion: 2.1 time: 0.130711 Sep 25 02:20:35.849640 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3745/7515] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:35 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:36.858740 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:36.860122 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:36.862285 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=16 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:36.870684 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:36.871957 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:36.872763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:36.874018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:36.874525 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:36.875157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:37.066389 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:37.078423 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-67f5cc5a-0015-4c82-a8b9-2538f03c5b5e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.224056 Sep 25 02:20:37.079935 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3771/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:36 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:37.306610 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a11ab502-86aa-4a71-b4ba-67003f705c0c req-57b51cff-5218-418d-ab9d-7313d09e0fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:37.321751 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a11ab502-86aa-4a71-b4ba-67003f705c0c req-57b51cff-5218-418d-ab9d-7313d09e0fde service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:37.322317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a11ab502-86aa-4a71-b4ba-67003f705c0c req-57b51cff-5218-418d-ab9d-7313d09e0fde service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:37.322811 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a11ab502-86aa-4a71-b4ba-67003f705c0c req-57b51cff-5218-418d-ab9d-7313d09e0fde service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:37.334541 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a11ab502-86aa-4a71-b4ba-67003f705c0c req-57b51cff-5218-418d-ab9d-7313d09e0fde service nova] Creating event network-changed:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h2-master-1 Sep 25 02:20:37.339681 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a11ab502-86aa-4a71-b4ba-67003f705c0c req-57b51cff-5218-418d-ab9d-7313d09e0fde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039145 Sep 25 02:20:37.340647 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3746/7517] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:20:38.102085 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:38.102727 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:38.109835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:38.110296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:38.110763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:38.111509 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:38.111992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:38.112446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:38.247313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:38.255156 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e7929c57-df56-40b3-9c90-04a736824549 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.157099 Sep 25 02:20:38.255725 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3772/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:38 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:39.280714 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:39.281457 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:39.287734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:39.288474 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:39.288912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:39.289654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:39.290113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:39.290544 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:39.423145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:39.436458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-616cac65-0db9-4cda-a147-ce89c2d2a6b8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.161637 Sep 25 02:20:39.437063 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3747/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:39 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:40.460018 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:40.460660 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:40.467719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:40.468238 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:40.468707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:40.469446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:40.469974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:40.470426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:40.609578 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:40.617555 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-95379e00-167f-4e95-99b1-be260a19d21a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.161495 Sep 25 02:20:40.618163 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3773/7520] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:40 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:41.640899 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:41.641718 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:41.648552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:41.649025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:41.649483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:41.650197 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:41.650648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:41.651067 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:41.789474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:41.797802 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55f58801-4f7b-4061-9a0b-298900c8390b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.161520 Sep 25 02:20:41.798396 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3748/7521] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:41 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:42.821425 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:42.822081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:42.829664 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:42.830162 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:42.830613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:42.831316 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:42.831782 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:42.832223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:42.962878 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:42.970715 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-23c36515-ae03-492f-bf2c-57b3c7762328 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.153261 Sep 25 02:20:42.971287 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3774/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:42 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:43.132104 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-d6999481-a81a-4458-aced-cd4031ba1114 req-abd1157b-a7d4-4ecd-82fb-6fe1b099dc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "name": "network-vif-plugged", "status": "completed", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:43.143988 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d6999481-a81a-4458-aced-cd4031ba1114 req-abd1157b-a7d4-4ecd-82fb-6fe1b099dc32 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:43.144512 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d6999481-a81a-4458-aced-cd4031ba1114 req-abd1157b-a7d4-4ecd-82fb-6fe1b099dc32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:43.145794 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-d6999481-a81a-4458-aced-cd4031ba1114 req-abd1157b-a7d4-4ecd-82fb-6fe1b099dc32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:43.158206 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-d6999481-a81a-4458-aced-cd4031ba1114 req-abd1157b-a7d4-4ecd-82fb-6fe1b099dc32 service nova] Creating event network-vif-plugged:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h2-master-1 Sep 25 02:20:43.163796 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-d6999481-a81a-4458-aced-cd4031ba1114 req-abd1157b-a7d4-4ecd-82fb-6fe1b099dc32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Sep 25 02:20:43.164405 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3749/7523] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:20:43.993723 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:43.994347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:44.001259 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:44.001790 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:44.002251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:44.002958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:44.003432 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:44.003874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:44.141838 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:44.150099 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-af532ba2-9263-48ce-8fbc-accffe641ac5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1391 microversion: 2.1 time: 0.160247 Sep 25 02:20:44.151031 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3775/7524] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:43 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:45.175888 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:45.176628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:45.179437 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:45.180233 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:45.186476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:45.186987 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:45.187410 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:45.188104 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:45.188563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:45.189022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:45.319393 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:45.327523 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9c290fde-9fc9-4dda-b3ff-b6ab406cebef tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1563 microversion: 2.1 time: 0.155899 Sep 25 02:20:45.328171 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3750/7525] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:45 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:45.350734 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:45.351379 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:45.353237 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:45.354971 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:20:45.362415 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:45.363019 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:45.363568 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:45.364310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:45.364830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:45.365363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:45.501313 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:45.509156 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-262f936d-98bc-48af-921d-cce38d14a863 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1563 microversion: 2.1 time: 0.162335 Sep 25 02:20:45.509760 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3776/7526] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:45 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:20:47.381804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:20:47.382426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:20:47.391911 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:47.392187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:47.392635 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:47.393346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:47.393826 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:47.394254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:47.456384 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-f47c20f7-c3aa-4c52-a7dd-18b65125f56f req-1b2760af-e15d-45b5-9fb6-c35c4d81209e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:20:47.466332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f47c20f7-c3aa-4c52-a7dd-18b65125f56f req-1b2760af-e15d-45b5-9fb6-c35c4d81209e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:20:47.466839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f47c20f7-c3aa-4c52-a7dd-18b65125f56f req-1b2760af-e15d-45b5-9fb6-c35c4d81209e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:20:47.468255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-f47c20f7-c3aa-4c52-a7dd-18b65125f56f req-1b2760af-e15d-45b5-9fb6-c35c4d81209e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:20:47.480259 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-f47c20f7-c3aa-4c52-a7dd-18b65125f56f req-1b2760af-e15d-45b5-9fb6-c35c4d81209e service nova] Creating event network-changed:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h2-master-1 Sep 25 02:20:47.487188 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-f47c20f7-c3aa-4c52-a7dd-18b65125f56f req-1b2760af-e15d-45b5-9fb6-c35c4d81209e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110091 Sep 25 02:20:47.490984 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3777/7527] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:20:47.543167 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:20:47.551453 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f4e9c86d-fe57-4c06-a40a-63fe774ad2f8 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1563 microversion: 2.1 time: 0.179109 Sep 25 02:20:47.552041 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3751/7528] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:20:47 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:18.822952 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:18.823756 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=38 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:18.828260 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:21:18.830614 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:18.837627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:18.838129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:18.838589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:18.839301 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:18.839778 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:18.840228 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:18.910230 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90057503-ab62-452d-8f70-5c9f2f46af57 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action" status: 200 len: 24566 microversion: 2.1 time: 0.088545 Sep 25 02:21:18.911112 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3778/7529] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:21:18 2022] POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:21:49.355146 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:49.355901 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=36 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:49.360550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:21:49.362816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:49.370600 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:49.371087 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:49.371529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:49.372227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:49.372683 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:49.373114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:49.416492 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:49.422628 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Old instance type m1.heat2, new instance type m1.heat {{(pid=122384) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 25 02:21:49.429630 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:21:49.430213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:21:49.430697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:21:49.431221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:21:49.431651 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:21:49.495826 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-12a7d923-c02a-47f6-87e5-033df5a770bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action" status: 202 len: 0 microversion: 2.1 time: 0.142484 Sep 25 02:21:49.496453 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3752/7530] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:21:49 2022] POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:21:49.506163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:49.507508 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:49.510081 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:49.510757 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:21:49.517300 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:49.517826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:49.518309 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:49.519011 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:49.520063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:49.520514 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:49.659893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:49.668424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f5397056-e355-46a2-8817-89590d4de77e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1691 microversion: 2.1 time: 0.167182 Sep 25 02:21:49.669005 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3779/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:49 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:50.694045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:50.694682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:50.701968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:50.702524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:50.703068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:50.703880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:50.704395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:50.704833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:50.846450 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:50.854746 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-133cf9f5-3040-4a51-954f-367441cdc6e0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1691 microversion: 2.1 time: 0.166576 Sep 25 02:21:50.855516 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3753/7532] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:50 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:51.880679 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:51.881224 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:51.891823 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:51.892327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:51.892788 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:51.893546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:51.894024 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:51.895120 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:52.027752 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:52.035867 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cfd61379-ef79-4a9d-a9af-5e90b2177db5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.159787 Sep 25 02:21:52.036459 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3780/7533] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:51 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:53.060416 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:53.061039 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:53.068565 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:53.069044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:53.069505 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:53.070199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:53.070653 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:53.071077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:53.208858 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:53.216743 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cf5632dc-12d2-42a6-99ae-4f9aac0b85c7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.160268 Sep 25 02:21:53.217324 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3754/7534] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:53 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:54.240795 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:54.241446 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:54.244647 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:21:54.244806 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:21:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 (ip 10.222.0.16) !!! Sep 25 02:21:54.250839 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:54.251335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:54.251787 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:54.252502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:54.252966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:54.253518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:54.390929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:54.399142 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c28ce9f7-2c74-4bd9-8865-389656e85113 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.162868 Sep 25 02:21:54.399752 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3781/7535] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:54 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:55.427518 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:55.428133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:55.434933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:55.435409 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:55.435838 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:55.436531 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:55.436968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:55.437391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:55.572313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:55.580065 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9975c637-52f2-42b0-8c65-fbf29fa93f00 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.156788 Sep 25 02:21:55.580661 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3755/7536] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:55 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:56.604753 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:56.605396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:56.612321 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:56.612826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:56.613291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:56.614048 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:56.614754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:56.615202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:56.746881 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:56.754708 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8e348ae9-4274-44da-a0e5-59160cdff074 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.153984 Sep 25 02:21:56.755848 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3782/7537] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:56 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:57.826237 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:57.826862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:57.832808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:57.833328 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:57.833790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:57.834479 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:57.834932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:57.835356 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:57.967329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:57.975807 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8d54ece1-8262-4eec-8e1f-d33222f4e373 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.200134 Sep 25 02:21:57.976379 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3756/7538] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:57 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:21:58.998416 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:21:58.999057 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:21:59.006760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:59.007299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:59.007766 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:59.008489 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:21:59.008966 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:21:59.009438 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:21:59.143963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:21:59.152014 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-22043b1c-3fe4-43d4-943f-0b437a83028b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.157526 Sep 25 02:21:59.152591 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3783/7539] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:21:58 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:00.176115 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:00.177219 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:00.184218 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:00.184729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:00.185168 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:00.185890 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:00.186346 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:00.186771 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:00.318764 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:00.326445 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0382501b-7317-440c-80d7-c99359b57e59 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.154331 Sep 25 02:22:00.327016 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3757/7540] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:00 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:01.350393 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:01.351036 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:01.358108 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:01.358611 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:01.359077 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:01.359793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:01.360278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:01.360727 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:01.499279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:01.507225 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fb505870-185c-4e90-9198-3fdcd2ae93d9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.160878 Sep 25 02:22:01.507807 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3784/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:01 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:02.530366 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:02.531020 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:02.539342 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:02.539828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:02.540267 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:02.540967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:02.541446 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:02.541880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:02.673595 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:02.681512 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af8634b2-920f-4919-a387-122dfd5fe15f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.155087 Sep 25 02:22:02.682095 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3758/7542] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:02 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:03.704367 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:03.704908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:03.712462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:03.712999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:03.713479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:03.714198 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:03.714671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:03.715117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:03.846706 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:03.855253 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d44c6280-6e12-4018-ad5b-17bd5fdec17d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1696 microversion: 2.1 time: 0.154963 Sep 25 02:22:03.855842 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3785/7543] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:03 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:04.595862 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "name": "network-vif-unplugged", "status": "completed", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:04.606283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:04.606763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:04.607195 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:04.619913 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] Creating event network-vif-unplugged:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h1-master-1 Sep 25 02:22:04.625249 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122384) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:22:04.639932 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-adab3c95-02c7-4170-8238-7796062940f0 req-7ff2a415-6f5f-4ba7-ad90-be00521b5f96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048812 Sep 25 02:22:04.640559 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3759/7544] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:22:04.878818 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:04.879550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:04.886614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:04.887128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:04.887666 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:04.888531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:04.889093 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:04.889574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:05.093773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:05.102984 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-85c93369-17c0-4e74-9f3e-d1e9ba423bb2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1695 microversion: 2.1 time: 0.228219 Sep 25 02:22:05.103866 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3786/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:04 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1695 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:06.130273 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:06.130990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:06.137248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:06.137764 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:06.138199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:06.138886 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:06.139343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:06.139763 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:06.277321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:06.285041 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-06b31ecc-9ed0-4a6d-8bf8-330d08c83b28 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1693 microversion: 2.1 time: 0.160503 Sep 25 02:22:06.286215 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3760/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:06 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:06.677479 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:06.687773 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:06.688267 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:06.688713 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:06.700247 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] Creating event network-changed:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h1-master-1 Sep 25 02:22:06.705514 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122385) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 25 02:22:06.717067 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a3b497ce-d1fb-4a82-a642-15de0c55a6b4 req-ea5765e0-d161-48ee-bec1-0c0ae1f2e09c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043683 Sep 25 02:22:06.717694 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3787/7547] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:22:07.310114 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:07.310728 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:07.318227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:07.319361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:07.319818 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:07.320792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:07.320985 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:07.321427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:07.518835 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:07.526705 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a44d9c9e-532e-4ccd-9f0d-0a7c822b0eba tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1693 microversion: 2.1 time: 0.220456 Sep 25 02:22:07.527549 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3761/7548] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:07 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:08.553525 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:08.554892 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:08.561142 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:08.561677 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:08.562235 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:08.563128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:08.563606 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:08.564049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:08.706790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:08.715429 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3129791b-7867-40c4-b3c9-b7afbd2f27e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1690 microversion: 2.1 time: 0.167655 Sep 25 02:22:08.715996 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3788/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:08 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:08.738120 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:08.738677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:08.745629 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:08.746114 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:08.746553 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:08.747243 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:08.747698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:08.748124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:08.806093 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b5c1891-d529-4f94-846e-00b4a0f37555 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action" status: 204 len: 0 microversion: 2.1 time: 0.071688 Sep 25 02:22:08.806731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3762/7550] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:22:08 2022] POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:22:08.814944 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:08.815702 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:08.822661 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:08.823288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:08.823833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:08.824633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:08.825141 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:08.825620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:08.965445 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:08.973868 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca6ce0c6-c469-4e33-906a-6f390e9bf43b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1690 microversion: 2.1 time: 0.162875 Sep 25 02:22:08.974676 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3789/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:08 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:08.998902 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:08.999783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:09.007025 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:09.007518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:09.008171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:09.008882 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:09.009340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:09.009894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:09.153723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:09.162012 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-af34e6be-f876-4482-9641-1329197b96bd tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1690 microversion: 2.1 time: 0.167720 Sep 25 02:22:09.163238 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3763/7552] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:08 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:10.186549 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:10.187247 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:10.194619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:10.195119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:10.195579 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:10.196291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:10.196760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:10.197199 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:10.330648 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:10.339032 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c8fc920c-8aef-4184-bf34-df61fe47b144 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1682 microversion: 2.1 time: 0.156505 Sep 25 02:22:10.339609 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3790/7553] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:10 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:10.595702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1a48c0a4-6c7f-455a-92c7-44feaf3b63ef req-406229d0-d545-42b6-ad97-b8f6e00975cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "name": "network-vif-plugged", "status": "completed", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:10.607244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1a48c0a4-6c7f-455a-92c7-44feaf3b63ef req-406229d0-d545-42b6-ad97-b8f6e00975cd service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:10.607786 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1a48c0a4-6c7f-455a-92c7-44feaf3b63ef req-406229d0-d545-42b6-ad97-b8f6e00975cd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:10.608220 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1a48c0a4-6c7f-455a-92c7-44feaf3b63ef req-406229d0-d545-42b6-ad97-b8f6e00975cd service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:10.619804 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1a48c0a4-6c7f-455a-92c7-44feaf3b63ef req-406229d0-d545-42b6-ad97-b8f6e00975cd service nova] Creating event network-vif-plugged:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h1-master-1 Sep 25 02:22:10.624641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1a48c0a4-6c7f-455a-92c7-44feaf3b63ef req-406229d0-d545-42b6-ad97-b8f6e00975cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032629 Sep 25 02:22:10.625353 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3764/7554] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:22:32.525762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:32.528029 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:32.530707 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=24 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:32.531385 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=70 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:32.538368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:32.538876 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:32.539455 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:32.540181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:32.540659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:32.541109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:32.610980 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1cdb5df3-8797-439f-aa38-aff3ec8ef273 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action" status: 200 len: 24575 microversion: 2.1 time: 0.089123 Sep 25 02:22:32.611665 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3791/7555] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:22:32 2022] POST /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01/action => generated 24575 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:22:40.066030 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=30 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:40.067420 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:40.071348 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-119fc2bd-f607-485c-931c-b8fc0cc54f0c req-e69713c4-bf05-483d-8205-fef3d407f0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:40.072493 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:40.073100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:40.079809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:40.080305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:40.080747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:40.081477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:40.081966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:40.083081 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:40.086105 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-119fc2bd-f607-485c-931c-b8fc0cc54f0c req-e69713c4-bf05-483d-8205-fef3d407f0f4 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:40.086818 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-119fc2bd-f607-485c-931c-b8fc0cc54f0c req-e69713c4-bf05-483d-8205-fef3d407f0f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:40.087350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-119fc2bd-f607-485c-931c-b8fc0cc54f0c req-e69713c4-bf05-483d-8205-fef3d407f0f4 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:40.100602 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-119fc2bd-f607-485c-931c-b8fc0cc54f0c req-e69713c4-bf05-483d-8205-fef3d407f0f4 service nova] Creating event network-changed:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h1-master-1 Sep 25 02:22:40.106204 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-119fc2bd-f607-485c-931c-b8fc0cc54f0c req-e69713c4-bf05-483d-8205-fef3d407f0f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040176 Sep 25 02:22:40.107218 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3792/7556] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:22:40.110470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:22:40.194484 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3d7fe7c6-4c81-47b5-9440-5561a405172d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 204 len: 0 microversion: 2.1 time: 0.130157 Sep 25 02:22:40.195435 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3765/7557] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:22:40 2022] DELETE /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:22:40.204027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:40.204788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:40.216208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:40.216545 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:40.217168 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:40.218042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:40.218520 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:40.219512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:40.359557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:40.368264 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9126d23c-a4ac-4f5a-8bbb-25d6712f826d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1688 microversion: 2.1 time: 0.168520 Sep 25 02:22:40.368856 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3793/7558] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:40 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:41.392730 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:41.393461 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:41.401266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:41.401787 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:41.402229 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:41.402922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:41.403383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:41.403809 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:41.615185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:41.623016 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a56f814d-5430-472f-b28b-1924dd53a546 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 200 len: 1688 microversion: 2.1 time: 0.234607 Sep 25 02:22:41.623595 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3766/7559] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:41 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:42.467443 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-b6cae80e-a71c-4b29-81d6-beb90bc81cd5 req-bc7646f3-a5da-45cd-9f06-531f0c8924e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a00980-4709-42b0-90a9-ad0e804b7c01", "name": "network-vif-deleted", "tag": "72064d4d-39d7-4edd-822a-05cfbc14145d"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:42.477961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b6cae80e-a71c-4b29-81d6-beb90bc81cd5 req-bc7646f3-a5da-45cd-9f06-531f0c8924e0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:42.478464 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b6cae80e-a71c-4b29-81d6-beb90bc81cd5 req-bc7646f3-a5da-45cd-9f06-531f0c8924e0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:42.478918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-b6cae80e-a71c-4b29-81d6-beb90bc81cd5 req-bc7646f3-a5da-45cd-9f06-531f0c8924e0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:42.491809 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-b6cae80e-a71c-4b29-81d6-beb90bc81cd5 req-bc7646f3-a5da-45cd-9f06-531f0c8924e0 service nova] Creating event network-vif-deleted:72064d4d-39d7-4edd-822a-05cfbc14145d for instance 53a00980-4709-42b0-90a9-ad0e804b7c01 on n-h1-master-1 Sep 25 02:22:42.496686 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-b6cae80e-a71c-4b29-81d6-beb90bc81cd5 req-bc7646f3-a5da-45cd-9f06-531f0c8924e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096783 Sep 25 02:22:42.497296 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3794/7560] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:22:42.650837 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:42.651407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 53a00980-4709-42b0-90a9-ad0e804b7c01] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:42.658333 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:42.658816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:42.659250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:42.659944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:42.661920 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:42.662364 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:42.962118 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] HTTP exception thrown: Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 could not be found. Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Request method failure captured: Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 HTTP/1.1 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7oYOH5DvFC4Dd32o4-wMglRI5eEbLLMNRysTmR7OTDp_cMWRFFQPmJbSJTg9bEPKRXQG4oARq0tpDjqvaZUjKack-_Qfp1bg7wB8FN34ludiMlpJ534dsxgmAZoSXiVvRvMNzjAG650dGBDTznitA15rql5J_BkAmji6Nlram_aAUA Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c81a9610beb448de86effadb691910a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c81a9610beb448de86effadb691910a8"}]}] Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: fda050fca295403c8695da4b37062cd7 Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 could not be found. Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '53a00980-4709-42b0-90a9-ad0e804b7c01'} Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 could not be found. Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 could not be found. Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:22:42.963844 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 could not be found. Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Returning 404 to user: Instance 53a00980-4709-42b0-90a9-ad0e804b7c01 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d6f48b08-da96-4ee5-b8e7-4a4fb0ae2bcb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01" status: 404 len: 111 microversion: 2.1 time: 0.318576 Sep 25 02:22:42.968131 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3767/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:42 2022] GET /compute/v2.1/servers/53a00980-4709-42b0-90a9-ad0e804b7c01 => generated 111 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:22:46.284203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-90b8277e-dff8-49df-9e08-a64f79169c41 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '.version_select at 0x7f7bf3fb2280>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:46.290117 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90b8277e-dff8-49df-9e08-a64f79169c41 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:22:47.296976 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [None req-90b8277e-dff8-49df-9e08-a64f79169c41 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [c53e4f3e-a088-45e4-bafa-62a0011aa366] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51332. Sep 25 02:22:47.316115 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-90b8277e-dff8-49df-9e08-a64f79169c41 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1289118938" status: 202 len: 0 microversion: 2.1 time: 1.037163 Sep 25 02:22:47.317624 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3795/7562] 10.222.0.16 () {58 vars in 1284 bytes} [Sun Sep 25 02:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1289118938 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 02:22:47.344372 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d3db534-0b2d-4f80-8c36-9acfb98f4db6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: .version_select at 0x7f7bea63b670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1194996164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLociC350Zb4okVzIii8MU4W98hpUOfzLdGa0zUYv8Svn8Dol2+qeLWlix+ntX3k+sQiq2nEeHDhKqZ3SPNgh1BAs2TZL1R/HO0a6aRWiOeleKvLoSOMgAZgE3bTc9vCxA=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:47.361074 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1d3db534-0b2d-4f80-8c36-9acfb98f4db6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:22:47.366950 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-1d3db534-0b2d-4f80-8c36-9acfb98f4db6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:22:47.393584 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d3db534-0b2d-4f80-8c36-9acfb98f4db6 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053385 Sep 25 02:22:47.394186 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3768/7563] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:22:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:22:53.139599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1078530919", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "2f235794-3fd7-4339-b122-056bf6f0209f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1194996164", "security_groups": [{"name": "tempest-secgroup-smoke-383772719"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:53.155603 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=14 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:53.275731 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] validate_networks() for [('2f235794-3fd7-4339-b122-056bf6f0209f', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:22:53.763596 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:22:53.763981 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:22:53.764694 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:22:53.765164 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:22:53.765643 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:22:53.780280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:53.780892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:53.781475 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:53.782565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:53.783130 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:53.783722 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:53.804562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:22:53.810273 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:22:53.824722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:22:53.828530 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:22:53.880160 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-3ecf8a9c-314e-48f8-9a43-a0a2c98c2278 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744693 Sep 25 02:22:53.881143 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3796/7564] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:22:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:22:53.892086 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-db2de8d8-3922-4247-b47a-5e5d3f8dc8cb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:53.893373 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-db2de8d8-3922-4247-b47a-5e5d3f8dc8cb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:53.901073 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:22:53.969656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-db2de8d8-3922-4247-b47a-5e5d3f8dc8cb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:53.978970 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-db2de8d8-3922-4247-b47a-5e5d3f8dc8cb tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1267 microversion: 2.1 time: 0.090626 Sep 25 02:22:53.993431 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3769/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:53 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:55.007401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:55.008109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:55.015554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:55.016290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:55.017166 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:55.019262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:55.020622 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:55.021260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:55.117019 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:55.127212 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f37dceb6-d8a3-4c66-b381-dcf34d391d6a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1319 microversion: 2.1 time: 0.126576 Sep 25 02:22:55.127809 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3797/7566] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:54 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1319 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:56.158527 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:56.161684 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:56.171605 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:56.172575 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:56.173256 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:56.174282 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:56.175043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:56.176227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:56.341240 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:56.361820 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4ab10507-8e65-44b7-be90-0a500823f0d5 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.213287 Sep 25 02:22:56.363572 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3770/7567] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:56 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:56.907708 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-c768d51a-bd84-4934-80a3-33c3ec74f854 req-98438da3-f63b-47f7-b8ea-78ac73de36ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d634bc7-38e6-4238-8592-860bc2966319", "tag": "0b2be173-6884-47a6-aa8e-63e7fe8545dd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:22:56.919072 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c768d51a-bd84-4934-80a3-33c3ec74f854 req-98438da3-f63b-47f7-b8ea-78ac73de36ce service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:56.919883 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c768d51a-bd84-4934-80a3-33c3ec74f854 req-98438da3-f63b-47f7-b8ea-78ac73de36ce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:56.920287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-c768d51a-bd84-4934-80a3-33c3ec74f854 req-98438da3-f63b-47f7-b8ea-78ac73de36ce service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:56.932832 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-c768d51a-bd84-4934-80a3-33c3ec74f854 req-98438da3-f63b-47f7-b8ea-78ac73de36ce service nova] Creating event network-changed:0b2be173-6884-47a6-aa8e-63e7fe8545dd for instance 2d634bc7-38e6-4238-8592-860bc2966319 on n-h1-master-1 Sep 25 02:22:56.937863 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-c768d51a-bd84-4934-80a3-33c3ec74f854 req-98438da3-f63b-47f7-b8ea-78ac73de36ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Sep 25 02:22:56.938467 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3798/7568] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:22:57.386100 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:57.387423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:57.395685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:57.396176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:57.396614 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:57.397358 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:57.397837 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:57.398266 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:57.534144 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:57.542894 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb5d43aa-07a2-443d-a1a0-867ee7f46852 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.160864 Sep 25 02:22:57.543462 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3771/7569] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:57 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:58.568998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:58.569736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:58.575988 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:58.576492 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:58.576941 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:58.577683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:58.578153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:58.578592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:58.714668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:58.723322 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-32df06e6-6efb-4d85-834f-8f354e976c67 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.160455 Sep 25 02:22:58.724111 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3799/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:58 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:22:59.747412 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:22:59.747970 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:22:59.755623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:59.756113 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:59.756551 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:59.757244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:22:59.757734 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:22:59.758165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:22:59.888342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:22:59.897095 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd117d03-8be5-42c4-9571-d7bbf7d28e62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.153688 Sep 25 02:22:59.897740 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3772/7571] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:22:59 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:00.920289 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:00.920845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:00.928159 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:00.928657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:00.929111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:00.930016 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:00.930302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:00.930742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:01.067450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:01.075735 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9999ca50-6388-4b9b-8084-0d1ea17658b7 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.159415 Sep 25 02:23:01.076317 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3800/7572] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:00 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:02.100705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:02.101454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:02.108305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:02.108792 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:02.109234 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:02.109959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:02.110419 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:02.110847 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:02.240385 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:02.248196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c55f9525-a9ba-444f-9e20-ec45ff99e2f0 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.152266 Sep 25 02:23:02.248775 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3773/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:02 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:02.883701 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7cec68dc-a3e0-4680-a8ef-4f0da72d8ae8 req-d520f1a7-7e63-4c9b-88e9-d0a59ff8f2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d634bc7-38e6-4238-8592-860bc2966319", "name": "network-vif-plugged", "status": "completed", "tag": "0b2be173-6884-47a6-aa8e-63e7fe8545dd"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:23:02.889080 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:02.900060 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7cec68dc-a3e0-4680-a8ef-4f0da72d8ae8 req-d520f1a7-7e63-4c9b-88e9-d0a59ff8f2b7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:02.900566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7cec68dc-a3e0-4680-a8ef-4f0da72d8ae8 req-d520f1a7-7e63-4c9b-88e9-d0a59ff8f2b7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:02.901023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7cec68dc-a3e0-4680-a8ef-4f0da72d8ae8 req-d520f1a7-7e63-4c9b-88e9-d0a59ff8f2b7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:02.912424 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-7cec68dc-a3e0-4680-a8ef-4f0da72d8ae8 req-d520f1a7-7e63-4c9b-88e9-d0a59ff8f2b7 service nova] Creating event network-vif-plugged:0b2be173-6884-47a6-aa8e-63e7fe8545dd for instance 2d634bc7-38e6-4238-8592-860bc2966319 on n-h1-master-1 Sep 25 02:23:02.917768 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7cec68dc-a3e0-4680-a8ef-4f0da72d8ae8 req-d520f1a7-7e63-4c9b-88e9-d0a59ff8f2b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092887 Sep 25 02:23:02.918371 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3801/7574] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:23:03.272025 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:03.272647 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:03.279486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:03.279972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:03.280411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:03.281105 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:03.281593 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:03.282021 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:03.712638 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:03.720387 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f448c55e-f7ef-48c2-ba3b-85ef750e510b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1392 microversion: 2.1 time: 0.452316 Sep 25 02:23:03.720969 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3774/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:03 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1392 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:04.741436 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:04.742193 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:04.747681 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:04.748410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:04.756150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:04.756657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:04.757129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:04.757863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:04.758348 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:04.758795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:04.888082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:04.896597 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a5e4e106-2cbe-4de4-9ee2-dade741c3b17 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1564 microversion: 2.1 time: 0.156230 Sep 25 02:23:04.897175 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3802/7576] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:04 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:04.919622 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:04.920246 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:04.922190 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:04.928494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:04.928983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:04.929445 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:04.930143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:04.930602 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:04.931031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:05.070903 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:05.078651 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ad76336-205e-4074-b075-17d81f15c9af tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1564 microversion: 2.1 time: 0.162890 Sep 25 02:23:05.079251 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3775/7577] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:04 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:06.675528 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:06.681556 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-c9c25eae-866a-4ae5-bcc9-947bb3832a6f req-4e7ed0ab-677d-4d5a-9f6c-73d21dc98ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d634bc7-38e6-4238-8592-860bc2966319", "tag": "0b2be173-6884-47a6-aa8e-63e7fe8545dd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:23:06.682709 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:06.696872 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c9c25eae-866a-4ae5-bcc9-947bb3832a6f req-4e7ed0ab-677d-4d5a-9f6c-73d21dc98ae7 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:06.697350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:06.697510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c9c25eae-866a-4ae5-bcc9-947bb3832a6f req-4e7ed0ab-677d-4d5a-9f6c-73d21dc98ae7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:06.698019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-c9c25eae-866a-4ae5-bcc9-947bb3832a6f req-4e7ed0ab-677d-4d5a-9f6c-73d21dc98ae7 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:06.698194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:06.698663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:06.699526 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:06.700087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:06.700610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:06.710665 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-c9c25eae-866a-4ae5-bcc9-947bb3832a6f req-4e7ed0ab-677d-4d5a-9f6c-73d21dc98ae7 service nova] Creating event network-changed:0b2be173-6884-47a6-aa8e-63e7fe8545dd for instance 2d634bc7-38e6-4238-8592-860bc2966319 on n-h1-master-1 Sep 25 02:23:06.715918 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-c9c25eae-866a-4ae5-bcc9-947bb3832a6f req-4e7ed0ab-677d-4d5a-9f6c-73d21dc98ae7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038909 Sep 25 02:23:06.716688 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3776/7578] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:23:06.852699 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:06.861911 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5905ad19-fb66-4c8b-89c3-2a37948ce899 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1564 microversion: 2.1 time: 0.190396 Sep 25 02:23:06.877711 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3803/7579] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:06 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:30.111092 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:30.111870 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=38 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:30.116563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:23:30.119491 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:30.127048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:30.127535 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:30.127975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:30.128673 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:30.129237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:30.129691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:30.198117 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ce8a3089-1eb4-4710-8989-7d509e34fb53 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action" status: 200 len: 24570 microversion: 2.1 time: 0.088743 Sep 25 02:23:30.198775 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3777/7580] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:23:30 2022] POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action => generated 24570 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:23:41.287542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ca29c8d7-628b-471f-852d-bd863e2f1b1f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:23:41.290714 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:41.291379 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=36 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:41.298339 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca29c8d7-628b-471f-852d-bd863e2f1b1f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:41.298848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca29c8d7-628b-471f-852d-bd863e2f1b1f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:41.299310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-ca29c8d7-628b-471f-852d-bd863e2f1b1f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:41.321980 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ca29c8d7-628b-471f-852d-bd863e2f1b1f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Going to try to stop instance {{(pid=122385) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 02:23:41.364229 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ca29c8d7-628b-471f-852d-bd863e2f1b1f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action" status: 202 len: 0 microversion: 2.1 time: 0.080700 Sep 25 02:23:41.365015 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3804/7581] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:23:41 2022] POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:23:41.375092 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:41.375955 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:41.379179 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:41.380193 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:23:41.386540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:41.387045 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:41.387491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:41.388290 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:41.388784 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:41.389236 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:41.524726 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:41.532389 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d1a53911-3c3b-44ab-819a-4d2487c34b70 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.161613 Sep 25 02:23:41.532951 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3778/7582] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:41 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:42.557845 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:42.558565 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:42.564745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:42.565249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:42.565739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:42.566450 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:42.566927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:42.567371 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:42.704070 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:42.712388 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f8bc54be-7a44-4c3d-bf6b-676a118189f2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.159988 Sep 25 02:23:42.712962 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3805/7583] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:42 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:43.736231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:43.736772 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:43.746125 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:43.746603 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:43.747034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:43.747717 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:43.748165 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:43.748594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:43.878221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:43.886436 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee5d657a-6fa0-4214-967c-98098fbe6a74 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.154289 Sep 25 02:23:43.887015 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3779/7584] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:43 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:44.909985 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:44.910617 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:44.917808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:44.918305 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:44.918760 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:44.919466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:44.919939 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:44.920377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:45.057728 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:45.066742 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-710aa6e4-d519-424b-8cc6-e7b842d0e34f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.160450 Sep 25 02:23:45.067800 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3806/7585] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:44 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:46.091410 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:46.092038 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:46.098563 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:46.099029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:46.099468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:46.100155 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:46.100670 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:46.101518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:46.231419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:46.239139 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e0361037-e154-4c53-b9ce-5425c15adfaa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.151796 Sep 25 02:23:46.239708 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3780/7586] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:46 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:47.264403 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:47.264979 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:47.271529 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:47.272034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:47.272530 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:47.273255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:47.273770 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:47.274222 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:47.408475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:47.417218 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4b82379a-2671-4c26-940f-4cfcd3247776 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.157046 Sep 25 02:23:47.417825 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3807/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:47 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:48.441895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:48.442549 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:48.449641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:48.450177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:48.450766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:48.451514 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:48.451981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:48.452637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:48.589097 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:48.597007 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0742581b-9d25-4389-8e32-642ed1a7b91f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.159056 Sep 25 02:23:48.597656 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3781/7588] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:48 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:49.621127 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:49.621785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:49.628585 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:49.629085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:49.629573 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:49.630278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:49.630752 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:49.631196 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:49.761265 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:49.769024 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d3f1e014-d5a4-443f-8d17-400458e42d50 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.152634 Sep 25 02:23:49.769634 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3808/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:49 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:50.793040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:50.793715 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:50.800420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:50.800900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:50.801336 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:50.802049 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:50.802504 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:50.802925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:50.937035 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:50.945170 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c2c1b9ce-d64f-4a2f-9f1a-a5b5bac1f972 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.156157 Sep 25 02:23:50.945776 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3782/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:50 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:51.970736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:51.971410 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:51.979618 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:51.980129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:51.980595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:51.981319 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:51.981892 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:51.982351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:52.112013 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:52.120483 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0c706df8-0a96-4b28-8994-e182fc517e30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.154040 Sep 25 02:23:52.121061 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3809/7591] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:51 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:53.144233 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:53.144852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:53.152880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:53.153396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:53.153860 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:53.154608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:53.155065 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:53.155515 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:53.294152 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:53.301937 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8856c384-7d90-4723-86b4-a5fb77eb88e4 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.161718 Sep 25 02:23:53.302494 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3783/7592] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:53 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:54.326327 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:54.326974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:54.333448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:54.333963 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:54.334429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:54.335817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:54.336302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:54.336754 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:54.472346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:54.480319 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2fd7b765-56ef-41d9-bcfb-da4c358d7769 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.158148 Sep 25 02:23:54.480890 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3810/7593] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:54 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:55.504700 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:55.505242 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:55.512305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:55.512781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:55.513213 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:55.513917 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:55.514370 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:55.514790 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:55.643948 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:55.651951 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c602cb3-f67b-4a34-9362-31b698a9e073 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.151260 Sep 25 02:23:55.652532 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3784/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:55 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:56.676330 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:56.676871 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:56.684295 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:56.684797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:56.685265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:56.686023 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:56.687280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:56.687280 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:56.821141 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:56.828913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69ff688a-cd62-427a-b457-2ad33c9e2c12 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1692 microversion: 2.1 time: 0.156707 Sep 25 02:23:56.829498 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3811/7595] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:56 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:57.853629 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:57.854245 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:57.861131 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:57.861633 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:57.862069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:57.862752 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:57.863198 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:57.863621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:57.995522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:58.003290 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a10e21d7-764d-498e-84b1-7b2f6190ec68 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1669 microversion: 2.1 time: 0.154387 Sep 25 02:23:58.003862 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3785/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:57 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:23:59.103896 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:23:59.106271 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:59.113223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:59.113771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:59.114234 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:59.114943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:59.115416 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:59.115904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:59.188865 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-601e5ad5-19f8-4593-aad9-809390f92d78 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action" status: 200 len: 38422 microversion: 2.1 time: 0.089493 Sep 25 02:23:59.189805 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3812/7597] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:23:59 2022] POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action => generated 38422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 02:23:59.201501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e8b12fe2-243c-4108-a7b7-61fbc4d61d85 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:23:59.208407 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8b12fe2-243c-4108-a7b7-61fbc4d61d85 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:59.208894 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8b12fe2-243c-4108-a7b7-61fbc4d61d85 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:59.209338 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e8b12fe2-243c-4108-a7b7-61fbc4d61d85 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:59.233263 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e8b12fe2-243c-4108-a7b7-61fbc4d61d85 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Going to try to start instance {{(pid=122384) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 02:23:59.274258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e8b12fe2-243c-4108-a7b7-61fbc4d61d85 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action" status: 202 len: 0 microversion: 2.1 time: 0.076563 Sep 25 02:23:59.274891 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3786/7598] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:23:59 2022] POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:23:59.284125 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:23:59.284865 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:23:59.293307 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:59.293848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:59.294318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:59.295076 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:23:59.295556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:23:59.296078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:23:59.443540 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:23:59.452148 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2dd89aea-7c07-4d60-b481-5446989b8bab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1678 microversion: 2.1 time: 0.172618 Sep 25 02:23:59.452734 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3813/7599] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:23:59 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:00.477447 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:00.478170 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:00.485523 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:00.486022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:00.486462 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:00.487169 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:00.487626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:00.488057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:00.629281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:00.637371 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-738a39e7-9d77-40fd-bbf1-b9ac2e37a586 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1678 microversion: 2.1 time: 0.164914 Sep 25 02:24:00.637986 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3787/7600] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:00 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:01.663064 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:01.663912 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:01.670759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:01.671264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:01.671729 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:01.672452 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:01.672925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:01.673374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:01.805163 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:01.813053 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a34ceb9e-66aa-43dd-bb1e-887c2b82b80e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1682 microversion: 2.1 time: 0.154165 Sep 25 02:24:01.813665 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3814/7601] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:01 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:26.012318 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:26.014557 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:26.017961 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=20 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:26.018824 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:26.024628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:26.025107 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:26.025607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:26.026319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:26.026777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:26.027208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:26.104467 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61a57113-e112-4b2a-a0ff-21169172e26f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action" status: 200 len: 62988 microversion: 2.1 time: 0.096799 Sep 25 02:24:26.105142 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3788/7602] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:24:26 2022] POST /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319/action => generated 62988 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:24:33.501675 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:33.507677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-3af8964b-aa95-482c-9dc7-2d6f68a6a7e3 req-37a9bf38-093b-46ed-b2ca-b69c86a8512e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d634bc7-38e6-4238-8592-860bc2966319", "tag": "0b2be173-6884-47a6-aa8e-63e7fe8545dd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:33.508350 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:33.515450 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=22 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:33.516279 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:33.529960 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3af8964b-aa95-482c-9dc7-2d6f68a6a7e3 req-37a9bf38-093b-46ed-b2ca-b69c86a8512e service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:33.530434 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3af8964b-aa95-482c-9dc7-2d6f68a6a7e3 req-37a9bf38-093b-46ed-b2ca-b69c86a8512e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:33.530866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-3af8964b-aa95-482c-9dc7-2d6f68a6a7e3 req-37a9bf38-093b-46ed-b2ca-b69c86a8512e service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:33.538628 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:33.539153 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:33.540349 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:33.541088 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:33.541598 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:33.542049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:33.552934 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-3af8964b-aa95-482c-9dc7-2d6f68a6a7e3 req-37a9bf38-093b-46ed-b2ca-b69c86a8512e service nova] Creating event network-changed:0b2be173-6884-47a6-aa8e-63e7fe8545dd for instance 2d634bc7-38e6-4238-8592-860bc2966319 on n-h1-master-1 Sep 25 02:24:33.558198 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-3af8964b-aa95-482c-9dc7-2d6f68a6a7e3 req-37a9bf38-093b-46ed-b2ca-b69c86a8512e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054637 Sep 25 02:24:33.559016 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3789/7603] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:24:33.572304 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:24:33.658953 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31ba2df4-e728-49c4-bdee-f56fe138f939 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 204 len: 0 microversion: 2.1 time: 0.160687 Sep 25 02:24:33.659706 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3815/7604] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:24:33 2022] DELETE /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:24:33.669012 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:33.669865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:33.676879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:33.677491 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:33.678029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:33.678926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:33.679473 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:33.681378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:33.883353 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:33.891498 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f2591fc0-e0cd-448c-8a08-49366cbb0d1e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1688 microversion: 2.1 time: 0.226718 Sep 25 02:24:33.892426 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3790/7605] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:33 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:24:34.916388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:34.917120 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:34.924065 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:34.924569 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:34.925034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:34.925775 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:34.926256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:34.926706 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:35.066037 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:35.075899 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-56051a37-3d2d-4115-bf0f-0111ebe10e6d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1688 microversion: 2.1 time: 0.164428 Sep 25 02:24:35.076481 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3816/7606] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:34 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:35.941603 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-bdb87b07-1c73-4d72-8922-560c2b542355 req-c602244e-68f9-4552-9faa-2b40ec38c91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d634bc7-38e6-4238-8592-860bc2966319", "name": "network-vif-deleted", "tag": "0b2be173-6884-47a6-aa8e-63e7fe8545dd"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:35.952421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bdb87b07-1c73-4d72-8922-560c2b542355 req-c602244e-68f9-4552-9faa-2b40ec38c91a service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:35.952906 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bdb87b07-1c73-4d72-8922-560c2b542355 req-c602244e-68f9-4552-9faa-2b40ec38c91a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:35.953343 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-bdb87b07-1c73-4d72-8922-560c2b542355 req-c602244e-68f9-4552-9faa-2b40ec38c91a service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:35.966230 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-bdb87b07-1c73-4d72-8922-560c2b542355 req-c602244e-68f9-4552-9faa-2b40ec38c91a service nova] Creating event network-vif-deleted:0b2be173-6884-47a6-aa8e-63e7fe8545dd for instance 2d634bc7-38e6-4238-8592-860bc2966319 on n-h1-master-1 Sep 25 02:24:35.971658 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-bdb87b07-1c73-4d72-8922-560c2b542355 req-c602244e-68f9-4552-9faa-2b40ec38c91a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Sep 25 02:24:35.972597 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3791/7607] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:24:36.099609 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:36.100172 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:36.107461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:36.108067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:36.108512 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:36.109265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:36.109776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:36.110292 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:36.142610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:36.143112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:36.143577 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:36.144046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lazy-loading 'fault' on Instance uuid 2d634bc7-38e6-4238-8592-860bc2966319 {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:24:36.189516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:36.198030 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-212281a5-7733-4a49-80e2-3726c42bf7ab tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 200 len: 1357 microversion: 2.1 time: 0.102471 Sep 25 02:24:36.198604 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3817/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:36 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:37.222321 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:37.222984 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 2d634bc7-38e6-4238-8592-860bc2966319] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:37.230051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:37.230526 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:37.230959 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:37.231642 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:37.232093 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:37.232518 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:37.245886 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] HTTP exception thrown: Instance 2d634bc7-38e6-4238-8592-860bc2966319 could not be found. Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Request method failure captured: Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 HTTP/1.1 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL7oYOH5DvFC4Dd32o4-wMglRI5eEbLLMNRysTmR7OTDp_cMWRFFQPmJbSJTg9bEPKRXQG4oARq0tpDjqvaZUjKack-_Qfp1bg7wB8FN34ludiMlpJ534dsxgmAZoSXiVvRvMNzjAG650dGBDTznitA15rql5J_BkAmji6Nlram_aAUA Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c81a9610beb448de86effadb691910a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c81a9610beb448de86effadb691910a8"}]}] Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: fda050fca295403c8695da4b37062cd7 Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 2d634bc7-38e6-4238-8592-860bc2966319 could not be found. Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '2d634bc7-38e6-4238-8592-860bc2966319'} Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d634bc7-38e6-4238-8592-860bc2966319 could not be found. Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d634bc7-38e6-4238-8592-860bc2966319 could not be found. Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:24:37.247501 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d634bc7-38e6-4238-8592-860bc2966319 could not be found. Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Returning 404 to user: Instance 2d634bc7-38e6-4238-8592-860bc2966319 could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-096660e4-f8e1-4b1a-bf0f-6df22085f9d2 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319" status: 404 len: 111 microversion: 2.1 time: 0.031847 Sep 25 02:24:37.252436 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3792/7609] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:37 2022] GET /compute/v2.1/servers/2d634bc7-38e6-4238-8592-860bc2966319 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:24:40.498380 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0654fb90-7bac-44c6-9f26-e9aa3e493826 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '.version_select at 0x7f7bf04c8d30>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:40.524629 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0654fb90-7bac-44c6-9f26-e9aa3e493826 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1194996164" status: 202 len: 0 microversion: 2.1 time: 0.033733 Sep 25 02:24:40.525799 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3818/7610] 10.222.0.16 () {58 vars in 1284 bytes} [Sun Sep 25 02:24:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1194996164 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:24:40.562590 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-0c0f29d4-c322-4e3e-b1af-7a6447f49f83 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: .version_select at 0x7f7bebce6670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-537711628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9xASIDenxRLjz5+P8QRNgd2oVFBYKREv6TM25dwICrEZvQH9LadUF/OaLKXEUlv175rMJeVqCgMSHrq4KhzDFuVYecoaA3JHq9Z9FEHYn43UuAw2SOiINlpqNj4jNsDw=="}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:40.579528 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0c0f29d4-c322-4e3e-b1af-7a6447f49f83 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:24:40.584763 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-0c0f29d4-c322-4e3e-b1af-7a6447f49f83 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'key_pairs'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:24:40.608509 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-0c0f29d4-c322-4e3e-b1af-7a6447f49f83 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050789 Sep 25 02:24:40.609111 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3793/7611] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:24:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:24:45.991502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1172716000", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "networks": [{"uuid": "7d88dc31-ca99-4fc8-b4b0-4d5fc4c73ead"}], "key_name": "tempest-TestNetworkAdvancedServerOps-537711628", "security_groups": [{"name": "tempest-secgroup-smoke-1385492172"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:46.194357 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:46.249241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] validate_networks() for [('7d88dc31-ca99-4fc8-b4b0-4d5fc4c73ead', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:24:46.687847 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:24:46.688413 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:24:46.689024 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:24:46.689597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:24:46.690116 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:24:46.700036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:46.700534 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:46.700998 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:46.701809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:46.702290 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:46.702742 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:46.722497 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:24:46.728621 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Getting quotas for user fda050fca295403c8695da4b37062cd7 and project c81a9610beb448de86effadb691910a8. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:24:46.743396 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:24:46.745843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:24:46.801267 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b5e27d2b-6ca5-40b6-b75a-9d07a58da9fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813976 Sep 25 02:24:46.802582 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3819/7612] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:24:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:24:46.815819 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-128c067a-97c7-42db-be9a-e5abe8bf8056 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:46.816469 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-128c067a-97c7-42db-be9a-e5abe8bf8056 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:46.883486 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-128c067a-97c7-42db-be9a-e5abe8bf8056 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:46.891883 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-128c067a-97c7-42db-be9a-e5abe8bf8056 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1266 microversion: 2.1 time: 0.080438 Sep 25 02:24:46.892506 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3794/7613] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:46 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:24:47.920851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:47.921674 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:47.928486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:47.928995 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:47.930591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:47.931816 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:47.932448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:47.932943 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:48.009926 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:48.018404 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-e5e6a2a5-d4e2-4694-9495-1667079f8f36 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1326 microversion: 2.1 time: 0.102429 Sep 25 02:24:48.029499 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3820/7614] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:47 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:49.043682 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:49.044307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:49.046595 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=16 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:49.062352 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:49.062983 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:49.063277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:49.063981 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:49.064440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:49.064871 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:49.289453 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:49.302382 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d31c9e92-128c-46c9-866a-f55096e76f30 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1392 microversion: 2.1 time: 0.262599 Sep 25 02:24:49.318644 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3795/7615] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:49 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:49.871298 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-98cc9ffc-2ec2-4c94-b776-79420bb7976f req-0585d0c5-c19a-452c-b059-946a9cdd56a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473935f3-f967-47cf-8294-e8bc5bfebb05", "tag": "edc04e64-d83b-4247-ac3f-9a1d52a0429c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:49.884208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-98cc9ffc-2ec2-4c94-b776-79420bb7976f req-0585d0c5-c19a-452c-b059-946a9cdd56a1 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:49.884707 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-98cc9ffc-2ec2-4c94-b776-79420bb7976f req-0585d0c5-c19a-452c-b059-946a9cdd56a1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:49.885195 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-98cc9ffc-2ec2-4c94-b776-79420bb7976f req-0585d0c5-c19a-452c-b059-946a9cdd56a1 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:49.896748 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-98cc9ffc-2ec2-4c94-b776-79420bb7976f req-0585d0c5-c19a-452c-b059-946a9cdd56a1 service nova] Creating event network-changed:edc04e64-d83b-4247-ac3f-9a1d52a0429c for instance 473935f3-f967-47cf-8294-e8bc5bfebb05 on n-h2-master-1 Sep 25 02:24:49.901988 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-98cc9ffc-2ec2-4c94-b776-79420bb7976f req-0585d0c5-c19a-452c-b059-946a9cdd56a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035135 Sep 25 02:24:49.902650 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3821/7616] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:24:50.332179 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:50.333213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:50.340411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:50.340902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:50.341455 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:50.342167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:50.342628 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:50.343062 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:50.474836 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:50.483350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-32a71870-6032-4c9b-a961-9d8d76dd2b92 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1392 microversion: 2.1 time: 0.156558 Sep 25 02:24:50.483925 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3796/7617] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:50 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:51.508782 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:51.509575 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:51.515843 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:51.516352 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:51.516817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:51.517561 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:51.518041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:51.518491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:51.653480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:51.661814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-786cb873-1482-4df8-8882-7dc3972a6927 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1392 microversion: 2.1 time: 0.158213 Sep 25 02:24:51.662388 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3822/7618] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:51 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:52.685896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:52.686520 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:52.693380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:52.694329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:52.694329 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:52.695576 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:52.696250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:52.696704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:52.833707 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:52.841600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ef9339f-c1e1-4dd0-abd3-df8e6514664b tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1392 microversion: 2.1 time: 0.159724 Sep 25 02:24:52.842192 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3797/7619] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:52 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:53.865310 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:53.865989 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:53.873589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:53.874087 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:53.874546 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:53.875250 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:53.875717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:53.876158 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:54.011891 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:54.019769 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-595eda93-8f17-458c-9074-85ba7cd7bbd9 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1392 microversion: 2.1 time: 0.158377 Sep 25 02:24:54.020357 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3823/7620] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:53 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:54.144376 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-a4105d5c-7bed-4656-a539-581671536a7b req-eadb15b2-8342-4bfd-b40f-b5e51cd6dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473935f3-f967-47cf-8294-e8bc5bfebb05", "name": "network-vif-plugged", "status": "completed", "tag": "edc04e64-d83b-4247-ac3f-9a1d52a0429c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:54.155465 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a4105d5c-7bed-4656-a539-581671536a7b req-eadb15b2-8342-4bfd-b40f-b5e51cd6dbc5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:54.156068 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a4105d5c-7bed-4656-a539-581671536a7b req-eadb15b2-8342-4bfd-b40f-b5e51cd6dbc5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:54.156567 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-a4105d5c-7bed-4656-a539-581671536a7b req-eadb15b2-8342-4bfd-b40f-b5e51cd6dbc5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:54.170843 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-a4105d5c-7bed-4656-a539-581671536a7b req-eadb15b2-8342-4bfd-b40f-b5e51cd6dbc5 service nova] Creating event network-vif-plugged:edc04e64-d83b-4247-ac3f-9a1d52a0429c for instance 473935f3-f967-47cf-8294-e8bc5bfebb05 on n-h2-master-1 Sep 25 02:24:54.176755 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-a4105d5c-7bed-4656-a539-581671536a7b req-eadb15b2-8342-4bfd-b40f-b5e51cd6dbc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Sep 25 02:24:54.177969 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3798/7621] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:24:55.043616 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:55.044280 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:55.051063 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:55.051633 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:55.052090 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:55.052794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:55.053265 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:55.053739 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:55.186785 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:55.194490 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4a61ad75-a35b-4148-b975-077ffc9d7d3d tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1392 microversion: 2.1 time: 0.155844 Sep 25 02:24:55.195203 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3824/7622] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:55 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:56.218641 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:56.219356 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:56.221314 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:56.227475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:56.227977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:56.228424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:56.229133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:56.229620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:56.230044 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:56.362166 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:56.371074 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5f54e92d-e083-41d3-a251-00f99bdf39b3 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1564 microversion: 2.1 time: 0.157667 Sep 25 02:24:56.371662 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3799/7623] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:56 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:56.394238 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:56.394877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:56.402149 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:56.402660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:56.403118 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:56.403835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:56.404363 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:56.404744 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:56.543255 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:56.551268 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2ba0ca70-1ce8-4220-8d22-21838a3086ca tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1564 microversion: 2.1 time: 0.160894 Sep 25 02:24:56.552016 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3825/7624] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:56 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:24:58.425974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-e1a9a93d-4dcc-45ff-90fe-660f45b6defd req-a3c0bcf2-a7bc-4505-b0ec-2ab919fd441b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473935f3-f967-47cf-8294-e8bc5bfebb05", "tag": "edc04e64-d83b-4247-ac3f-9a1d52a0429c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:24:58.426656 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:24:58.427157 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:24:58.429647 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:58.431728 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:58.432634 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:24:58.437334 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:58.437858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:58.438296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:58.439031 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:58.439664 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:58.440099 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:58.441223 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e1a9a93d-4dcc-45ff-90fe-660f45b6defd req-a3c0bcf2-a7bc-4505-b0ec-2ab919fd441b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:24:58.441982 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e1a9a93d-4dcc-45ff-90fe-660f45b6defd req-a3c0bcf2-a7bc-4505-b0ec-2ab919fd441b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:24:58.442441 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-e1a9a93d-4dcc-45ff-90fe-660f45b6defd req-a3c0bcf2-a7bc-4505-b0ec-2ab919fd441b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:24:58.455088 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-e1a9a93d-4dcc-45ff-90fe-660f45b6defd req-a3c0bcf2-a7bc-4505-b0ec-2ab919fd441b service nova] Creating event network-changed:edc04e64-d83b-4247-ac3f-9a1d52a0429c for instance 473935f3-f967-47cf-8294-e8bc5bfebb05 on n-h2-master-1 Sep 25 02:24:58.460537 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-e1a9a93d-4dcc-45ff-90fe-660f45b6defd req-a3c0bcf2-a7bc-4505-b0ec-2ab919fd441b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038032 Sep 25 02:24:58.461136 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3826/7625] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:24:58.589709 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:24:58.597701 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-43071bb1-624d-4d37-a9e3-373522a57e25 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1564 microversion: 2.1 time: 0.179443 Sep 25 02:24:58.598285 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3800/7626] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:24:58 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:25:29.892791 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:25:29.893676 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=36 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:25:29.899097 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:25:29.901637 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:25:29.910426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:25:29.910924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:25:29.911379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:25:29.912085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:25:29.912554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:25:29.913000 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:25:29.984501 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-36a4fd29-244d-4868-91af-49fdc28bcc55 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action" status: 200 len: 24561 microversion: 2.1 time: 0.093610 Sep 25 02:25:29.985446 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3827/7627] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:25:29 2022] POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action => generated 24561 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:26:00.389849 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:00.390928 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:00.395808 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:00.396359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:00.403589 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:00.404075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:00.404517 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:00.405208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:00.405695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:00.406129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:00.430082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lazy-loading 'flavor' on Instance uuid 473935f3-f967-47cf-8294-e8bc5bfebb05 {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:26:00.496111 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-debd9d2b-90e7-4047-b208-ef2ae2077be1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action" status: 202 len: 0 microversion: 2.1 time: 0.107864 Sep 25 02:26:00.499573 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3801/7628] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:26:00 2022] POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:26:00.505718 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:00.506557 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:00.510122 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:00.510837 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:00.516473 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:00.516984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:00.517466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:00.518189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:00.518662 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:00.519104 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:00.653226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:00.661068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d6fd8fbe-5dc5-41bb-959b-6ab5fcb7b0da tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1691 microversion: 2.1 time: 0.159790 Sep 25 02:26:00.661679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3828/7629] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:00 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:26:01.687191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:01.687886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:01.695020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:01.695654 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:01.696101 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:01.696803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:01.697262 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:01.697729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:01.835188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:01.843132 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e2b1a55e-e55f-4947-9a08-51a0d72270b1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1691 microversion: 2.1 time: 0.161469 Sep 25 02:26:01.843711 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3802/7630] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:01 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:02.868003 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:02.868639 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:02.875613 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:02.876115 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:02.876575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:02.877287 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:02.877797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:02.878245 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:03.012441 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:03.020484 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b98493dd-d427-495e-aa51-14c83971bace tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1674 microversion: 2.1 time: 0.156527 Sep 25 02:26:03.021070 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3829/7631] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:02 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:26:04.118548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:04.120758 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:04.127562 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:04.128047 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:04.128488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:04.129183 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:04.129667 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:04.130094 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:04.192196 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c20227e0-9b89-458e-b093-6e74bb4f534f tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action" status: 200 len: 38291 microversion: 2.1 time: 0.077804 Sep 25 02:26:04.192835 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3803/7632] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:26:04 2022] POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action => generated 38291 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:26:04.204790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:04.205353 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:04.212815 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:04.213317 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:04.213804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:04.214513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:04.214984 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:04.215429 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:04.281316 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54f06d70-8f15-456f-a333-1c6f21f9aa3e tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action" status: 202 len: 0 microversion: 2.1 time: 0.079701 Sep 25 02:26:04.281954 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3830/7633] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:26:04 2022] POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:26:04.291972 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:04.292672 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:04.301124 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:04.301634 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:04.302375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:04.303071 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:04.303522 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:04.303944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:04.447952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:04.455749 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c8201204-6038-46ef-b623-7549c08eda5c tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1680 microversion: 2.1 time: 0.168828 Sep 25 02:26:04.456318 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3804/7634] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:04 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:05.480555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:05.481288 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:05.488399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:05.488905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:05.489368 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:05.490113 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:05.490603 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:05.491049 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:05.625278 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:05.634200 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eb5615d9-2535-49f4-bd50-31b63a0ab3de tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1680 microversion: 2.1 time: 0.157703 Sep 25 02:26:05.634781 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3831/7635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:05 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:06.658148 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:06.658706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:06.666986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:06.667477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:06.667919 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:06.668621 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:06.669075 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:06.669530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:06.798908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:06.806835 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9f29a0af-b484-4326-8204-20f237960323 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1683 microversion: 2.1 time: 0.152740 Sep 25 02:26:06.807407 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3805/7636] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:06 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:06.904682 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:06.906970 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:06.914700 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:06.915117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:06.915575 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:06.916288 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:06.916761 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:06.917205 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:06.979716 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eaef3ed8-307c-44ba-93e8-a58c1de816fa tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action" status: 200 len: 38291 microversion: 2.1 time: 0.078858 Sep 25 02:26:06.980369 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3832/7637] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:26:06 2022] POST /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05/action => generated 38291 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 02:26:07.957359 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:07.957882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:07.971630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:07.972128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:07.972581 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:07.973296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:07.973789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:07.974245 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:08.004865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:26:08.014770 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-dc2d9b45-be55-4555-9edc-adeb06fe73ac req-e2097852-cea8-48db-bb14-76047356ac07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473935f3-f967-47cf-8294-e8bc5bfebb05", "tag": "edc04e64-d83b-4247-ac3f-9a1d52a0429c"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:08.026052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dc2d9b45-be55-4555-9edc-adeb06fe73ac req-e2097852-cea8-48db-bb14-76047356ac07 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:08.026934 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dc2d9b45-be55-4555-9edc-adeb06fe73ac req-e2097852-cea8-48db-bb14-76047356ac07 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:08.027490 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-dc2d9b45-be55-4555-9edc-adeb06fe73ac req-e2097852-cea8-48db-bb14-76047356ac07 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:08.039301 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-dc2d9b45-be55-4555-9edc-adeb06fe73ac req-e2097852-cea8-48db-bb14-76047356ac07 service nova] Creating event network-changed:edc04e64-d83b-4247-ac3f-9a1d52a0429c for instance 473935f3-f967-47cf-8294-e8bc5bfebb05 on n-h2-master-1 Sep 25 02:26:08.045347 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-dc2d9b45-be55-4555-9edc-adeb06fe73ac req-e2097852-cea8-48db-bb14-76047356ac07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085805 Sep 25 02:26:08.046524 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3833/7638] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:26:08.094452 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-63fce925-c24a-44d5-8db0-fa9379b8ae62 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 204 len: 0 microversion: 2.1 time: 0.140706 Sep 25 02:26:08.097478 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3806/7639] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:26:07 2022] DELETE /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:26:08.105134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:08.105899 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:08.112885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:08.113880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:08.114559 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:08.115375 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:08.115925 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:08.116454 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:08.266661 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:08.275313 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-5b5e2e28-f241-4388-a34c-4a711f1b4da1 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1689 microversion: 2.1 time: 0.175122 Sep 25 02:26:08.275916 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3834/7640] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:08 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:09.301697 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:09.302407 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:09.309726 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:09.310208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:09.310645 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:09.311331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:09.311805 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:09.312227 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:09.445917 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:09.453941 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05f9a7fb-32d5-4f93-a761-be57aad48a8a tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1689 microversion: 2.1 time: 0.156594 Sep 25 02:26:09.454519 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3807/7641] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:09 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:10.478366 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:10.479020 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:10.486453 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:10.486968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:10.487460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:10.488194 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:10.488683 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:10.489135 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:10.624733 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda050fca295403c8695da4b37062cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81a9610beb448de86effadb691910a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:10.633061 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-49db47af-b916-44ce-8705-11e2a1b80801 tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 200 len: 1570 microversion: 2.1 time: 0.158490 Sep 25 02:26:10.633871 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3835/7642] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:10 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:10.758866 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-fbc95ddf-656f-401f-95af-474d3c671afe req-8c461c8e-7425-400f-951f-571868662bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473935f3-f967-47cf-8294-e8bc5bfebb05", "name": "network-vif-deleted", "tag": "edc04e64-d83b-4247-ac3f-9a1d52a0429c"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:10.772748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fbc95ddf-656f-401f-95af-474d3c671afe req-8c461c8e-7425-400f-951f-571868662bd0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:10.774693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fbc95ddf-656f-401f-95af-474d3c671afe req-8c461c8e-7425-400f-951f-571868662bd0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:10.775477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-fbc95ddf-656f-401f-95af-474d3c671afe req-8c461c8e-7425-400f-951f-571868662bd0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:10.787937 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-fbc95ddf-656f-401f-95af-474d3c671afe req-8c461c8e-7425-400f-951f-571868662bd0 service nova] Creating event network-vif-deleted:edc04e64-d83b-4247-ac3f-9a1d52a0429c for instance 473935f3-f967-47cf-8294-e8bc5bfebb05 on n-h2-master-1 Sep 25 02:26:10.794801 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-fbc95ddf-656f-401f-95af-474d3c671afe req-8c461c8e-7425-400f-951f-571868662bd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040312 Sep 25 02:26:10.795454 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3808/7643] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:26:11.658316 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:11.658947 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] [instance: 473935f3-f967-47cf-8294-e8bc5bfebb05] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:11.666909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:11.667554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:11.668106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:11.668846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:11.669324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:11.669795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:11.683776 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] HTTP exception thrown: Instance 473935f3-f967-47cf-8294-e8bc5bfebb05 could not be found. Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Request method failure captured: Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 HTTP/1.1 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7oYOH5DvFC4Dd32o4-wMglRI5eEbLLMNRysTmR7OTDp_cMWRFFQPmJbSJTg9bEPKRXQG4oARq0tpDjqvaZUjKack-_Qfp1bg7wB8FN34ludiMlpJ534dsxgmAZoSXiVvRvMNzjAG650dGBDTznitA15rql5J_BkAmji6Nlram_aAUA Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c81a9610beb448de86effadb691910a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c81a9610beb448de86effadb691910a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c81a9610beb448de86effadb691910a8"}]}] Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: c81a9610beb448de86effadb691910a8 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1739505605 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: fda050fca295403c8695da4b37062cd7 Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1739505605-project Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 473935f3-f967-47cf-8294-e8bc5bfebb05 could not be found. Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '473935f3-f967-47cf-8294-e8bc5bfebb05'} Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473935f3-f967-47cf-8294-e8bc5bfebb05 could not be found. Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473935f3-f967-47cf-8294-e8bc5bfebb05 could not be found. Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:26:11.685469 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473935f3-f967-47cf-8294-e8bc5bfebb05 could not be found. Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Returning 404 to user: Instance 473935f3-f967-47cf-8294-e8bc5bfebb05 could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-710b4f92-3e58-4fec-bb5d-5fabc32e0caf tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05" status: 404 len: 111 microversion: 2.1 time: 0.032658 Sep 25 02:26:11.690323 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3836/7644] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:11 2022] GET /compute/v2.1/servers/473935f3-f967-47cf-8294-e8bc5bfebb05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:26:14.665454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c7d97ea-d791-4a72-ba1a-37b5248a7cac tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] Calling method '.version_select at 0x7f7bea6103a0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:14.685586 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c7d97ea-d791-4a72-ba1a-37b5248a7cac tempest-TestNetworkAdvancedServerOps-1739505605 tempest-TestNetworkAdvancedServerOps-1739505605-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537711628" status: 202 len: 0 microversion: 2.1 time: 0.025750 Sep 25 02:26:14.686205 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3809/7645] 10.222.0.16 () {58 vars in 1281 bytes} [Sun Sep 25 02:26:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537711628 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 02:26:26.216631 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=18 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:26.218079 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:26.415139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6da17d59-4447-47a9-b510-576a60ed7921 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'create', calling method: .version_select at 0x7f7bebde7af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-203707580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9i+jnbRgR0MyQ1yyWrIqH956MnehduOTnUq5jKZ/DbJaj2+EFmyxzVNz3Gs+NBi4F/kxFNpuh9pDuSjPaWB42xV8JHMXu02vhyDmk+gWwaOiX0RIRT10RPtTO2Eqw10Q=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:26.432607 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6da17d59-4447-47a9-b510-576a60ed7921 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for project 22ad80c717834d09b7a3e0d396510679. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:26:26.438147 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-6da17d59-4447-47a9-b510-576a60ed7921 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for user 2ba2c22356c54347901fa631b2d2ea28 and project 22ad80c717834d09b7a3e0d396510679. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:26:26.466337 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6da17d59-4447-47a9-b510-576a60ed7921 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256503 Sep 25 02:26:26.467079 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3837/7646] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:26:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:26:27.478224 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1239988956", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-203707580", "security_groups": [{"name": "tempest-secgroup-smoke-654735306"}], "networks": [{"uuid": "e6878162-96c4-4d30-a16a-a0eba135fde9"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:27.488772 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:27.489724 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:27.597754 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] validate_networks() for [('e6878162-96c4-4d30-a16a-a0eba135fde9', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:26:28.085961 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:26:28.086426 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:26:28.086911 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:26:28.087329 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:26:28.087756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:26:28.096679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:28.097167 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:28.097641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:28.098380 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:28.098840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:28.099269 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:28.122396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for project 22ad80c717834d09b7a3e0d396510679. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:26:28.129828 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for user 2ba2c22356c54347901fa631b2d2ea28 and project 22ad80c717834d09b7a3e0d396510679. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:26:28.143729 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:26:28.146267 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:26:28.192629 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [27b0457f-6593-43d4-95eb-c65e040a7e37] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:26:29.200189 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [27b0457f-6593-43d4-95eb-c65e040a7e37] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51840. Sep 25 02:26:29.204895 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-263da0a5-33f8-4618-954e-e7d86f01b567 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.730937 Sep 25 02:26:29.205672 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3810/7647] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:26:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:26:29.218144 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-05b0ebf2-5efe-47d4-9a56-4b7b1ea915ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:29.219083 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-05b0ebf2-5efe-47d4-9a56-4b7b1ea915ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:29.299685 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-05b0ebf2-5efe-47d4-9a56-4b7b1ea915ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:29.307536 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-05b0ebf2-5efe-47d4-9a56-4b7b1ea915ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1246 microversion: 2.1 time: 0.093166 Sep 25 02:26:29.308194 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3838/7648] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:29 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:30.335782 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:30.336449 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:30.344580 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:30.345082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:30.345555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:30.346259 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:30.346721 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:30.347158 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:30.417454 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:30.426458 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61b4791a-fa81-411c-b78b-975c21bc2f75 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1306 microversion: 2.1 time: 0.096010 Sep 25 02:26:30.436611 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3811/7649] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:30 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:31.451427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:31.452060 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:31.458960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:31.459462 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:31.459910 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:31.461208 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:31.461712 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:31.462160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:31.607864 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:31.615790 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-410b48a5-2a11-4308-ac58-b7cc1542cb80 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1371 microversion: 2.1 time: 0.168355 Sep 25 02:26:31.617346 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3839/7650] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:31 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:31.857959 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-aacfc8d0-b198-4032-8863-5f94377a4e3f req-8661b6ab-0b46-4ca3-acba-0772b60dd55b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:31.870001 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-aacfc8d0-b198-4032-8863-5f94377a4e3f req-8661b6ab-0b46-4ca3-acba-0772b60dd55b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:31.870587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-aacfc8d0-b198-4032-8863-5f94377a4e3f req-8661b6ab-0b46-4ca3-acba-0772b60dd55b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:31.871146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-aacfc8d0-b198-4032-8863-5f94377a4e3f req-8661b6ab-0b46-4ca3-acba-0772b60dd55b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:31.882840 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-aacfc8d0-b198-4032-8863-5f94377a4e3f req-8661b6ab-0b46-4ca3-acba-0772b60dd55b service nova] Creating event network-changed:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h2-master-1 Sep 25 02:26:31.887986 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-aacfc8d0-b198-4032-8863-5f94377a4e3f req-8661b6ab-0b46-4ca3-acba-0772b60dd55b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034109 Sep 25 02:26:31.888699 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3812/7651] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:26:32.639993 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:32.640555 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:32.648132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:32.648828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:32.649291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:32.650042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:32.650523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:32.650974 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:32.781541 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:32.790260 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f7309b2d-8378-4492-916e-6497df084aae tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1371 microversion: 2.1 time: 0.154276 Sep 25 02:26:32.790835 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3840/7652] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:32 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:33.814305 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:33.815040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:33.821552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:33.822057 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:33.822489 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:33.823176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:33.823623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:33.824041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:33.954538 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:33.962639 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b53c1df3-864e-4d24-9ac1-5e014b9c9f8b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1371 microversion: 2.1 time: 0.153425 Sep 25 02:26:33.963210 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3813/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:33 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:34.985677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:34.986326 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:34.993832 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:34.994341 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:34.994810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:34.995556 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:34.996036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:34.996488 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:35.134475 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:35.142851 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8f66ffc3-4910-4757-9b46-8c3807c00a1a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1371 microversion: 2.1 time: 0.161274 Sep 25 02:26:35.143494 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3841/7654] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:34 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:36.166176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:36.166783 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:36.173706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:36.174187 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:36.174618 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:36.175303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:36.175750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:36.176166 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:36.306752 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:36.314445 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-808c6194-b161-406a-b1c9-102677d8a8bc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1371 microversion: 2.1 time: 0.152899 Sep 25 02:26:36.315022 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3814/7655] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:36 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:36.692821 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-fe90efb3-5f3f-45c6-9875-31fc3812294e req-8544aad7-1eeb-4307-ac42-758a8dbbce32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "name": "network-vif-plugged", "status": "completed", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:36.703413 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fe90efb3-5f3f-45c6-9875-31fc3812294e req-8544aad7-1eeb-4307-ac42-758a8dbbce32 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:36.703908 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fe90efb3-5f3f-45c6-9875-31fc3812294e req-8544aad7-1eeb-4307-ac42-758a8dbbce32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:36.704444 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-fe90efb3-5f3f-45c6-9875-31fc3812294e req-8544aad7-1eeb-4307-ac42-758a8dbbce32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:36.719800 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-fe90efb3-5f3f-45c6-9875-31fc3812294e req-8544aad7-1eeb-4307-ac42-758a8dbbce32 service nova] Creating event network-vif-plugged:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h2-master-1 Sep 25 02:26:36.724957 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-fe90efb3-5f3f-45c6-9875-31fc3812294e req-8544aad7-1eeb-4307-ac42-758a8dbbce32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Sep 25 02:26:36.726264 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3842/7656] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:26:37.338912 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:37.339543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:37.346464 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:37.346986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:37.347429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:37.348129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:37.348596 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:37.349027 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:37.485185 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:37.493119 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cd992675-2197-498d-9637-2b3287ab0f13 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1371 microversion: 2.1 time: 0.158887 Sep 25 02:26:37.493731 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3815/7657] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:37 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:38.517974 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:38.518712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:38.525581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:38.526085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:38.526513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:38.527210 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:38.527671 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:38.528103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:38.659529 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:38.668619 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8cda147c-49ce-4748-8234-1fe64417180a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1553 microversion: 2.1 time: 0.155785 Sep 25 02:26:38.669212 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3843/7658] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:38 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:26:38.691886 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:26:38.692517 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:26:38.694534 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:38.695349 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:38.701876 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:38.702367 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:38.702807 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:38.703507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:38.703967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:38.704399 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:38.839296 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:26:38.847108 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-35c5c0ad-8e49-455f-bf1c-a34fe4e16de6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1553 microversion: 2.1 time: 0.159331 Sep 25 02:26:38.847691 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3816/7659] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:26:38 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:26:40.458726 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-1d4e59bd-500e-478c-bad4-a78a71c7bc67 req-d7f5e777-0218-4dc3-807a-cfe50c7ce0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:26:40.465262 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:26:40.470964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1d4e59bd-500e-478c-bad4-a78a71c7bc67 req-d7f5e777-0218-4dc3-807a-cfe50c7ce0e0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:26:40.471461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1d4e59bd-500e-478c-bad4-a78a71c7bc67 req-d7f5e777-0218-4dc3-807a-cfe50c7ce0e0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:26:40.471946 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-1d4e59bd-500e-478c-bad4-a78a71c7bc67 req-d7f5e777-0218-4dc3-807a-cfe50c7ce0e0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:26:40.484127 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-1d4e59bd-500e-478c-bad4-a78a71c7bc67 req-d7f5e777-0218-4dc3-807a-cfe50c7ce0e0 service nova] Creating event network-changed:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h2-master-1 Sep 25 02:26:40.489494 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-1d4e59bd-500e-478c-bad4-a78a71c7bc67 req-d7f5e777-0218-4dc3-807a-cfe50c7ce0e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034636 Sep 25 02:26:40.490187 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3844/7660] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:29:06.102648 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71316119-ca8d-457e-a845-7566a7d0a6aa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:29:06.103837 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8553e11c-cff0-496f-9dce-acabc3fc9342] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:29:06.104300 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:06.105230 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=34 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:06.106371 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:29:06.106520 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df/action (ip 10.222.0.16) !!! Sep 25 02:29:06.112653 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:29:06.113199 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:06.122660 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:06.123171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:06.123607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:06.124301 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:06.124754 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:06.125177 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:06.153804 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lazy-loading 'flavor' on Instance uuid 0a103cff-456b-4adb-83bf-835cb20f33df {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:29:06.344191 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7d7b5a43-f4e2-4f90-b975-cf587173d54b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df/action" status: 202 len: 0 microversion: 2.1 time: 0.242975 Sep 25 02:29:06.344840 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3817/7661] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:29:06 2022] POST /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:29:06.354907 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:06.356245 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:06.359190 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:29:06.360010 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc84e85e-dedb-4daa-b018-ffc2f4bea8d7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:29:06.361252 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:06.362232 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=28 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:06.363200 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:29:06.363356 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df (ip 10.222.0.16) !!! Sep 25 02:29:06.364728 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:29:06.364853 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df (ip 10.222.0.16) !!! Sep 25 02:29:06.375746 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:06.376243 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:06.376697 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:06.377434 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:06.377917 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:06.378402 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:06.522851 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:06.530925 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0a6029bb-7041-41f6-903b-0f8ac75099e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.181454 Sep 25 02:29:06.531506 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3845/7662] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:06 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:07.560304 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:07.561019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:07.574022 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] [8553e11c-cff0-496f-9dce-acabc3fc9342] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51962. Sep 25 02:29:07.576221 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:07.576708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:07.577176 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:07.577909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:07.578366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:07.578795 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:07.579396 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] [71316119-ca8d-457e-a845-7566a7d0a6aa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51960. Sep 25 02:29:07.712184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:07.719920 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c160e2dd-9374-4670-a43b-482fb210a3c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.168705 Sep 25 02:29:07.720492 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3818/7663] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:07 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:08.745002 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:08.745569 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:08.754784 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:08.755291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:08.755745 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:08.756513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:08.757314 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:08.757793 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:08.762470 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51966. Sep 25 02:29:08.765258 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc84e85e-dedb-4daa-b018-ffc2f4bea8d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51968. Sep 25 02:29:09.180066 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:09.188011 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b3a23ec1-afaa-4608-af6f-ed28482144a7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.447990 Sep 25 02:29:09.188583 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3846/7664] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:08 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:10.211325 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:10.211932 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:10.218748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:10.219688 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:10.220121 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:10.220801 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:10.221248 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:10.221695 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:10.351576 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:10.360222 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-566d0831-668a-4316-bc8f-c7b3498c3a3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.152886 Sep 25 02:29:10.360790 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3819/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:10 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:11.383714 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:11.384356 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:11.391369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:11.391874 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:11.392333 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:11.393079 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:11.393589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:11.394035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:11.528166 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:11.536041 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-0afaccc2-b6be-4a65-b445-0fe461327e7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.156618 Sep 25 02:29:11.536616 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3847/7666] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:11 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:12.560564 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:12.561196 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:12.568086 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:12.568570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:12.569388 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:12.570247 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:12.570709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:12.571147 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:12.701942 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:12.710217 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd2ac7b5-79b6-495d-b742-d6ad52517831 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.153401 Sep 25 02:29:12.710796 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3820/7667] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:12 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:13.734190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:13.734836 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:13.741952 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:13.742456 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:13.742924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:13.743638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:13.744116 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:13.744566 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:13.873539 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:13.881857 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-71b24084-70fc-4041-869d-daa06806d8b8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.151086 Sep 25 02:29:13.882447 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3848/7668] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:13 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:14.906287 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:14.906915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:14.913832 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:14.914319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:14.915028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:14.915727 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:14.916188 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:14.916624 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:15.050652 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:15.058946 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6bef8ebe-07ef-43cd-8b4c-c5c45dced535 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.156998 Sep 25 02:29:15.059550 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3821/7669] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:14 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:16.084076 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:16.085422 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:16.092393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:16.092902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:16.093362 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:16.094103 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:16.094581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:16.095037 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:16.228872 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:16.236974 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-589db647-f86f-42bc-955e-2e732923a5c2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.156919 Sep 25 02:29:16.237605 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3849/7670] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:16 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:17.261136 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:17.261816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:17.268789 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:17.269298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:17.269778 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:17.270471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:17.270923 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:17.271349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:17.405659 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:17.415407 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-139cc2ad-c246-4b9c-9c5a-86c9832fceb0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.158652 Sep 25 02:29:17.415995 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3822/7671] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:17 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:18.438902 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:18.439582 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:18.446693 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:18.447202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:18.447663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:18.448378 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:18.448855 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:18.449306 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:18.582599 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:18.591073 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-15407ad1-c720-4f7c-b891-17455a7e5c6b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1698 microversion: 2.1 time: 0.156120 Sep 25 02:29:18.591653 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3850/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:18 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:19.614830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:19.615966 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:19.623340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:19.623816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:19.624254 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:19.624961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:19.625599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:19.626029 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:19.763238 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:19.771106 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc4e98fc-0329-40cc-a62d-6de93941c8c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1698 microversion: 2.1 time: 0.160253 Sep 25 02:29:19.771718 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3823/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:19 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:20.794542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:20.795190 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:20.802150 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:20.802657 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:20.803763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:20.804483 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:20.804961 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:20.805435 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:20.938438 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:20.946497 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4582a648-d64e-4eca-94dd-1e6dee6c86cf tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1698 microversion: 2.1 time: 0.155900 Sep 25 02:29:20.947082 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3851/7674] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:20 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:21.520705 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2595a616-ffd3-4c5c-9123-9b0e819a3b7d req-7393f25e-5187-46f3-ba74-c2c6f1b2ef41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "name": "network-vif-plugged", "status": "completed", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:29:21.531427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2595a616-ffd3-4c5c-9123-9b0e819a3b7d req-7393f25e-5187-46f3-ba74-c2c6f1b2ef41 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:21.531930 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2595a616-ffd3-4c5c-9123-9b0e819a3b7d req-7393f25e-5187-46f3-ba74-c2c6f1b2ef41 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:21.532357 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2595a616-ffd3-4c5c-9123-9b0e819a3b7d req-7393f25e-5187-46f3-ba74-c2c6f1b2ef41 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:21.544446 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2595a616-ffd3-4c5c-9123-9b0e819a3b7d req-7393f25e-5187-46f3-ba74-c2c6f1b2ef41 service nova] Creating event network-vif-plugged:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h2-master-1 Sep 25 02:29:21.549815 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2595a616-ffd3-4c5c-9123-9b0e819a3b7d req-7393f25e-5187-46f3-ba74-c2c6f1b2ef41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098568 Sep 25 02:29:21.550425 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3824/7675] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:29:21.970205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:21.970904 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:21.978190 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:21.978743 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:21.979264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:21.980097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:21.980583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:21.981128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:22.110693 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:22.119068 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-2b983898-05c1-492f-8128-0c77aae43bbc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1698 microversion: 2.1 time: 0.152767 Sep 25 02:29:22.119650 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3852/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:21 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:23.143221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:23.143929 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:23.151977 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:23.152463 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:23.152902 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:23.153617 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:23.154069 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:23.154483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:23.293573 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:23.301735 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e61afdeb-123e-4f49-a9f7-9ded53c5398a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.162503 Sep 25 02:29:23.302402 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3825/7677] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:23 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:24.325361 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:24.326134 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:24.334239 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:24.335624 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:24.336331 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:24.337266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:24.337964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:24.338641 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:24.492692 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:24.501609 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-eab31491-b9c1-412f-98e7-d567e908c5df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.180586 Sep 25 02:29:24.513424 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3853/7678] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:24 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:25.526943 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:25.528350 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:25.536216 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:25.536705 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:25.537146 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:25.537887 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:25.538912 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:25.539641 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:25.693871 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:25.701953 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-cec4f018-db59-4992-a45e-a5b39e2d47b3 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.179297 Sep 25 02:29:25.707053 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3826/7679] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:25 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:26.726934 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:26.727538 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:26.734820 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:26.735596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:26.736266 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:26.737203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:26.737897 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:26.738537 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:26.887920 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:26.897324 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-775725f0-08e9-490f-9d82-1869605c7da2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.174836 Sep 25 02:29:26.898353 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3854/7680] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:26 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:27.923147 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:27.923778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:27.931582 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:27.932361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:27.932855 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:27.933829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:27.934366 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:27.934870 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:28.087005 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:28.095600 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ec70664d-ccbb-44b5-8f59-bd94612d60c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.176377 Sep 25 02:29:28.096183 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3827/7681] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:27 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:29.139010 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:29.139597 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:29.147221 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:29.147981 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:29.148588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:29.149524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:29.150062 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:29.150256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:29.307006 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:29.317363 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8214a66e-42ec-404d-84d5-78c8d8d5f7df tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.192592 Sep 25 02:29:29.333814 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3855/7682] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:29 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:30.343548 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:30.344443 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:30.352305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:30.352875 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:30.353385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:30.354215 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:30.355228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:30.356089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:30.505778 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:30.516418 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4edebd0e-ac6f-456b-a59d-7731fd12fb87 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.176756 Sep 25 02:29:30.517021 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3828/7683] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:30 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:31.541349 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:31.542011 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:31.549763 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:31.550421 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:31.550884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:31.551889 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:31.552365 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:31.552804 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:31.716267 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:31.724870 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c5e5f2f2-0870-4def-a7ed-b3b8a88cbd43 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.188746 Sep 25 02:29:31.726037 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3856/7684] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:31 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:32.748044 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:32.748674 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:32.755529 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:32.756018 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:32.756459 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:32.757191 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:32.757677 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:32.758110 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:32.891870 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:32.900047 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e00d0f8f-7147-430e-bff8-e7af0b2306a1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1693 microversion: 2.1 time: 0.155972 Sep 25 02:29:32.900631 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3829/7685] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:32 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:33.923480 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:33.924155 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:33.931659 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:33.932182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:33.932645 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:33.933367 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:33.933870 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:33.934320 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:34.067168 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:34.075825 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-29b1d314-13b0-4ddb-bf0b-5382705a36ce tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1675 microversion: 2.1 time: 0.156265 Sep 25 02:29:34.076421 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3857/7686] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:33 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:35.100231 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:35.101010 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:35.107827 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:35.108317 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:35.108760 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:35.109482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:35.109945 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:35.110378 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:35.313563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:35.321511 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-91ed9a21-d710-443d-93ac-d313c5dea7a0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1675 microversion: 2.1 time: 0.225251 Sep 25 02:29:35.322093 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3830/7687] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:35 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:36.344668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:36.345311 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:36.353181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:36.353723 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:36.354181 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:36.354923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:36.355396 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:36.355845 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:36.373957 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=82 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:36.488231 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:36.496549 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-276388a6-0d98-4f06-93fc-b9d48ff48770 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1618 microversion: 2.1 time: 0.155879 Sep 25 02:29:36.497127 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3858/7688] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:36 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1618 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:36.519311 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:29:36.519941 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:36.522745 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=29 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:36.528041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:36.528858 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:36.529012 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:36.529674 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:36.530129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:36.530555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:36.533484 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:36.575307 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122384) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 02:29:36.638638 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [27b0457f-6593-43d4-95eb-c65e040a7e37] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:29:37.560885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7390b318-2c21-48fd-976b-5ad927e1f510 req-1a32c2d6-3030-4474-8c7d-edbdb243a196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "name": "network-vif-unplugged", "status": "completed", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:29:37.566776 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=29 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:29:37.574399 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7390b318-2c21-48fd-976b-5ad927e1f510 req-1a32c2d6-3030-4474-8c7d-edbdb243a196 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:37.574902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7390b318-2c21-48fd-976b-5ad927e1f510 req-1a32c2d6-3030-4474-8c7d-edbdb243a196 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:37.575351 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7390b318-2c21-48fd-976b-5ad927e1f510 req-1a32c2d6-3030-4474-8c7d-edbdb243a196 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:37.587162 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.server_external_events [req-7390b318-2c21-48fd-976b-5ad927e1f510 req-1a32c2d6-3030-4474-8c7d-edbdb243a196 service nova] Unable to find a host for instance 0a103cff-456b-4adb-83bf-835cb20f33df. Dropping event network-vif-unplugged {{(pid=122385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 02:29:37.588061 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7390b318-2c21-48fd-976b-5ad927e1f510 req-1a32c2d6-3030-4474-8c7d-edbdb243a196 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031098 Sep 25 02:29:37.588653 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3859/7689] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 25 02:29:37.645658 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [27b0457f-6593-43d4-95eb-c65e040a7e37] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52078. Sep 25 02:29:37.649734 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-59a16e67-22fe-4cff-9008-208e0ecd9510 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df/action" status: 202 len: 0 microversion: 2.1 time: 1.134345 Sep 25 02:29:37.650462 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3831/7690] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:29:36 2022] POST /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:29:37.658501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:37.659131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:37.666457 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:37.666960 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:37.667411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:37.668117 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:37.668583 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:37.669033 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:37.810550 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:37.820804 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-54f6160f-cc9a-4a45-ae4d-3e2ebd216720 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1626 microversion: 2.1 time: 0.166101 Sep 25 02:29:37.821388 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3860/7691] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:37 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1626 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:29:38.845347 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:38.846015 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:38.853476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:38.853970 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:38.854411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:38.855096 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:38.855550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:38.855978 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:38.985204 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:38.993286 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ad353f07-2c2a-4b70-a702-5eaef86a14ca tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.153129 Sep 25 02:29:38.993899 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3832/7692] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:38 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:39.984772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:29:39.997332 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:39.997891 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:39.998423 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:40.012772 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] Creating event network-changed:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h1-master-1 Sep 25 02:29:40.018133 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:40.018774 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:40.025889 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:40.026150 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] [37e8c059-29c2-4f75-b760-85a25e703565] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 02:29:40.026588 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:40.027032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:40.027740 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:40.028196 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:40.028623 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:40.262411 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:40.270306 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-75137765-8e70-4808-a730-752401574305 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.256308 Sep 25 02:29:40.270903 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3833/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:40 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:29:41.045865 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] [37e8c059-29c2-4f75-b760-85a25e703565] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52130. Sep 25 02:29:41.056492 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ff2aceb6-0215-4493-ab60-86f65c5e265b req-cbd99861-3938-42c6-8aeb-9578187a60e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.075186 Sep 25 02:29:41.059755 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3861/7694] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:29:41.294698 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:41.295419 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:41.302973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:41.303510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:41.304055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:41.305019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:41.305873 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:41.306609 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:41.461865 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:41.470261 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-847becbe-beb4-4535-8bba-6503d44469c1 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.179489 Sep 25 02:29:41.471108 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3834/7695] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:41 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:42.496964 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:42.497712 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:42.515714 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:42.516240 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:42.516719 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:42.517658 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:42.518182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:42.518654 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:42.660427 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:42.673449 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-daaa1dbe-213c-44e6-aec2-5013e03862c4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.182393 Sep 25 02:29:42.676952 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3862/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:42 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:43.701059 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:43.702048 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:43.710776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:43.711283 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:43.711728 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:43.712626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:43.713088 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:43.713742 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:43.855583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:43.863490 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bb84375d-c83c-4835-8018-effe2695d45f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.166589 Sep 25 02:29:43.864297 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3835/7697] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:43 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:44.888834 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:44.889626 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:44.896642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:44.898591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:44.899138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:44.899851 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:44.900344 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:44.900805 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:45.049279 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:45.058368 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-07b38739-750e-4159-94ff-b0cee4f4ec8f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.173517 Sep 25 02:29:45.058956 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3863/7698] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:44 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:46.082358 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:46.083173 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:46.090657 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:46.091143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:46.091578 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:46.092273 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:46.092723 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:46.093145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:46.237337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:46.247061 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7b5f73c6-7b5c-4b2d-ad5b-cb98cef998fe tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.168306 Sep 25 02:29:46.247760 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3836/7699] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:46 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:47.271522 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:47.272180 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:47.279327 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:47.279826 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:47.280278 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:47.280992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:47.281491 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:47.281921 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:47.575646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:47.584161 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-760df0c8-23f8-4d32-a85d-d0d99b475778 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.316919 Sep 25 02:29:47.584756 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3864/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:47 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:48.608254 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:48.608874 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:48.615833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:48.616345 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:48.617019 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:48.617749 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:48.618207 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:48.618638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:48.792563 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:48.800730 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d5303e2-1173-4e98-9f29-3022b59fb17c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.196449 Sep 25 02:29:48.801302 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3837/7701] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:48 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:29:49.825044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:49.825778 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:49.834528 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:49.835609 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:49.836084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:49.836828 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:49.837310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:49.837792 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:50.086063 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:50.093784 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-989c1809-f30d-483a-9735-04a5afa9cc45 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.273470 Sep 25 02:29:50.094371 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3865/7702] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:49 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:51.118053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:51.118711 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:51.125716 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:51.126208 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:51.126652 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:51.127351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:51.127819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:51.128252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:51.261083 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:51.269350 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-fd4b82d3-e5b7-4d21-8834-63d0cdc73605 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.155689 Sep 25 02:29:51.269966 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3838/7703] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:51 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:52.294516 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:52.295160 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:52.302146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:52.302652 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:52.303119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:52.303949 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:52.304486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:52.304937 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:52.435553 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:52.443430 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bdc12585-c4ab-4298-b02f-95fd1fc0bc33 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.152885 Sep 25 02:29:52.444006 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3866/7704] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:52 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:52.754989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-2cdb996b-6c3b-488e-b189-d6f902c2b80f req-fe489a67-b2f8-4662-923a-d9f8cc945479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "name": "network-vif-plugged", "status": "completed", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:29:52.765800 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2cdb996b-6c3b-488e-b189-d6f902c2b80f req-fe489a67-b2f8-4662-923a-d9f8cc945479 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:52.766281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2cdb996b-6c3b-488e-b189-d6f902c2b80f req-fe489a67-b2f8-4662-923a-d9f8cc945479 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:52.766711 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-2cdb996b-6c3b-488e-b189-d6f902c2b80f req-fe489a67-b2f8-4662-923a-d9f8cc945479 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:52.779302 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-2cdb996b-6c3b-488e-b189-d6f902c2b80f req-fe489a67-b2f8-4662-923a-d9f8cc945479 service nova] Creating event network-vif-plugged:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h1-master-1 Sep 25 02:29:52.784456 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-2cdb996b-6c3b-488e-b189-d6f902c2b80f req-fe489a67-b2f8-4662-923a-d9f8cc945479 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033294 Sep 25 02:29:52.785065 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3839/7705] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:29:53.467395 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:53.468044 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:53.475092 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:53.475627 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:53.476182 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:53.476969 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:53.477484 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:53.477938 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:53.609182 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:53.617773 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-c9b313cf-8c2a-4ff0-8fe6-e4ef08b8a2fc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.154229 Sep 25 02:29:53.618361 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3867/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:53 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:54.643792 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:54.644587 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:54.651964 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:54.652447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:54.652879 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:54.653594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:54.654041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:54.654461 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:54.793188 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:54.801028 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-de424980-35f0-4352-a693-1362a3fa3958 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1684 microversion: 2.1 time: 0.162483 Sep 25 02:29:54.801626 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3840/7707] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:54 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:29:55.824786 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:29:55.825449 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:29:55.832405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:55.832905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:55.833369 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:55.834111 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:29:55.834591 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:29:55.835044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:29:55.969806 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:29:55.977575 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f5a1d567-0834-44b7-863e-f025a83f8528 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1671 microversion: 2.1 time: 0.157302 Sep 25 02:29:55.978157 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3868/7708] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:29:55 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:09.347997 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:09.348760 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:09.349791 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:31:09.349939 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:31:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df (ip 10.222.0.16) !!! Sep 25 02:31:09.351477 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=19 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:09.353195 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=54 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:09.357087 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:09.361315 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:09.378359 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:09.380862 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:09.381331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:09.382090 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:09.382560 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:09.382984 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:09.419364 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:31:09.444423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-ce304508-53c0-46f4-935c-40abf21ce198 req-a0b73a64-229f-4918-bf44-9758955ed962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:09.456852 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ce304508-53c0-46f4-935c-40abf21ce198 req-a0b73a64-229f-4918-bf44-9758955ed962 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:09.457676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ce304508-53c0-46f4-935c-40abf21ce198 req-a0b73a64-229f-4918-bf44-9758955ed962 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:09.458324 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-ce304508-53c0-46f4-935c-40abf21ce198 req-a0b73a64-229f-4918-bf44-9758955ed962 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:09.473892 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-ce304508-53c0-46f4-935c-40abf21ce198 req-a0b73a64-229f-4918-bf44-9758955ed962 service nova] Creating event network-changed:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h1-master-1 Sep 25 02:31:09.481607 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-ce304508-53c0-46f4-935c-40abf21ce198 req-a0b73a64-229f-4918-bf44-9758955ed962 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132547 Sep 25 02:31:09.482572 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3869/7709] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:31:09.516856 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-7152cdb5-a277-4df3-a3aa-11859fbcaab8 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 204 len: 0 microversion: 2.1 time: 0.170717 Sep 25 02:31:09.518233 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3841/7710] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:31:09 2022] DELETE /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:31:09.528929 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:09.529747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:09.547679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:09.548863 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:09.549858 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:09.550992 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:09.551767 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:09.552771 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:09.698423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:09.707064 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6fff1303-cce6-4dfa-8a52-7bcdbd403970 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.184254 Sep 25 02:31:09.707677 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3870/7711] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:09 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:10.732797 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:10.733760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:10.740685 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:10.741174 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:10.741638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:10.742353 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:10.743375 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:10.743831 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:10.936004 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:10.943902 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-a2240c90-ce80-4658-8bf3-4edd1f02655a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1677 microversion: 2.1 time: 0.215883 Sep 25 02:31:10.944571 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3842/7712] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:10 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:11.630206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6d88e7ee-25d8-4925-a5e1-084b2b667f46 req-b555e21c-fc8c-4251-a828-1d734a55b0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a103cff-456b-4adb-83bf-835cb20f33df", "name": "network-vif-deleted", "tag": "23261723-d4ea-4789-9ad9-15ced6937ca8"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:11.643822 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6d88e7ee-25d8-4925-a5e1-084b2b667f46 req-b555e21c-fc8c-4251-a828-1d734a55b0ee service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:11.644323 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6d88e7ee-25d8-4925-a5e1-084b2b667f46 req-b555e21c-fc8c-4251-a828-1d734a55b0ee service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:11.644780 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6d88e7ee-25d8-4925-a5e1-084b2b667f46 req-b555e21c-fc8c-4251-a828-1d734a55b0ee service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:11.657724 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6d88e7ee-25d8-4925-a5e1-084b2b667f46 req-b555e21c-fc8c-4251-a828-1d734a55b0ee service nova] Creating event network-vif-deleted:23261723-d4ea-4789-9ad9-15ced6937ca8 for instance 0a103cff-456b-4adb-83bf-835cb20f33df on n-h1-master-1 Sep 25 02:31:11.663710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6d88e7ee-25d8-4925-a5e1-084b2b667f46 req-b555e21c-fc8c-4251-a828-1d734a55b0ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036927 Sep 25 02:31:11.664505 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3871/7713] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:31:11.967915 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:11.968676 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:11.975966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:11.976546 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:11.977706 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:11.978631 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:11.979103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:11.979608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:12.013179 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:12.013777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:12.014217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:12.014677 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.objects.instance [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lazy-loading 'fault' on Instance uuid 0a103cff-456b-4adb-83bf-835cb20f33df {{(pid=122384) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:31:12.057483 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:12.065207 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-61dc31cd-fab7-4d3c-a73b-974d3d21d0ac tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 200 len: 1336 microversion: 2.1 time: 0.101290 Sep 25 02:31:12.065810 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3843/7714] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:11 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:13.089908 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:13.090707 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 0a103cff-456b-4adb-83bf-835cb20f33df] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:13.097881 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:13.098393 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:13.098857 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:13.099572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:13.100051 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:13.100502 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:13.113700 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] HTTP exception thrown: Instance 0a103cff-456b-4adb-83bf-835cb20f33df could not be found. Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Request method failure captured: Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df HTTP/1.1 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7xN5yP9LVe5Ys9ZkE9HLAAW-wUr2oefxPBONxuR9WQqyMKhOHU8IhvV7nPHXhTHHtOuR1cvixJIUorNXxvBXDAHtzM9ush3e86cnI7z1b593Uc5x_vE4PXq0cqgLFTNu8iN6x6rP1V9sqKRkl2dwJmWQN9hpxP6HQQUb6hHSCBwypE Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 22ad80c717834d09b7a3e0d396510679 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestShelveInstance-1151124943 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/22ad80c717834d09b7a3e0d396510679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22ad80c717834d09b7a3e0d396510679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22ad80c717834d09b7a3e0d396510679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_22ad80c717834d09b7a3e0d396510679"}]}] Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestShelveInstance-1151124943 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 22ad80c717834d09b7a3e0d396510679 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestShelveInstance-1151124943 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestShelveInstance-1151124943-project Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2ba2c22356c54347901fa631b2d2ea28 Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestShelveInstance-1151124943-project Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 0a103cff-456b-4adb-83bf-835cb20f33df could not be found. Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '0a103cff-456b-4adb-83bf-835cb20f33df'} Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a103cff-456b-4adb-83bf-835cb20f33df could not be found. Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a103cff-456b-4adb-83bf-835cb20f33df could not be found. Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:31:13.115339 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a103cff-456b-4adb-83bf-835cb20f33df could not be found. Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Returning 404 to user: Instance 0a103cff-456b-4adb-83bf-835cb20f33df could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-48e43233-6c7c-4707-a504-94cff143ebdd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df" status: 404 len: 111 microversion: 2.1 time: 0.031858 Sep 25 02:31:13.121811 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3872/7715] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:13 2022] GET /compute/v2.1/servers/0a103cff-456b-4adb-83bf-835cb20f33df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:31:13.277434 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d71c3f3b-72a3-49bd-8f7b-3a98b2bc14ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '.version_select at 0x7f7bea668430>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:13.304170 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d71c3f3b-72a3-49bd-8f7b-3a98b2bc14ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203707580" status: 202 len: 0 microversion: 2.1 time: 0.030868 Sep 25 02:31:13.304792 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3844/7716] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 02:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203707580 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:31:13.327401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7a09dd00-06ef-4f05-862e-1acfc3fbd335 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'create', calling method: .version_select at 0x7f7bebf089d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-741346414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3hLugI5qZHctnc5MsbvhENe5R+XaInwSZToUg7GJrNWUhgZ5NRaabqnPQiZIeCfWvdGlmOiXSIQnHkOSfh+1is9Ygrmr7KKOpeWL0I0ddE9RSr4ZQoHEoaUPqMxIunMQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:13.343150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7a09dd00-06ef-4f05-862e-1acfc3fbd335 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for project 22ad80c717834d09b7a3e0d396510679. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:31:13.348370 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-7a09dd00-06ef-4f05-862e-1acfc3fbd335 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for user 2ba2c22356c54347901fa631b2d2ea28 and project 22ad80c717834d09b7a3e0d396510679. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:31:13.375944 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7a09dd00-06ef-4f05-862e-1acfc3fbd335 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052455 Sep 25 02:31:13.376562 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3873/7717] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:31:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:31:29.653547 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:29.654295 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:29.658260 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1631636794", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-741346414", "security_groups": [{"name": "tempest-secgroup-smoke-2105953025"}], "networks": [{"uuid": "e6878162-96c4-4d30-a16a-a0eba135fde9"}], "block_device_mapping_v2": [{"uuid": "d3bc69a9-bbf1-4305-9b76-886a364fe269", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:29.777721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] validate_networks() for [('e6878162-96c4-4d30-a16a-a0eba135fde9', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:31:30.192423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:31:30.192856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:31:30.193340 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:31:30.193793 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:31:30.194213 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:31:30.203034 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:30.203519 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:30.203961 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:30.204693 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:30.205154 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:30.205620 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:30.224060 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for project 22ad80c717834d09b7a3e0d396510679. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:31:30.230019 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Getting quotas for user 2ba2c22356c54347901fa631b2d2ea28 and project 22ad80c717834d09b7a3e0d396510679. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:31:30.287111 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:31:30.289295 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3bc69a9-bbf1-4305-9b76-886a364fe269',volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:31:30.418307 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3bea8358-1221-464c-ab69-13fd73afdf99 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766483 Sep 25 02:31:30.419158 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3845/7718] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:31:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:31:30.428096 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=12 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:30.429113 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=4 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:30.429527 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:30.434095 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dd230b43-91e3-41c2-814d-3be0a7e64013 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:30.434730 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dd230b43-91e3-41c2-814d-3be0a7e64013 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:30.492669 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dd230b43-91e3-41c2-814d-3be0a7e64013 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:30.500361 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dd230b43-91e3-41c2-814d-3be0a7e64013 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1088 microversion: 2.1 time: 0.074003 Sep 25 02:31:30.500939 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3874/7719] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:30 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:31.525023 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:31.525779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:31.532662 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:31.533149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:31.533951 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:31.534391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:31.534852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:31.535467 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:31.603394 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:31.612323 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-9d433b02-2869-4d0d-9dc7-c856463dc0ee tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1194 microversion: 2.1 time: 0.092058 Sep 25 02:31:31.612323 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3846/7720] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:31 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:32.636603 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:32.637347 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:32.644446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:32.645082 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:32.645676 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:32.646518 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:32.647106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:32.647660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:32.791033 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:32.799112 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-303d79ba-5cd8-4f67-bcbe-47034240428d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1272 microversion: 2.1 time: 0.167158 Sep 25 02:31:32.799928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3875/7721] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:32 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:32.990077 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-706449aa-3b28-45db-b0ea-ce4715206bf1 req-8f7dde35-d5ca-4432-b65e-91a525902233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:33.002127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-706449aa-3b28-45db-b0ea-ce4715206bf1 req-8f7dde35-d5ca-4432-b65e-91a525902233 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:33.002982 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-706449aa-3b28-45db-b0ea-ce4715206bf1 req-8f7dde35-d5ca-4432-b65e-91a525902233 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:33.003698 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-706449aa-3b28-45db-b0ea-ce4715206bf1 req-8f7dde35-d5ca-4432-b65e-91a525902233 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:33.017258 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-706449aa-3b28-45db-b0ea-ce4715206bf1 req-8f7dde35-d5ca-4432-b65e-91a525902233 service nova] Creating event network-changed:b0568252-2e53-47c0-aee0-1e3e3d839dac for instance 950267d3-bad5-4a93-a98a-4250f9b658ce on n-h2-master-1 Sep 25 02:31:33.023692 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-706449aa-3b28-45db-b0ea-ce4715206bf1 req-8f7dde35-d5ca-4432-b65e-91a525902233 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037527 Sep 25 02:31:33.026499 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3847/7722] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:31:33.823971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:33.824512 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:33.831202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:33.831774 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:33.832861 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:33.833620 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:33.834918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:33.835377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:33.975448 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:33.985710 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-69190f5c-26df-4346-b62e-5cef4d5711ef tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1272 microversion: 2.1 time: 0.166170 Sep 25 02:31:33.997596 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3876/7723] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:33 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:35.012003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:35.012706 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:35.019077 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:35.019555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:35.019986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:35.020669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:35.021120 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:35.021572 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:35.162123 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:35.170648 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-313bfbe9-644d-440d-a314-4580c3f96988 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1272 microversion: 2.1 time: 0.164585 Sep 25 02:31:35.171229 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3848/7724] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:35 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:36.193704 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:36.194335 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:36.202346 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:36.202846 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:36.203299 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:36.204007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:36.204477 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:36.204918 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:36.348963 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:36.358215 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-4e81f503-69e9-4002-876c-aead412c408f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1272 microversion: 2.1 time: 0.168432 Sep 25 02:31:36.358867 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3877/7725] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:36 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:37.381531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:37.382156 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:37.389986 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:37.390477 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:37.390925 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:37.391638 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:37.392384 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:37.392817 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:37.527494 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:37.535252 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-77ace0fd-791b-4e7d-b080-a02a9400a4ed tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.158135 Sep 25 02:31:37.535847 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3849/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:37 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:38.559634 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:38.560274 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:38.567225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:38.567724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:38.568178 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:38.568887 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:38.569356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:38.569821 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:38.708866 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:38.716913 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b1298388-a2b8-44ea-906e-c0b2b977d8e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.161635 Sep 25 02:31:38.717784 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3878/7727] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:38 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:39.741883 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:39.742504 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:39.748543 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:39.749032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:39.749494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:39.750180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:39.750630 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:39.751048 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:39.882078 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:39.890688 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f85a80eb-5be4-4701-b1f5-2fe314fc4d83 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.153041 Sep 25 02:31:39.891265 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3850/7728] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:39 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:31:40.913233 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:40.913967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:40.916994 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:40.922513 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:40.923041 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:40.923496 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:40.924207 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:40.924679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:40.925119 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:41.058534 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:41.066300 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8754c6ad-f03a-4808-bdd1-90bd452c1089 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.157185 Sep 25 02:31:41.066878 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3879/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:40 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:42.090547 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:42.091145 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:42.093078 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:42.093814 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:31:42.100608 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:42.101089 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:42.101559 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:42.102579 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:42.103038 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:42.103466 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:42.234040 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:42.241841 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-21e8b460-33f0-47b7-a6df-cb01edd0175c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.156047 Sep 25 02:31:42.242966 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3851/7730] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:42 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:43.266558 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:43.267194 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:43.274904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:43.275385 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:43.275844 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:43.276554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:43.277028 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:43.277497 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:43.412452 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:43.420758 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f7023a6a-5d83-42f5-9cf5-b2b74084fa79 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.158110 Sep 25 02:31:43.421343 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3880/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:43 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:44.443055 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:44.443704 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:44.450815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:44.451298 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:44.451736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:44.452421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:44.452874 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:44.453297 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:44.584113 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:44.592427 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c12c2460-bdbd-4cf9-ad77-e3206e24d30f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.153291 Sep 25 02:31:44.592999 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3852/7732] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:44 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:45.616199 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:45.616842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:45.624589 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:45.625089 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:45.625574 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:45.626283 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:45.626749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:45.627189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:45.759381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:45.767076 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8770f7a8-b9b3-4ecb-b4e0-f43960d2620a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.154892 Sep 25 02:31:45.767647 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3881/7733] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:45 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:46.790562 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:46.791191 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:46.798129 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:46.798625 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:46.799073 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:46.799781 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:46.800240 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:46.800679 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:46.937956 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:46.946863 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-ee36f209-f384-428d-8a3b-5b0faefa7b48 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.160360 Sep 25 02:31:46.947439 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3853/7734] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:46 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:47.969868 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:47.970510 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:47.977527 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:47.978021 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:47.978486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:47.979202 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:47.979680 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:47.980157 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:48.113174 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:48.121664 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f1f1905b-8fa4-48f1-ba96-2514b324346d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.155783 Sep 25 02:31:48.122481 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3882/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:47 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:48.218220 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-89ca26b3-cc4b-44e2-9841-622715879e8a req-0be2f9cb-da0d-46b6-9fc0-66acca3f27ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "name": "network-vif-plugged", "status": "completed", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:48.230820 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-89ca26b3-cc4b-44e2-9841-622715879e8a req-0be2f9cb-da0d-46b6-9fc0-66acca3f27ca service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:48.231394 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-89ca26b3-cc4b-44e2-9841-622715879e8a req-0be2f9cb-da0d-46b6-9fc0-66acca3f27ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:48.231859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-89ca26b3-cc4b-44e2-9841-622715879e8a req-0be2f9cb-da0d-46b6-9fc0-66acca3f27ca service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:48.244215 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-89ca26b3-cc4b-44e2-9841-622715879e8a req-0be2f9cb-da0d-46b6-9fc0-66acca3f27ca service nova] Creating event network-vif-plugged:b0568252-2e53-47c0-aee0-1e3e3d839dac for instance 950267d3-bad5-4a93-a98a-4250f9b658ce on n-h2-master-1 Sep 25 02:31:48.249386 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-89ca26b3-cc4b-44e2-9841-622715879e8a req-0be2f9cb-da0d-46b6-9fc0-66acca3f27ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034885 Sep 25 02:31:48.250013 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3854/7736] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:31:49.146102 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:49.146745 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:49.154619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:49.155137 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:49.155604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:49.156328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:49.156808 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:49.157257 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:49.298886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:49.306983 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-d8b243e5-52a3-4255-8714-9f8ce46deec0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1260 microversion: 2.1 time: 0.164909 Sep 25 02:31:49.307577 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3883/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:49 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:50.334760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:50.335474 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:50.343281 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:50.343769 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:50.344212 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:50.344907 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:50.345365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:50.345819 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:50.478663 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:50.486427 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bc061e96-0bf1-4f34-b6e4-1e728a463562 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1442 microversion: 2.1 time: 0.156030 Sep 25 02:31:50.486993 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3855/7738] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:50 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:50.510500 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:31:50.511140 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:31:50.517967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:50.518469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:50.518924 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:50.519626 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:50.520097 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:50.520541 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:50.650423 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:31:50.658263 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ef92842-e84d-4fa1-a7ec-051abc981978 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1442 microversion: 2.1 time: 0.152717 Sep 25 02:31:50.658842 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3884/7739] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:31:50 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:31:52.342597 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1a11811c-4a96-47dd-989c-d1371c4924a3 req-cb241098-d96c-4ec8-a28a-4dedddc47f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:31:52.352932 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1a11811c-4a96-47dd-989c-d1371c4924a3 req-cb241098-d96c-4ec8-a28a-4dedddc47f1d service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:31:52.353691 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1a11811c-4a96-47dd-989c-d1371c4924a3 req-cb241098-d96c-4ec8-a28a-4dedddc47f1d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:31:52.354127 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1a11811c-4a96-47dd-989c-d1371c4924a3 req-cb241098-d96c-4ec8-a28a-4dedddc47f1d service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:31:52.368342 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1a11811c-4a96-47dd-989c-d1371c4924a3 req-cb241098-d96c-4ec8-a28a-4dedddc47f1d service nova] Creating event network-changed:b0568252-2e53-47c0-aee0-1e3e3d839dac for instance 950267d3-bad5-4a93-a98a-4250f9b658ce on n-h2-master-1 Sep 25 02:31:52.373735 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1a11811c-4a96-47dd-989c-d1371c4924a3 req-cb241098-d96c-4ec8-a28a-4dedddc47f1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093355 Sep 25 02:31:52.374358 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3856/7740] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:33:47.332128 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=24 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:33:47.332889 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=60 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:33:47.334024 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:33:47.334206 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce/action (ip 10.222.0.16) !!! Sep 25 02:33:47.336394 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:33:47.336533 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce/action (ip 10.222.0.16) !!! Sep 25 02:33:47.347072 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:33:47.347649 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:47.357038 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:47.357587 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:47.358044 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:47.358759 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:47.359262 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:47.359709 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:47.384187 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.objects.instance [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lazy-loading 'flavor' on Instance uuid 950267d3-bad5-4a93-a98a-4250f9b658ce {{(pid=122385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 02:33:47.460201 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-45ec639e-d0f2-4e60-b810-573f03d328d0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce/action" status: 202 len: 0 microversion: 2.1 time: 0.129848 Sep 25 02:33:47.460968 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3885/7741] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:33:47 2022] POST /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:33:47.468773 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:33:47.469627 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=56 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:33:47.470762 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:33:47.470925 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce (ip 10.222.0.16) !!! Sep 25 02:33:47.477370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:47.478106 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:47.491233 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:47.491719 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:47.492163 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:47.492867 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:47.493327 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:47.493782 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:47.635583 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:47.644641 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-4c6d09f7-9aec-44f4-871a-671e9c311b59 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.177618 Sep 25 02:33:47.645322 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3857/7742] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:47 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:33:48.669251 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:48.669932 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:48.677669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:48.678177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:48.678638 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:48.679356 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:48.679836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:48.680286 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:48.812841 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:48.820821 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-bb85adf4-5de7-480a-8024-3acd5cd4c72a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.156295 Sep 25 02:33:48.821421 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3886/7743] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:48 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:49.844617 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:49.845207 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:49.853035 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:49.853556 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:49.854006 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:49.854701 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:49.855162 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:49.855598 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:49.997897 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:50.006009 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3c4d6838-607e-4e00-8895-5db7d970b87f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.165355 Sep 25 02:33:50.006587 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3858/7744] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:49 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:51.030486 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:51.031381 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:51.038602 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:51.039112 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:51.039581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:51.040312 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:51.041046 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:51.041510 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:51.185772 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:51.193993 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-809cf855-6a47-431d-a18f-c7ea8c41aa78 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.167904 Sep 25 02:33:51.194571 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3887/7745] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:51 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:52.217550 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:52.218176 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:52.225850 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:52.226331 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:52.226776 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:52.227475 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:52.227935 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:52.228395 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:52.358247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:52.366128 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-87094e5b-f94c-4e98-9531-0bee477082b2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.152637 Sep 25 02:33:52.366713 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3859/7746] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:52 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:53.389543 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:53.390186 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:53.397225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:53.397762 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:53.398225 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:53.398936 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:53.399411 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:53.399859 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:53.535906 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:53.544224 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-65a29dc0-aeb9-4e35-9488-9d884bbc103a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.158722 Sep 25 02:33:53.544739 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3888/7747] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:53 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:54.568541 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:54.569172 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:54.576199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:54.576686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:54.577178 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:54.577928 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:54.578383 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:54.578812 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:54.712424 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:54.720218 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-d4ef4247-1b10-4ca1-be4b-58bb58c27d9b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.156408 Sep 25 02:33:54.720805 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3860/7748] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:54 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:55.744636 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:55.745281 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:55.752431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:55.752972 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:55.753554 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:55.754274 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:55.754980 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:55.755426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:55.892504 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:55.900822 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-11075be5-cd4e-4962-89d4-cae5c7c84e34 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.160953 Sep 25 02:33:55.901424 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3889/7749] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:55 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:56.924235 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:56.924860 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:56.932386 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:56.932878 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:56.933319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:56.934051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:56.934511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:56.934942 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:57.064990 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:57.073791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-669e3f44-1768-498f-88b8-12b248f8f96f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.153542 Sep 25 02:33:57.074372 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3861/7750] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:56 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:58.096241 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:58.096922 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:58.104047 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:58.104549 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:58.105034 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:58.105833 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:58.106310 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:58.106769 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:58.242873 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:58.250813 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-190aa6e3-908e-47c4-a67e-6d4ba3b452dc tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.158485 Sep 25 02:33:58.251397 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3890/7751] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:58 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:33:59.274690 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:33:59.275324 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:33:59.282339 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:59.282828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:59.283270 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:59.283968 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:33:59.284427 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:33:59.284859 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:33:59.710992 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:33:59.719089 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-31483171-f17c-4560-bc59-b0bb5279aa8c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.448755 Sep 25 02:33:59.719672 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3862/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:33:59 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:00.743185 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:00.743839 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:00.751067 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:00.751675 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:00.752353 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:00.753085 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:00.753595 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:00.754043 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:00.889200 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:00.897794 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-cca765a9-0928-44fd-b658-b3b806f78e3c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.159196 Sep 25 02:34:00.898401 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3891/7753] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:00 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:01.920625 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:01.921186 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:01.929552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:01.929552 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:01.929885 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:01.930587 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:01.931041 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:01.931470 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:02.071328 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:02.079175 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-05e7201c-eba3-42c8-8250-bd999a493761 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1568 microversion: 2.1 time: 0.162578 Sep 25 02:34:02.079772 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3863/7754] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:01 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:02.102653 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:34:02.103283 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:02.110160 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:02.110669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:02.111138 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:02.111854 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:02.112335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:02.112786 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:02.198796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122385) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 02:34:02.267792 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a0717ef0-6b94-41f6-bca8-ca04ecddb862 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "POST /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce/action" status: 202 len: 0 microversion: 2.1 time: 0.169512 Sep 25 02:34:02.268422 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3892/7755] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:34:02 2022] POST /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:34:02.276882 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:02.277545 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:02.283626 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:02.284064 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:02.284704 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:02.285439 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:02.285897 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:02.286555 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:02.462852 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:02.470955 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8ae65290-0a3f-4228-be8f-40b1c94e0aa0 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1516 microversion: 2.1 time: 0.197969 Sep 25 02:34:02.471607 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3864/7756] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:02 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:02.792219 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-7c386a63-9a2d-4723-b08f-ac1b3806eeb0 req-ebe4b5dc-dc02-4d8e-a2b9-5f5ca137590b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "name": "network-vif-unplugged", "status": "completed", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:34:02.806249 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7c386a63-9a2d-4723-b08f-ac1b3806eeb0 req-ebe4b5dc-dc02-4d8e-a2b9-5f5ca137590b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:02.806987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7c386a63-9a2d-4723-b08f-ac1b3806eeb0 req-ebe4b5dc-dc02-4d8e-a2b9-5f5ca137590b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:02.807451 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-7c386a63-9a2d-4723-b08f-ac1b3806eeb0 req-ebe4b5dc-dc02-4d8e-a2b9-5f5ca137590b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:02.821952 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.compute.server_external_events [req-7c386a63-9a2d-4723-b08f-ac1b3806eeb0 req-ebe4b5dc-dc02-4d8e-a2b9-5f5ca137590b service nova] Unable to find a host for instance 950267d3-bad5-4a93-a98a-4250f9b658ce. Dropping event network-vif-unplugged {{(pid=122385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 02:34:02.823503 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-7c386a63-9a2d-4723-b08f-ac1b3806eeb0 req-ebe4b5dc-dc02-4d8e-a2b9-5f5ca137590b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036031 Sep 25 02:34:02.824558 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3893/7757] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 25 02:34:03.495301 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:03.495896 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:03.503729 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:03.504263 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:03.504756 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:03.505488 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:03.505954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:03.506385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:03.644140 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:03.652601 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8aced1bd-ffac-407c-8350-71cbb8197b7a tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1518 microversion: 2.1 time: 0.161215 Sep 25 02:34:03.653184 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3865/7758] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:03 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:04.676677 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:04.677301 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:04.684236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:04.684737 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:04.685193 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:04.685933 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:04.686405 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:04.686848 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:04.819388 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:04.827332 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-221faf58-aa21-477b-9e3e-1b5486cc3a23 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1518 microversion: 2.1 time: 0.155086 Sep 25 02:34:04.828266 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3894/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:04 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:05.851762 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:05.852467 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:05.859607 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:05.860100 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:05.860530 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:05.861231 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:05.861709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:05.862133 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:06.001068 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:06.011251 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-184366e9-a007-4078-8a53-d3c06fdaea21 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1518 microversion: 2.1 time: 0.164102 Sep 25 02:34:06.023051 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3866/7760] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:05 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:07.036722 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:07.037360 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:07.044531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:07.045036 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:07.045531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:07.046255 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:07.046726 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:07.047173 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:07.179887 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:07.187942 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b84bb845-c77a-496f-9792-7742db1008db tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1518 microversion: 2.1 time: 0.155785 Sep 25 02:34:07.188525 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3895/7761] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:07 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:34:08.212283 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:08.212936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:08.219411 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:08.219905 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:08.220350 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:08.221050 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:08.221536 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:08.221969 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:08.359795 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:08.367889 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-28288fb5-6b68-4df3-a794-4f098da3fd7b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.160371 Sep 25 02:34:08.368506 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3867/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:08 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 02:34:09.391930 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:09.392570 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:09.399064 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:09.399565 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:09.400022 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:09.400731 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:09.401203 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:09.401678 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:09.536713 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:09.544918 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-9cb49d56-2fb6-4118-8884-a4a5dfae47b5 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.157111 Sep 25 02:34:09.545509 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3896/7763] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:09 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:10.569255 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:10.569930 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:10.576863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:10.577337 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:10.577806 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:10.578494 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:10.578943 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:10.579361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:10.711392 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:10.719314 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6b082f25-5afa-4e57-a351-ccc279805216 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.154481 Sep 25 02:34:10.719892 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3868/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:10 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:11.743205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:11.743762 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:11.750806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:11.751313 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:11.751776 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:11.752487 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:11.752964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:11.753431 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:11.887842 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:11.896402 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-dbcba3db-f627-4adc-a75a-ae6d81c04b1c tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.157810 Sep 25 02:34:11.896990 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3897/7765] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:11 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:12.920339 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:12.920898 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:12.927900 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:12.928385 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:12.928829 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:12.929558 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:12.930020 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:12.930452 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:13.062153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:13.070768 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-55cb8191-1a0b-48aa-b5d1-beea619c2eab tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.154774 Sep 25 02:34:13.071365 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3869/7766] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:12 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:14.094927 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:14.095568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:14.102508 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:14.103018 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:14.103479 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:14.104192 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:14.104663 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:14.105109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:14.240243 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:14.248104 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-20ac0847-c2c7-410d-b2fe-1b24e79b78e4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.157271 Sep 25 02:34:14.248679 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3898/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:14 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:15.272719 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:15.273343 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:15.280391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:15.280877 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:15.281314 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:15.282028 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:15.282486 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:15.282913 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:15.418221 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:15.426053 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-adcae41f-4284-4966-ac04-5ce7a4fde9f2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.157866 Sep 25 02:34:15.426627 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3870/7768] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:15 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:16.449109 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:16.449788 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:16.456635 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:16.457140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:16.457637 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:16.459078 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:16.459649 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:16.460106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:16.464208 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:34:16.595924 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:16.604803 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-826fd072-5ac3-48a8-91d1-62a28c5db6e7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.159559 Sep 25 02:34:16.605418 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3899/7769] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:16 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:17.628253 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:17.628800 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:17.632178 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=29 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:34:17.637650 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:17.638143 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:17.638594 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:17.639287 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:17.639748 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:17.640180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:17.643011 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=85 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:34:17.772423 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:17.780300 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-384b6108-80a2-4f36-966a-9ace47ea7d49 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.156061 Sep 25 02:34:17.780876 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3871/7770] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:17 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:18.803664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:18.804306 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:18.807030 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:34:18.812347 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:18.812835 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:18.813302 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:18.814045 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:18.814523 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:18.814968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:18.947658 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:18.955881 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-533c032a-4833-46d6-8d1c-f9cdc8de4ee7 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.156125 Sep 25 02:34:18.956448 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3900/7771] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:18 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:19.980150 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:19.980720 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:19.987880 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:19.988372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:19.988813 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:19.990053 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:19.990511 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:19.990944 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:20.124721 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:20.133255 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1d3b37f9-acd0-4a27-9f4c-e7fd7665bded tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.157145 Sep 25 02:34:20.133862 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3872/7772] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:19 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:20.874796 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-0a6639bc-d7f1-4d07-82e0-8611c57f8d74 req-8c2caa7a-7ce1-41fc-9404-43ffbff74589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "name": "network-vif-plugged", "status": "completed", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:34:20.886354 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0a6639bc-d7f1-4d07-82e0-8611c57f8d74 req-8c2caa7a-7ce1-41fc-9404-43ffbff74589 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:20.886902 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0a6639bc-d7f1-4d07-82e0-8611c57f8d74 req-8c2caa7a-7ce1-41fc-9404-43ffbff74589 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:20.887374 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-0a6639bc-d7f1-4d07-82e0-8611c57f8d74 req-8c2caa7a-7ce1-41fc-9404-43ffbff74589 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:20.899202 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-0a6639bc-d7f1-4d07-82e0-8611c57f8d74 req-8c2caa7a-7ce1-41fc-9404-43ffbff74589 service nova] Creating event network-vif-plugged:b0568252-2e53-47c0-aee0-1e3e3d839dac for instance 950267d3-bad5-4a93-a98a-4250f9b658ce on n-h2-master-1 Sep 25 02:34:20.904321 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-0a6639bc-d7f1-4d07-82e0-8611c57f8d74 req-8c2caa7a-7ce1-41fc-9404-43ffbff74589 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Sep 25 02:34:20.904934 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3901/7773] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:34:21.156132 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:21.156789 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:21.164016 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:21.164510 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:21.164954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:21.165757 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:21.166483 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:21.166916 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:21.297342 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:21.305655 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-e533b2ed-f4f1-4ad1-a83c-3e25cf483d3f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.153435 Sep 25 02:34:21.306427 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3873/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:21 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:22.330860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:22.331592 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:22.338703 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:22.339214 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:22.339679 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:22.340426 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:22.340915 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:22.341364 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:22.480098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:22.488131 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10533a82-e081-4f11-9dbd-80a2918dab3b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1574 microversion: 2.1 time: 0.162440 Sep 25 02:34:22.488721 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3902/7775] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:22 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:34:23.510786 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:34:23.511417 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:34:23.518532 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:23.519054 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:23.519498 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:23.520209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:34:23.520732 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:34:23.521145 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:34:23.653642 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:34:23.661976 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-520d04c1-8974-4dc8-bb56-9bce78baef06 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1561 microversion: 2.1 time: 0.154651 Sep 25 02:34:23.662555 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3874/7776] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:34:23 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:36.178734 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=5 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:36.179750 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=18 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:36.180884 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:35:36.181043 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce (ip 10.222.0.16) !!! Sep 25 02:35:36.181513 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=7 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:36.182532 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=23 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:35:36.183842 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:35:36.184146 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 25 02:35:36.185158 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:35:36.185274 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 25 02:35:36.189268 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:36.189856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:36.190578 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-362f5123-96fc-435a-a4d4-6d34f8b72e6e req-19380ee1-8faa-4d93-8315-a8a631541236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:35:36.200466 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:36.200958 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:36.201446 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:36.202581 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:36.203236 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:36.205256 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:36.205396 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-362f5123-96fc-435a-a4d4-6d34f8b72e6e req-19380ee1-8faa-4d93-8315-a8a631541236 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:36.205821 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-362f5123-96fc-435a-a4d4-6d34f8b72e6e req-19380ee1-8faa-4d93-8315-a8a631541236 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:36.206252 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-362f5123-96fc-435a-a4d4-6d34f8b72e6e req-19380ee1-8faa-4d93-8315-a8a631541236 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:36.218854 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-362f5123-96fc-435a-a4d4-6d34f8b72e6e req-19380ee1-8faa-4d93-8315-a8a631541236 service nova] Creating event network-changed:b0568252-2e53-47c0-aee0-1e3e3d839dac for instance 950267d3-bad5-4a93-a98a-4250f9b658ce on n-h2-master-1 Sep 25 02:35:36.225101 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-362f5123-96fc-435a-a4d4-6d34f8b72e6e req-19380ee1-8faa-4d93-8315-a8a631541236 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046349 Sep 25 02:35:36.225968 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3875/7777] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:35:36.241158 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Going to try to terminate instance {{(pid=122385) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:35:36.328641 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f9bc3d26-d6a5-473c-99be-24f7b50b2dbd tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 204 len: 0 microversion: 2.1 time: 0.151987 Sep 25 02:35:36.329950 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3903/7778] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:35:36 2022] DELETE /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:35:36.339702 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:36.341223 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:36.347777 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:36.348372 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:36.348909 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:36.349730 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:36.350601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:36.351111 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:36.551788 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:35:36.559784 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-86d44b91-d5a5-42c5-8888-5eb1440bff7d tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.225049 Sep 25 02:35:36.560385 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3876/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:36 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:37.585214 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:37.586088 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:37.594817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:37.595252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:37.595710 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:37.596445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:37.596923 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:37.597377 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:37.776733 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:35:37.784942 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-772025f8-649c-46a3-9fc1-9624075d194b tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1567 microversion: 2.1 time: 0.204442 Sep 25 02:35:37.785566 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3904/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:37 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:38.523794 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-54f40086-51b6-434b-bac9-d4a84fb827f3 req-62f70706-35bd-4eb7-8892-78777aadf6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950267d3-bad5-4a93-a98a-4250f9b658ce", "name": "network-vif-deleted", "tag": "b0568252-2e53-47c0-aee0-1e3e3d839dac"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:35:38.534228 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-54f40086-51b6-434b-bac9-d4a84fb827f3 req-62f70706-35bd-4eb7-8892-78777aadf6cf service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:38.534714 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-54f40086-51b6-434b-bac9-d4a84fb827f3 req-62f70706-35bd-4eb7-8892-78777aadf6cf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:38.535149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-54f40086-51b6-434b-bac9-d4a84fb827f3 req-62f70706-35bd-4eb7-8892-78777aadf6cf service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:38.547317 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-54f40086-51b6-434b-bac9-d4a84fb827f3 req-62f70706-35bd-4eb7-8892-78777aadf6cf service nova] Creating event network-vif-deleted:b0568252-2e53-47c0-aee0-1e3e3d839dac for instance 950267d3-bad5-4a93-a98a-4250f9b658ce on n-h2-master-1 Sep 25 02:35:38.552668 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-54f40086-51b6-434b-bac9-d4a84fb827f3 req-62f70706-35bd-4eb7-8892-78777aadf6cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Sep 25 02:35:38.553558 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3877/7781] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:35:38.810623 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:38.811915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:38.821219 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:38.822035 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:38.822507 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:38.823251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:38.823734 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:38.824187 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:38.895941 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:35:38.907297 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-8ebce055-a383-4204-9fe9-d9e56f58cbda tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1219 microversion: 2.1 time: 0.102427 Sep 25 02:35:38.908829 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3905/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:38 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:39.934265 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:39.935158 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:39.941499 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:39.942051 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:39.942550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:39.943237 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:39.943686 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:39.944103 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:40.020053 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:35:40.028351 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-76460d49-36a6-4f52-84b8-96c8cf1eb928 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1219 microversion: 2.1 time: 0.100368 Sep 25 02:35:40.028934 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3878/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:39 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:41.051671 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:41.052404 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:41.060264 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:41.060794 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:41.061251 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:41.061987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:41.062486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:41.062927 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:41.129995 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:35:41.141084 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-36f0dae8-f623-4a9a-bd15-1d01f537bcf6 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1219 microversion: 2.1 time: 0.093268 Sep 25 02:35:41.142123 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3906/7784] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:41 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:42.164723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:42.165259 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:42.172468 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:42.172956 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:42.173418 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:42.174130 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:42.174592 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:42.175023 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:42.238139 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba2c22356c54347901fa631b2d2ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ad80c717834d09b7a3e0d396510679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:35:42.247704 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5721305c-d80a-4ff3-acbe-f57a466b5db4 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 200 len: 1219 microversion: 2.1 time: 0.087031 Sep 25 02:35:42.248304 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3879/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:42 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:35:43.271276 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:43.271915 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] [instance: 950267d3-bad5-4a93-a98a-4250f9b658ce] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:35:43.279400 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:43.279916 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:43.280404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:43.281102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:35:43.281610 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:35:43.282059 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:35:43.296573 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] HTTP exception thrown: Instance 950267d3-bad5-4a93-a98a-4250f9b658ce could not be found. Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Request method failure captured: Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce HTTP/1.1 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL7xN5yP9LVe5Ys9ZkE9HLAAW-wUr2oefxPBONxuR9WQqyMKhOHU8IhvV7nPHXhTHHtOuR1cvixJIUorNXxvBXDAHtzM9ush3e86cnI7z1b593Uc5x_vE4PXq0cqgLFTNu8iN6x6rP1V9sqKRkl2dwJmWQN9hpxP6HQQUb6hHSCBwypE Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: 22ad80c717834d09b7a3e0d396510679 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestShelveInstance-1151124943 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/22ad80c717834d09b7a3e0d396510679"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22ad80c717834d09b7a3e0d396510679"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22ad80c717834d09b7a3e0d396510679"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_22ad80c717834d09b7a3e0d396510679"}]}] Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestShelveInstance-1151124943 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: 22ad80c717834d09b7a3e0d396510679 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestShelveInstance-1151124943 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestShelveInstance-1151124943-project Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 2ba2c22356c54347901fa631b2d2ea28 Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestShelveInstance-1151124943-project Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 950267d3-bad5-4a93-a98a-4250f9b658ce could not be found. Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '950267d3-bad5-4a93-a98a-4250f9b658ce'} Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950267d3-bad5-4a93-a98a-4250f9b658ce could not be found. Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950267d3-bad5-4a93-a98a-4250f9b658ce could not be found. Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:35:43.298308 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950267d3-bad5-4a93-a98a-4250f9b658ce could not be found. Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Returning 404 to user: Instance 950267d3-bad5-4a93-a98a-4250f9b658ce could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-7cd3b6c4-2d6a-41cc-96c3-a5113ddc919f tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce" status: 404 len: 111 microversion: 2.1 time: 0.032523 Sep 25 02:35:43.306885 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3907/7786] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:35:43 2022] GET /compute/v2.1/servers/950267d3-bad5-4a93-a98a-4250f9b658ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:35:43.466594 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b621de33-7756-4bdb-bf51-34f9344218e2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] Calling method '.version_select at 0x7f7bf3ec7ca0>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:35:43.498587 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b621de33-7756-4bdb-bf51-34f9344218e2 tempest-TestShelveInstance-1151124943 tempest-TestShelveInstance-1151124943-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-741346414" status: 202 len: 0 microversion: 2.1 time: 0.036055 Sep 25 02:35:43.499580 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3880/7787] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 02:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-741346414 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 02:36:00.820546 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:00.822346 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:01.035652 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-10b30329-b1ae-46e8-9ef5-47233d0df47d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Action: 'create', calling method: .version_select at 0x7f7bf00563a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-51228136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYgzyNB8zyytV9xN9AfOctxyNP1286Rlal1+i7HLxFK5bkM1smBb8K6663GZ/xvZHILgOpz9q6YFbT9FqUAKZYVHEjxRlt2ChDRKJ3oZxf0AYUo0lFHE8ZuImd0ZHtycQ=="}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:36:01.052451 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-10b30329-b1ae-46e8-9ef5-47233d0df47d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Getting quotas for project f3e7e2a4385b4a82b425e2996388b19f. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:36:01.059950 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-10b30329-b1ae-46e8-9ef5-47233d0df47d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Getting quotas for user 50316ca84b47420e93d1a492dbca830a and project f3e7e2a4385b4a82b425e2996388b19f. Resources: {'key_pairs'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:36:01.102960 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-10b30329-b1ae-46e8-9ef5-47233d0df47d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.289161 Sep 25 02:36:01.104044 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3908/7788] 10.222.0.16 () {60 vars in 1159 bytes} [Sun Sep 25 02:36:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:36:02.121670 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=22 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:02.122433 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:02.126531 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-410417407", "imageRef": "a3c714ab-6173-44d8-8a52-bcbf97934f05", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-51228136", "security_groups": [{"name": "tempest-secgroup-smoke-1853269554"}], "networks": [{"uuid": "5e9a570a-2934-4c68-809b-9b3f054222a1"}]}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:36:02.235405 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.network.neutron [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] validate_networks() for [('5e9a570a-2934-4c68-809b-9b3f054222a1', None, None, None, None, None)] {{(pid=122384) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:36:02.627153 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Flavor limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:36:02.627952 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Image limits 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:36:02.628601 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Flavor pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:36:02.629082 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Image pref 0:0:0 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:36:02.629717 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.virt.hardware [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122384) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:36:02.639238 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:02.639736 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:02.640180 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:02.640946 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:02.641424 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:02.641853 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:02.660816 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Getting quotas for project f3e7e2a4385b4a82b425e2996388b19f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:36:02.667428 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.quota [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Getting quotas for user 50316ca84b47420e93d1a492dbca830a and project f3e7e2a4385b4a82b425e2996388b19f. Resources: {'ram', 'instances', 'cores'} {{(pid=122384) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:36:02.680713 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Going to run 1 instances... {{(pid=122384) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:36:02.683337 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3c714ab-6173-44d8-8a52-bcbf97934f05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122384) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:36:02.732925 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-b6cf4d47-d512-481e-82b5-1ff6323bed5c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.613005 Sep 25 02:36:02.733854 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3881/7789] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:36:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:36:02.750802 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ebd7dc26-f522-4aa0-8702-a7b1a2d63db5 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:02.751455 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ebd7dc26-f522-4aa0-8702-a7b1a2d63db5 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:02.812644 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ebd7dc26-f522-4aa0-8702-a7b1a2d63db5 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:02.820170 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ebd7dc26-f522-4aa0-8702-a7b1a2d63db5 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1246 microversion: 2.1 time: 0.079318 Sep 25 02:36:02.820757 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3909/7790] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:02 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:03.845936 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:03.847281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:03.863362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:03.863863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:03.864303 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:03.865072 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:03.865611 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:03.866043 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:03.943338 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:03.951957 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-756ee993-0e00-4bb5-997c-4f82f9514277 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1306 microversion: 2.1 time: 0.111463 Sep 25 02:36:03.967944 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3882/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:03 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:04.977027 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:04.978084 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:04.989380 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:04.990052 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:04.990802 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:05.006128 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:05.006976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:05.007642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:05.177568 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:05.187654 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-72aa9c5b-6abc-4a98-b41b-74c143c1819a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.215827 Sep 25 02:36:05.202532 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3910/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:04 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:05.524781 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-808983e4-9fe6-4cb2-afb9-d4370876b378 req-c44ef98c-ed05-45b4-bf36-f98ba04ec6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:36:05.550032 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-808983e4-9fe6-4cb2-afb9-d4370876b378 req-c44ef98c-ed05-45b4-bf36-f98ba04ec6d5 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:05.550648 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-808983e4-9fe6-4cb2-afb9-d4370876b378 req-c44ef98c-ed05-45b4-bf36-f98ba04ec6d5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:05.551265 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-808983e4-9fe6-4cb2-afb9-d4370876b378 req-c44ef98c-ed05-45b4-bf36-f98ba04ec6d5 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:05.569014 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-808983e4-9fe6-4cb2-afb9-d4370876b378 req-c44ef98c-ed05-45b4-bf36-f98ba04ec6d5 service nova] Creating event network-changed:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:36:05.576821 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-808983e4-9fe6-4cb2-afb9-d4370876b378 req-c44ef98c-ed05-45b4-bf36-f98ba04ec6d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064040 Sep 25 02:36:05.578137 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3883/7793] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:36:06.211038 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:06.211711 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:06.219291 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:06.219795 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:06.220252 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:06.220967 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:06.221460 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:06.221911 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:06.354794 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:06.362587 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-31d68bf8-866c-436c-864d-1f19427d6fed tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.155545 Sep 25 02:36:06.363167 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3911/7794] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:06 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:07.386895 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:07.387644 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:07.395816 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:07.396305 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:07.396747 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:07.397471 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:07.397933 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:07.398361 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:07.531383 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:07.539353 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-28eae8de-2b5f-4546-910e-0b29b546db1f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.156819 Sep 25 02:36:07.539947 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3884/7795] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:07 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:08.563860 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:08.564502 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:08.571404 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:08.571909 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:08.572370 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:08.573836 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:08.574273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:08.574724 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:08.710440 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:08.719334 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b5caf056-e5d1-4791-877b-e04299e616be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.159415 Sep 25 02:36:08.719919 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3912/7796] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:08 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:09.741953 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:09.742566 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:09.749348 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:09.749866 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:09.750296 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:09.750973 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:09.751420 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:09.751841 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:09.886488 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:09.894470 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3afadced-5899-41bf-8a4c-edb3c82b9479 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.156320 Sep 25 02:36:09.895246 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3885/7797] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:09 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:10.919355 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:10.920046 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:10.926350 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:10.926791 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:10.927244 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:10.927964 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:10.928445 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:10.928893 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:11.063226 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:11.071109 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1b372ea3-0722-4589-befe-d4b87df202c8 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.156679 Sep 25 02:36:11.071691 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3913/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:10 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:11.464003 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-e06dbfdf-4213-415b-97b1-3e17c025878b req-87114247-0a55-4368-a7ce-77006482b740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "name": "network-vif-plugged", "status": "completed", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:36:11.473482 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e06dbfdf-4213-415b-97b1-3e17c025878b req-87114247-0a55-4368-a7ce-77006482b740 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:11.474142 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e06dbfdf-4213-415b-97b1-3e17c025878b req-87114247-0a55-4368-a7ce-77006482b740 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:11.474573 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-e06dbfdf-4213-415b-97b1-3e17c025878b req-87114247-0a55-4368-a7ce-77006482b740 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:11.486858 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-e06dbfdf-4213-415b-97b1-3e17c025878b req-87114247-0a55-4368-a7ce-77006482b740 service nova] Creating event network-vif-plugged:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:36:11.491821 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-e06dbfdf-4213-415b-97b1-3e17c025878b req-87114247-0a55-4368-a7ce-77006482b740 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100071 Sep 25 02:36:11.492404 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3886/7799] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:36:12.095401 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:12.096098 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:12.103102 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:12.103660 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:12.104129 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:12.104840 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:12.105318 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:12.105819 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:12.237967 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:12.246477 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-643ccbfb-5979-4655-9486-1fe77ff5796a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1372 microversion: 2.1 time: 0.155090 Sep 25 02:36:12.247059 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3914/7800] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:12 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:13.267035 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:13.267805 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=6 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:13.272281 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:13.273000 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:13.280791 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:13.281280 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:13.281750 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:13.282447 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:13.282910 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:13.283340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:13.416871 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:13.424733 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-422e43f3-060c-4266-ad22-38184496b9be tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1558 microversion: 2.1 time: 0.159504 Sep 25 02:36:13.425313 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3887/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:13 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:13.446736 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:36:13.447886 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:36:13.449795 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=6 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:36:13.456070 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:13.456571 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:13.457030 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:13.457798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:13.458273 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:13.458717 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:13.592923 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:36:13.600860 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-1f7f1260-1620-4641-938c-2331062cc36c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1558 microversion: 2.1 time: 0.158039 Sep 25 02:36:13.601460 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3915/7802] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:36:13 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:36:15.556723 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-29cdb9a7-15bc-40f8-839f-de46aec7e291 req-6b171c64-747e-4493-8d9b-9508a5ec9454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:36:15.567082 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29cdb9a7-15bc-40f8-839f-de46aec7e291 req-6b171c64-747e-4493-8d9b-9508a5ec9454 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:36:15.567708 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29cdb9a7-15bc-40f8-839f-de46aec7e291 req-6b171c64-747e-4493-8d9b-9508a5ec9454 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:36:15.568209 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-29cdb9a7-15bc-40f8-839f-de46aec7e291 req-6b171c64-747e-4493-8d9b-9508a5ec9454 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:36:15.579805 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-29cdb9a7-15bc-40f8-839f-de46aec7e291 req-6b171c64-747e-4493-8d9b-9508a5ec9454 service nova] Creating event network-changed:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:36:15.585374 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-29cdb9a7-15bc-40f8-839f-de46aec7e291 req-6b171c64-747e-4493-8d9b-9508a5ec9454 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032531 Sep 25 02:36:15.586113 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3888/7803] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:38:41.739243 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:38:41.740102 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc84e85e-dedb-4daa-b018-ffc2f4bea8d7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:38:41.740902 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:41.741777 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=36 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:41.742919 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:38:41.743059 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b/action (ip 10.222.0.16) !!! Sep 25 02:38:41.744613 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 02:38:41.744613 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b/action (ip 10.222.0.16) !!! Sep 25 02:38:41.745362 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:38:41.745617 n-d-master-1 devstack@n-api.service[122385]: Sun Sep 25 02:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b/action (ip 10.222.0.16) !!! Sep 25 02:38:41.751123 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1185518646"}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:38:41.753668 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:38:41.764749 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:38:41.765260 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:38:41.765750 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:38:41.766469 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:38:41.766976 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:38:41.767533 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:38:41.977281 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-33e908f9-b755-4f06-b005-90c5b324371a tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "POST /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b/action" status: 202 len: 0 microversion: 2.1 time: 0.239686 Sep 25 02:38:41.977965 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3916/7804] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:38:41 2022] POST /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 25 02:38:48.100302 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71316119-ca8d-457e-a845-7566a7d0a6aa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:38:48.101549 n-d-master-1 devstack@n-api.service[122384]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8553e11c-cff0-496f-9dce-acabc3fc9342] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 02:38:48.102216 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:48.102951 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=32 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:38:48.104052 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:38:48.104317 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 25 02:38:48.105598 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:38:48.105724 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 25 02:38:48.106847 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 02:38:48.106975 n-d-master-1 devstack@n-api.service[122384]: Sun Sep 25 02:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 25 02:38:48.113441 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-08700a1f-54f7-49d0-84bb-22671117b468 req-a9936357-26c1-4cb1-af7c-254dbb847ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "name": "network-vif-plugged", "status": "completed", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:38:48.128332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08700a1f-54f7-49d0-84bb-22671117b468 req-a9936357-26c1-4cb1-af7c-254dbb847ead service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:38:48.128808 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08700a1f-54f7-49d0-84bb-22671117b468 req-a9936357-26c1-4cb1-af7c-254dbb847ead service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:38:48.129319 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-08700a1f-54f7-49d0-84bb-22671117b468 req-a9936357-26c1-4cb1-af7c-254dbb847ead service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:38:48.149216 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-08700a1f-54f7-49d0-84bb-22671117b468 req-a9936357-26c1-4cb1-af7c-254dbb847ead service nova] Creating event network-vif-plugged:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:38:48.158355 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-08700a1f-54f7-49d0-84bb-22671117b468 req-a9936357-26c1-4cb1-af7c-254dbb847ead service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059973 Sep 25 02:38:48.158972 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3889/7805] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:39:01.681237 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:01.682059 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:01.686861 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1102751091", "imageRef": "c7b0eb72-a7d3-4141-9f28-b7fad58fd557", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-51228136", "security_groups": [{"name": "tempest-secgroup-smoke-1853269554"}], "networks": [{"uuid": "5e9a570a-2934-4c68-809b-9b3f054222a1"}]}} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:39:01.717488 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53050. Sep 25 02:39:01.718488 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc84e85e-dedb-4daa-b018-ffc2f4bea8d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53052. Sep 25 02:39:01.805196 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.network.neutron [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] validate_networks() for [('5e9a570a-2934-4c68-809b-9b3f054222a1', None, None, None, None, None)] {{(pid=122385) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 02:39:02.226898 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Flavor limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 02:39:02.227346 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Image limits 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 02:39:02.227843 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Flavor pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 02:39:02.228272 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Image pref 0:0:0 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 02:39:02.228710 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.virt.hardware [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 02:39:02.237642 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:02.238146 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:02.238604 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:02.239904 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:02.240379 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:02.240825 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:02.258459 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Getting quotas for project f3e7e2a4385b4a82b425e2996388b19f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 02:39:02.263747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.quota [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Getting quotas for user 50316ca84b47420e93d1a492dbca830a and project f3e7e2a4385b4a82b425e2996388b19f. Resources: {'ram', 'instances', 'cores'} {{(pid=122385) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 02:39:02.276417 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Going to run 1 instances... {{(pid=122385) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 02:39:02.278984 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b0eb72-a7d3-4141-9f28-b7fad58fd557',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 02:39:02.328889 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b4f8e3e9-c956-410e-87e6-26b9e59f72fd tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650505 Sep 25 02:39:02.329576 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3917/7806] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 25 02:39:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 02:39:02.341918 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-282cfc64-d31b-4203-87ae-c3723d8ac619 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:02.342632 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-282cfc64-d31b-4203-87ae-c3723d8ac619 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:02.347618 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:02.348614 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:02.355914 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] [8553e11c-cff0-496f-9dce-acabc3fc9342] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53070. Sep 25 02:39:02.365193 n-d-master-1 devstack@n-api.service[122384]: INFO oslo.messaging._drivers.impl_rabbit [-] [71316119-ca8d-457e-a845-7566a7d0a6aa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53068. Sep 25 02:39:02.419248 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-282cfc64-d31b-4203-87ae-c3723d8ac619 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:02.427478 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-282cfc64-d31b-4203-87ae-c3723d8ac619 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1247 microversion: 2.1 time: 0.089958 Sep 25 02:39:02.428042 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3890/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:02 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:03.450686 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-16861d23-15e3-462d-a768-104ea55e84fb tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:03.451321 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-16861d23-15e3-462d-a768-104ea55e84fb tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:03.510369 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-16861d23-15e3-462d-a768-104ea55e84fb tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:03.517307 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-16861d23-15e3-462d-a768-104ea55e84fb tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1247 microversion: 2.1 time: 0.071326 Sep 25 02:39:03.517928 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3918/7808] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:03 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:04.155522 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-f6e1fa51-c287-4b92-a1f1-0341ef09212b req-0b9eb601-c77b-48a2-b91f-61f02506e722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:39:04.167014 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f6e1fa51-c287-4b92-a1f1-0341ef09212b req-0b9eb601-c77b-48a2-b91f-61f02506e722 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:04.167766 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f6e1fa51-c287-4b92-a1f1-0341ef09212b req-0b9eb601-c77b-48a2-b91f-61f02506e722 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:04.168224 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-f6e1fa51-c287-4b92-a1f1-0341ef09212b req-0b9eb601-c77b-48a2-b91f-61f02506e722 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:04.182942 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-f6e1fa51-c287-4b92-a1f1-0341ef09212b req-0b9eb601-c77b-48a2-b91f-61f02506e722 service nova] Creating event network-vif-unplugged:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:39:04.188285 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-f6e1fa51-c287-4b92-a1f1-0341ef09212b req-0b9eb601-c77b-48a2-b91f-61f02506e722 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036503 Sep 25 02:39:04.189120 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3891/7809] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:39:04.541184 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-ab0f1771-dfe0-4917-ab46-896b754b632f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:04.541857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-ab0f1771-dfe0-4917-ab46-896b754b632f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:04.596608 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-ab0f1771-dfe0-4917-ab46-896b754b632f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:04.604612 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-ab0f1771-dfe0-4917-ab46-896b754b632f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1247 microversion: 2.1 time: 0.067453 Sep 25 02:39:04.605183 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3919/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:04 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:05.628745 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-14242ecc-0244-4f80-a7be-d187eb78cb8d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:05.629539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-14242ecc-0244-4f80-a7be-d187eb78cb8d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:05.689796 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-14242ecc-0244-4f80-a7be-d187eb78cb8d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:05.697632 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-14242ecc-0244-4f80-a7be-d187eb78cb8d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1247 microversion: 2.1 time: 0.073897 Sep 25 02:39:05.700930 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3892/7811] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:05 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:06.720535 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:06.721081 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:06.730177 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:06.730682 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:06.731140 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:06.731880 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:06.732355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:06.732798 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:06.794562 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:06.802702 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f31beb2e-2144-4af0-8d77-f5d4344d2649 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1251 microversion: 2.1 time: 0.086406 Sep 25 02:39:06.803471 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3920/7812] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:06 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1251 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:07.825543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:07.826779 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:07.834709 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:07.835250 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:07.835690 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:07.837046 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:07.837540 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:07.837980 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:07.907298 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:07.916150 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6e146aed-d3ca-4579-88eb-e9a36277a036 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1299 microversion: 2.1 time: 0.094548 Sep 25 02:39:07.916724 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3893/7813] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:07 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:08.940585 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:08.941139 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:08.949669 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:08.950592 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:08.951296 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:08.952304 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:08.953015 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:08.953817 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:09.060664 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:09.078008 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-61f4cf72-cd80-4fc5-8d51-1a0795d94cd0 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1305 microversion: 2.1 time: 0.141496 Sep 25 02:39:09.079086 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3921/7814] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:08 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:10.103692 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:10.104313 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:10.111278 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:10.111774 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:10.112217 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:10.112926 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:10.113376 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:10.114703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:10.301830 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:10.311931 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5dfa1ea2-af91-4009-bbb0-8b104150cc87 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.211783 Sep 25 02:39:10.334435 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3894/7815] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:10 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:11.340206 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:11.340840 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:11.347806 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:11.349106 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:11.349810 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:11.350538 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:11.351007 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:11.351448 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:11.509773 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:11.517994 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-fd726b6b-9cde-43e9-b431-8fdb46cb9b32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.181603 Sep 25 02:39:11.529428 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3922/7816] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:11 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:12.542986 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:12.544002 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:12.551332 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:12.551828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:12.552261 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:12.552966 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:12.553440 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:12.553864 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:12.704515 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:12.717514 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-141e0945-f7c7-4c75-9e99-c4b49bb68f65 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.178902 Sep 25 02:39:12.718320 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3895/7817] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:12 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:13.740646 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:13.741203 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:13.743195 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=2 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:13.749702 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:13.750204 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:13.750797 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:13.751425 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:13.751905 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:13.752361 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:13.899429 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:13.909919 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-64c5a325-18c5-489f-8452-767d50871dbe tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.172839 Sep 25 02:39:13.926795 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3923/7818] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:13 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:14.936427 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:14.938045 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:14.946362 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:14.946852 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:14.947291 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:14.950429 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:14.953171 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:14.955803 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:15.114543 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:15.122486 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f55fad92-5c3f-4bcf-97ac-b30f14b05a7b tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.190097 Sep 25 02:39:15.123077 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3896/7819] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:14 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:16.146893 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:16.147542 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:16.149360 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell0:SELECT=10 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:16.155612 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:16.156114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:16.156580 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:16.157297 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:16.157809 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:16.158232 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:16.295201 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:16.303480 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-b2044861-78fe-462d-bfa3-b2ddccb5a303 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.161107 Sep 25 02:39:16.304074 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3924/7820] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:16 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:16.944901 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell0:SELECT=4 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:39:17.043057 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [req-1ec39d91-b2bc-4871-a107-1e9718b41d29 req-dd5f68d5-50c6-46ef-b4c5-0521d66e8bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2975f025-2fcc-4424-9d39-e13f095a43ba", "tag": "8a8559d9-e369-4d71-b06b-652c43e07531"}]} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:39:17.053351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1ec39d91-b2bc-4871-a107-1e9718b41d29 req-dd5f68d5-50c6-46ef-b4c5-0521d66e8bb3 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:17.054513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1ec39d91-b2bc-4871-a107-1e9718b41d29 req-dd5f68d5-50c6-46ef-b4c5-0521d66e8bb3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:17.054954 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [req-1ec39d91-b2bc-4871-a107-1e9718b41d29 req-dd5f68d5-50c6-46ef-b4c5-0521d66e8bb3 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:17.066301 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.compute.server_external_events [req-1ec39d91-b2bc-4871-a107-1e9718b41d29 req-dd5f68d5-50c6-46ef-b4c5-0521d66e8bb3 service nova] Creating event network-changed:8a8559d9-e369-4d71-b06b-652c43e07531 for instance 2975f025-2fcc-4424-9d39-e13f095a43ba on n-h1-master-1 Sep 25 02:39:17.072005 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [req-1ec39d91-b2bc-4871-a107-1e9718b41d29 req-dd5f68d5-50c6-46ef-b4c5-0521d66e8bb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132263 Sep 25 02:39:17.072617 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3897/7821] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:39:17.326131 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:17.326790 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:17.333830 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:17.334417 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:17.334886 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:17.335639 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:17.336122 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:17.336572 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:17.479362 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:17.487295 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-81621cc8-3cc8-4fd9-a6bc-37d296326fe9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.165206 Sep 25 02:39:17.487896 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3925/7822] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:17 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:18.512741 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:18.513479 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:18.520340 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:18.520845 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:18.521391 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:18.522115 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:18.522568 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:18.522994 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:18.658820 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:18.668000 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-f59a0eb0-7df4-41ee-8d1e-5e93bfe4bc32 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.160185 Sep 25 02:39:18.668692 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3898/7823] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:18 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:19.691489 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:19.692150 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:19.699387 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:19.699884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:19.700335 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:19.701042 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:19.701531 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:19.701968 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:19.840857 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:19.848894 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-849a92aa-e2cf-46cd-8549-61ed23ca531f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.161363 Sep 25 02:39:19.849565 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3926/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:19 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:20.871856 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:20.872470 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:20.879444 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:20.880122 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:20.880767 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:20.881351 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:20.881836 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:20.882022 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:21.046760 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:21.054565 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-1a3aa200-a242-466c-88ff-e1d5b1b7274e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.186611 Sep 25 02:39:21.055154 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3899/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:20 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:21.147877 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a069796c-5979-4d13-b01e-eabbc3d9ee77 req-b80bab82-ddd4-4215-ae5d-eecc7fabd8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2975f025-2fcc-4424-9d39-e13f095a43ba", "name": "network-vif-plugged", "status": "completed", "tag": "8a8559d9-e369-4d71-b06b-652c43e07531"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:39:21.159472 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a069796c-5979-4d13-b01e-eabbc3d9ee77 req-b80bab82-ddd4-4215-ae5d-eecc7fabd8b0 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:21.160055 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a069796c-5979-4d13-b01e-eabbc3d9ee77 req-b80bab82-ddd4-4215-ae5d-eecc7fabd8b0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:21.160524 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a069796c-5979-4d13-b01e-eabbc3d9ee77 req-b80bab82-ddd4-4215-ae5d-eecc7fabd8b0 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:21.173001 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a069796c-5979-4d13-b01e-eabbc3d9ee77 req-b80bab82-ddd4-4215-ae5d-eecc7fabd8b0 service nova] Creating event network-vif-plugged:8a8559d9-e369-4d71-b06b-652c43e07531 for instance 2975f025-2fcc-4424-9d39-e13f095a43ba on n-h1-master-1 Sep 25 02:39:21.178271 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a069796c-5979-4d13-b01e-eabbc3d9ee77 req-b80bab82-ddd4-4215-ae5d-eecc7fabd8b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034917 Sep 25 02:39:21.178893 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3927/7826] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:39:22.077206 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:22.077846 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:22.085599 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:22.086078 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:22.086513 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:22.087199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:22.087651 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:22.088349 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:22.220332 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:22.228194 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-6272f2d9-acc3-44a2-84a1-68d35fc7eaae tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1373 microversion: 2.1 time: 0.154925 Sep 25 02:39:22.228786 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3900/7827] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:22 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:23.253177 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:23.253931 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:23.260382 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:23.260885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:23.261343 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:23.262080 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:23.262563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:23.263012 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:23.398457 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:23.406220 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-19705b0b-30db-4670-915e-c4d1559dd54e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1558 microversion: 2.1 time: 0.158239 Sep 25 02:39:23.406794 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3928/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:23 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:23.429552 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:39:23.430168 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:39:23.436972 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:23.437478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:23.437914 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:23.438601 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:23.439055 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:23.439476 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:23.571129 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:39:23.578936 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-350fadf8-cf68-4fe2-ab37-aafe232782a9 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1558 microversion: 2.1 time: 0.153951 Sep 25 02:39:23.579512 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3901/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:39:23 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:39:25.514829 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-99372612-e11b-4cf1-978f-a010ec659cc1 req-3c101c27-a918-43d3-ac10-6b09ac445e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2975f025-2fcc-4424-9d39-e13f095a43ba", "tag": "8a8559d9-e369-4d71-b06b-652c43e07531"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:39:25.524440 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99372612-e11b-4cf1-978f-a010ec659cc1 req-3c101c27-a918-43d3-ac10-6b09ac445e6c service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:39:25.524935 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99372612-e11b-4cf1-978f-a010ec659cc1 req-3c101c27-a918-43d3-ac10-6b09ac445e6c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:39:25.525383 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-99372612-e11b-4cf1-978f-a010ec659cc1 req-3c101c27-a918-43d3-ac10-6b09ac445e6c service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:39:25.537682 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-99372612-e11b-4cf1-978f-a010ec659cc1 req-3c101c27-a918-43d3-ac10-6b09ac445e6c service nova] Creating event network-changed:8a8559d9-e369-4d71-b06b-652c43e07531 for instance 2975f025-2fcc-4424-9d39-e13f095a43ba on n-h1-master-1 Sep 25 02:39:25.543178 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-99372612-e11b-4cf1-978f-a010ec659cc1 req-3c101c27-a918-43d3-ac10-6b09ac445e6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087295 Sep 25 02:39:25.543903 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3929/7830] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:40:56.816485 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=28 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:40:56.817340 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=52 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:40:56.822960 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-977273188"}} {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:40:56.825351 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:40:56.833365 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:40:56.833863 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:40:56.834292 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:40:56.834975 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:40:56.835421 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:40:56.835840 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:40:57.217836 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-c66373b7-e454-4155-8127-326b79d4a331 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "POST /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba/action" status: 202 len: 0 microversion: 2.1 time: 0.403173 Sep 25 02:40:57.218490 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3902/7831] 10.222.0.16 () {60 vars in 1278 bytes} [Sun Sep 25 02:40:56 2022] POST /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 25 02:41:03.532884 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 25 02:41:03.534954 n-d-master-1 devstack@n-api.service[122385]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc84e85e-dedb-4daa-b018-ffc2f4bea8d7] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 25 02:41:03.536065 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:03.536975 n-d-master-1 devstack@n-api.service[122385]: DEBUG dbcounter [-] [122385] Writing DB stats nova_cell1:SELECT=54 {{(pid=122385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:03.547082 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-6252d2b7-52e8-48a2-a902-fa32042e5561 req-8b81ba94-b233-40fc-a7b1-db6b5444025b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2975f025-2fcc-4424-9d39-e13f095a43ba", "name": "network-vif-plugged", "status": "completed", "tag": "8a8559d9-e369-4d71-b06b-652c43e07531"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:41:03.564493 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6252d2b7-52e8-48a2-a902-fa32042e5561 req-8b81ba94-b233-40fc-a7b1-db6b5444025b service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:03.564953 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6252d2b7-52e8-48a2-a902-fa32042e5561 req-8b81ba94-b233-40fc-a7b1-db6b5444025b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:03.565486 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-6252d2b7-52e8-48a2-a902-fa32042e5561 req-8b81ba94-b233-40fc-a7b1-db6b5444025b service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:03.578867 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-6252d2b7-52e8-48a2-a902-fa32042e5561 req-8b81ba94-b233-40fc-a7b1-db6b5444025b service nova] Creating event network-vif-plugged:8a8559d9-e369-4d71-b06b-652c43e07531 for instance 2975f025-2fcc-4424-9d39-e13f095a43ba on n-h1-master-1 Sep 25 02:41:03.586682 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-6252d2b7-52e8-48a2-a902-fa32042e5561 req-8b81ba94-b233-40fc-a7b1-db6b5444025b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056303 Sep 25 02:41:03.587617 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3930/7832] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:41:10.871681 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_api:SELECT=2 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:10.872712 n-d-master-1 devstack@n-api.service[122384]: DEBUG dbcounter [-] [122384] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 02:41:10.876469 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-43390583-49b2-40d0-9c2d-0469008535a4 req-59bcc05e-2a85-44af-8e75-317c53bdb1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2975f025-2fcc-4424-9d39-e13f095a43ba", "tag": "8a8559d9-e369-4d71-b06b-652c43e07531"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:41:10.877608 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:10.879756 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:10.892096 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-43390583-49b2-40d0-9c2d-0469008535a4 req-59bcc05e-2a85-44af-8e75-317c53bdb1bc service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:10.892507 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:10.892885 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-43390583-49b2-40d0-9c2d-0469008535a4 req-59bcc05e-2a85-44af-8e75-317c53bdb1bc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:10.893214 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:10.893696 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-43390583-49b2-40d0-9c2d-0469008535a4 req-59bcc05e-2a85-44af-8e75-317c53bdb1bc service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:10.893869 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:10.895669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:10.895669 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:10.896149 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:10.906213 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1166447-777e-4355-8a9a-f9bb2dee251e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53366. Sep 25 02:41:10.909628 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-43390583-49b2-40d0-9c2d-0469008535a4 req-59bcc05e-2a85-44af-8e75-317c53bdb1bc service nova] Creating event network-changed:8a8559d9-e369-4d71-b06b-652c43e07531 for instance 2975f025-2fcc-4424-9d39-e13f095a43ba on n-h1-master-1 Sep 25 02:41:10.913566 n-d-master-1 devstack@n-api.service[122385]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc84e85e-dedb-4daa-b018-ffc2f4bea8d7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53368. Sep 25 02:41:10.915505 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-43390583-49b2-40d0-9c2d-0469008535a4 req-59bcc05e-2a85-44af-8e75-317c53bdb1bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043752 Sep 25 02:41:10.916294 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3931/7833] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:41:10.931070 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:41:11.017857 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd637dbe-0d2e-47ab-976e-99ab944ac56e tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 204 len: 0 microversion: 2.1 time: 0.148194 Sep 25 02:41:11.018501 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3903/7834] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:41:10 2022] DELETE /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:41:11.029205 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:11.029971 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:11.038189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:11.038704 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:11.039167 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:11.039884 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:11.040355 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:11.040991 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:11.256889 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:41:11.264807 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6db901a5-1ee1-45b9-970b-23e82f144f23 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1682 microversion: 2.1 time: 0.241047 Sep 25 02:41:11.265394 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3932/7835] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:11 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:41:12.289687 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:12.290396 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:12.297478 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:12.297967 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:12.298402 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:12.299092 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:12.299542 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:12.299963 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:12.437289 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:41:12.446058 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-16810d83-e0ae-4119-a4fd-c6341b16be3f tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1682 microversion: 2.1 time: 0.160703 Sep 25 02:41:12.446646 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3904/7836] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:12 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:41:13.427986 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-a5782dcb-54ca-44c7-8697-6144b4514560 req-41187904-cc83-42f8-b8f9-4b962b604064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2975f025-2fcc-4424-9d39-e13f095a43ba", "name": "network-vif-deleted", "tag": "8a8559d9-e369-4d71-b06b-652c43e07531"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:41:13.445563 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a5782dcb-54ca-44c7-8697-6144b4514560 req-41187904-cc83-42f8-b8f9-4b962b604064 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:13.446461 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a5782dcb-54ca-44c7-8697-6144b4514560 req-41187904-cc83-42f8-b8f9-4b962b604064 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:13.446999 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-a5782dcb-54ca-44c7-8697-6144b4514560 req-41187904-cc83-42f8-b8f9-4b962b604064 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:13.462986 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-a5782dcb-54ca-44c7-8697-6144b4514560 req-41187904-cc83-42f8-b8f9-4b962b604064 service nova] Creating event network-vif-deleted:8a8559d9-e369-4d71-b06b-652c43e07531 for instance 2975f025-2fcc-4424-9d39-e13f095a43ba on n-h1-master-1 Sep 25 02:41:13.469370 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-a5782dcb-54ca-44c7-8697-6144b4514560 req-41187904-cc83-42f8-b8f9-4b962b604064 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045790 Sep 25 02:41:13.470467 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3933/7837] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:41:13.470668 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:13.471430 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:13.482528 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:13.483116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:13.483666 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:13.484457 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:13.484993 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:13.485524 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:13.563539 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:41:13.572833 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-bd8f4db9-7806-4766-8ab2-d657f676a981 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 200 len: 1332 microversion: 2.1 time: 0.107106 Sep 25 02:41:13.573560 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3905/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:13 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:41:14.597532 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:14.598501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 2975f025-2fcc-4424-9d39-e13f095a43ba] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:14.604594 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:14.605086 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:14.605588 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:14.606284 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:14.606751 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:14.607189 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:14.621342 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.wsgi [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] HTTP exception thrown: Instance 2975f025-2fcc-4424-9d39-e13f095a43ba could not be found. Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Request method failure captured: Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: request: GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba HTTP/1.1 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Accept: application/json Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Accept-Encoding: identity Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Connection: close Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Content-Length: 0 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Content-Type: application/json Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Host: 10.222.0.16 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: Openstack-System-Scope: None Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: User-Agent: python-urllib3/1.26.12 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Auth-Token: gAAAAABjL76LkXa8OPhIuu80z35Yl5eTMEX-vkuKuqSzFr1De1yCyoxMhFUViQK_mkbkJynhrsxmSzq4wV8OIkXfUaXvsUzrJlE8WvXGVut900fZs0stuYbDAIjCJA92OmEVe0N7e5obY4AJ_oZmLGj5s-GShFVpMNxAiqCJCcl_SxPkG8CgJoY Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Id: None Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Domain-Name: None Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Identity-Status: Confirmed Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Is-Admin-Project: True Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Id: default Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Project-Domain-Name: Default Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Project-Id: f3e7e2a4385b4a82b425e2996388b19f Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Project-Name: tempest-TestSnapshotPattern-496205457 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Role: reader,member Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Roles: reader,member Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3e7e2a4385b4a82b425e2996388b19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3e7e2a4385b4a82b425e2996388b19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3e7e2a4385b4a82b425e2996388b19f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3e7e2a4385b4a82b425e2996388b19f"}]}] Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Tenant: tempest-TestSnapshotPattern-496205457 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Id: f3e7e2a4385b4a82b425e2996388b19f Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-Tenant-Name: tempest-TestSnapshotPattern-496205457 Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-User: tempest-TestSnapshotPattern-496205457-project Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Id: default Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-User-Domain-Name: Default Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-User-Id: 50316ca84b47420e93d1a492dbca830a Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: X-User-Name: tempest-TestSnapshotPattern-496205457-project Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: method: > Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: exception: Instance 2975f025-2fcc-4424-9d39-e13f095a43ba could not be found. Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: action_args: {'id': '2975f025-2fcc-4424-9d39-e13f095a43ba'} Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2975f025-2fcc-4424-9d39-e13f095a43ba could not be found. Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2975f025-2fcc-4424-9d39-e13f095a43ba could not be found. Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:41:14.622998 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2975f025-2fcc-4424-9d39-e13f095a43ba could not be found. Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: ERROR nova.api.openstack.wsgi Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Returning 404 to user: Instance 2975f025-2fcc-4424-9d39-e13f095a43ba could not be found. {{(pid=122385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-6ed9ae35-1d15-4583-8f95-585b4b66c412 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba" status: 404 len: 111 microversion: 2.1 time: 0.032048 Sep 25 02:41:14.628501 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3934/7839] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:14 2022] GET /compute/v2.1/servers/2975f025-2fcc-4424-9d39-e13f095a43ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:41:15.964551 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:15.965096 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-d9eb7650-ab6f-401a-8031-ade683fc4e0e req-2c1bf3bc-0632-4ba6-8354-c70050a74674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:41:15.966184 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:15.974703 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:15.976116 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:15.976833 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:15.978109 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d9eb7650-ab6f-401a-8031-ade683fc4e0e req-2c1bf3bc-0632-4ba6-8354-c70050a74674 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:15.978619 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d9eb7650-ab6f-401a-8031-ade683fc4e0e req-2c1bf3bc-0632-4ba6-8354-c70050a74674 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:15.978828 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:15.979482 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-d9eb7650-ab6f-401a-8031-ade683fc4e0e req-2c1bf3bc-0632-4ba6-8354-c70050a74674 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:15.980244 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:15.980922 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:15.994814 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-d9eb7650-ab6f-401a-8031-ade683fc4e0e req-2c1bf3bc-0632-4ba6-8354-c70050a74674 service nova] Creating event network-changed:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:41:16.000286 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-d9eb7650-ab6f-401a-8031-ade683fc4e0e req-2c1bf3bc-0632-4ba6-8354-c70050a74674 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042686 Sep 25 02:41:16.005305 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3935/7840] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 02:41:16.018620 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Going to try to terminate instance {{(pid=122384) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 02:41:16.122791 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-3b1814ce-8412-49a8-b0e2-49b6bed67e9c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 204 len: 0 microversion: 2.1 time: 0.167689 Sep 25 02:41:16.124194 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3906/7841] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 25 02:41:15 2022] DELETE /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 02:41:16.133747 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:16.134870 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.compute.api [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122385) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:16.141987 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:16.142596 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:16.143132 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:16.143983 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:16.145328 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:16.146084 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:16.302856 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.policy [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122385) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:41:16.310876 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-f9cdaa38-a7de-4132-a2c7-a8732a8771ef tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1683 microversion: 2.1 time: 0.182377 Sep 25 02:41:16.311372 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3936/7842] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:16 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:41:17.336247 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:17.336908 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:17.343931 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:17.344368 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:17.344815 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:17.345550 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:17.346013 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:17.346441 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:17.497884 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.policy [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50316ca84b47420e93d1a492dbca830a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e7e2a4385b4a82b425e2996388b19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122384) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 02:41:17.506781 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-5c0aebc4-7657-4648-b314-f1512538d94d tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 200 len: 1564 microversion: 2.1 time: 0.175732 Sep 25 02:41:17.507614 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3907/7843] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:17 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 02:41:17.536450 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [req-627aaf74-f529-4c8f-a9d9-d09ba3dba1dd req-a9aa9d16-38bf-4fee-94fe-ea2c92adaa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d502a3c-ac83-4e07-af03-11a12f757a2b", "name": "network-vif-deleted", "tag": "24198939-d4e8-462d-9a7f-e03b29f9f5f7"}]} {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 02:41:17.548614 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-627aaf74-f529-4c8f-a9d9-d09ba3dba1dd req-a9aa9d16-38bf-4fee-94fe-ea2c92adaa32 service nova] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:17.549114 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-627aaf74-f529-4c8f-a9d9-d09ba3dba1dd req-a9aa9d16-38bf-4fee-94fe-ea2c92adaa32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:17.549601 n-d-master-1 devstack@n-api.service[122385]: DEBUG oslo_concurrency.lockutils [req-627aaf74-f529-4c8f-a9d9-d09ba3dba1dd req-a9aa9d16-38bf-4fee-94fe-ea2c92adaa32 service nova] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:17.562673 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.compute.server_external_events [req-627aaf74-f529-4c8f-a9d9-d09ba3dba1dd req-a9aa9d16-38bf-4fee-94fe-ea2c92adaa32 service nova] Creating event network-vif-deleted:24198939-d4e8-462d-9a7f-e03b29f9f5f7 for instance 9d502a3c-ac83-4e07-af03-11a12f757a2b on n-h2-master-1 Sep 25 02:41:17.569037 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [req-627aaf74-f529-4c8f-a9d9-d09ba3dba1dd req-a9aa9d16-38bf-4fee-94fe-ea2c92adaa32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036322 Sep 25 02:41:17.569688 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3937/7844] 10.222.0.16 () {64 vars in 1317 bytes} [Sun Sep 25 02:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 02:41:18.531370 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '>' {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:18.531989 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.compute.api [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] [instance: 9d502a3c-ac83-4e07-af03-11a12f757a2b] Fetching instance by UUID {{(pid=122384) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 02:41:18.539637 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:18.540128 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:18.540570 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:18.541277 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Acquiring lock "565278a3-bcc6-4580-bd99-37100e140af1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 02:41:18.541768 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 02:41:18.542199 n-d-master-1 devstack@n-api.service[122384]: DEBUG oslo_concurrency.lockutils [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Lock "565278a3-bcc6-4580-bd99-37100e140af1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 02:41:18.556346 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.wsgi [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] HTTP exception thrown: Instance 9d502a3c-ac83-4e07-af03-11a12f757a2b could not be found. Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Request method failure captured: Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: request: GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b HTTP/1.1 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Accept: application/json Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Accept-Encoding: identity Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Connection: close Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Content-Length: 0 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Content-Type: application/json Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Host: 10.222.0.16 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: Openstack-System-Scope: None Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: User-Agent: python-urllib3/1.26.12 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Auth-Token: gAAAAABjL76LkXa8OPhIuu80z35Yl5eTMEX-vkuKuqSzFr1De1yCyoxMhFUViQK_mkbkJynhrsxmSzq4wV8OIkXfUaXvsUzrJlE8WvXGVut900fZs0stuYbDAIjCJA92OmEVe0N7e5obY4AJ_oZmLGj5s-GShFVpMNxAiqCJCcl_SxPkG8CgJoY Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Id: None Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Domain-Name: None Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Identity-Status: Confirmed Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Is-Admin-Project: True Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Id: default Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Domain-Name: Default Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Id: f3e7e2a4385b4a82b425e2996388b19f Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Project-Name: tempest-TestSnapshotPattern-496205457 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Role: reader,member Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Roles: reader,member Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3e7e2a4385b4a82b425e2996388b19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3e7e2a4385b4a82b425e2996388b19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3e7e2a4385b4a82b425e2996388b19f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3e7e2a4385b4a82b425e2996388b19f"}]}] Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Tenant: tempest-TestSnapshotPattern-496205457 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Id: f3e7e2a4385b4a82b425e2996388b19f Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-Tenant-Name: tempest-TestSnapshotPattern-496205457 Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-User: tempest-TestSnapshotPattern-496205457-project Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Id: default Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-User-Domain-Name: Default Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-User-Id: 50316ca84b47420e93d1a492dbca830a Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: X-User-Name: tempest-TestSnapshotPattern-496205457-project Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: method: > Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: exception: Instance 9d502a3c-ac83-4e07-af03-11a12f757a2b could not be found. Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: action_args: {'id': '9d502a3c-ac83-4e07-af03-11a12f757a2b'} Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: {{(pid=122384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d502a3c-ac83-4e07-af03-11a12f757a2b could not be found. Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d502a3c-ac83-4e07-af03-11a12f757a2b could not be found. Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 02:41:18.559085 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d502a3c-ac83-4e07-af03-11a12f757a2b could not be found. Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: ERROR nova.api.openstack.wsgi Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: DEBUG nova.api.openstack.wsgi [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Returning 404 to user: Instance 9d502a3c-ac83-4e07-af03-11a12f757a2b could not be found. {{(pid=122384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: INFO nova.api.openstack.requestlog [None req-8318db51-e2fa-4508-b964-d317c4b8d50c tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b" status: 404 len: 111 microversion: 2.1 time: 0.033120 Sep 25 02:41:18.563785 n-d-master-1 devstack@n-api.service[122384]: [pid: 122384|app: 0|req: 3908/7845] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 25 02:41:18 2022] GET /compute/v2.1/servers/9d502a3c-ac83-4e07-af03-11a12f757a2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 02:41:18.723317 n-d-master-1 devstack@n-api.service[122385]: DEBUG nova.api.openstack.wsgi [None req-a093c42b-1e44-437c-b5f3-a6a04b1cf3b4 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] Calling method '.version_select at 0x7f7beae2da60>' {{(pid=122385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 02:41:18.751768 n-d-master-1 devstack@n-api.service[122385]: INFO nova.api.openstack.requestlog [None req-a093c42b-1e44-437c-b5f3-a6a04b1cf3b4 tempest-TestSnapshotPattern-496205457 tempest-TestSnapshotPattern-496205457-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-51228136" status: 202 len: 0 microversion: 2.1 time: 0.032874 Sep 25 02:41:18.752352 n-d-master-1 devstack@n-api.service[122385]: [pid: 122385|app: 0|req: 3938/7846] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 25 02:41:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-51228136 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)